Performance and accuracy
ScanToExcel’s internal evaluation reported a weighted F1 of 98.0% across 3000 test documents and 6 document types.
Evaluation date
What these results mean for your documents
These results describe the evaluated documents and scored fields at the stated date. Individual results vary with document quality, structure, and content. Review exported data before further use.
Results by document type
| Document type | Test documents | Field-level F1 | All evaluated fields matched |
|---|---|---|---|
| Invoices | 600 | 99.5% | 96.2% |
| Image tables | 200 | 99.2% | 95.9% |
| Credit-card statements | 500 | 98.8% | 95.7% |
| Bank statements | 650 | 98.7% | 95.2% |
| Receipts | 600 | 97.3% | 93.9% |
| Paystubs | 450 | 94.6% | 92.1% |
Across the full test set, every evaluated field matched the answer key in 94.8% of documents.
| Document type | Precision | Recall |
|---|---|---|
| Invoices | 0.993 | 0.997 |
| Image tables | 0.992 | 0.992 |
| Credit-card statements | 0.989 | 0.987 |
| Bank statements | 0.989 | 0.985 |
| Receipts | 0.959 | 0.988 |
| Paystubs | 0.952 | 0.940 |
Conversion time in the evaluation
| Document type | Median (p50) | 95th percentile (p95) |
|---|---|---|
| Invoices | 3.3 s | 5.1 s |
| Image tables | 2.6 s | 7.0 s |
| Credit-card statements | 6.4 s | 8.8 s |
| Bank statements | 10.2 s | 17.2 s |
| Receipts | 2.3 s | 3.1 s |
| Paystubs | 5.5 s | 8.7 s |
Held-out evaluation
A separate set was reserved during development. The table compares its F1 results with the main set; differences alone do not establish their cause.
| Document type | Main set | Held-out set | F1 difference |
|---|---|---|---|
| Invoices | 99.5% (n=600) | 97.8% (n=150) | −0.017 |
| Image tables | 99.2% (n=200) | 96.7% (n=50) | −0.025 |
| Credit-card statements | 98.8% (n=500) | 99.9% (n=130) | +0.011 |
| Bank statements | 98.7% (n=650) | 99.8% (n=160) | +0.011 |
| Receipts | 97.3% (n=600) | 98.6% (n=150) | +0.013 |
| Paystubs | 94.6% (n=450) | 95.3% (n=110) | +0.007 |
How to read the measurements
- Precision
- How much of the returned field data matched the answer key.
- Recall
- How much of the expected field data was captured correctly.
- F1
- The harmonic mean of precision and recall, shown as a percentage in the results table.
- Every evaluated field matched
- A document-level measure covering the scored fields, rather than certification of the complete document or export.
Conversion time in the evaluation
Times were measured end to end, from upload to output readiness, on single documents in a single-threaded run. p50 is the median; p95 is the 95th percentile, not a maximum.
How the evaluation works
Test documents
The set combines public datasets and samples, licensed or purchased documents, and synthetic documents for edge cases. User uploads are not part of this evaluation set.
Hand-checked answer keys
Outputs are compared field by field with manually checked reference answers. Matching fields, incorrect returned values, and missed values contribute to the reported scores.
Evaluated fields
These are the benchmark’s scored fields, not a list of columns available in every standard export.
- Invoices (16 fields)
- issue date, due date, currency, vendor info, customer info, line items, subtotal, tax, tax-inclusive flag, tax rows, line tax fields, total and withholdings.
- Image tables (5 fields)
- header rows, header cell, row identification, row type and row cell.
- Credit-card statements (20 fields)
- card network, holder, statement period, payment due date, minimum payment due, credit limit, available credit, summary purchases, summary payments, summary fees, summary interest, opening and closing balances, transactions, posted date, transaction type, transaction amount and currency.
- Bank statements (16 fields)
- account holder, account currency, statement period, opening and closing balances, interest paid, fees charged, transactions, posted date, transaction type, transaction amount, running balance, credit total and debit total.
- Receipts (11 fields)
- date, currency, vendor, line items, subtotal, tax, tax row breakdown, tip, total and payment details.
- Paystubs (40 fields)
- employee, employer, country, currency, pay period, base pay rate and unit, annual salary, current net pay, summary YTD totals (gross, taxes, net), and per-row earnings, taxes, deductions and employer contributions (each with hours, rate, current amount and YTD).