Jul 7, 2026 · by Marianna Babayan · View source

On-Device Field Extraction by Veryfi

Secure on-device extraction even if you're offline

On-Device Field Extraction by Veryfi

Editorial analysis

Why the Receipt Validation That Happens in Your Pocket Matters More Than Half the SaaS in Your Stack

Every cross-border operator I know has a version of the same silent bleed: a customer returns a defective unit, you ask for a photo of the packing slip or receipt, and the image comes back blurry, cropped, or missing the critical total. Your team spends 15 minutes chasing a replacement photo, the customer gets annoyed, and the return window stretches past what your carrier policy allows. Multiply that by thousands of SKUs and dozens of suppliers, and you are losing margin in the friction between capture and action. The same pain shows up in reimbursement claims with Amazon, in vendor invoice matching, and in expense reporting for your logistics team.

What I saw on Product Hunt this week (the launch for Veryfi Lens SDK with its on-device field detection) is not just a document-scanning API update. It is a case study in a principle that most e-commerce tooling gets backward: validate at the moment of capture, not at the moment of processing. The difference between a receipt that passes on the phone and one that fails two days later is the difference between a smooth return workflow and a support ticket that costs $5 to resolve. This essay breaks down why that shift matters for Amazon sellers, Shopify store owners, and anyone who touches documents in cross-border operations — and where the implementation still leaves you with an unglamorous engineering problem to solve.


What Problem This Product Actually Solves (and Why Most Document Capture Tools Miss It)

The Veryfi Lens SDK announces a feature called on-device field detection: the SDK checks that the vendor name, date, and total are readable on the confirmation screen before the user taps submit. It runs entirely on the device, works offline, and gives instant feedback. If the scan is missing a field, the user retakes it right there, while they are still holding the receipt. No server round trip. No “we’ll review it and get back to you.”

Compare that to the standard flow used by most expense apps, returns platforms, and even Amazon’s own document upload in Seller Central. You snap a photo, it uploads to a cloud API, and a few seconds or hours later you get a validation result. If it fails, you have to find the receipt again, retake it, and resubmit. The round-trip latency — and the cognitive friction of being told “try again later” — is where the abandonment happens. Marianna Babayan, Veryfi’s marketing manager, captured it perfectly in the launch thread: “the receipt looked fine when it was captured, then it got rejected two days later.” That two-day gap is what kills operational efficiency in cross-border e-commerce.

The incumbents in this space — ABBYY, Google ML Kit, and even Amazon Textract — all offer cloud-first OCR. They are accurate, but they assume connectivity and tolerate latency. Their design bet is that the server model is better, so accept the round-trip. Veryfi’s bet is the opposite: make the on-device model good enough to catch the obvious failures at capture, so the server only sees the cleaned data. That is a sound design decision for any touchpoint where the user is holding the physical document — which is nearly every e-commerce return and vendor invoice scenario.

Why Amazon Sellers Should Care More Than Shopify Ones

If you sell on Shopify, your returns process is often a branded portal Loop Returns or Returnly that handles receipt uploads with a standard UX. It works, but the validation step is typically server-side and batched. On Amazon, the stakes are higher. When you file a reimbursement claim for an FBA inbound shipment that was lost or damaged, Amazon requires proof of value and proof of delivery. The documents are often PDFs or photos of packing slips from Chinese suppliers. If the photo is unreadable, the claim is rejected and you wait 30 days to escalate. The loss isn’t just the value of the inventory — it’s the opportunity cost of capital tied up in non-collectible claims.

On-device validation means your warehouse staff in Shenzhen or your 3PL in California can snap a photo of a bill of lading and get immediate confirmation that the document is scannable. The server never sees a bad image. This alone could cut your claim rejection rate by double-digit percentages — and that directly improves your Amazon selling margin.


How This Differs from Every Other Receipt SDK (and Where the Comparison Breaks)

The obvious competitors to Veryfi Lens SDK are Scanbot, Cognex Mobile Barcode SDK, and the aforementioned ML Kit. I have integrated two of them in past projects. Here is the nuanced difference: Most SDKs give you a raw image and maybe a JSON of extracted fields after a server call. Veryfi’s on-device detection gives you field-level confidence and real-time retry instructions at capture. That is a UX innovation, not a pure OCR accuracy improvement.

But the thread revealed a subtle gap. Commenter Qifeng Zheng pointed out that the on-device model might flag a field as missing when the heavier server model would have accepted it. This is the classic precision-recall tradeoff at the edge. If your on-device model is too aggressive, you annoy users with unnecessary retakes. If it is too lenient, you still pass bad scans to the server. Veryfi’s Marianna acknowledged the tension, but the calibration details remain undisclosed — and that matters for e-commerce operators who need deterministic accuracy for compliance.

Where the Math Breaks

Another comment from Dipankar Sarkar raised the quantization issue: the on-device model is almost certainly int8 quantized to fit in an app bundle, which shifts confidence distributions. A cutoff that works on the full-precision server model may misbehave on-device. If you are an e-commerce brand building a custom returns app or a warehouse scanning tool, you need to know whether Veryfi recalibrates thresholds per device type. They said they account for it internally, but that is a black box. Without per-field confidence scores exposed, you cannot build your own retry logic. Valeria asked exactly this: “do I get per-field confidence back to drive my own retry UI, or just pass/fail?” Veryfi’s reply was to contact them directly — which is fine for an enterprise evaluation, but a red flag if you need to automate this at scale.

For cross-border operators, the math matters most when scanning Asian receipts with non-Latin characters, thermal paper, or faded ink. Those are precisely the documents that break OCR models. If the on-device model fails silently, you won’t know until the server rejects the claim days later — which puts you right back in the original pain.


What Cross-Border Sellers Can Borrow from This (Even If You Never Use the SDK)

The core lesson is architectural: shift validation to the data-entry point. In e-commerce operations, we often build tools that accept messy input and clean it downstream — whether that’s inventory feeds, customer addresses, or return photos. The cost of cleaning bad data after it enters your system is exponentially higher than catching it at the source. Veryfi’s SDK is a reminder that you can move that validation into the user’s camera roll before they ever hit upload.

Here are three concrete applications for a cross-border operation:

  1. Supplier invoice capture. When your sourcing agent in Yiwu snaps a photo of a commercial invoice, embed an on-device check that the supplier name, date, and total are present. Your ERP only gets clean data. Fewer mismatches when reconciling payments.

  2. Customer return photos. For DTC Shopify stores, require a photo of the return label and the product defect. Use on-device detection to confirm the label barcode is decodable and the defect area is in frame. This eliminates the “I got a black screen” return queries.

  3. Amazon VAT documentation. For European VAT returns, sellers need scanned invoices that show the seller’s VAT number and the date. A real-time capture validation would prevent the “missing VAT ID” rejection that delays your refund by months.

None of these require Veryfi’s specific SDK. You can implement similar logic using ML Kit’s on-device barcode scanning or Apple’s Vision framework. The principle is the same — but you need engineering bandwidth to build the retry UX and confidence thresholds. Veryfi’s value is that they package it into a drop-in SDK with a pre-trained receipt model.


Where My Judgment Says It Falls Short

I like the idea, but I see three operational gaps for cross-border use cases:

First, the model coverage for non-English receipts. Veryfi mentions vendor, date, and total. That covers typical US receipts. But cross-border operators deal with Chinese, Japanese, Arabic, and European characters. The on-device model may not handle cursive script or mixed-language lines (e.g., a Thai receipt with an English total). The launch post does not specify language support for the on-device detection. The comment thread suggests advanced users are still asking about offline capability — that implies the on-device model might be limited to Latin script until proven otherwise.

Second, the enterprise integration cost. The SDK is a developer tool, not a SaaS plug-in. If you are a small Amazon FBA brand using a managed returns service like ReturnGo, you cannot swap their SDK. You would need to build a custom app or ask your returns provider to integrate it. For most operators below $10M in revenue, the engineering investment is not justified solely for receipt capture. You would be better off using a general purpose tool like Zapier with Cloudmersive OCR — but then you lose the on-device advantage.

Third, the model disagreement problem never really goes away. Even with perfect calibration, the on-device model and the server model will disagree on some edge cases. When that happens, the user gets a false sense of success — they thought the scan was fine, but the server rejects it later. Veryfi’s answer seems to be that the on-device model is “deliberately lighter-weight,” which means some rejections will still surface post-upload. If you need zero post-upload rejections (which is the ultimate goal for Amazon claims), you need a single model deployed at both edges — not two models that can disagree.


What I’d Watch / Test Next

This week, I would do two things:

  1. Test Veryfi Lens SDK on a sample set of your actual receipts. Grab a batch from your supplier invoices (thermal paper from China, faded ink from India, handwritten totals from small factories). Run them through the SDK’s on-device validation and measure the false-positive rate — how many times does it say “good” but the server later rejects? If that rate is above 5%, the tool is not ready for compliance-heavy workflows.

  2. Audit your current document upload flow for latency from capture to validation. Map the journey a customer takes when they submit a return photo or an invoice. How many seconds pass before they get feedback? How many minutes before a human reviews it? If the latency exceeds 10 seconds anywhere, consider embedding a lightweight on-device check — even if you build it via ML Kit. The ROI on reducing return-related support tickets is often 10x the development cost.

For larger operations, I would loop your engineering team into Veryfi’s enterprise sales. Ask for the per-field confidence API, the language support matrix, and a demo of the model disagreement cases. If they can demonstrate that false positives (unnecessary retakes) are below 1% for your receipt set, the SDK becomes a no-brainer for your warehouse scanning app. If not, the principle is still sound — but you may need to own the model yourself.

The shift from “upload and pray” to “validate at capture” is inevitable. Veryfi is early, but they have the right instinct. Cross-border sellers who move onto this curve first will save weeks of back-and-forth and tighten their operational margins. The question is whether you want to build it or buy it — and your answer depends on how many bad receipts you can afford to chase.

Ready to Create Your Own?

Join thousands of brands creating high-performing video ads with VEONIB. No editing skills required.

Start Creating for Free