Einstein Platform Services

What is Einstein OCR?

Einstein OCR provides OCR (optical character recognition) models that detect alphanumeric text in an image or PDF (beta).

You access the models from a single REST API endpoint. Each model is used for specific use cases, such as business card scanning, product lookup, and digitizing documents and tables.

Model ID
Used For
Recommended Task Parameter Values

OCRModel

  • Business cards
  • Images that contain unformatted data
  • Common forms such as driver's license, Form W-2, and Form 1040
  • contact
  • text
  • form

tabulatev2

  • Images that contain data in tables
  • table

When you call the API, you send in an image, and the JSON response contains various elements based on the value of the task parameter:

  • String of alphanumeric characters that the model predicts.
  • Confidence (probability) that the detected bounding box contains text.
  • XY coordinates for the location of the character string within the image (also called a bounding box).
  • For tabular data, the table row and column in which the text is located.
  • For business cards, the entity type of the detected text such as ORG, PERSON, and so on.
  • For common forms, key-value pairs that contain the detected text, bounding box data for the detected text, and the entity (a consistent field name).

Here’s a sample image. The orange boxes and text indicate the detected text.

Note

Currently, Einstein OCR supports only English.

Updated about a month ago

What is Einstein OCR?


Einstein OCR provides OCR (optical character recognition) models that detect alphanumeric text in an image or PDF (beta).

Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.