Skip to main content

Microsoft Azure Form Recognizer Client Library for Python

Project description

Azure Form Recognizer client library for Python

Azure Cognitive Services Form Recognizer is a cloud service that uses machine learning to analyze text and structured data from your documents. It includes the following main features:

  • Layout - Extract content and structure (ex. words, selection marks, tables) from documents.
  • Document - Analyze key-value pairs and entities in addition to general layout from documents.
  • Prebuilt - Extract common field values from select document types (ex. receipts, invoices, business cards, ID documents) using prebuilt models.
  • Custom - Build custom models from your own data to extract tailored field values in addition to general layout from documents.

Source code | Package (PyPI) | API reference documentation | Product documentation | Samples

Disclaimer

Azure SDK Python packages support for Python 2.7 is ending 01 January 2022. For more information and questions, please refer to https://github.com/Azure/azure-sdk-for-python/issues/20691

Getting started

Prerequisites

Install the package

Install the Azure Form Recognizer client library for Python with pip:

pip install azure-ai-formrecognizer --pre

Note: This version of the client library defaults to the 2021-09-30-preview version of the service.

This table shows the relationship between SDK versions and supported API versions of the service:

SDK version Supported API version of service
3.2.0b2 - Latest beta release 2.0, 2.1, 2021-09-30-preview
3.1.X - Latest GA release 2.0, 2.1 (default)
3.0.0 2.0

Note: Starting with version 2021-09-30-preview, a new set of clients were introduced to leverage the newest features of the Form Recognizer service. Please see the Migration Guide for detailed instructions on how to update application code from client library version 3.1.X or lower to the latest version. Additionally, see the Changelog for more detailed information. The below table describes the relationship of each client and its supported API version(s):

API version Supported clients
2021-09-30-preview DocumentAnalysisClient and DocumentModelAdministrationClient
2.1 FormRecognizerClient and FormTrainingClient
2.0 FormRecognizerClient and FormTrainingClient

Create a Cognitive Services or Form Recognizer resource

Form Recognizer supports both multi-service and single-service access. Create a Cognitive Services resource if you plan to access multiple cognitive services under a single endpoint/key. For Form Recognizer access only, create a Form Recognizer resource. Please note that you will need a single-service resource if you intend to use Azure Active Directory authentication.

You can create either resource using:

Below is an example of how you can create a Form Recognizer resource using the CLI:

# Create a new resource group to hold the form recognizer resource
# if using an existing resource group, skip this step
az group create --name <your-resource-name> --location <location>
# Create form recognizer
az cognitiveservices account create \
    --name <your-resource-name> \
    --resource-group <your-resource-group-name> \
    --kind FormRecognizer \
    --sku <sku> \
    --location <location> \
    --yes

For more information about creating the resource or how to get the location and sku information see here.

Authenticate the client

In order to interact with the Form Recognizer service, you will need to create an instance of a client. An endpoint and credential are necessary to instantiate the client object.

Get the endpoint

You can find the endpoint for your Form Recognizer resource using the Azure Portal or Azure CLI:

# Get the endpoint for the form recognizer resource
az cognitiveservices account show --name "resource-name" --resource-group "resource-group-name" --query "properties.endpoint"

Either a regional endpoint or a custom subdomain can be used for authentication. They are formatted as follows:

Regional endpoint: https://<region>.api.cognitive.microsoft.com/
Custom subdomain: https://<resource-name>.cognitiveservices.azure.com/

A regional endpoint is the same for every resource in a region. A complete list of supported regional endpoints can be consulted here. Please note that regional endpoints do not support AAD authentication.

A custom subdomain, on the other hand, is a name that is unique to the Form Recognizer resource. They can only be used by single-service resources.

Get the API key

The API key can be found in the Azure Portal or by running the following Azure CLI command:

az cognitiveservices account keys list --name "<resource-name>" --resource-group "<resource-group-name>"

Create the client with AzureKeyCredential

To use an API key as the credential parameter, pass the key as a string into an instance of AzureKeyCredential.

from azure.core.credentials import AzureKeyCredential
from azure.ai.formrecognizer import DocumentAnalysisClient

endpoint = "https://<my-custom-subdomain>.cognitiveservices.azure.com/"
credential = AzureKeyCredential("<api_key>")
document_analysis_client = DocumentAnalysisClient(endpoint, credential)

Create the client with an Azure Active Directory credential

AzureKeyCredential authentication is used in the examples in this getting started guide, but you can also authenticate with Azure Active Directory using the azure-identity library. Note that regional endpoints do not support AAD authentication. Create a custom subdomain name for your resource in order to use this type of authentication.

To use the DefaultAzureCredential type shown below, or other credential types provided with the Azure SDK, please install the azure-identity package:

pip install azure-identity

You will also need to register a new AAD application and grant access to Form Recognizer by assigning the "Cognitive Services User" role to your service principal.

Once completed, set the values of the client ID, tenant ID, and client secret of the AAD application as environment variables: AZURE_CLIENT_ID, AZURE_TENANT_ID, AZURE_CLIENT_SECRET.

from azure.identity import DefaultAzureCredential
from azure.ai.formrecognizer import DocumentAnalysisClient

credential = DefaultAzureCredential()
document_analysis_client = DocumentAnalysisClient(
    endpoint="https://<my-custom-subdomain>.cognitiveservices.azure.com/",
    credential=credential
)

Key concepts

DocumentAnalysisClient

DocumentAnalysisClient provides operations for analyzing input documents using prebuilt and custom models through the begin_analyze_document and begin_analyze_document_from_url APIs. Use the model parameter to select the type of model for analysis.

Model Features
prebuilt-layout Text extraction, selection marks, tables
prebuilt-document Text extraction, selection marks, tables, key-value pairs and entities
prebuilt-invoices Text extraction, selection marks, tables, and pre-trained fields and values pertaining to English invoices
prebuilt-businessCard Text extraction and pre-trained fields and values pertaining to English business cards
prebuilt-idDocument Text extraction and pre-trained fields and values pertaining to US driver licenses and international passports
prebuilt-receipt Text extraction and pre-trained fields and values pertaining to English sales receipts
{custom-model-id} Text extraction, selection marks, tables, labeled fields and values from your custom documents

Sample code snippets are provided to illustrate using a DocumentAnalysisClient here. More information about analyzing documents, including supported features, locales, and document types can be found in the service documentation.

DocumentModelAdministrationClient

DocumentModelAdministrationClient provides operations for:

  • Building custom models to analyze specific fields you specify by labeling your custom documents. A DocumentModel is returned indicating the document type(s) the model can analyze, as well as the estimated confidence for each field. See the service documentation for a more detailed explanation.
  • Creating a composed model from a collection of existing models.
  • Managing models created in your account.
  • Listing document model operations or getting a specific model operation created within the last 24 hours.
  • Copying a custom model from one Form Recognizer resource to another.

Please note that models can also be built using a graphical user interface such as Form Recognizer Studio.

Sample code snippets are provided to illustrate using a DocumentModelAdministrationClient here.

Long-running operations

Long-running operations are operations which consist of an initial request sent to the service to start an operation, followed by polling the service at intervals to determine whether the operation has completed or failed, and if it has succeeded, to get the result.

Methods that analyze documents, build models, or copy/compose models are modeled as long-running operations. The client exposes a begin_<method-name> method that returns an LROPoller or AsyncLROPoller. Callers should wait for the operation to complete by calling result() on the poller object returned from the begin_<method-name> method. Sample code snippets are provided to illustrate using long-running operations below.

Examples

The following section provides several code snippets covering some of the most common Form Recognizer tasks, including:

Extract Layout

Extract text, selection marks, text styles, and table structures, along with their bounding region coordinates, from documents.

from azure.ai.formrecognizer import DocumentAnalysisClient
from azure.core.credentials import AzureKeyCredential

endpoint = "https://<my-custom-subdomain>.cognitiveservices.azure.com/"
credential = AzureKeyCredential("<api_key>")

document_analysis_client = DocumentAnalysisClient(endpoint, credential)

with open("<path to your document>", "rb") as fd:
    document = fd.read()

poller = document_analysis_client.begin_analyze_document("prebuilt-layout", document)
result = poller.result()

for page in result.pages:
    print("----Analyzing layout from page #{}----".format(page.page_number))
    print(
        "Page has width: {} and height: {}, measured with unit: {}".format(
            page.width, page.height, page.unit
        )
    )

    for line_idx, line in enumerate(page.lines):
        print(
            "...Line # {} has content '{}' within bounding box '{}'".format(
                line_idx,
                line.content,
                line.bounding_box,
            )
        )

    for word in page.words:
        print(
            "...Word '{}' has a confidence of {}".format(
                word.content, word.confidence
            )
        )

    for selection_mark in page.selection_marks:
        print(
            "...Selection mark is '{}' within bounding box '{}' and has a confidence of {}".format(
                selection_mark.state,
                selection_mark.bounding_box,
                selection_mark.confidence,
            )
        )

for table_idx, table in enumerate(result.tables):
    print(
        "Table # {} has {} rows and {} columns".format(
            table_idx, table.row_count, table.column_count
        )
    )
    for region in table.bounding_regions:
        print(
            "Table # {} location on page: {} is {}".format(
                table_idx,
                region.page_number,
                region.bounding_box
            )
        )
    for cell in table.cells:
        print(
            "...Cell[{}][{}] has content '{}'".format(
                cell.row_index,
                cell.column_index,
                cell.content,
            )
        )

Using the General Document Model

Analyze entities, key-value pairs, tables, styles, and selection marks from documents using the general document model provided by the Form Recognizer service. Select the General Document Model by passing model="prebuilt-document" into the begin_analyze_document method:

from azure.ai.formrecognizer import DocumentAnalysisClient
from azure.core.credentials import AzureKeyCredential

endpoint = "https://<my-custom-subdomain>.cognitiveservices.azure.com/"
credential = AzureKeyCredential("<api_key>")

document_analysis_client = DocumentAnalysisClient(endpoint, credential)

with open("<path to your document>", "rb") as fd:
    document = fd.read()

poller = document_analysis_client.begin_analyze_document("prebuilt-document", document)
result = poller.result()

print("----Entities found in document----")
for entity in result.entities:
    print("Entity '{}' has category '{}' with sub-category '{}'".format(
        entity.content, entity.category, entity.sub_category
    ))
    print("...with confidence {}\n".format(entity.confidence))

print("----Key-value pairs found in document----")
for kv_pair in result.key_value_pairs:
    if kv_pair.key:
        print(
                "Key '{}' found within '{}' bounding regions".format(
                    kv_pair.key.content,
                    kv_pair.key.bounding_regions,
                )
            )
    if kv_pair.value:
        print(
                "Value '{}' found within '{}' bounding regions\n".format(
                    kv_pair.value.content,
                    kv_pair.value.bounding_regions,
                )
            )

print("----Tables found in document----")
for table_idx, table in enumerate(result.tables):
    print(
        "Table # {} has {} rows and {} columns".format(
            table_idx, table.row_count, table.column_count
        )
    )
    for region in table.bounding_regions:
        print(
            "Table # {} location on page: {} is {}".format(
                table_idx,
                region.page_number,
                region.bounding_box,
            )
        )

print("----Styles found in document----")
for style in result.styles:
    if style.is_handwritten:
        print("Document contains handwritten content: ")
        print(",".join([result.content[span.offset:span.offset + span.length] for span in style.spans]))

for page in result.pages:
    print("----Analyzing document from page #{}----".format(page.page_number))
    print(
        "Page has width: {} and height: {}, measured with unit: {}".format(
            page.width, page.height, page.unit
        )
    )

    for line_idx, line in enumerate(page.lines):
        words = line.get_words()
        print(
            "...Line # {} has {} words and text '{}' within bounding box '{}'".format(
                line_idx,
                len(words),
                line.content,
                format_bounding_box(line.bounding_box),
            )
        )

        for word in words:
            print(
                "......Word '{}' has a confidence of {}".format(
                    word.content, word.confidence
                )
            )

    for selection_mark in page.selection_marks:
        print(
            "...Selection mark is '{}' within bounding box '{}' and has a confidence of {}".format(
                selection_mark.state,
                selection_mark.bounding_box,
                selection_mark.confidence,
            )
        )
  • Read more about the features provided by the prebuilt-document model here.

Using Prebuilt Models

Extract fields from select document types such as receipts, invoices, business cards, and identity documents using prebuilt models provided by the Form Recognizer service.

For example, to analyze fields from a sales receipt, use the prebuilt receipt model provided by passing model="prebuilt-receipt" into the begin_analyze_document method:

from azure.ai.formrecognizer import DocumentAnalysisClient
from azure.core.credentials import AzureKeyCredential

endpoint = "https://<my-custom-subdomain>.cognitiveservices.azure.com/"
credential = AzureKeyCredential("<api_key>")

document_analysis_client = DocumentAnalysisClient(endpoint, credential)

with open("<path to your receipt>", "rb") as fd:
    receipt = fd.read()

poller = document_analysis_client.begin_analyze_document("prebuilt-receipt", receipt)
result = poller.result()

for receipt in result.documents:
    for name, field in receipt.fields.items():
        if name == "Items":
            print("Receipt Items:")
            for idx, item in enumerate(field.value):
                print("...Item #{}".format(idx+1))
                for item_field_name, item_field in item.value.items():
                    print("......{}: {} has confidence {}".format(
                        item_field_name, item_field.value, item_field.confidence))
        else:
            print("{}: {} has confidence {}".format(name, field.value, field.confidence))

You are not limited to receipts! There are a few prebuilt models to choose from, each of which has its own set of supported fields:

  • Analyze receipts using the prebuilt-receipt model (fields recognized by the service can be found here)
  • Analyze business cards using the prebuilt-businessCard model (fields recognized by the service can be found here).
  • Analyze invoices using the prebuilt-invoice model (fields recognized by the service can be found here).
  • Analyze identity documents using the prebuilt-idDocuments model (fields recognized by the service can be found here).

Build a Custom Model

Build a custom model on your own document type. The resulting model can be used to analyze values from the types of documents it was trained on. Provide a container SAS URL to your Azure Storage Blob container where you're storing the training documents.

More details on setting up a container and required file structure can be found in the service documentation.

from azure.ai.formrecognizer import DocumentModelAdministrationClient
from azure.core.credentials import AzureKeyCredential

endpoint = "https://<my-custom-subdomain>.cognitiveservices.azure.com/"
credential = AzureKeyCredential("<api_key>")

document_model_admin_client = DocumentModelAdministrationClient(endpoint, credential)

container_sas_url = "<container-sas-url>"  # training documents uploaded to blob storage
poller = document_model_admin_client.begin_build_model(
    source=container_sas_url, model_id="my-first-model"
)
model = poller.result()

print("Model ID: {}".format(model.model_id))
print("Description: {}".format(model.description))
print("Model created on: {}\n".format(model.created_on))
print("Doc types the model can recognize:")
for name, doc_type in model.doc_types.items():
    print("\nDoc Type: '{}' which has the following fields:".format(name))
    for field_name, confidence in doc_type.field_confidence.items():
        print("Field: '{}' has confidence score {}".format(field_name, confidence))

Analyze Documents Using a Custom Model

Analyze document fields, tables, selection marks, and more. These models are trained with your own data, so they're tailored to your documents. For best results, you should only analyze documents of the same document type that the custom model was built with.

from azure.ai.formrecognizer import DocumentAnalysisClient
from azure.core.credentials import AzureKeyCredential

endpoint = "https://<my-custom-subdomain>.cognitiveservices.azure.com/"
credential = AzureKeyCredential("<api_key>")

document_analysis_client = DocumentAnalysisClient(endpoint, credential)
model_id = "<your custom model id>"

with open("<path to your document>", "rb") as fd:
    document = fd.read()

poller = document_analysis_client.begin_analyze_document(model=model_id, document=document)
result = poller.result()

for analyzed_document in result.documents:
    print("Document was analyzed by model with ID {}".format(result.model_id))
    print("Document has confidence {}".format(analyzed_document.confidence))
    for name, field in analyzed_document.fields.items():
        print("Field '{}' has value '{}' with confidence of {}".format(name, field.value, field.confidence))

# iterate over lines, words, and selection marks on each page of the document
for page in result.pages:
    print("\nLines found on page {}".format(page.page_number))
    for line in page.lines:
        print("...Line '{}'".format(line.content))
    print("\nWords found on page {}".format(page.page_number))
    for word in page.words:
        print(
            "...Word '{}' has a confidence of {}".format(
                word.content, word.confidence
            )
        )
    print("\nSelection marks found on page {}".format(page.page_number))
    for selection_mark in page.selection_marks:
        print(
            "...Selection mark is '{}' and has a confidence of {}".format(
                selection_mark.state, selection_mark.confidence
            )
        )

# iterate over tables in document
for i, table in enumerate(result.tables):
    print("\nTable {} can be found on page:".format(i + 1))
    for region in table.bounding_regions:
        print("...{}".format(region.page_number))
    for cell in table.cells:
        print(
            "...Cell[{}][{}] has content '{}'".format(
                cell.row_index, cell.column_index, cell.content
            )
        )

Alternatively, a document URL can also be used to analyze documents using the begin_analyze_document_from_url method.

document_url = "<url_of_the_document>"
poller = document_analysis_client.begin_analyze_document_from_url(model=model_id, document_url=document_url)
result = poller.result()

Manage Your Models

Manage the custom models attached to your account.

from azure.ai.formrecognizer import DocumentModelAdministrationClient
from azure.core.credentials import AzureKeyCredential
from azure.core.exceptions import ResourceNotFoundError

endpoint = "https://<my-custom-subdomain>.cognitiveservices.azure.com/"
credential = AzureKeyCredential("<api_key>")

document_model_admin_client = DocumentModelAdministrationClient(endpoint, credential)

account_info = document_model_admin_client.get_account_info()
print("Our account has {} custom models, and we can have at most {} custom models".format(
    account_info.model_count, account_info.model_limit
))

# Here we get a paged list of all of our models
models = document_model_admin_client.list_models()
print("We have models with the following ids: {}".format(
    ", ".join([m.model_id for m in models])
))

# Replace with the custom model ID from the "Build a model" sample
model_id = "<model_id from the Build a Model sample>"

custom_model = document_model_admin_client.get_model(model_id=model_id)
print("Model ID: {}".format(custom_model.model_id))
print("Description: {}".format(custom_model.description))
print("Model created on: {}\n".format(custom_model.created_on))

# Finally, we will delete this model by ID
document_model_admin_client.delete_model(model_id=custom_model.model_id)

try:
    document_model_admin_client.get_model(model_id=custom_model.model_id)
except ResourceNotFoundError:
    print("Successfully deleted model with id {}".format(custom_model.model_id))

Troubleshooting

General

Form Recognizer client library will raise exceptions defined in Azure Core. Error codes and messages raised by the Form Recognizer service can be found in the service documentation.

Logging

This library uses the standard logging library for logging.

Basic information about HTTP sessions (URLs, headers, etc.) is logged at INFO level.

Detailed DEBUG level logging, including request/response bodies and unredacted headers, can be enabled on the client or per-operation with the logging_enable keyword argument.

See full SDK logging documentation with examples here.

Optional Configuration

Optional keyword arguments can be passed in at the client and per-operation level. The azure-core reference documentation describes available configurations for retries, logging, transport protocols, and more.

Next steps

More sample code

See the Sample README for several code snippets illustrating common patterns used in the Form Recognizer Python API.

Additional documentation

For more extensive documentation on Azure Cognitive Services Form Recognizer, see the Form Recognizer documentation on docs.microsoft.com.

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Release History

3.2.0b2 (2021-11-09)

Features Added

  • Added get_words() on DocumentLine.
  • Added samples showing how to use get_words() on a DocumentLine under /samples/v3.2-beta: sample_get_words_on_document_line.py and sample_get_words_on_document_line_async.py.

Breaking Changes

  • Renamed DocumentElement to DocumentContentElement.

3.2.0b1 (2021-10-07)

This version of the SDK defaults to the latest supported API version, which is currently 2021-09-30-preview.

Note: Starting with version 2021-09-30-preview, a new set of clients were introduced to leverage the newest features of the Form Recognizer service. Please see the Migration Guide for detailed instructions on how to update application code from client library version 3.1.X or lower to the latest version. Also, please refer to the README for more information about the library.

Features Added

  • Added new DocumentAnalysisClient with begin_analyze_document and begin_analyze_document_from_url methods. Use these methods with the latest Form Recognizer API version to analyze documents, with prebuilt and custom models.
  • Added new models to use with the new DocumentAnalysisClient: AnalyzeResult, AnalyzedDocument, BoundingRegion, DocumentElement, DocumentEntity, DocumentField, DocumentKeyValuePair, DocumentKeyValueElement, DocumentLine, DocumentPage, DocumentSelectionMark, DocumentSpan, DocumentStyle, DocumentTable, DocumentTableCell, DocumentWord.
  • Added new DocumentModelAdministrationClient with methods: begin_build_model, begin_create_composed_model, begin_copy_model, get_copy_authorization, get_model, delete_model, list_models, get_operation, list_operations, get_account_info, get_document_analysis_client.
  • Added new models to use with the new DocumentModelAdministrationClient: DocumentModel, DocumentModelInfo, DocTypeInfo, ModelOperation, ModelOperationInfo, AccountInfo, DocumentAnalysisError, DocumentAnalysisInnerError.
  • Added samples using the DocumentAnalysisClient and DocumentModelAdministrationClient under /samples/v3.2-beta.
  • Added DocumentAnalysisApiVersion to be used with DocumentAnalysisClient and DocumentModelAdministrationClient.

Other Changes

  • Python 3.5 is no longer supported in this release.

3.1.2 (2021-08-10)

Bugs Fixed

  • A HttpResponseError will be immediately raised when the call quota volume is exceeded in a F0 tier Form Recognizer resource.

Other Changes

  • Bumped azure-core minimum dependency version from 1.8.2 to 1.13.0

3.1.1 (2021-06-08)

Bug Fixes

  • Handles invoices that do not have sub-line item fields detected.

3.1.0 (2021-05-26)

This version of the SDK defaults to the latest supported API version, which currently is v2.1

Note: this version will be the last to officially support Python 3.5, future versions will require Python 2.7 or Python 3.6+

Breaking Changes

  • begin_recognize_id_documents renamed to begin_recognize_identity_documents.
  • begin_recognize_id_documents_from_url renamed to begin_recognize_identity_documents_from_url.
  • The model TextAppearance now includes the properties style_name and style_confidence that were part of the TextStyle object.
  • Removed the model TextStyle.
  • Removed field value types "gender" and "country" from the FieldValueType enum.
  • Added field value type "countryRegion" to the FieldValueType enum.
  • Renamed field name for identity documents from "Country" to "CountryRegion".

New features

  • Added to_dict and from_dict methods to all of the models

3.1.0b4 (2021-04-06)

New features

  • New methods begin_recognize_id_documents and begin_recognize_id_documents_from_url introduced to the SDK. Use these methods to recognize data from identity documents.
  • New field value types "gender" and "country" described in the FieldValueType enum.
  • Content-type image/bmp now supported by custom forms and training methods.
  • Added keyword argument pages for business cards, receipts, custom forms, and invoices to specify which page to process of the document.
  • Added keyword argument reading_order to begin_recognize_content and begin_recognize_content_from_url.

Dependency Updates

  • Bumped msrest requirement from 0.6.12 to 0.6.21.

3.1.0b3 (2021-02-09)

Breaking Changes

  • Appearance is renamed to TextAppearance
  • Style is renamed to TextStyle
  • Client property api_version is no longer exposed. Pass keyword argument api_version into the client to select the API version

Dependency Updates

  • Bumped six requirement from 1.6 to 1.11.0.

3.1.0b2 (2021-01-12)

Bug Fixes

  • Package requires azure-core version 1.8.2 or greater

3.1.0b1 (2020-11-23)

This version of the SDK defaults to the latest supported API version, which currently is v2.1-preview.

New features

  • New methods begin_recognize_business_cards and begin_recognize_business_cards_from_url introduced to the SDK. Use these methods to recognize data from business cards
  • New methods begin_recognize_invoices and begin_recognize_invoices_from_url introduced to the SDK. Use these methods to recognize data from invoices
  • Recognize receipt methods now take keyword argument locale to optionally indicate the locale of the receipt for improved results
  • Added ability to create a composed model from the FormTrainingClient by calling method begin_create_composed_model()
  • Added support to train and recognize custom forms with selection marks such as check boxes and radio buttons. This functionality is only available for models trained with labels
  • Added property selection_marks to FormPage which contains a list of FormSelectionMark
  • When passing include_field_elements=True, the property field_elements on FieldData and FormTableCell will also be populated with any selection marks found on the page
  • Added the properties model_name and properties to types CustomFormModel and CustomFormModelInfo
  • Added keyword argument model_name to begin_training() and begin_create_composed_model()
  • Added model type CustomFormModelProperties that includes information like if a model is a composed model
  • Added property model_id to CustomFormSubmodel and TrainingDocumentInfo
  • Added properties model_id and form_type_confidence to RecognizedForm
  • appearance property added to FormLine to indicate the style of extracted text - like "handwriting" or "other"
  • Added keyword argument pages to begin_recognize_content and begin_recognize_content_from_url to specify the page numbers to analyze
  • Added property bounding_box to FormTable
  • Content-type image/bmp now supported by recognize content and prebuilt models
  • Added keyword argument language to begin_recognize_content and begin_recognize_content_from_url to specify which language to process document in

Dependency updates

3.0.0 (2020-08-20)

First stable release of the azure-ai-formrecognizer client library.

New features

  • Client-level, keyword argument api_version can be used to specify the service API version to use. Currently only v2.0 is supported. See the enum FormRecognizerApiVersion for supported API versions.
  • FormWord and FormLine now have attribute kind which specifies the kind of element it is, e.g. "word" or "line"

3.0.0b1 (2020-08-11)

The version of this package now targets the service's v2.0 API.

Breaking Changes

  • Client library version bumped to 3.0.0b1
  • Values are now capitalized for enums FormContentType, LengthUnit, TrainingStatus, and CustomFormModelStatus
  • document_name renamed to name on TrainingDocumentInfo
  • Keyword argument include_sub_folders renamed to include_subfolders on begin_training methods

New features

  • FormField now has attribute value_type which contains the semantic data type of the field value. The options for value_type are described in the enum FieldValueType

Fixes and improvements

  • Fixes a bug where error code and message weren't being returned on HttpResponseError if operation failed during polling
  • FormField property value_data is now set to None if no values are returned on its FieldData. Previously value_data returned a FieldData with all its attributes set to None in the above case.

1.0.0b4 (2020-07-07)

Breaking Changes

  • RecognizedReceipts class has been removed.
  • begin_recognize_receipts and begin_recognize_receipts_from_url now return RecognizedForm.
  • requested_on has been renamed to training_started_on and completed_on renamed to training_completed_on on CustomFormModel and CustomFormModelInfo
  • FieldText has been renamed to FieldData
  • FormContent has been renamed to FormElement
  • Parameter include_text_content has been renamed to include_field_elements for begin_recognize_receipts, begin_recognize_receipts_from_url, begin_recognize_custom_forms, and begin_recognize_custom_forms_from_url
  • text_content has been renamed to field_elements on FieldData and FormTableCell

Fixes and improvements

  • Fixes a bug where text_angle was being returned out of the specified interval (-180, 180]

1.0.0b3 (2020-06-10)

Breaking Changes

  • All asynchronous long running operation methods now return an instance of an AsyncLROPoller from azure-core
  • All asynchronous long running operation methods are renamed with the begin_ prefix to indicate that an AsyncLROPoller is returned:
    • train_model is renamed to begin_training
    • recognize_receipts is renamed to begin_recognize_receipts
    • recognize_receipts_from_url is renamed to begin_recognize_receipts_from_url
    • recognize_content is renamed to begin_recognize_content
    • recognize_content_from_url is renamed to begin_recognize_content_from_url
    • recognize_custom_forms is renamed to begin_recognize_custom_forms
    • recognize_custom_forms_from_url is renamed to begin_recognize_custom_forms_from_url
  • Sync method begin_train_model renamed to begin_training
  • training_files parameter of begin_training is renamed to training_files_url
  • use_labels parameter of begin_training is renamed to use_training_labels
  • list_model_infos method has been renamed to list_custom_models
  • Removed get_form_training_client from FormRecognizerClient
  • Added get_form_recognizer_client to FormTrainingClient
  • A HttpResponseError is now raised if a model with status=="invalid" is returned from the begin_training methods
  • PageRange is renamed to FormPageRange
  • first_page and last_page renamed to first_page_number and last_page_number, respectively on FormPageRange
  • FormField does not have a page_number
  • use_training_labels is now a required positional param in the begin_training APIs
  • stream and url parameters found on methods for FormRecognizerClient have been renamed to form and form_url, respectively
  • For begin_recognize_receipt methods, parameters have been renamed to receipt and receipt_url
  • created_on and last_modified are renamed to requested_on and completed_on in the CustomFormModel and CustomFormModelInfo models
  • models property of CustomFormModel is renamed to submodels
  • CustomFormSubModel is renamed to CustomFormSubmodel
  • begin_recognize_receipts APIs now return a list of RecognizedReceipt instead of USReceipt
  • Removed USReceipt. To see how to deal with the return value of begin_recognize_receipts, see the recognize receipt samples in the samples directory for details.
  • Removed USReceiptItem. To see how to access the individual items on a receipt, see the recognize receipt samples in the samples directory for details.
  • Removed USReceiptType and the receipt_type property from RecognizedReceipt. See the recognize receipt samples in the samples directory for details.

New features

  • Support to copy a custom model from one Form Recognizer resource to another
  • Authentication using azure-identity credentials now supported
  • page_number attribute has been added to FormTable
  • All long running operation methods now accept the keyword argument continuation_token to restart the poller from a saved state

Dependency updates

1.0.0b2 (2020-05-06)

Fixes and improvements

  • Bug fixed where confidence == 0.0 was erroneously getting set to 1.0
  • __repr__ has been added to all of the models

1.0.0b1 (2020-04-23)

Version (1.0.0b1) is the first preview of our efforts to create a user-friendly and Pythonic client library for Azure Form Recognizer. This library replaces the package found here: https://pypi-hypernode.com/project/azure-cognitiveservices-formrecognizer/

For more information about this, and preview releases of other Azure SDK libraries, please visit https://azure.github.io/azure-sdk/releases/latest/python.html.

Breaking changes: New API design

  • New namespace/package name:
    • The namespace/package name for the Form Recognizer client library has changed from azure.cognitiveservices.formrecognizer to azure.ai.formrecognizer
  • Two client design:
    • FormRecognizerClient to analyze fields/values on custom forms, receipts, and form content/layout
    • FormTrainingClient to train custom models (with/without labels), and manage the custom models on your account
  • Different analyze methods based on input type: file stream or URL.
    • URL input should use the method with suffix from_url
    • Stream methods will automatically detect content-type of the input file
  • Asynchronous APIs added under azure.ai.formrecognizer.aio namespace
  • Authentication with API key supported using AzureKeyCredential("<api_key>") from azure.core.credentials
  • New underlying REST pipeline implementation based on the azure-core library
  • Client and pipeline configuration is now available via keyword arguments at both the client level, and per-operation. See README for a link to optional configuration arguments
  • New error hierarchy:
    • All service errors will now use the base type: azure.core.exceptions.HttpResponseError

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azure-ai-formrecognizer-3.2.0b2.zip (487.8 kB view details)

Uploaded Source

Built Distribution

azure_ai_formrecognizer-3.2.0b2-py2.py3-none-any.whl (219.7 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file azure-ai-formrecognizer-3.2.0b2.zip.

File metadata

  • Download URL: azure-ai-formrecognizer-3.2.0b2.zip
  • Upload date:
  • Size: 487.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.5.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0

File hashes

Hashes for azure-ai-formrecognizer-3.2.0b2.zip
Algorithm Hash digest
SHA256 bda1bede0cc07034627c4b758c98dd461dc70522d48bc7b1414b391d80dd8a5b
MD5 0b84050c665dd09b2b631fbb352b3d31
BLAKE2b-256 784dd78727529ff8a6189cf19b474a8f3a704c0e4732e051c644b11ec604be3a

See more details on using hashes here.

File details

Details for the file azure_ai_formrecognizer-3.2.0b2-py2.py3-none-any.whl.

File metadata

  • Download URL: azure_ai_formrecognizer-3.2.0b2-py2.py3-none-any.whl
  • Upload date:
  • Size: 219.7 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.5.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0

File hashes

Hashes for azure_ai_formrecognizer-3.2.0b2-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 3fbf386ed32163c1a127eae943cf86c9110c881382e42a90dd984df947d7babf
MD5 63bf211d73df8fedab8118977008e489
BLAKE2b-256 a311e6d5a4235bae8bf987f91081dc3d950ce054ec0fae5acc6d0de6cf8cf998

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page