Field Identification Quality Assurance

Field Identification QA tasks are specific to Semi-structured documents. All fields’ occurrences and bounding boxes are eligible for Field Identification QA sampling.

If the Continuous Field Locator model improvement setting is enabled in the "Identification" section of Administration > System Settings, Model Validation Tasks will also be loaded into this queue. These tasks look identical to Field ID QA tasks. For more information about these tasks, see Model Validation Tasks.

To start a Field Identification QA task, follow these steps:

  1. Go to Tasks > Perform Tasks.

  2. In the Quality Assurance Tasks card, click Perform Tasks for Identification QA.

image-20220909-141414.png

In order to improve performance, it is imperative to perform QA tasks using the best practices. For more information on these, see Best Practices for Field ID Supervision and QA.

Field Identification QA tasks

During Field Identification QA, you need to review all fields that are sampled for QA within a document and make sure their locations are correct. If a field’s location is incorrect, you need to redraw its bounding box.

All fields within a document that are sampled for QA are listed in the right-hand sidebar. All fields that aren’t reviewed are marked with a red warning sign (mceclip1__5_.png) on the right-hand sidebar.

When you select a field from the list in the right-hand sidebar, the field’s bounding box will be highlighted in the document. When you select a field that has multiple occurrences, a drop-down menu will appear containing all of the field’s occurrences. Selecting an occurrence from the drop-down menu highlights the occurrence’s bounding box on the document.

During Field Identification QA tasks, you can add, remove, and re-draw additional bounding boxes for fields. When you select a field that has multiple bounding boxes, all of the field’s bounding boxes will be highlighted on the document.

mceclip0.jpeg

If…

Then…

The field’s location is correct.

Proceed with reviewing the rest of the document’s fields (if any). 

The field’s location is incorrect.

Draw a bounding box around the field’s correct location.

The field is identified as “not present” during an extraction task (by human or machine), but it actually exists in the document.

Draw a bounding box around the field’s location.

The field is identified as “present” during an extraction task (by human or machine), but it actually does not exist in the document.

Delete the field’s bounding box by clicking its X button.

Note

You can add and remove fields’ occurrences and bounding boxes during Field ID QA.

If the layout is incorrect

If the page displayed in the QA task does not appear to have been matched to the correct layout, follow these steps:

  1. Go to the Document Details drop-down list in the right-hand sidebar and expand it.

  2. Click the Mark Layout Variation Incorrect button.

If the page is marked as incorrect:

  • The task will terminate and the user will be taken to the next Field ID QA task that exists. If one does not, they will be taken back to the dashboard.

  • None of the fields on the respective document will be scored for accuracy.

  • The document will not be automatically marked as "No Layout Found".

It is imperative that these pages are caught in QA because we do not want these pages to be included in a Field Locator Model Training job. If those inaccurate pages were included in a training job, it may lead to poor model performance.

Note

This practice is especially important if you have the Continuous Field Locator model improvement setting enabled in the "Identification" section of Administration > System Settings.

Field ID QA keyboard shortcuts

Field Identification QA

Task

Mac Shortcut

Windows Shortcut

Change label location

F4

F4

Clear bounding box

Delete

Backspace

Next field in list

E or ⬇

E or ⬇

Previous field in list

W or ⬆

W or ⬆

Free draw a bounding box

Spacebar + click and drag

Spacebar + click and drag

Add an additional occurrence of a field

Command + Option + +

Control + Alt + +

Remove an additional occurrence of a field

Command + Option + -

Control + Alt + -

Complete task

Command + Return

Control + Enter

All tasks

Task

Mac Shortcut

Windows Shortcut

Zoom in

Option + +

Alt + +

Zoom out

Option + -

Alt + -

Next page

Fn + ⬇

Page down

Previous page

Fn + ⬆

Page up

Keyboard shortcuts

F2

F2

Close task

Option + Command + X

Alt + Control + X