Layout performance reporting is specifically available for Structured layouts and shows only machine transcription errors. Layout Performance Reports are version-specific, so you can only access them through the version table within a Layout Details page.
Once you select a layout name from the table, click on the Layout Performance button in the "Actions" column to see the performance data.
Since field definitions may change across layout versions, field configurations and errors are displayed at a layout-version level.
Errors can only be shown on fields in which the machine’s response was used as output and then sampled for QA.
If the QA sample rate is low, there may be few, if any, errors for a given layout version or for a particular field.
Note that not all machine errors are preventable. For example, the machine may have difficulty correctly transcribing poor handwriting. However, by reviewing fields with low automation or multiple occurrences of errors, the field configuration can be reviewed to determine whether any improvements can be made.
Navigating layout performance reports
Header
The header shows the name and version of the layout currently being viewed. To switch between different versions of the layout, use the Version dropdown menu on the right side.
Left panel – field list
The left panel lists all of the fields in the layout ordered by their field names. If the same field name is used across pages, the page number of that particular field will be shown after the field name.
The list of fields may be sorted either by automation (how often the machine’s response had sufficiently high confidence to be outputted) or by the number of machine errors scored by QA.
Fields with the lowest automation or highest number of machine errors are good candidates for review. You can filter the list by data type.
Right panel – field details
The right panel includes detailed information for the field selected from the field list in the left panel.
The top portion of the panel contains a number of helpful statistics – the automation rate, the number of times the field was sampled, how many of those sampled instances were scored as errors, and selected configuration details of the field.
The configuration details display the Data Type, Multiline, and Dropout settings. These elements contribute to the machine’s ability to transcribe the field.
In the table in the lower part of the right panel, each row shows details of a transcription value for the fields that were scored as errors.
These details include the document ID on which the error occurred, the value provided by the machine, the correct value determined by QA, and the crop of that field value from the processed page.