Custom Supervision

Using JSON Schema Form as a form builder to create customer-driven UIs for Supervision tasks.

A Custom Supervision task’s interface is configured directly in the JSON that defines the custom flow. Each custom flow can have its own Custom Supervision task logic, name, and interface. You can find more details about how to configure a Custom Supervision task’s interface and what the customization options are in the sections below.

⚠️ Keep in mind that Custom Supervision was designed to be as flexible as possible, but there are still recommended best practices to maximize the potential of the feature. Most of what is defined in this article is to outline those recommended practices.

Additionally, please note that:

  • We have 2 Custom Supervision offerings: IDP Custom Supervision and Custom Supervision. The IDP Custom Supervision Block is a modified version of the more generic base Custom Supervision Block and includes an IDP wrapper to handle reading/writing data from the IDP database. For ease of use, the IDP block also manages the auto-population of the data field that is ingested by the base Custom Supervision Block. Users who prefer their data to be transient (i.e., NOT saved to the database) should use the base Custom Supervision Block and not the IDP block. However, when doing so, users are responsible for managing the data field directly, which comes with some restrictions.

  • These instructions are tailored for v34 and later.

  • For the purpose of illustration, JSON examples in this article reference what may appear to be hardcoded identifiers (e.g., data_identifier: '2afd7a67-ddee-484f-ab6b-2d292752e5ee'), but it is possible to dynamically reference entities using a Custom Code Block. Doing so enables the Custom Supervision task interface to be dynamic in which transcription fields, pages, decisions, text blocks, etc. are presented to a user during the execution of a particular flow.

JSON Configuration

Custom Supervision Block Basics

The base of the custom portion of the Custom Supervision Block is the supervision_template. Defining the Supervision template and its version is the first step of configuring the Custom Supervision task’s interface.

⚠️ There is currently only a single template built for Custom Supervision - three_column_template. Details of this template are defined below.

Flow Studio JSON Validations

If you are receiving a validation error in Flows Studio, it could be because of an issue with the supervision_template JSON. We validate that:

  • In a decision schema, one of anyOf or oneOf is defined but not both.

  • The type in the decision relation is supported: case, document, page, field, or table_cell.

  • The type in an Input Component is supported. See documentation below for a comprehensive list of Input Components.

  • Options for a Decision Component are unique.

Due to the dynamic nature of Custom Supervision, it’s possible for your supervision_template to pass static validation but fail validation while the flow is running. If your Custom Supervision job is failing to run, you can check for validation issues by selecting the failed Custom Supervision job and inspecting the “Reason for Incompletion,” as shown below.

reason_for_incompletion

Property Definitions

A template will always have a base with two properties:

Property

Description

name

Name of the Supervision template that should be tied to the UI. Valid names are currently limited to the amount of development done by the Hyperscience team. As of v34, the only valid name is three_column_template.

version

The Supervision template’s version. This property is for future use to handle version control as Custom Supervision evolves. Currently, the only available version for three_column_template is 1.0.

{
  supervision_template: [
    {
      name: 'three_column_template',
      version: '1.0'
    }
  ]
}

⚠️ While in the future you will be able to list multiple templates in the top-level list, currently only one is supported.

Three Column Template - Basics

For v34 and later, there is a single template that can be used with Custom Supervision, which is the three_column_template. There are three sections of this template: a thumbnail panel (left panel), an image panel (middle panel), and an actions panel (right panel). The thumbnail and actions panels are customizable, while the middle panel is not customizable and shows a full-page view of the document pages that are sent to Custom Supervision. If a table is selected, a section will appear at the bottom of the image panel with information about the table.

Property Definitions

Property

Description

thumbnail

Configurable options for the thumbnail panel.
group_by_document - boolean - Group pages at the document level.
group_by_case - boolean - Group pages/documents at the case level.

actions

List of tabs to be included in the action panel. Representative of the structure used in JSON Schema Form.

{
  supervision_template: [
    {
      name: 'three_column_template',
      version: '1.0',
      thumbnail: {
        group_by_document: true,
        group_by_case: true
      },
      action: [
        {
          name: 'my_tab',
          display: 'SSN Info',
          input: [
            {
              name: 'ssn_field',
              type: 'transcription',
              data_identifier: '2afd7a67-ddee-484f-ab6b-2d292752e5ee',
              title: 'SSN'
            }
          ],
          ui: {
            groups: [
              {
                title: 'My Group',
                fields: ['ssn_field']
              }
            ]
          }
        }
      ]
    }
  ]
}

Three Column Template - Thumbnail

There are two options available for configuration of the left thumbnail panel. Both options are independent boolean values, which makes four different combinations possible:

  • Pages are listed individually and are not grouped (both options set to false)

  • Group by documents

  • Group by cases

  • Group by both documents and cases (both options set to true)

Each screenshot is from the same set of pages, documents, and cases, but with different configurations.


thumbnail: {
  group_by_document: false,
  group_by_case: false
}

document_false_case_false


thumbnail: {
  group_by_document: true,
  group_by_case: false
}

document_true_case_false


thumbnail: {
  group_by_document: false,
  group_by_case: true
}

document_false_case_true


thumbnail: {
  group_by_document: true,
  group_by_case: true
}

document_true_case_true

Three Column Template - Actions

The action property will be a list of Tab objects. Each Tab in the action property corresponds to a tab in the Custom Supervision task’s right panel.

⚠️ You can have a maximum of 3 tabs. If you configure more than 3, they will be automatically truncated in the UI.

Property Definitions

⚠️ The name property must be unique.

Property

Description

name

Internal name of the tab; only used for internal navigation and not displayed in the UI.

display

Text to display on the tab in the UI. Users will see this text as the name of tab.

input

List of Input Components as defined below. This list contains the bulk of the definition of what the Action pane is going to look like.

ui

Contains the groups property, which defines where the components will appear and in what order.

Input Component Types

There are several different types of components that can be rendered in the first version of Custom Supervision. These components are specifically defined by the type property of each of the inputs.

The following types of Input Components are supported:

  • Titles

  • Text blocks

  • Transcriptions

  • Crops

  • Decisions

  • Cases

Title Components

There are two title components subtypes:

  • document_title - Designed to be used as a header when displaying document-related data. This component will display information for the currently selected document, including document ID and layout name.

  • case_title - Designed to be used as a header when displaying case-related data. This component will display the case ID for the currently selected case.

Document Title Component

⚠️ The name property must be unique.

The name of the document_title input is needed for rendering, but it is not shown in the UI.

When defining a document_title component, set the type to document_title.

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        {
          name: 'doc_title',
          type: 'document_title'
        },
        ...
      ]
    }
  ]
}

document_title

Case Title Component

⚠️ The name property must be unique.

The name of the case_title input is needed for rendering, but it is not shown in the UI.

When defining a case_title component, set the type to case_title.

{
  action: [
    {
      name: 'case_tab',
      display: 'Case Data',
      input: [
        {
          name: 'case_title',
          type: 'case_title'
        },
        ...
      ]
    }
  ]
}

case_title

Text Block Components

Text block components show static text on a tab. Text block components have a single subtype called text_block.

⚠️ The name property must be unique.

Property

Description

name

The text block component’s internal name. It is needed for rendering, but it is not shown in the UI.

type

The text block component’s subtype. Currently, text_block is the only valid value.

title

The text block component’s title that is displayed on the tab.

description

Static text displayed on the tab. This property supports a subset of Markdown (read more in the “Markdown support” section below). Use \n to move text to the next line.

Markdown support

In v37 and later, you can use Markdown in description text. The following Markdown functionality is officially supported:

  • Headers from H1 through H3

  • Blockquotes without nesting

  • Ordered and unordered lists with up to 3 levels of nesting

  • Strong (bold) and emphasised (italic) notation

  • Links

The following features are officially not supported and are disabled:

  • Inline HTML (disabled for security reasons and will be rendered as regular text when used)

  • Inputs

  • Tables

  • Footnotes

Any features that aren’t listed as supported or not supported are considered experimental features. Experimental features might work, but we cannot guarantee that their output will remain the same—or that they will work at all—in future versions.

Pro-tip - The value of description must be given as one line of text. You can search the web for “slash escape text” to help you convert your Markdown text into a single line.

{
  action: [
    {
      name: 'case_tab',
      display: 'Case Data',
      input: [
        ...
        {
          name: 'instructions',
          type: 'text_block,
          title: '',
          description: '#Instructions\n\n- __$100__ Processing fee\n  - *Shipping cost included*\n- __$50__ optional fee for expediting case\n\n[Read More](https://hyperscience.com)'
        }
        ...
      ]
    }
  ]
}

text_block_field

Transcription Components

There are three transcription component subtypes:

  • transcription - Designed to be used with non-table fields.

  • crop_transcription - Designed to be used with crops.

  • table_transcription - Designed to be used with tables.

Transcription components are useful for showing both complete and incomplete values from the current submission or previous submissions. If the field, crop, or table is from the current submission, the user will be able to edit the value (or provide one if it is blank).

Transcription components respect the Custom Supervision Block’s Custom Supervision Transcription Masking setting. Once the data is matched with the component, we take advantage of the data_type_uuid associated with the data piece to include masking and validation based on this block setting.

Field Transcription Component

⚠️ The name property must be unique. If you use the field_name, for example, it might not be unique and could cause issues when the Custom Supervision task is displayed.

Property

Description

name

The transcription component’s internal name. It is needed for rendering, but it is not shown in the UI.

type

The transcription component’s subtype, which in this case is transcription.

data_identifier

Identifier that will match up with what is provided in the data portion of the payload. For transcription, this identifier is the layout field UUID.

title

If provided, the text for the label displayed in this component. If not provided, the field’s name, as stored in the database, will be used.

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'courtesy_amount',
          type: 'transcription,
          data_identifier: 'd82c1d10-45ff-4a66-b4a1-f300a0ff0a07',
          title: 'Courtesy Amount'
        },
        {
          name: 'legal_amount',
          type: 'transcription',
          data_identifier: 'b31c2239-d184-4914-8f17-d281c4df493b',
          title: 'Legal Amount'
        },
        ...
      ]
    }
  ]
}

currency_not_highlighted


Transcription component when selected, showing masking and validation.

currency_highlighted

The Courtesy Amount will only allow numeric inputs and will have the currency format.


The Mark Illegible button, when clicked, will clear the field, and users will no longer be able to interact with the text box. Fields marked as illegible will have null as their values on submit.

currency_illegible


Checkboxes have their own rendering component, but they have the same features as text box fields.

checkbox


Mandatory Transcriptions

In v39 and later, you can designate the transcriptions of certain fields as mandatory. This feature works similarly to mandatory Decision components. See the Mandatory Decisions section for more information.

All the same restrictions for mandatory Decisions apply to mandatory Field Transcriptions, along with the UI indicators for mandatory fields.

JSON Example
{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'courtesy_amount',
          type: 'transcription,
          data_identifier: 'd82c1d10-45ff-4a66-b4a1-f300a0ff0a07',
          title: 'Courtesy Amount'
          ui: {
            required: true
          },
        },
        ...
      ]
    }
  ]
}
Crop Transcription Component

Property

Description

name

The crop transcription component’s internal name. It is needed for rendering, but it is not shown in the UI.

type

The transcription component’s subtype, which in this case is crop_transcription.

data_identifier

Identifier that will be matched with what is provided in the data portion of the payload. For crop_transcription, this identifier is the UUID of the crop previously identified by the machine.

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'crop_1',
          type: 'crop_transcription,
          data_identifier: '84de1459-29be-4cc9-bfc7-c60896974a91',
        },
        {
          name: 'crop_2',
          type: 'crop_transcription,
          data_identifier: '4bcb43ef-d381-4fc8-a6b1-9cc05cc30b8b',
        },
        ...
      ]
    }
  ]
}

Simple design to display the values of the crops defined. You can also edit the value of these crops.

⚠️ Crop values are not saved to the database but are updated in the output JSON.

crop_transcription_sample

Table Transcription Component

Property

Description

name

The transcription component’s internal name. It is needed for rendering, but it is not shown in the UI.

type

The transcription component’s subtype, which in this case is table_transcription.

data_identifier

Identifier that will match up with what is provided in the data portion of the payload. For table_transcription, this identifier is the layout table UUID.

title

If provided, the text for the label displayed in this component. If not provided, the table name will be used.

columns

An optional list of table columns. If included, only these columns will be displayed in the right-hand panel.

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'receipt',
          type: 'table_transcription,
          data_identifier: '4fe5e47b-ccdb-4f42-8091-4cd48aa0bd0a',
          title: 'Receipt Table'
        },
        ...
      ]
    }
  ]
}

tables_panel_display


With only one column selected.

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'receipt',
          type: 'table_transcription,
          data_identifier: '4fe5e47b-ccdb-4f42-8091-4cd48aa0bd0a',
          title: 'Receipt Table',
          columns: [
            {
              uuid: '672185ce-dbd2-45f9-bd50-d066cfed00cf'
            }
          ]
        },
        ...
      ]
    }
  ]
}

tables_column_filter

Decision Components

Unique to Custom Supervision is the ability to make decisions on different entities. Decisions, or decision components, are drop-down menus with options from a predetermined set of choices set in the JSON configuration. A decision component can be tied to a document, case, page, field, or table cell.

To add a decision component, you need to define the properties described in the sections below.

title

The display header, or name, for the decision component.

relation

A nested object containing a required type property. If the decision applies to a field or table cell, you need to define another required property called match.

  • type - string - Type of entity you want to associate with the decision component. The possible values for the type property are the following:

    • case - Associates the decision with the currently selected case.

    • document - Associates the decision with the currently selected document.

    • page - Associates the decision with the currently selected page.

    • field - Associates the decision with a predefined field.

    • table_cell - Associates the decision with a predefined table cell.

  • match - string - Only used for field and table_cell type decisions. This value is the same as the field’s layout UUID and the table cell’s UUID. The relation object uses this match property to associate the decision with a predefined field or table cell.

⚠️ Even though we use layout field UUID as the data_identifier to match the decision for fields, we still save it back to the specific Field ID when a decision is made.

⚠️ Note that the decision component is not responsible for populating the values related to its relation e.g. field names, table_cell values or bounding boxes. To include that information, the appropriate component will also be included in the supervision template.

Mandatory Decisions

For decision fields, there is now an additional flag to mark the decision as “Required”.

  • required - boolean - Marks the decision field as mandatory. The keyer must select a choice for the decision field in order to complete the task.

⚠️ Mandatory decisions are exactly that: mandatory. If decisions are configured with this setting, then the supervision task cannot be completed until the decision has a choice selected for it. There is no way to bypass this requirement.

JSON Example
{
  action: [
    {
      name: 'Decisions',
      display: 'Decisions',
      input: [
        {
          name": '_decision',
          type": 'decision',
          title": 'Document Decision',
          relation: {
            type: 'document'
          },
          ui: {
            required: true
          },
          schema: {
            oneOf: [
              {
                const: 'accept',
                title: 'Accept Document'
              },
              {
                const: 'reject',
                title: 'Reject Document'
              }
            ]
          }
        }
      ]
    }
  }
}


There are a couple different indicators that appear in the supervision task to let the keyer know which decisions are required.

Right-hand panel

mandatory_decision_right

Left-hand panel

Depending on the decision relation type, we have different levels of notifications that will appear in the supervision task.

Page-level and Document-level

mandatory_decision_left_1

For page-level decisions, the page that the decision is associated with will be marked with an asterisk. For document-level decisions, you will see the “* REQUIRED” indicator above the document ID.

Case-level

mandatory_decision_left_2

For case-level decisions, you will see an indicator next to the case’s external ID.

Completing the task

As you select a choice for each mandatory decision, these indicators will disappear, signaling to the keyer that there are no required decisions left for the page, document, or case.

Once all mandatory decisions are complete, the “Complete task” button will be enabled.

schema

A nested object containing an array. You need to define one and only one of the following arrays:

  • oneOf - array - Selection type for a single-select decision.

  • anyOf - array - Selection type for multi-select decision.

Regardless of the array type, it contains a list of choices with these properties:

{
  const: 'my_internal_choice_name',
  title: 'Display Choice Name'
}

The title is the option’s name that will be displayed in the UI.

The const is the option’s internal name. It is used if there is a need to define an internal value that will be passed along in the workflow and eventually stored in the database.

default_value

This is an optional property that allows you to specify a default or pre-selected value for the decision. You should provide the const value(s) to be pre-selected in a list.

default_value: ['first_choice']

If the decision is multi-select you can provide multiple values.

default_value: ['first_choice', 'third_choice']

Single-select document decision

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'check_decision',
          type: 'decision',
          title: 'Decision',
          relation: {
            type: 'document'
          },
          schema: {
            oneOf: [
              {
                const: 'accept',
                title: 'Accept Check'
              },
              {
                const: 'reject',
                title: 'Reject Check'
              },
              {
                const: 'return',
                title: 'Return overpaid fees'
              }
            ]
          }
        },  
        ...
      ]
    }
  ]
}

Default state - No option previously selected

decision_default

The default state of the decision component is “None selected”. When the type property is case, document, or page, a footer label appears below the decision field to provide context.

Open state:

decision_open

When opened, the decision component displays the available options.

Default state - default_value specified

default_decision_closed default_decision_open

When the task loads the value specified by default_value is already selected. In the case of multi-select decisions, all specified values are selected.


Single-select field decision - includes the transcription field that the decision is tied to for context. Note the match and data_identifier are the same UUID.

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        {
          name: 'first_name',
          type: 'transcription,
          data_identifier: '29e7ff35-a085-415e-9fe2-9dd464a24971',
          title: 'First Name'
        },
        {
          name: 'first_name_single_decision',
          type: 'decision,
          title: 'My Decision',
          relation: {
            type: 'field',
            match: '29e7ff35-a085-415e-9fe2-9dd464a24971'
          },
          schema: {
            oneOf: [
              {
                const: 'first_choice',
                title: 'My First Choice'
              },
              {
                const: 'second_choice',
                title: 'My Second Choice'
              }
            ]
          }
        },
        ...
      ]
    }
  ]
}

The default state of the decision component is pre-populated from an existing decision in the database. Here, the default state is for My First Choice to be selected.

decision_from_database

When the type property’s value is field, a footer label appears below the decision field displaying the value of the title property of the input field.

⚠️ There is also an indented state with a visual indicator to try to help the user associate the decision with the field. You need to order the inputs properly, though, to get this effect. They do NOT order themselves automatically. See UI Groups.

Open state:

decision_from_database_open

When opened, the decision component displays the available options.

Decision filtering:

decision_filter_empty decision_filter_a

When there are ten or more options for a decision, a search bar will appear to filter the options.


Multi-select field decision

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        {
          name: 'first_name',
          type: 'transcription,
          data_identifier: '29e7ff35-a085-415e-9fe2-9dd464a24971',
          title: 'First Name'
        },
        ...
        {
          name: 'first_name_multiple_decision',
          type: 'decision',
          title: 'Multi Decision',
          relation: {
            type: 'field',
            match: '29e7ff35-a085-415e-9fe2-9dd464a24971'
          },
          schema: {
            anyOf: [
              {
                const: 'one',
                title: 'One Fish'
              },
              {
                const: 'two',
                title: 'Two Fish'
              },
              {
                const: 'red',
                title: 'Red Fish'
              },
              {
                const: 'blue',
                title: 'Blue Fish'
              }
            ]
          }
        },
        ...
      ]
    }
  ]
}

The default state of the decision component is pre-populated from existing decisions in the database. Here, the default state is for both One Fish and Two Fish to be selected.

default_multi

My Decision is the same single-select decision from above, but Multi Decision is the rendering of the JSON we have defined on the left.

The same notes from above about how the footer label and indentation behave apply here, as well.

Open state:

open_multi

When opened, the decision component displays the available options.


Single-select table cell decision

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        {
          name: 'table_name',
          type: 'table_transcription,
          data_identifier: '0fcac26e-4332-490f-a728-bcc44be47b30',
          title: 'Receipt Table'
        },
        ...
        {
          name: 'table_cell_decision',
          type: 'decision',
          title: 'Example Table Cell Decision',
          relation: {
            type: 'table_cell',
            match: '7decaca3-c59c-4fb8-ae56-f08d5d2ad14e'
          },
          schema: {
            oneOf: [
              {
                const: 'one',
                title: 'One Fish'
              },
              {
                const: 'two',
                title: 'Two Fish'
              },
              {
                const: 'red',
                title: 'Red Fish'
              },
              {
                const: 'blue',
                title: 'Blue Fish'
              }
            ]
          }
        },
        ...
      ]
    }
  ]
}

Although table cell decisions are configured in the tabs portion of the Supervision Template, they appear underneath the table editor when the impacted cell is selected.

table_cell_decision_bottom

Multi-select decisions are also supported for table cell decisions and behave in a similar manner to field decisions. They also will appear below the table cell when it is active.

dependencies

There is an additional use case for dependencies for decisions. You can create a parent/child relationship between two different decisions, where one set of options (child) depends on the selected choice of another decision (parent).

⚠️ There are two caveats: these relationships can only be configured between either document-level or case-level decisions. Also, these relationships cannot be nested, meaning that there cannot be parent-to-child-to-grandchild relationships.

There are two different “types” that are configurable for these relationships: decision dependencies within the same document (or case) and decision dependencies across documents (or cases).

Decisions within the same document

JSON Example
{
  action: [
    {
      name: 'job_offer_tab',
      display: 'Job Offer',
      input: [
        {
          name: 'javascript',
          type: 'decision',
          title: 'Has javascript experience?',
          relation: {
            type: 'document'
          },
          schema: {
            oneOf: [
              { const: 'yes', title: 'Yes' },
              { const: 'no', title: 'No' },
              { const: 'partial', title: 'Needs Revision' },
            ]
          }
        },
        {
          name: 'job_offer',
          type: 'decision',
          title: 'Select job offer:',
          relation: {
            type: 'document'
          },
          schema: {
            oneOf: [
              {
                const: 'be',
                title: 'Backend Engineer'
              },
              {
                const: 'senior_be',
                title: 'Senior Backend Engineer'
              }
            ]
          },
          dependencies: [
            {
              condition: {
                properties: {
                  decisions: {
                    type: 'array'
                    contains: {
                      anyOf: [
                        {
                          type: 'object',
                          properties: {
                            decisionName: {
                              const: 'javascript'
                            },
                            decisionValue: {
                              const: ['yes']
                            },
                            isCurrentDocument: {
                              const: true
                            }
                          }
                        },
                        {
                          type: 'object',
                          properties: {
                            decisionName: {
                              const: 'javascript'
                            },
                            decisionValue: {
                              const: ['partial']
                            },
                            isCurrentDocument: {
                              const: true
                            }
                          }
                        }
                      ]
                    }
                  }
                }
              },
              override: {
                schema: {
                  oneOf: [
                    {
                      const: 'fe',
                      title: 'Frontend Engineer'
                    },
                    {
                      const: 'senior_fe',
                      title: 'Senior Frontend Engineer'
                    }
                  ]
                }
              }
            }
          ]
        }
      ]
    }
  ]
}


Here the “javascript” decision is the parent, which is defined as any other decision would be.

The definition comes from the “job_offer” decision, specifically in the dependencies block. A condition + override pair is created to map out the relationship.

On a more detailed level, there is some JSON schema syntax to identify that describes the decisions object captured with the context of our task. There are also potentially multiple conditions to check against (anyOf).

...
properties: {
  decisions: {
    type: 'array'
    contains: {
      anyOf: [...]
      ...
    }
    ...
  }
}

Within the anyOf block, we have the conditions defined that would trigger the override.

...
anyOf: [
  {
    type: 'object',
    properties: {
      decisionName: {
        const: 'javascript'
      },
      decisionValue: {
        const: ['yes']
      },
      isCurrentDocument: {
        const: true
      }
    }
  },
  {
    type: 'object',
    properties: {
      decisionName: {
        const: 'javascript'
      },
      decisionValue: {
        const: ['partial']
      },
      isCurrentDocument: {
        const: true
      }
    }
  }
]
...
  • decisionName defines the parent decision that the child depends on.

  • decisionValue defines the value that must be selected in that decision to trigger the override.

  • isCurrentDocument indicates that this dependency occurs within the same document.

  • isCurrentCase is not seen in this example, but it is analogous to isCurrentDocument, and the two are mutually exclusive.

There are two conditions that can apply the override here:

  1. “Yes” is chosen for the “Has javascript experience?” question.

  2. “Needs Revision” is chosen for the “Has javascript experience?” question.

...
override: {
  schema: {
    oneOf: [
      {
        const: 'fe',
        title: 'Frontend Engineer'
      },
      {
        const: 'senior_fe',
        title: 'Senior Frontend Engineer'
      }
    ]
  }
}
...

If either of these options are chosen, then the options of this decision are changed to more appropriate Frontend-related choices.

decision_dependencies_intra_updated

If no option is selected in the parent, or an option not defined in the dependency is chosen, then we use the original schema defined for the decision:

...
schema: {
  oneOf: [
    {
      const: 'be',
      title: 'Backend Engineer'
    },
    {
      const: 'senior_be',
      title: 'Senior Backend Engineer'
    }
  ]
},
...

decision_dependencies_intra_default

⚠️ If a parent is updated after an option has been selected in its child decision, that option will be unselected IF the update to the parent makes that option unavailable.

Decisions across documents

We recommend reading the section above, “Decisions within the same document,” as there are many concepts there that also apply to decision dependencies across documents and cases.

The differences between the configurations are described below.

JSON Example
{
  action: [
    {
      name: 'insurance_tab',
      display: 'Insurance',
      input: [
        {
          name: 'provider',
          type: 'decision',
          title: 'Medical insurance provider:',
          relation: {
            type: 'document'
          },
          schema: {
            oneOf: [
              {
                const: 'a',
                title: 'Provider Alpha'
              },
              {
                const: 'b',
                title: 'Provider Bravo'
              },
              {
                const: 'c',
                title: 'Provider Charlie'
              }
            ]
          },
          ui: {
            hidden: true
          },
          dependencies: [
            {
              condition: {
                properties: {
                  layoutId: {
                    const: '<insurance_card_uuid>'
                  },
                },
              },
              override: {
                ui: {
                  hidden: false
                }
              }
            }
          ]
        },
        {
          name: 'billing_code',
          type: 'decision',
          title: 'Select billing code:',
          relation: {
            type: 'document'
          },
          schema: {
            oneOf: []
          },
          ui: {
            hidden: true
          },
          dependencies: [
            {
              condition: {
                properties: {
                  layoutId: {
                    const: '<eob_uuid>'
                  }
                }
              },
              override: {
                ui: {
                  hidden: false
                }
              }
            },
            {
              condition: {
                properties: {
                  decisions: {
                    type: 'array',
                    contains: {
                      anyOf: [
                        {
                          type: 'object',
                          properties: {
                            decisionName: {
                              const: 'provider'
                            },
                            decisionValue: {
                              const: ['a']
                            }
                          }
                        }
                      ]
                    }
                  }
                }
              },
              override: {
                schema: {
                  oneOf: [
                    {
                      const: 'a1',
                      title: 'Code A024'
                    },
                    {
                      const: 'a2',
                      title: 'Code A099'
                    }
                  ]
                }
              }
            },
            {
              condition: {
                properties: {
                  decisions: {
                    type: 'array',
                    contains: {
                      anyOf: [
                        {
                          type: 'object',
                          properties: {
                            decisionName: {
                              const: 'provider'
                            },
                            decisionValue: {
                              const: ['b']
                            }
                          }
                        }
                      ]
                    }
                  }
                }
              },
              override: {
                schema: {
                  oneOf: [
                    {
                      const: 'b1',
                      title: 'Code fre_87'
                    },
                    {
                      const: 'b2',
                      title: 'Code ortho_12'
                    }
                  ]
                }
              }
            },
            {
              condition: {
                properties: {
                  decisions: {
                    type: 'array',
                    contains: {
                      anyOf: [
                        {
                          type: 'object',
                          properties: {
                            decisionName: {
                              const: 'provider'
                            },
                            decisionValue: {
                              const: ['c']
                            }
                          }
                        }
                      ]
                    }
                  }
                }
              },
              override: {
                schema: {
                  oneOf: [
                    {
                      const: 'c1',
                      title: 'Code C038'
                    },
                    {
                      const: 'c2',
                      title: 'Not Covered'
                    }
                  ]
                }
              }
            }
          ]
        }
      ]
    }
  ]
}


In this scenario, we have two different types of documents, but the structure is very similar to the configuration for setting up dependencies within the same document or case.

The largest difference here is that we do need isCurrentDocument or isCurrentCase defined within the condition properties.

Other than that, the configuration of this example is a bit longer, but mainly because we have different options for a range of different choices in the parent. The core of the syntax and logic is the same. Again, there are more detailed explanations of these properties in the “Decisions within the same document” section.

Selecting Provider Alpha in the parent

decision_dependencies_inter_parent_a

Updating the billing codes

decision_dependencies_inter_child_a

Going back to updating to Provider Bravo in the parent

decision_dependencies_inter_parent_b

Updating the available billing codes again

decision_dependencies_inter_child_b

Add to Case Components

This component is rather unique and allows users to add a document to an existing case or add a document to a newly created case. You can also edit the case assignment of documents that already belong to cases.

Note that in order for the case assignments to be saved in the database, a Machine Collation Block must follow the Custom Supervision Block.

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'assign_to_case',
          type: 'case_dropdown',
          title: ''
        },
        ...
      ]
    }
  ]
}

⚠️ The name property must be unique.

The name and title properties are not shown in the UI, but are still included in the JSON.

The only valid value for type in Add to Case fields is case_dropdown.

Default state when document is not assigned to a case:

case_default

The default value of this component is None. To assign a document to a case, click the pencil (“Edit”) button, and an “Add to case” dialog box will appear. This dialog box is very similar to the one used when assigning a submission to a case during Submission Upload.

case_edit

Assigning to an existing case

case_existing

Lazy-loaded case lookup. When you type in the search bar, a list of matching cases appears. You can search only by case ID.

Assigning to a new case

case_new

To assign to a new case, click the Create a new case link and enter a custom case ID.

State when case is assigned

case_assigned

Nothing is assigned until the entire task is submitted, so you can freely edit this multiselect as much as you want.

  • To cancel the addition of a document to a case, click the case’s “X” button.

  • You can assign a document to multiple cases at once.

Case Note components

This component allows users to add or edit the case note for a case.

Example

{
  action: [
    {
      name: 'case_note_tab',
      display: 'Case Note Data',
      input: [
        ...
        {
          name: 'case_notes_name',
          type: 'case_notes',
          title: ''
        },
        ...
      ]
    }
  ]
}

⚠️ The name property in the input must be unique.

The name and title properties in input are not shown in the UI, but they are still required in the JSON template.

The only valid value for type in Case Note fields is case_notes.

Default state when no case notes have been specified for a case:

case_notes_default

The disabled state when the selected page or document is not associated with a case:

case_notes_non_existing_case

To add or edit a case note during a Custom Supervision task, enter the note in the text box. When the task is completed and the Machine Collation Block is run, the new case note will be saved for the case.

case_notes_edit

  • In order for the case notes to be saved in the database, a Machine Collation Block must follow the Custom Supervision Block.

  • When pages are grouped by case in Custom Supervision, only the case notes of the selected document will be updated.

  • If a page or document is not grouped by case, that page or document may be assigned to more than one case. However, it is not currently possible to choose which assigned case to edit during Custom Supervision. For these ungrouped pages or documents, only one assigned case (and its case note) can be viewed at a time. Any case notes edits will apply to all assigned cases for the selected page or document. If no edits are made, then there will be no applied changes to any of the assigned cases.

  • The character limit for a case note is 2000 characters.

Search Components

In combination with Storage (available in v38 and later), Search components look up custom items that are kept in Storage. Based on the item selected, the properties of the item can be mapped to transcription fields defined alongside the Search component.

Property

Description

name

The internal name. It is needed for rendering, but it is not shown in the UI.

type

The component type, which is always search.

params

See Params properties table below.

property_to_field

A map of properties of the selected item from the search field to corresponding transcription fields in the task. More details can be found after the examples below.

display_accessors

A list of property names used for display purposes in the UI. More details can be found after the examples below.

⚠️ As of v38, display_accessors only supports a single property name.

Params properties

Property

Description

collection

The collection of custom items that the Search component looks for in Storage.

Mapping to transcription fields
JSON Example
{
  action: [
    {
      name: 'search_tab',
      display: 'Search Results',
      input: [
        ...
        {
          type: 'search',
          params: {
            'collection': 'recipe',
          },
          property_to_field: {
            name: ['dessert_name'],
            kilocalories: ['dessert_kilocalories'],
            author: ['dessert_author'],
          },
          display_accessors: ['name']
        },
        {
          name: 'dessert_name',
          type: 'transcription',
          data_identifier: '7174ebc4-a5d5-4705-8ed0-3d3211092a16',
          title: 'Dessert Name'
        },
        {
          name: 'dessert_kilocalories',
          type: 'transcription',
          data_identifier: 'ad806af5-c1c0-4225-8470-6cedafbb023b',
          title: 'Dessert Calories'
        },
        {
          name: 'dessert_author',
          type: 'transcription',
          data_identifier: 'dfbf11d6-f2c5-4da6-b8d0-f94c9f6ee0ba',
          title: 'Dessert Author'
        },
        ...
      ]
    }
  ]
}


In this scenario, we have a search field mapped to three different transcription fields. This mapping is controlled by property_to_field.

search_field_blank

To help illustrate this concept, we will also define what the Item from Storage looks like:

{
  id: 'd4a4c906-0d17-4c8a-b845-95396fa62970',
  collection: 'recipe',
  properties: {
    name: 'Creme Brulee',
    kilocalories: 123,
    author: 'Wolfgang Puck'
  }
}

Keep in mind that we are storing a completely customizable item. And, for this example, we can say that we have several hundred of these items in the collection 'recipe' with different name, kilocalories, and author values.

You can use the Search component to look up these items by the collection specified in the Search component’s params.

  • When the search bar is initially clicked, we immediately perform a search for all items in the collection.

  • Based on what you enter in the search bar, it performs a substring search across all properties defined on the Item.

⚠️ We have limited the results of the search to 50 results. If the option you want is not in the 50 results, you will need to perform a more specific search.

search_field_search

display_accessors is used when generating the options in the dropdown list. With what we defined in our example, when the dropdown list opens, the name values of the recipe items are shown.

Upon selecting an item from the results of your search, we then map the properties of the Item to the fields defined in property_to_field.

To extend the example, when “Creme Brulee” is selected:

  • dessert_name transcription field is populated with “Creme Brulee”.

  • dessert_kilocalories transcription field is populated with “123”.

  • dessert_author transcription field is populated with “Wolfgang Puck”.

search_field_final

We do not track the Storage Item beyond populating the associated transcription fields. The Search component should be viewed as a tool to help populate defined transcription fields. When completing the task, we extract the information from the transcription field and do not look at the search field.

⚠️ You can overwrite what you select by typing in the transcription field. If you perform another search, it will again update the associated transcription fields. The last action taken will be used to update the transcription field.

Document Metadata Components

Document Metadata components are used to add, edit, or remove metadata values from a document. The metadata is stored in the database on the Document object and can be used for downstream processing in a flow.

Metadata properties on the document are key-value pairs. Each key is a string, and each value is a list of strings.

Property

Description

name

The internal name. It is needed for rendering, but it is not shown in the UI.

type

The component type, which is always document_metadata.

title

Text for the label displayed for this component.

metadata_keys

List of keys from the Document Metadata object to be displayed in the UI.

restricted_values

Boolean value that determines if the user can add strings to / remove strings from the key’s value.

With this component, the user is not able to change metadata key strings. As mentioned, they can add, edit, or remove value strings for the keys defined in the Supervision template.

JSON Example
{
  action: [
    {
      name: 'document_metadata_tab',
      display: 'Document Metadata',
      input: [
        ...
        {
          name: 'document_metadata_field_name',
          type: 'document_metadata',
          title: 'Document Metadata',
          metadata_keys: [
            'external_id',
            'other_information'
          ],
          restricted_values: false,
        },
        ...
      ]
    }
  ]
}


In this scenario, the user sees the keys listed in the component definition: “external_id” and “other_information”.

There are two possible initial states of the metadata field in the UI, depending on whether there is existing data or not.

If there is no existing metadata, when the task loads, the Document Metadata field will appear as follows:

metadata_field_new_keys

If there is existing metadata, for example:

{
  ...
  metadata: {
    external_id: ['123'],
    other_information: ['ABC', 'DEF'],
  }

then the Document Metadata field will be pre-populated with the existing metadata.

metadata_field_existing_keys

The user will then be able to perform the add, edit, and remove actions on the values, as mentioned before.

metadata_field_add_edit_remove

restricted_values is another option that can be toggled in the JSON configuration. If restricted_values is set to true, then the user will not be able to add strings to or remove strings from metadata keys’ values. They will only be able to edit a single value string.

metadata_field_restricted_values

⚠️ If there are no existing value strings for a key, and restricted_values is set to true, then the user will still be able to add a single value string for the metadata key.

Generic Input Configuration

There is some additional configuration that can be applied to any of the fields defined above. These are features supported by our more encompassing form builder know as JSON Schema Form. Here are a couple useful features that can be used for Custom Supervision:

  • UI settings - Allows you to hide components and disable input.

  • Dependencies settings - Sets conditions under which the values of the UI settings parameters can be automatically changed.

UI Settings

UI settings allow you to hide components and disable components. It also provides the ability to mark certain components as in need of review. To define a UI setting for a component, you need to add a subset of the following options:

  • hidden - boolean - Prevents the component from being shown in the action pane; defaults to false.

  • disabled - boolean - Disables input for a component; defaults to false.

  • needs_review - boolean - Forces the user to interact with this component before they can complete the task; defaults to false. As of v34, this feature is only supported for type: ‘transcription’.

Example

{
  action: [
    {
      name: 'document_tab',
      display: 'Document Data',
      input: [
        ...
        {
          name: 'example_disabled_component',
          type: 'transcription',
          data_identifier: 'be2fe4f4-a073-484c-a4b7-3579c3c6fc3b',
          title: 'Example Disabled Component',
          ui: {
            disabled: true
          }
        },
        {
          name: 'example_hidden_component',
          type: 'transcription',
          data_identifier: 'b18cb177-106a-44db-b395-03905ddf722a',
          title: 'Example Hidden Component',
          ui: {
            hidden: true
          }
        },
        {
          name: 'example_both_component',
          type: 'transcription',
          data_identifier: '9b6a1694-193f-4c87-a685-243572ab7779',
          title: 'Example Both Component',
          ui: {
            hidden: true,
            disabled: true
          }
        },
        ...
      ]
    }
  ]
}
Dependencies Settings

This is the most dynamic piece of Custom Supervision that takes some time to understand what makes sense to set up. The idea of dependencies in their initial iteration is to set conditions, which, when met, will be able to change the ui settings as defined above.

The most common predicted use case of this feature is to dynamically show and hide components by toggling the ui.hidden flag when a certain document or case is selected. Since submissions can contain several different layout variations, you may want to hide components that are irrelevant to the user. With dependencies, you can control which components show up when. Similarly, you can use the same approach to disable input for specific components.

Because depenedencies settings directly interact with the ui settings, you can also dynamically ui.disable fields, as well.

We are using the Ajv Library and are currently focused on using the const property in Ajv’s JSON schema validator to test equivalence. To learn more, see Ajv’s JSON Schema and const documentation.

This feature requires a larger JSON configuration to really show the benefit. The example below contains parts of some of the Input Components defined above, since it is a full working use case of how these components can be configured. It also uses mock UUIDs, just to be a little more clear what matches to what.

Dependencies Settings Example
{
  "action": [
    {
      "name": "review_data",
      "display": "Review Data",
      "input": [
        {
          "name": "tab_1_document_title",
          "type": "document_title",
          "title": "Document Title"
        },
        {
          "name": "participant_account_number",
          "data_identifier": "<participant_account_number_uuid>",
          "type": "transcription",
          "ui": {
            "hidden": true
          },
          "dependencies": [
            {
              "condition": {
                "properties": {
                  "layoutId": {
                    "const": "<beneficiary_change_layout_uuid>"
                  }
                }
              },
              "override": {
                "ui": {
                  "hidden": false
                }
              }
            }
          ]
        },
        {
          "name": "participant_name",
          "data_identifier": "<participant_name_uuid>",
          "type": "transcription",
          "ui": {
            "hidden": true
          },
          "dependencies": [
            {
              "condition": {
                "properties": {
                  "layoutId": {
                    "const": "<beneficiary_change_layout_uuid>"
                  }
                }
              },
              "override": {
                "ui": {
                  "hidden": false
                }
              }
            }
          ]
        },
        {
          "name": "current_beneficiary_name",
          "data_identifier": "<current_beneficiary_name_uuid>",
          "type": "transcription",
          "ui": {
            "hidden": true
          },
          "dependencies": [
            {
              "condition": {
                "properties": {
                  "layoutId": {
                    "const": "<beneficiary_change_layout_uuid>"
                  }
                }
              },
              "override": {
                "ui": {
                  "hidden": false
                }
              }
            }
          ]
        },
        {
          "name": "check_number",
          "data_identifier": "<check_number_uuid>",
          "type": "transcription",
          "ui": {
            "hidden": true
          },
          "dependencies": [
            {
              "condition": {
                "properties": {
                  "layoutId": {
                    "const": "<check_layout_uuid>"
                  }
                }
              },
              "override": {
                "ui": {
                  "hidden": false
                }
              }
            }
          ]
        },
        {
          "name": "payer_name",
          "data_identifier": "<payer_name_uuid>",
          "type": "transcription",
          "ui": {
            "hidden": true
          },
          "dependencies": [
            {
              "condition": {
                "properties": {
                  "layoutId": {
                    "const": "<check_layout_uuid>"
                  }
                }
              },
              "override": {
                "ui": {
                  "hidden": false
                }
              }
            }
          ]
        },
        {
          "name": "payer_address",
          "data_identifier": "<payer_address_uuid>",
          "type": "transcription",
          "ui": {
            "hidden": true
          },
          "dependencies": [
            {
              "condition": {
                "properties": {
                  "layoutId": {
                    "const": "<check_layout_uuid>"
                  }
                }
              },
              "override": {
                "ui": {
                  "hidden": false
                }
              }
            }
          ]
        }
      ]
    }
  ]
}

\

First, here is a GIF of what this code produces. Below, there is a more in-depth description and breakdown of the JSON to help clarify.

dependencies

Note: The sample JSON above is trimmed to just a few components for each document compared to the components seen in the GIF. Also, the documents and transcribed fields use mock data with mock images.

  • Notice the document_title component stays the same across both documents. This is because there are no dependencies and it will always default to ui.hidden: false.

  • Looking at the first input defined, we have the ui.hidden property set to true. If you want to achieve the dynamic rendering shown in the example, this setting is required.

        {
          "name": "participant_account_number",
          "data_identifier": "<participant_account_number_uuid>",
          "type": "transcription",
          "ui": {
            "hidden": true
          },
          "dependencies": [
            {
              "condition": {
                "properties": {
                  "layoutId": {
                    "const": "<beneficiary_change_layout_uuid>"
                  }
                }
              },
              "override": {
                "ui": {
                  "hidden": false
                }
              }
            }
          ]
        }
  • Each dependencies contains an array of conditions. Thus, you can configure multiple conditions under which a specific component is to be displayed, hidden, or disabled.

  • Each dependency has a condition that needs to be met, and then an override that will take place. Again, the only overrides that make sense at this point are the ones that affect the ui settings.

  • In this specific example for participant_account_number, the nesting of condition.properties is standard syntax when using Ajv.

  • We have configurability around the next nesting, though:

    • layoutId - Used when you want to match to the currently selected layout.

    • pageId - Used when you want to match to the currently selected page.

    • documentId - Used when you want to match to the currently selected document.

    • caseId - Used when you want to match to the currently selected case.

  • In this example, we use the layoutId to match against.

  • The const is the Ajv syntax for checking equivalence, as mentioned above.

  • Putting all these elementes together, this condition is saying, “When the currently selected Layout ID is <beneficiary_change_layout_uuid>, … “

  • When this condition is true, the override will toggle the ui.hidden flag to false.

    • “When the currently selected Layout ID is <beneficiary_change_layout_uuid>, show this field.”

  • Looking back at the GIF, you can see that the Participant Account Number component only appears when the Beneficiary Change document is selected.

You can review the rest of the sample JSON, but these points are the core of what is going on behind the scenes. There are some assumptions here that the data coming in for these documents, separate from what is defined in this input, have the layout UUIDs that match up (<beneficiary_change_layout_uuid> and <check_layout_uuid>).

UI Groups

UI groups determine how components should be grouped within a tab.

Adding a UI group is optional. If you do not add a UI group, all Input Components will be included in a single section in the order they are defined.

If you do include a UI group, the string defined within each fields list needs to correspond to a component name in the input section.

⚠️ You’ll notice that throughout this documentation, we refer to the UI components that can be added to the fields list as “Input Components” rather than as “Fields” or “Input Fields.” We’ve made this distinction to avoid confusion with the concept of a “layout field” that can be a part of document and is a specific sub-type of the transcription input component.

To add a UI group, you need to define the following properties:

  • fields - List that contains the name properties of the Input Components you want to add to the UI group.

  • (optional) title - Text displayed at the top of a UI group. If you do not define a title property for a group, the listed components will still be grouped together, but no text will be displayed at the top of the UI group.

Multiple groups are separated by a single horizontal line. The order in which Input Components are displayed on a tab matches the order of the Input Components in the fields list.

No Titles

{
  ui: {
    groups: [
      {
        fields: ['ssn_field']
      },
      {
        fields: [
          'check_amount_field',
          'account_number'
        ],
      },
    ]
  }
}

no_titles

Light horizontal divider between the two groups


With Titles

{
  ui: {
    groups: [
      {
        title: 'My Group',
        fields: ['ssn_field']
      },
      {
        title: 'Check Info',
        fields: ['check_amount_field', 'account_number']
      }
    ]
  }
}

with_titles


Missing Fields

{
  ui: {
    groups: [
      {
        title: 'My Group',
        fields: ['ssn_field']
      },
      {
        title: 'Check Info',
        fields: ['check_amount_field']
      }
    ]
  }
}

missing_fields

Input Components that are not added to any UI group appear at the top of the tab. Here, Account Number is not defined within groups, so it is shown at the top.

External Sources

In addition to customizing the three-panel interface, you can also display pages that come from submissions that the Custom Supervision Block is not currently processing (“external submissions”). Users can compare these pages with the documents and pages being processing through the Custom Supervision Block.

To display pages from external submissions, you need to define their respective page IDs at the same level as supervision_template. Here is an example of defining page IDs:

{
  page_ids: [1, 2, 3, 15],
  supervision_template: [
    {
      name: 'three_column_template',
      version: '1.0'
    }
  ]
}

⚠️ There are restrictions that come with this added flexibility. Since this data is not in the current submission and thus may have already gone through transcription and other Supervision tasks, all transcription components that are displayed for these pages will be uneditable.

Examples

Here is a full example of a two-tab setup. Again, we used mock UUIDs for readability.

{
  supervision_template: [
    {
      name: 'three_column_template',
      version: '1.0',
      thumbnail: {
        group_by_document: true,
        group_by_case: true,
      },
      action: [
        {
          name: 'document_tab',
          display: 'Document Data',
          input: [
            {
              name: 'doc_title',
              type: 'document_title',
            },
            {
              name: 'check_amount',
              type: 'transcription',
              data_identifier: '<check_amount_uuid>',
              title: 'Check Amount',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: { layoutId: { const: '<check_layout_uuid>' } },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'check_pay_to_the_order_of',
              type: 'transcription',
              data_identifier: '<check_pay_to_the_order_of_uuid>',
              title: 'Pay to the Order of',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: { layoutId: { const: '<check_layout_uuid>' } },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'check_date',
              type: 'transcription',
              data_identifier: '<check_date_uuid>',
              title: 'Name',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: { layoutId: { const: '<check_layout_uuid>' } },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'check_decision',
              type: 'decision',
              data_identifier: '<check_name_uuid>',
              title: 'Decision',
              relation: {
                type: 'document',
              },
              schema: {
                oneOf: [
                  {
                    const: 'accept',
                    title: 'Accept Check',
                  },
                  {
                    const: 'reject',
                    title: 'Reject Check',
                  },
                  {
                    const: 'return',
                    title: 'Return overpaid fees',
                  },
                ],
              },
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: { layoutId: { const: '<check_layout_uuid>' } },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_name',
              type: 'transcription',
              data_identifier: '<change_of_bene_name_uuid>',
              title: 'Name',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<account_application_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_dob',
              type: 'transcription',
              data_identifier: '<change_of_bene_dob_uuid>',
              title: 'Date of Birth',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<account_application_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_ssn',
              type: 'transcription',
              data_identifier: '<change_of_bene_ssn_uuid>',
              title: 'SSN',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<account_application_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_phone_number',
              type: 'transcription',
              data_identifier: '<change_of_bene_phone_number_uuid>',
              title: 'Phone Number',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<account_application_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_trustees_ssn',
              type: 'transcription',
              data_identifier: '<change_of_bene_trustees_ssn_uuid>',
              title: "Participant's/Trustee's SSN",
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<change_of_bene_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_new_bene_ssn',
              type: 'transcription',
              data_identifier: '<change_of_bene_new_bene_ssn_uuid>',
              title: "New Beneficiary's SSN",
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<change_of_bene_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_descendant',
              type: 'transcription',
              data_identifier: '<change_of_bene_descendant_uuid>',
              title: 'Son/Daughter/Descendant',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<change_of_bene_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_partial_account_xfer',
              type: 'transcription',
              data_identifier: '<change_of_bene_partial_account_xfer_uuid>',
              title: 'Partial Account Transfer',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<change_of_bene_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'change_of_bene_partial_account_xfer_amount',
              type: 'transcription',
              data_identifier: '<change_of_bene_partial_account_xfer_amount_uuid>',
              title: 'Partial Account Transfer Amount',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: {
                    properties: {
                      layoutId: { const: '<change_of_bene_layout_uuid>' },
                    },
                  },
                  override: { ui: { hidden: false } },
                },
              ],
            },
          ],
          ui: {
            groups: [
              {
                fields: ['doc_title'],
              },
              {
                fields: [
                  'check_amount',
                  'check_pay_to_the_order_of',
                  'check_date',
                  'check_decision',
                  'change_of_bene_name',
                  'change_of_bene_dob',
                  'change_of_bene_ssn',
                  'change_of_bene_phone_number',
                  'change_of_bene_trustees_ssn',
                  'change_of_bene_new_bene_ssn',
                  'change_of_bene_descendant',
                  'change_of_bene_partial_account_xfer',
                  'change_of_bene_partial_account_xfer_amount',
                ],
              },
            ],
          },
        },
        {
          name: 'case_tab',
          display: 'Case Data',
          input: [
            {
              name: 'case_title',
              type: 'case_title',
            },
            {
              name: 'instructions',
              type: 'text_block',
              title: '',
              description:
                'Instructions:\n$100 Processing fee\n$50 optional fee for expediting case',
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: { properties: { caseId: { const: '99021' } } },
                  override: { ui: { hidden: false } },
                },
                {
                  condition: { properties: { caseId: { const: '100034' } } },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'region',
              type: 'decision',
              title: 'Region',
              relation: {
                type: 'case',
              },
              schema: {
                oneOf: [
                  {
                    const: 'new_york',
                    title: 'New York',
                  },
                  {
                    const: 'boston',
                    title: 'Boston',
                  },
                  {
                    const: 'philadelphia',
                    title: 'Philadelphia',
                  },
                ],
              },
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: { properties: { caseId: { const: '99021' } } },
                  override: { ui: { hidden: false } },
                },
                {
                  condition: { properties: { caseId: { const: '100034' } } },
                  override: { ui: { hidden: false } },
                },
              ],
            },
            {
              name: 'flag',
              type: 'decision',
              title: 'Flag',
              relation: {
                type: 'case',
              },
              schema: {
                oneOf: [
                  {
                    const: 'yes',
                    title: 'Yes, flag case',
                  },
                  {
                    const: 'no',
                    title: 'No, case clear',
                  },
                ],
              },
              ui: {
                hidden: true,
              },
              dependencies: [
                {
                  condition: { properties: { caseId: { const: '99021' } } },
                  override: { ui: { hidden: false } },
                },
                {
                  condition: { properties: { caseId: { const: '100034' } } },
                  override: { ui: { hidden: false } },
                },
              ],
            },
          ],
          ui: {
            groups: [
              {
                fields: ['case_title'],
              },
              {
                fields: ['instructions', 'region', 'flag'],
              },
            ]
          }
        }
      ]
    }
  ]
}

Images and data are all mocked (and often repeated), but hopefully, you now have an idea of what can be done with Custom Supervision.

Data Payload

⚠️ Note that this payload is only relevant when using the Custom Supervision Block directly as opposed to the IDP Custom Supervision Block. The IDP Custom Supervision automatically populates the data field for you.

When using the Custom Supervision Block directly, one should be more deliberate how to populate the data payload. It is the primary source of truth for Custom Supervision, and the UI depends on it to render properly. It’s not recommended to populate data manually, but there are some instances where a user may want to populate data that does not exist in the database. For example, you would manually populate data after a Full Page Transcription flow if you wanted to use Custom Supervision to display crops. If a user chooses to manually populate data, there are some guidelines to follow to ensure a seamless experience.

⚠️ In v38 and later, an invalid data payload will cause the flow to fail.

Formatting

Here is the schema validated by the Custom Supervision Block. Note that you can add fields that are outside of this definition; the block validates only those mentioned below.

For data, we follow the defined dataclass. Note that these fields, with the exception of task_purpose_code, are all optional lists.

class Data:
  task_purpose_code: Optional[int]
  pages: Optional[list[Page]]
  cases: Optional[list[Case]]
  documents: Optional[list[Document]]
  fields: Optional[list[FieldData]]
  template_fields: Optional[list[TemplateField]]
  tables: Optional[list[Table]]
  selected_choices: Optional[list[SelectedChoice]]
  crops: Optional[list[Crop]]

cases

class Case:
  id: int
  uuid: UUID
  external_case_id: str
  start_time: str
  update_time: str
  to_delete_time: Optional[str]
  notes: str
  documents: list[int]
  unassigned_pages: list[int]
  submission_files: list[str]
  submissions: list[int]

pages

class Page:
    id: int
    file_page_number: int
    document_page_number: Optional[int]
    image_url: Optional[str]
    form_id: Optional[int]
    submission_id: int
    external_case_ids: list[str]
    read_only: bool
    filename: str
    form_page_id: Optional[int]

documents

class Document:
  id: int
  layout_uuid: UUID
  layout_name: str
  pages_count: int
  read_only: bool

fields

class Field:
  id: int
  uuid: UUID
  value: Optional[Union[bool, str]]
  page_id: int
  layout_field_id: UUID
  bounding_box: Optional[list[float]]
  validation_overridden: bool
  occurrence_index: Optional[int]

template_fields

class TemplateField:
  uuid: UUID
  notes: str
  type: str
  data_type_uuid: UUID
  name: str

tables

class Table:
  id: int
  name: str
  uuid: UUID
  document_id: int
  layout_table_uuid: UUID
  parent_table_uuid: Optional[UUID]
  parent_layout_table_uuid: Optional[UUID]
  rows: list[Row]
  columns: list[Column]
  cells: list[Cell]
  
class Cell:
  id: int
  uuid: UUID
  row_uuid: UUID
  column_uuid: UUID
  value: Optional[Union[bool, str]]
  bounding_box: Optional[list[float]]
  validation_overridden: bool
  page_id: int

class Column:
  uuid: UUID
  name: str
  data_type_uuid: UUID

class Row:
  id: int
  uuid: UUID

selected_choices

class SelectedChoice:
  decision_name: str
  choice_name: str
  task_purpose_id: int

  case_id: Optional[int]
  document_id: Optional[int]
  field_id: Optional[int]
  page_id: Optional[int]
  cell_uuid: Optional[UUID]

crops

class Crop:
  uuid: UUID
  page_id: int
  bounding_box: Optional[list[float]]
  value: str

ID References

You may have noticed that the schemas of individual fields all have some sort of identifier, usually id but sometimes uuid. We validate that any of the included id/uuids in one key of data should exist elsewhere. As an example, for every page_id in Field, there should be a corresponding id in Page.

✅ Valid Reference

"pages": [
    {
    "id": 1,
    "file_page_number": 1,
    "document_page_number": 1,
    "image_url": "/image/2ed3d989-b64a-44bd-a9fb-6e0dcc5ccdb8",
    "form_id": 1,
    "submission_id": 1,
    "external_case_ids": [],
    "read_only": false,
    "filename": "1 page.pdf",
    "form_page_id": 1
    }
],
"fields": [
  {
    "id": 1,
    "uuid": "1ebb7125-1664-4268-9a1a-8a7c5a75ffd4",
    "value": "Test",
    "page_id": 1,  # This matches the defined page with ID of 1 
    "layout_field_id": "71046ffb-8f00-4da5-aef9-9bf74a7bddc8",
    "bounding_box": [
      0.616888888888889,
      0.262362637362637,
      0.883555555555556,
      0.276098901098901
    ],
    "validation_overridden": false,
    "occurrence_index": 0
  }
]

❌ Invalid Reference

"pages": [
    {
    "id": 1,
    "file_page_number": 1,
    "document_page_number": 1,
    "image_url": "/image/2ed3d989-b64a-44bd-a9fb-6e0dcc5ccdb8",
    "form_id": 1,
    "submission_id": 1,
    "external_case_ids": [],
    "read_only": false,
    "filename": "1 page.pdf",
    "form_page_id": 1
    }
],
"fields": [
  {
    "id": 1,
    "uuid": "1ebb7125-1664-4268-9a1a-8a7c5a75ffd4",
    "value": "Test",
    "page_id": 15,  # There is no page with ID of 15 defined
    "layout_field_id": "71046ffb-8f00-4da5-aef9-9bf74a7bddc8",
    "bounding_box": [
      0.616888888888889,
      0.262362637362637,
      0.883555555555556,
      0.276098901098901
    ],
    "validation_overridden": false,
    "occurrence_index": 0
  }
]

List of Reference Validations

  • For every page_id in fields, there should be a corresponding id in pages.

  • For every layout_field_id in fields , there should be a corresponding uuid in template_fields.

  • For every form_id in pages, there should be a corresponding id in documents.

  • For every document_id in tables, there should be a corresponding id in documents.

  • For every case_id in selected_choices, there should be a corresponding id in cases.

  • For every document_id in selected_choices, there should be a corresponding id in documents.

  • For every field_id in selected_choices, there should be a corresponding id in fields.

  • For every page_id in selected_choices, there should be a corresponding id in pages.

  • For every cell_uuid in selected_choices, there should be a corresponding uuid in table.cells.

  • For every field_id in selected_choices, there should be a corresponding id in fields.

  • For every page_id in table.cells, there should be a corresponding id in pages.

  • For every row_uuid in table.cells, there should be a corresponding uuid in table.rows.

  • For every column_uuid in table.cells, there should be a corresponding uuid in table.columns.

  • For every page_id in crops, there should be a corresponding id in pages.

Example of Valid data

"data": {
  "task_purpose_code": 2003,
  "pages": [
    {
      "id": 1,
      "file_page_number": 1,
      "document_page_number": 1,
      "image_url": "/image/2ed3d989-b64a-44bd-a9fb-6e0dcc5ccdb8",
      "form_id": 1,
      "submission_id": 1,
      "external_case_ids": [],
      "read_only": false,
      "filename": "1 page.pdf",
      "form_page_id": 1
    }
  ],
  "cases": [
    {
      "id": 1,
      "uuid": "1ebb7125-1664-4268-9a1a-8a7c5a75ffd1",
      "external_case_id": "HS-1",
      "start_time": "2023-07-10T21:29:50.379413Z",
      "update_time": "2023-07-10T21:32:57.824724Z",
      "to_delete_time": null,
      "notes": "",
      "documents": [
          1
      ],
      "unassigned_pages": [],
      "submission_files": [
          "1939_f_1.jpg"
      ],
      "submissions": [
          1
      ]
    }
  ],
  "documents": [
    {
      "id": 1,
      "layout_uuid": "8bc9739d-2fc3-4ffa-b8b8-14e12155b64c",
      "layout_name": "MCCANN_ZENITH",
      "pages_count": 1,
      "read_only": false
    }
  ],
  "fields": [
    {
      "id": 1,
      "uuid": "1ebb7125-1664-4268-9a1a-8a7c5a75ffd4",
      "value": "Test",
      "page_id": 1,
      "layout_field_id": "71046ffb-8f00-4da5-aef9-9bf74a7bddc8",
      "bounding_box": [
          0.616888888888889,
          0.262362637362637,
          0.883555555555556,
          0.276098901098901
      ],
      "validation_overridden": false,
      "occurrence_index": 0
    }
  ],
  "template_fields": [
    {
      "uuid": "71046ffb-8f00-4da5-aef9-9bf74a7bddc8",
      "notes": "",
      "type": "entry",
      "data_type_uuid": "5b4101e7-58eb-4fba-8247-c1486cc8b45c",
      "name": "Claimant ID"
    }
  ],
  "tables": [
    {
      "id": 1,
      "name": "Table 1",
      "uuid": "3d960b0c-724a-4ee2-adef-da29e038c331",
      "document_id": 1,
      "layout_table_uuid": "30270622-becd-4e80-ad06-ca2197e92358",
      "parent_table_uuid": null,
      "parent_layout_table_uuid": null,
      "rows": [
          {
            "id": 1,
            "uuid": "dce0158b-0d97-40ea-b794-de029339df2e"
          }
      ],
      "columns": [
          {
            "uuid": "f23e9370-4f1f-4a8d-beee-e3f27aed252b",
            "name": "NETWORK CODE",
            "data_type_uuid": "5b4101e7-58eb-4fba-8247-c1486cc8b441"
          }
      ],
      "cells": [
          {
            "id": 1,
            "uuid": "b0a10394-8b56-458e-ae5a-cfa5824bbdb4",
            "row_uuid": "dce0158b-0d97-40ea-b794-de029339df2e",
            "column_uuid": "f23e9370-4f1f-4a8d-beee-e3f27aed252b",
            "value": "0130P0200P",
            "bounding_box": [
              0.6875,
              0.3134765625,
              0.7548828125,
              0.32421875
            ],
            "validation_overridden": false,
            "page_id": 1
          }
      ]
    }
  ],
  "selected_choices": [
    {
      "decision_name": "verify_account",
      "choice_name": "yes",
      "task_purpose_id": 2003,
      "case_id": null,
      "document_id": null,
      "field_id": null,
      "page_id": 1,
      "cell_uuid": null
    }
  ],
  "crops": [
    {
      "uuid": "8e84768a-30f2-4867-9bfa-30370b98f148",
      "page_id": 1,
      "bounding_box": [
        0.6875,
        0.3134765625,
        0.7548828125,
        0.32421875
      ],
      "value": "Test"
    }
  ]
}