Work with the Data Store

What is the Data Store?

The Data Store feature is an internal data storage system located on MongoDB that allows users to design a schema and import data from .csv files directly into Hero Platform_ to use in business automations. 

This feature allows for data to be added directly to Hero Platform_ that can be used in business processes.

Create a New Schema

  1. Enter a name for the schema.
  2. Click Add field.
  3. Enter a field name and assign the field a data type.
    1. Click Add field to enter additional fields and data types as needed.
  4. After all the fields have been added, click OK to save the schema.
  5. The created schema now appears in the Data Store list on the overview page.

Import Schema

The Data Store import feature supports importing fields with a native data type but does not support importing fields with the List data type.

  1. Enter a name for the schema.
  2. Click Choose file and select a CSV file that contains the schema.
  3. Click Next.
  4. Select the schema delimiter.
    1. comma: ","
    2. simi colon: ";"
    3. /t (TAB)
    4. vertical bar: "|"
  5. Mark if headers are present in the schema. 
    1. If headers are present, mark if the header case should be upper, lower, or the the original as imported.
  6. Select the character set.
  7. Select the field detection strategy.
    1. Detect field data types.
    2. Convert all field data types to strings.
  8. Click Next.
  9. Review or edit the mapped fields.
  10. Click Next to save the schema.

Edit a Schema

To edit a schema:

  1. Click the settings icon and select Edit.
  2. When finished editing the schema, click OK to save.

Hero Platform_ protects schemas used in Data Store Inputs, Data Store Outputs, and Robin skills so that they cannot be accidentally modified or deleted.

Add Data to a Schema

After creating a schema, the schema has field names (column names) and is empty with no data.

Add data to the schema by importing a .csv file and pairing the .csv file column names with the schema field names.

To add data to a schema:

  1. Double-click the schema name or click the settings icon and select Show Data.
  2. Click Import data.
  3. Browse for a .csv file with data for the schema.
    Click Next.
  4. Configure the csv settings. 
    Click Next.
  5. Map the fields in the .csv file to the fields created in the schema. 
    Click Save to finish adding data to the schema.

View or Edit Data in a Schema

To view data that has been added to a schema:

  1. Double-click the schema name or click the settings icon and select Show Data.
  2. The data in the schema is displayed.
  3. To edit a data in the schema, double-click within the row to edit.
    Data can be edited from each field in the row.
    Save an edit by click the disk icon under the actions column.
  4. When complete, click the Close.

Hero Platform_ protects schemas used in Data Store Inputs, Data Store Outputs, and Robin skills so that they cannot be accidentally modified or deleted.

When filtering column names in a schema, note that the sorting filter is case sensitive and upper case letters come before lowercase letters. 

Example: "Z" is sorted before "a"

Export Schema Data

The Data Store export feature supports exporting all fields with any data type. This can cause a problem because importing schema data does not support importing fields with the List data type.

To export the schema data to a .csv file:

  1. Double-click the schema name or click the settings icon and select Show Data.
  2. Click Export data.
  3. The .csv file is exported to the computer's default download folder.

Clone a Schema

To clone/copy a schema:

  1. Click the settings icon and select Clone.
  2. Click Yes, Clone to continue.
  3. A copy of the schema and data is created given an iterative name.
    Example: A schema with the name "User_Data" is cloned to the default name "User_Data_(1)"
  4. Cloned schema names can be changed using the Edit action.

Delete Schema Data

Delete All Schema Data

To delete all the data within a schema:

  1. Click the settings icon and select Delete Data.
  2. Click Yes, Delete to delete all data records within the schema. 

or

  1. Double-click the schema name or click the settings icon and select Show Data.
  2. Click Delete all.
  3. Click Yes, Delete to delete all data records within the schema. 

Delete Individual Schema Records

To delete individual schema records:

  1. Double-click the schema name or click the settings icon and select Show Data.
  2. Navigate to the record for deletion and click the X icon under the actions column.
  3. Click Yes, Delete to delete the record from the schema.

Delete a Schema

A schema cannot be delete if the schema contains data. To delete a schema that contains data, the data from the schema must first be deleted.

To delete a schema:

  1. Click the settings icon and select Delete Schema.
  2. Click Yes, Delete to delete the schema. 

Hero Platform_ protects schemas used in Data Store Inputs, Data Store Outputs, and Robin skills so that they cannot be accidentally modified or deleted. 

Knowledge Graph

A Knowledge Graph is a schema with one or more fields that contain data of possible OCRed results. Using OCR features in combination with a Knowledge Graph increases the results accuracy. 

You can designate buckets stored in the Data Store to be used as a Knowledge Graph to add additional support for the OCR engine building models or in a Flow with a Knowledge Graph.

Enable

Enable a Data Store bucket as a Knowledge Graph:

Click the settings icon and select Enable Knowledge Graph.

Enabling a Knowledge Graphs with over 150,000 entries may take some time to complete. If no results have been displayed after one or two minutes, please refresh to view the results. 

Disable

Disable a Data Store bucket as a Knowledge Graph:

Click the settings icon and select Disable Knowledge Graph.

Refresh

If the data in a Data Store bucket being used as a Knowledge Graph has been updated, it is necessary to refresh that bucket in the Data Store.

Click the settings icon and select Refresh Knowledge Graph.

Maintaining a Knowledge Graph

If a schema designated as a Knowledge Graph is used in a Flow, and that Flow is exported, that Data Store artifact is not automatically set to be exported. This may cause Flows that are imported without the corresponding Knowledge Graph artifact to fail. It is recommended to check that all exports that include a document extractor using a Knowledge Graph specifically include the related Knowledge Graph artifacts in the Data Store. 

Values in Knowledge Graph buckets can be added, updated, and/or removed by users at any time.  These changes immediately take effect the next time the function runs.


Search