Create a JDBC Input

JDBC Connections available:

  • MS Sql
  • MySql
  • Oracle
  • PostgreSQL
  • Qubole
  • Snowflake

Create an Input for JDBC in Hero_Flow

  1. Open Hero_Flow.
  2. Click Inputs from the menu on the left.
  3. Click Create New Input.

  4. Enter a name for the JDBC Input and select an JDBC Connection from the drop-down list.
  5. Configure the JDBC Input data.

    • Enter a SQL query to pull data.
      • Placeholders
        • ${partition} 
        • ${checkpoint} 

          Example query:

          select * from <field name> where {checkpoint} and {partition}

          Partition and checkpoint placeholders are not supported  when the query has more than one table.

    • Select a field from the drop-down menu if partitioning a column input is required.
    • Select a field from the drop-down menu if checkpointing a column input is required.
    • Click the Refresh icon to display field mapping for the Input
    • From the field mapping table:
      • Confirm or change column names.
      • Confirm or change column data types.
      • Remove or confirm the arrangement of columns.
    • Click OK.