Create a Output to a File System in Hero_Flow

1. Open Hero_Flow.
2. Click Outputs from the menu on the left.
   
   
3. Click Create New Output.
   
   
4. Give the Output a name and select a file system Connection.
5. Configure the file system Output data.

CSV Output

• Enter the file path where the outgoing data is stored.

  • Variable syntax:

    ${TUPLE.<field name>}

  • The new data written from the Output overwrites the current file with the same file name. Create a new file with an added time stamp suffix with the syntax:

    ${TIMESTAMP}

• Mark if suffixes should be excluded from file names.
  • If marked, numbers are not appended to the file name created in a file system Output. The system matches the Input file name to the Output name with no additional characters, spaces, or numbers.
• Select the CSV output format to write image data. 
• Enter the delimiter that separates values in the file.
• Check the radio button to indicate if headers are present. 
• Select the character set for the CSV 
• If the Input being used in the Flow that is connected to this Output contains multiple files,
  Check the radio button to indicate:
  • Yes, all results are written to a single CSV file.

  • No, results are written to multiple incremental CSV files based on the number of files in the Input.

    • Hero_Flow writes to the CSV whole partition. If the Input data produces multiple partitions, the Output writes multiple CSV files.
      • When the checkbox is marked, Hero_Flow merges multiple partitions in one partition. 
      • When the checkbox is unmarked, Hero_Flow continues with the standard behavior.
        • If the Input data has a single partition, the Output is a single file.
        • If the Input data has multiple partitions, the Output is multiple files.
    • This feature is supported for Connections to Dropbox and S3.
    • Use of the aggregation function in a Flow may cause additional partitions. 
• Click the Refresh icon to display field mapping for the Input.
  • From the field mapping table:
    • Confirm or change field names.
    • Confirm or change field data types.
    • Remove or confirm the arrangement of fields.
• Click OK to save the Output.

PDF Output

• Enter the file path where the outgoing data is stored.

  • Variable syntax:
    

    ${TUPLE.<field name>}

• Mark if suffixes should be excluded from file names.
  • If marked, numbers are not appended to the file name created in a file system Output. The system matches the Input file name to the Output name with no additional characters, spaces, or numbers.
• Select the PDF output format to write image data. 
• Click Choose file... to select a file template.
  • Select a template file that can be stored in ~/sflow/templates/pdf/{UUID}/{pdfFileName}
• Click the Refresh Icon to display the mapping table.
• Click OK to save the Output.

RAW Output

• Enter the file path where the outgoing data is stored.
  • File naming scheme: <file name>_suffix number.extension.
    
    • Example: testImage_0001.jpg

  • Variable syntax:
    

    ${TUPLE.<field name>}

• Mark if suffixes should be excluded from file names.
  • If marked, numbers are not appended to the file name created in a file system Output. The system matches the Input file name to the Output name with no additional characters, spaces, or numbers.
• Select the RAW output format to write binary data. 
• Review the field mapping and select the data type BINARY_DATA.
  
• Click OK to save the Output.

TEXT Output

The TEXT Output format allows for Flow users to write out any type of text file. (E.g., JSON or XML)

• Enter the file path where the outgoing data is stored.

  • Variable syntax:
    

    ${TUPLE.<field name>}

• Mark if suffixes should be excluded from file names.
  • If marked, numbers are not appended to the file name created in a file system Output. The system matches the Input file name to the Output name with no additional characters, spaces, or numbers.

• Select the TEXT output format to write text data. 

• Review the field mapping and select the data type STRING. 

• Click OK to save the Output.