Connecting to Kafka

The following properties can be specified when loading data from a Kafka connection.

Not all properties listed here may be necessary when creating the data connection. However, at a minimum, basic information must be provided.

Basic Information

• Title - The name of the connection.

• Description - The description (optional) of the connection.

• Host - The IP address or host name of the storage system.

• Port - The network port number through which the storage system connects.

Consumer Properties

• Property - The name of the property (e.g., fetchSize, autoCommit) to use when obtaining data from the database.
• Value - The value of this property.

Advanced

Concurrency Control

• Maximum Allowed Concurrency - The overall limit on concurrent executions used to process the source.
• Number of Nodes - The number of nodes to use when processing the source.
• Executors per Node - The number of executors to use per node when processing the source.
• Maximum Request Rate - The maximum aggregate request rate against the source (e.g., 100 / s, 480 / minute).

Localization Settings

• Locale - The locale to use when parsing dates and numbers (e.g., ar-SA, en-US, ja-JP).
• Character Encoding - The default character encoding used by the connection (e.g., EBCDIC, UTF-8).
• Timezone - The timezone to use for dates and times that don't contain one (e.g., GMT+2, PST).

Data Formats

• Recognize only the configured formats - Specifies whether only those formats configured here should be recognized.
• DateTime Formats - How date and time values should be encoded (e.g., yyyy-MM-dd'T'HH:mm:ss, MM/dd/yyyy HH:mm, dd-MMM-yyyy HH:mm:ss).
• Date Formats - How calendar dates without time information should be encoded (e.g., yyyy-MM-dd, MM/dd/yyyy, dd-MMM-yyyy).
• Time Formats - How time-of-day values should be encoded (e.g., HH:mm:ss, hh:mm a, HH:mm:ss.SSS).
• Boolean Formats - How true/false or binary logical values should be encoded (e.g., true/false, 1/0, Y/N).
• Double Formats - How double-precision floating values should be encoded (e.g., ##,##0.00, $, %).
• Float Formats - How single-precision floating-point values should be encoded (e.g., ##,##0.00, %, e).
• Integer Formats - How whole numbers should be encoded (e.g., #, #,###,##0).
• Long Formats - How long integer values exceeding the range of standard integers should be encoded (e.g., #, #,###,##0).
• Month Formats - How standalone month values should be encoded (e.g., MM, MMMM).
• Year Month Formats - How combined month and year values should be encoded (e.g., yyyy MM, yyyy-MMM).
• Month Day Formats - How combined month/day values should be encoded (e.g., MM-dd, MMM dd, MM/dd)
• Year Formats - How standalone year values are encoded (e.g., yyyy, YY).