Apache Kafka Configuration Parameters

Apache Kafka includes numerous configuration parameters for producers, consumers, and Kafka Connect. Most of these parameters can be supplied as key=value pairs in the Configuration Parameters field of the streaming connection alias. Integration Server forwards these to the provider when creating the Producer object (to send) and the Consumer object (to receive). However, some of the properties are set by Integration Server based on data specified elsewhere and cannot be directly set in the Configuration Parameters field of the streaming connection alias.

If a Kafka configuration property is not set by Integration Server, you can set it in the Configuration Parameters field. Integration Server passes the value to the streaming provider when it establishes a connection. For example if you set session.timeout.ms=1300, Integration Server forwards this value to Kafka. However, if the you include the property group.id, Integration Server disregards it because Integration Server automatically sets this property.

Note that the properties in the connection alias Configuration Parameters field are also passed to the consumer by the trigger. This means any triggers using the same connection alias will receive the properties.

The following table identifies the Apache Kafka connection parameters that are set by Integration Server and cannot be set in the Configuration Parameters field.

Connection Parameter	Information
bootstrap.server	The Provider URI in the streaming connection alias.
security.protocol	Security settings for streaming connection alias.
ssl.truststore.location	Security settings for streaming connection alias.
ssl.truststore.password	Security settings for streaming connection alias.
ssl.keystore.location	Security settings for streaming connection alias.
ssl.keystore.password	Security settings for streaming connection alias.
ssl.key.password	Security settings for streaming connection alias.

The following table identifies the Apache Kafka producer parameters that are set by Integration Server and cannot be set in the Configuration Parameters field of a streaming connection alias.

Producer parameter	Information
key.serializer	Integration Server always sets this to a byte array. The event specification determines how Integration Server serializes the data.
value.serializer	Integration Server always sets this to a byte array. The event specification determines how Integration Server serializes the data.

The following table identifies the Apache Kafka consumer parameters that are set by Integration Server and cannot be set in the Configuration Parameters field of a streaming connection alias.

Consumer parameter	Information
group.id	Derived from the value of the Client Prefix in the streaming connection alias and the trigger name.
enable.auto.commit	Obtained from the Commit mode property in the event trigger.
key.deserializer	Integration Server always sets this to a byte array. The event specification determines how Integration Server deserializes the data.
max.poll.records	Obtained from the Polling request size property in the event trigger.
value.deserializer	Integration Server always sets this to a byte array. The event specification determines how Integration Server deserializes the data.