Kafka Java describe consumer group
If you want to describe Kafka Consumer group in Java, you may want to use this method:
READ MORECategory: Kafka
Kafka client gets stuck in CHECKING API VERSIONS state
If you face the problems, when: Kafka Consumer is not involving in rebalance process Kafka Consumer is not reading messages Partitions are not allocated to the Kafka Consumer, but the Consumer is subscribed to the topic Kafka Consumer connection gets stuck in CHECKING_API_VERSIONS state Kafka Producer connection gets stuck in CHECKING_API_VERSIONS state Then this is […]
READ MOREHow to get Kafka Consumer connection states
If you want to gather information about the interaction of Kafka Consumer with Kafka Broker, you may want to use this method: Helper methods:
READ MOREHow to get client id from Kafka Consumer
If you want to read clientid from Kafka Consumer, you may use this method:
READ MOREKafka broker Kerberos
Let’s see how we can configure Kerberos between Kafka broker and Kafka client on server side. The client side is presented here: https://mchesnavsky.tech/how-to-create-kafka-kerberos-java-consumer. <kafka_home>/conf/server.properties <kafka_home>/bin/kafka-run-class.sh Insert this: To KAFKA_OPTS: Result: /your/path/to/kafka_server_jaas.conf Kerberos between Kafka brokers is configuring with separate conf keys (which we not mentioned in this article). Above configuration is for broker-client interaction.
READ MOREHow to create Kafka Kerberos Java consumer
Suppose that you need to create Kafka Java consumer with Kerberos. The code will be: You don’t need to specify java.security.auth.login.config Java property, because we set SaslConfigs.SASL_JAAS_CONFIG property directly to the consumer. You just need to made changes in kafkaJaasConfiguration() method that necessary for your Kerberos configuration.
READ MOREKafka new consumer group does not read the topic from beginning
Suppose that you have a Kafka Topic with some data, and you connect to it with Kafka Consumer with a new group.id. But this consumer does not read messages from the beginning of the topic. Consumer Config has a specific property auto.offset.reset, which indicates which offset will be assigned to the consumer with the new […]
READ MORE