Unable to consume messages from kafka topic using apigee kafka connector

[aishwaryab]

Hi everyone,

When trying to consume messages from kafka topic using kafka connector in apigee integration it fails with below error

{"error":{"code":400,"details":[{"@type":"type.googleapis.com/google.rpc.ErrorInfo","metadata":{"cause":"Not authorized to access group: 7048818b-74c0-4296-a53e-d471246c0b1e","conditions":"","connection_type":"Apache Kafka","entity_type":"topic_2161"}}],"message":"Unable to list entities.","status":"FAILED_PRECONDITION"}}

Any particular access is required for consuming messages from kafka topic using kafka connector?

[API-Evangelist]

Did you follow below steps? 

https://cloud.google.com/integration-connectors/docs/connectors/apachekafka/configure

Just by looking at the error it seems to be issue is with ACL's. Talk to Kafka Admin & cross verify.

Check service accounts credentials are correct, ensure that the consumer group ID exists and is correctly associated with the topic you're trying to access., correct permissions are granted  to service account for the group "7048818b-74c0-4296-a53e-d471246c0b1e".

Do a detail post if you resolve the issue & able to consume the messages. It will help others on the usage.

[aishwaryab]

Consumer group id gets randomly generated for each request. We cannot specify consumer group id in connector task to which we have given access.