Kafka Consumer Crash

[abjoe]

Hi All,

If I am using a Confluent Kafka Consumer Snap and it crashes in between, Will it commit an offset?

For example if there are 500 documents in Kafka and after reading 250 documents Kafka crashes. Will it read from the 251st document when I run it again or will it start from the 1st document in the next try?

[aanchalrajpal]

Hi,

If you get answer of your question do let me know also , I have same query.

[kzhou]

The consumer can do auto-commit with an auto-commit interval, or it can commit manually using an Acknowledge Snap. When it restart again with the same consumer group ID, If we set “seek type” to End, it would resume from the last committed offset (251st document in your example). If set “seek type” to Begin, then it would restart from the 1st message of the topic. Hope it helps