This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Kafka Consumer Crash

abjoe
New Contributor II

โ€Ž04-11-2018 07:10 AM

Hi All,

If I am using a Confluent Kafka Consumer Snap and it crashes in between, Will it commit an offset?

For example if there are 500 documents in Kafka and after reading 250 documents Kafka crashes. Will it read from the 251st document when I run it again or will it start from the 1st document in the next try?

0 Kudos
2 REPLIES 2

aanchalrajpal
New Contributor

โ€Ž05-07-2018 11:53 AM

Hi,

If you get answer of your question do let me know also , I have same query.

0 Kudos

kzhou
Former Employee

โ€Ž05-08-2018 09:14 PM

The consumer can do auto-commit with an auto-commit interval, or it can commit manually using an Acknowledge Snap. When it restart again with the same consumer group ID, If we set โ€œseek typeโ€ to End, it would resume from the last committed offset (251st document in your example). If set โ€œseek typeโ€ to Begin, then it would restart from the 1st message of the topic. Hope it helps

0 Kudos