報錯
You should retry committing the latest consumed offsets.
Caused by: org.apache.kafka.common.errors.CoordinatorNotAvailableException: The coordinator is not available.
但是任務還在正常跑.
開源bug
[FLINK-28060] Kafka Commit on checkpointing fails repeatedly after a broker restart - ASF JIRA?
導致的現象
任務還在跑 認識消費kafka的偏移量沒有隨著checkpoint提交到kafka broker. 會導致如果監控任務監控kafka broker存儲的偏移量,那么就會任務你的任務一致沒有消費.
解決
重啟任務?
升級到flink 1.16.x
?