首页 > 其他分享 >Kafka学习笔记(十):Resetting Offsets

Kafka学习笔记(十):Resetting Offsets

时间:2023-01-08 17:11:42浏览次数:38  
标签:Offsets -- consumer kafka sh groups Kafka Resetting first

Consumer Groups -Reset Offsets kafka-consumer-groups.sh

# Replace "kafka-consumer-groups" 
# by "kafka-consumer-groups.sh" or "kafka-consumer-groups.bat" based on your system # (or bin/kafka-consumer-groups.sh or bin\windows\kafka-consumer-groups.bat if you didn't setup PATH / Environment variables)

# look at the documentation again
kafka-consumer-groups

# reset the offsets to the beginning of each partition
kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group my-first-application --reset-offsets --to-earliest

# execute flag is needed
kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group my-first-application --reset-offsets --to-earliest --execute

# topic flag is also needed
kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group my-first-application --reset-offsets --to-earliest --execute --topic first_topic

# consume from where the offsets have been reset
kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic first_topic --group my-first-application

# describe the group again
kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --group my-first-application

# documentation for more options
kafka-consumer-groups.sh

# shift offsets by 2 (forward) as another strategy
kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group my-first-application --reset-offsets --shift-by 2 --execute --topic first_topic

# shift offsets by 2 (backward) as another strategy
kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group my-first-application --reset-offsets --shift-by -2 --execute --topic first_topic

# consume again
kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic first_topic --group my-first-application

标签:Offsets,--,consumer,kafka,sh,groups,Kafka,Resetting,first
From: https://www.cnblogs.com/Bota5ky/p/17034912.html

相关文章

  • Kafka学习笔记(九):CLI Consumer in Groups & Consumer Groups
    CLIConsumerinGroupswithkafka-console-consumer.sh#Replace"kafka-console-consumer.sh"#by"kafka-console-consumer"or"kafka-console-consumer.bat"base......
  • Kafka学习笔记(八):Kafka CLI
    KafkaCLI:kafka-topics.sh#Replace"kafka-topics.sh"#by"kafka-topics"or"kafka-topics.bat"basedonyoursystem#(orbin/kafka-topics.shorbin\windows......
  • Kafka学习笔记(七):Kafka KRaft - Removing Zookeeper
    关于KafkaKRaft在2020年,ApacheKafka项目做开始着手移除Zookeeper依赖(KIP-500)当Kafka集群拥有超过10万个分区时,Zookeeper有扩展问题删除Zookeeper之后,ApacheKa......
  • Kafka学习笔记(六):Zookeeper
    ZookeeperZookeeper管理代理,保留一份代理的名单Zookeeper帮助完成分区的领导者选举当kafka有更改时,Zookeeper会发送通知,比如新的主题、代理崩溃、代理启动、删除主题等......
  • 基于SpringBoot 使用 Flink 收发Kafka消息
    前言这周学习下Flink相关的知识,学习到一个读写Kafka消息的示例,自己动手实践了一下,别人示例使用的是普通的JavaMain方法,没有用到springboot.我们在实际工作中会使用spr......
  • centos7搭建kafka
    一、安装java8yuminstalljava-1.8.0-openjdk.x86_64yuminstalljava-1.8.0-openjdk-devel.x86_64二、安装 Zookeeper1.下载zookeeperwgethttps://archive.a......
  • kafka学习总结018 --- 消息过期设置
    一、kafka全局消息过期时间设置目录:kafka_2.13-3.3.1/config/server.properties#Theminimumageofalogfiletobeeligiblefordeletionduetoagelog.retentio......
  • kafka核心原理的秘密,藏在这16张图里【转】
    作者:码哥字节kafka是一个优秀的分布式消息中间件,许多系统中都会使用到Kafka来做消息通信。对分布式消息系统的了解和使用几乎成为一个后台开发人员必备的技能。今天码......
  • kafka详解(5)-KAFKA重复消费和消息丢失
    Kafka重复消费重复消费消息重复消费的根本原因都在于:已经消费了数据,但是offset没有成功提交。其中很大一部分原因在于发生了再均衡。1)消费者宕机、重启等。导致消息已......
  • kafka-windows启动遇到的一个小问题
    在安装kafka后启动Windows下启动文件,出现输入行太长,语法错误的问题,原因在于,kafka所在目录结构太长,将目录缩短就行了  zookeeper启动脚本zookeeper-server-start......