just test

be id:10006

I20240601 10:18:35.661039 43762 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083262, version=48306, num_rows=0, res=[OK], cost: 537055(us) [Publish Statistics: schedule time(us): 430552, lock wait time(us): 4, save meta time(us): 105569, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 908]
I20240601 10:18:35.760407 43641 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:18:35.701671) [db/memtable_list.cc:375] [meta] Level-0 commit table #3832 started
I20240601 10:18:35.760496 43641 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:18:35.760127) [db/memtable_list.cc:407] [meta] Level-0 commit table #3832: memtable #1 done
I20240601 10:18:35.760548 43641 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:18:35.760229) EVENT_LOG_v1 {"time_micros": 1717208315760212, "job": 2124, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [3, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
I20240601 10:18:35.760593 43641 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:18:35.760315) [db/db_impl_compaction_flush.cc:175] [meta] Level summary: base level 1 max bytes base 268435456 files[3 1 0 0 0 0 0] max score 0.75
I20240601 10:18:35.760649 43641 olap_meta.cpp:73] [Rocksdb] [db/db_impl_files.cc:337] [JOB 2124] Try to delete WAL files size 31452898, prev total WAL file size 31482437, number of live WAL files 2.
I20240601 10:18:38.874642 43411 load_channel_mgr.cpp:224] cleaning timed out load channels
I20240601 10:18:40.298200 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:18:40.485209 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264706266316 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264706266316 Bytes.];[/data5/storage/wal: limit 279283386368 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279283386368 Bytes.];[/data6/storage/wal: limit 277839455027 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277839455027 Bytes.];
I20240601 10:18:41.199151 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:18:41.199189 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:18:41.199209 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:18:41.199215 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:18:41.199224 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:18:41.199229 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:18:41.199235 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:18:41.199240 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:18:41.946655 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:18:42.736016 43957 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:18:45.933547 43826 tablet_manager.cpp:1013] find expired transactions for 0 tablets
I20240601 10:18:45.953766 43826 tablet_manager.cpp:1044] success to build all report tablets info. tablet_count=10659
I20240601 10:18:45.985448 44778 daemon.cpp:214] os physical memory 125.29 GB. process memory used 9.71 GB, limit 112.77 GB, soft limit 101.49 GB. sys available memory 47.64 GB, low water mark 1.60 GB, warning water mark 3.20 GB. Refresh interval memory growth 0 B
W20240601 10:18:46.162989 42563 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=2b45a3110edc4144-92835977bbbf3a82, job_id=25716, txn_id=2083274, label=rr_service_kafka-25716-2b45a3110edc4144-92835977bbbf3a82-2083274, elapse(s)=30
I20240601 10:18:46.163133 42563 routine_load_task_executor.cpp:262] finished routine load task id=2b45a3110edc4144-92835977bbbf3a82, job_id=25716, txn_id=2083274, label=rr_service_kafka-25716-2b45a3110edc4144-92835977bbbf3a82-2083274, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 4
W20240601 10:18:46.555778 42566 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=3683062355da4c9f-856bafe5dd8a44d1, job_id=25385, txn_id=2083268, label=rr_error_kafka-25385-3683062355da4c9f-856bafe5dd8a44d1-2083268, elapse(s)=31
I20240601 10:18:46.556176 42566 routine_load_task_executor.cpp:262] finished routine load task id=3683062355da4c9f-856bafe5dd8a44d1, job_id=25385, txn_id=2083268, label=rr_error_kafka-25385-3683062355da4c9f-856bafe5dd8a44d1-2083268, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 3
W20240601 10:18:46.677654 42560 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=b54713ed2dc4409c-9bfee1031e773f23, job_id=25385, txn_id=2083272, label=rr_error_kafka-25385-b54713ed2dc4409c-9bfee1031e773f23-2083272, elapse(s)=31
I20240601 10:18:46.677832 42560 routine_load_task_executor.cpp:262] finished routine load task id=b54713ed2dc4409c-9bfee1031e773f23, job_id=25385, txn_id=2083272, label=rr_error_kafka-25385-b54713ed2dc4409c-9bfee1031e773f23-2083272, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 2
W20240601 10:18:47.132830 42565 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=2f9d032a13804104-bd2c3810ecf7cc68, job_id=25385, txn_id=2083270, label=rr_error_kafka-25385-2f9d032a13804104-bd2c3810ecf7cc68-2083270, elapse(s)=31
I20240601 10:18:47.133088 42565 routine_load_task_executor.cpp:262] finished routine load task id=2f9d032a13804104-bd2c3810ecf7cc68, job_id=25385, txn_id=2083270, label=rr_error_kafka-25385-2f9d032a13804104-bd2c3810ecf7cc68-2083270, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 1
I20240601 10:18:47.133141 42565 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1740ms in state CONNECT)
W20240601 10:18:47.177253 42561 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=78df28ef89f84788-ba0192e3add36b9d, job_id=25385, txn_id=2083276, label=rr_error_kafka-25385-78df28ef89f84788-ba0192e3add36b9d-2083276, elapse(s)=31
I20240601 10:18:47.177433 42561 routine_load_task_executor.cpp:262] finished routine load task id=78df28ef89f84788-ba0192e3add36b9d, job_id=25385, txn_id=2083276, label=rr_error_kafka-25385-78df28ef89f84788-ba0192e3add36b9d-2083276, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 0
I20240601 10:18:47.177549 42561 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1670ms in state CONNECT)
I20240601 10:18:50.513267 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264706263040 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264706263040 Bytes.];[/data5/storage/wal: limit 279283382272 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279283382272 Bytes.];[/data6/storage/wal: limit 277839129395 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277839129395 Bytes.];
I20240601 10:18:52.021606 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 2546
I20240601 10:18:52.023805 43681 storage_engine.cpp:1110] collected 2206 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:18:52.024592 43681 storage_engine.cpp:1126] removed all collected unused rowsets
W20240601 10:18:54.235975 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:18:55.733688 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=0f77c0df0bfe4274-bc84ce776877d7d4, job_id=25385, txn_id=2083283, label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, elapse(s)=0, current tasks num: 1
I20240601 10:18:55.733721 42559 routine_load_task_executor.cpp:290] begin to execute routine load task: id=0f77c0df0bfe4274-bc84ce776877d7d4, job_id=25385, txn_id=2083283, label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, elapse(s)=0
I20240601 10:18:55.733976 42559 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:18:55.734426 42559 data_consumer_pool.cpp:103] get consumer group 1a4aff030aa3d3ea-cdd34958e72fafae with 2 consumers
I20240601 10:18:55.734444 42559 data_consumer.cpp:169] consumer: cd451f87bc122092-ff2ef73ec9152194, grp: 1a4aff030aa3d3ea-cdd34958e72fafae assign topic partitions: ott-rr-error, [1: -1] 
I20240601 10:18:55.734511 42559 data_consumer.cpp:169] consumer: 81459f927072e126-e6552897c1c64bad, grp: 1a4aff030aa3d3ea-cdd34958e72fafae assign topic partitions: ott-rr-error, [6: -1] 
I20240601 10:18:55.734647 42559 stream_load_executor.cpp:71] begin to execute stream load. label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, txn_id=2083283, query_id=0-0
I20240601 10:18:55.734724 42559 fragment_mgr.cpp:636] query_id: 0f77c0df0bfe4274-bc84ce776877d7d4 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:18:55.734746 42559 fragment_mgr.cpp:661] Query/load id: f77c0df0bfe4274-bc84ce776877d7d4, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:18:55.734772 42559 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: f77c0df0bfe4274-bc84ce776877d7d4 limit: 0
I20240601 10:18:55.734792 42559 pipeline_fragment_context.cpp:244] Preparing instance f77c0df0bfe4274-bc84ce776877d7d4|f77c0df0bfe4274-bc84ce776877d7d5, backend_num 0
I20240601 10:18:55.735368 42559 data_consumer_group.cpp:108] start consumer group: 1a4aff030aa3d3ea-cdd34958e72fafae. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=0f77c0df0bfe4274-bc84ce776877d7d4, job_id=25385, txn_id=2083283, label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, elapse(s)=0
I20240601 10:18:55.735435 76649 data_consumer.cpp:194] start kafka consumer: cd451f87bc122092-ff2ef73ec9152194, grp: 1a4aff030aa3d3ea-cdd34958e72fafae, max running time(ms): 30000
I20240601 10:18:55.735481 76648 data_consumer.cpp:194] start kafka consumer: 81459f927072e126-e6552897c1c64bad, grp: 1a4aff030aa3d3ea-cdd34958e72fafae, max running time(ms): 30000
I20240601 10:18:55.736619 44181 tablets_channel.cpp:134] open tablets channel: (load_id=0f77c0df0bfe4274-bc84ce776877d7d4, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:18:55.742197 44082 tablets_channel.cpp:134] open tablets channel: (load_id=6b75d61b4d3e4304-bdfcb95ab68097d6, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:18:55.772720 44029 tablets_channel.cpp:134] open tablets channel: (load_id=dd3f8fff9f454457-9b06712024fc1402, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:18:55.807121 44230 tablets_channel.cpp:134] open tablets channel: (load_id=ddecd2e5715d4b56-bac6e32bc1d17c1d, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:18:55.856917 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=551a1cec71f74400-99d0c6dfd03e89c2, job_id=25052, txn_id=2083286, label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, elapse(s)=0, current tasks num: 2
I20240601 10:18:55.856946 42562 routine_load_task_executor.cpp:290] begin to execute routine load task: id=551a1cec71f74400-99d0c6dfd03e89c2, job_id=25052, txn_id=2083286, label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, elapse(s)=0
I20240601 10:18:55.857296 42562 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:18:55.857918 42562 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:18:55.858464 42562 data_consumer_pool.cpp:103] get consumer group 8f4b2fee10ad02a1-4bdb40020a9152ae with 2 consumers
I20240601 10:18:55.858496 42562 data_consumer.cpp:169] consumer: 074bbf39c1c0d91d-c0880e0065b80091, grp: 8f4b2fee10ad02a1-4bdb40020a9152ae assign topic partitions: doris-ott-liveprepull, [3: -1] 
I20240601 10:18:55.858713 42562 data_consumer.cpp:169] consumer: 0d452e72f3f94d92-ed1bfb82b59297a5, grp: 8f4b2fee10ad02a1-4bdb40020a9152ae assign topic partitions: doris-ott-liveprepull, [8: -1] 
I20240601 10:18:55.858875 42562 stream_load_executor.cpp:71] begin to execute stream load. label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, txn_id=2083286, query_id=0-0
I20240601 10:18:55.859017 42562 fragment_mgr.cpp:636] query_id: 551a1cec71f74400-99d0c6dfd03e89c2 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:18:55.859047 42562 fragment_mgr.cpp:661] Query/load id: 551a1cec71f74400-99d0c6dfd03e89c2, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:18:55.859084 42562 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 551a1cec71f74400-99d0c6dfd03e89c2 limit: 0
I20240601 10:18:55.859107 42562 pipeline_fragment_context.cpp:244] Preparing instance 551a1cec71f74400-99d0c6dfd03e89c2|551a1cec71f74400-99d0c6dfd03e89c3, backend_num 0
I20240601 10:18:55.869755 42562 data_consumer_group.cpp:108] start consumer group: 8f4b2fee10ad02a1-4bdb40020a9152ae. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=551a1cec71f74400-99d0c6dfd03e89c2, job_id=25052, txn_id=2083286, label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, elapse(s)=0
I20240601 10:18:55.869835 76662 data_consumer.cpp:194] start kafka consumer: 074bbf39c1c0d91d-c0880e0065b80091, grp: 8f4b2fee10ad02a1-4bdb40020a9152ae, max running time(ms): 30000
I20240601 10:18:55.869868 76663 data_consumer.cpp:194] start kafka consumer: 0d452e72f3f94d92-ed1bfb82b59297a5, grp: 8f4b2fee10ad02a1-4bdb40020a9152ae, max running time(ms): 30000
I20240601 10:18:55.880404 44079 tablets_channel.cpp:134] open tablets channel: (load_id=551a1cec71f74400-99d0c6dfd03e89c2, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:18:55.895336 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=476e47b6ce404fe5-bb433baa9706a1bd, job_id=25716, txn_id=2083287, label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, elapse(s)=0, current tasks num: 3
I20240601 10:18:55.895344 42567 routine_load_task_executor.cpp:290] begin to execute routine load task: id=476e47b6ce404fe5-bb433baa9706a1bd, job_id=25716, txn_id=2083287, label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, elapse(s)=0
I20240601 10:18:55.895665 42567 data_consumer_pool.cpp:103] get consumer group 6d4735db0b723a2b-83567732ebc41888 with 2 consumers
I20240601 10:18:55.895691 42567 data_consumer.cpp:169] consumer: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: 6d4735db0b723a2b-83567732ebc41888 assign topic partitions: ott-rr, [3: -1] 
I20240601 10:18:55.895731 42567 data_consumer.cpp:169] consumer: 934a57c7cfeb18a4-3e692a0fbda987ba, grp: 6d4735db0b723a2b-83567732ebc41888 assign topic partitions: ott-rr, [8: -1] 
I20240601 10:18:55.895759 42567 stream_load_executor.cpp:71] begin to execute stream load. label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, txn_id=2083287, query_id=0-0
I20240601 10:18:55.895877 42567 fragment_mgr.cpp:636] query_id: 476e47b6ce404fe5-bb433baa9706a1bd coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:18:55.895908 42567 fragment_mgr.cpp:661] Query/load id: 476e47b6ce404fe5-bb433baa9706a1bd, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:18:55.895942 42567 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 476e47b6ce404fe5-bb433baa9706a1bd limit: 0
I20240601 10:18:55.895968 42567 pipeline_fragment_context.cpp:244] Preparing instance 476e47b6ce404fe5-bb433baa9706a1bd|476e47b6ce404fe5-bb433baa9706a1be, backend_num 0
I20240601 10:18:55.896821 42567 data_consumer_group.cpp:108] start consumer group: 6d4735db0b723a2b-83567732ebc41888. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=476e47b6ce404fe5-bb433baa9706a1bd, job_id=25716, txn_id=2083287, label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, elapse(s)=0
I20240601 10:18:55.896911 76678 data_consumer.cpp:194] start kafka consumer: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: 6d4735db0b723a2b-83567732ebc41888, max running time(ms): 30000
I20240601 10:18:55.896953 76679 data_consumer.cpp:194] start kafka consumer: 934a57c7cfeb18a4-3e692a0fbda987ba, grp: 6d4735db0b723a2b-83567732ebc41888, max running time(ms): 30000
I20240601 10:18:55.898154 44088 tablets_channel.cpp:134] open tablets channel: (load_id=476e47b6ce404fe5-bb433baa9706a1bd, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:18:55.901618 42564 routine_load_task_executor.cpp:290] begin to execute routine load task: id=7da4489c380f4065-b333c4c8797fe432, job_id=25716, txn_id=2083288, label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, elapse(s)=0
I20240601 10:18:55.901973 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=7da4489c380f4065-b333c4c8797fe432, job_id=25716, txn_id=2083288, label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, elapse(s)=0, current tasks num: 4
I20240601 10:18:55.902037 42564 data_consumer_pool.cpp:103] get consumer group bb4d731fdb40fb9c-f1b115a43862f6ad with 2 consumers
I20240601 10:18:55.902081 42564 data_consumer.cpp:169] consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: bb4d731fdb40fb9c-f1b115a43862f6ad assign topic partitions: ott-rr, [2: -1] 
I20240601 10:18:55.902828 42564 data_consumer.cpp:169] consumer: 874e44f576bc1a40-9f9c469aee9b4a82, grp: bb4d731fdb40fb9c-f1b115a43862f6ad assign topic partitions: ott-rr, [7: -1] 
I20240601 10:18:55.902976 42564 stream_load_executor.cpp:71] begin to execute stream load. label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, txn_id=2083288, query_id=0-0
I20240601 10:18:55.903123 42564 fragment_mgr.cpp:636] query_id: 7da4489c380f4065-b333c4c8797fe432 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:18:55.903151 42564 fragment_mgr.cpp:661] Query/load id: 7da4489c380f4065-b333c4c8797fe432, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:18:55.903189 42564 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 7da4489c380f4065-b333c4c8797fe432 limit: 0
I20240601 10:18:55.903221 42564 pipeline_fragment_context.cpp:244] Preparing instance 7da4489c380f4065-b333c4c8797fe432|7da4489c380f4065-b333c4c8797fe433, backend_num 0
I20240601 10:18:55.904120 42564 data_consumer_group.cpp:108] start consumer group: bb4d731fdb40fb9c-f1b115a43862f6ad. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=7da4489c380f4065-b333c4c8797fe432, job_id=25716, txn_id=2083288, label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, elapse(s)=0
I20240601 10:18:55.904527 76681 data_consumer.cpp:194] start kafka consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: bb4d731fdb40fb9c-f1b115a43862f6ad, max running time(ms): 30000
I20240601 10:18:55.904603 76682 data_consumer.cpp:194] start kafka consumer: 874e44f576bc1a40-9f9c469aee9b4a82, grp: bb4d731fdb40fb9c-f1b115a43862f6ad, max running time(ms): 30000
I20240601 10:18:55.906034 44179 tablets_channel.cpp:134] open tablets channel: (load_id=7da4489c380f4065-b333c4c8797fe432, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:18:55.909665 44221 tablets_channel.cpp:134] open tablets channel: (load_id=16e27a21400e4e3f-a36efe089368fa28, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:18:55.914176 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=e748d44e841940ec-ade81941e08876d9, job_id=25385, txn_id=2083290, label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, elapse(s)=0, current tasks num: 5
I20240601 10:18:55.914186 42558 routine_load_task_executor.cpp:290] begin to execute routine load task: id=e748d44e841940ec-ade81941e08876d9, job_id=25385, txn_id=2083290, label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, elapse(s)=0
I20240601 10:18:55.914544 42558 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:18:55.915064 42558 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:18:55.915562 42558 data_consumer_pool.cpp:103] get consumer group e041991129caafe4-996c5cc61103c8ad with 2 consumers
I20240601 10:18:55.915582 42558 data_consumer.cpp:169] consumer: c64861c10bd4eeac-1a67fdc989cc238c, grp: e041991129caafe4-996c5cc61103c8ad assign topic partitions: ott-rr-error, [0: -1] 
I20240601 10:18:55.915789 42558 data_consumer.cpp:169] consumer: 8d4643df3b742a59-8b54f5415f3a34a7, grp: e041991129caafe4-996c5cc61103c8ad assign topic partitions: ott-rr-error, [5: -1] 
I20240601 10:18:55.915958 42558 stream_load_executor.cpp:71] begin to execute stream load. label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, txn_id=2083290, query_id=0-0
I20240601 10:18:55.916064 42558 fragment_mgr.cpp:636] query_id: e748d44e841940ec-ade81941e08876d9 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:18:55.916155 42558 fragment_mgr.cpp:661] Query/load id: e748d44e841940ec-ade81941e08876d9, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:18:55.916184 42558 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: e748d44e841940ec-ade81941e08876d9 limit: 0
I20240601 10:18:55.916219 42558 pipeline_fragment_context.cpp:244] Preparing instance e748d44e841940ec-ade81941e08876d9|e748d44e841940ec-ade81941e08876da, backend_num 0
I20240601 10:18:55.917085 42558 data_consumer_group.cpp:108] start consumer group: e041991129caafe4-996c5cc61103c8ad. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=e748d44e841940ec-ade81941e08876d9, job_id=25385, txn_id=2083290, label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, elapse(s)=0
I20240601 10:18:55.917165 76685 data_consumer.cpp:194] start kafka consumer: c64861c10bd4eeac-1a67fdc989cc238c, grp: e041991129caafe4-996c5cc61103c8ad, max running time(ms): 30000
I20240601 10:18:55.917228 76684 data_consumer.cpp:194] start kafka consumer: 8d4643df3b742a59-8b54f5415f3a34a7, grp: e041991129caafe4-996c5cc61103c8ad, max running time(ms): 30000
I20240601 10:18:55.918692 44212 tablets_channel.cpp:134] open tablets channel: (load_id=e748d44e841940ec-ade81941e08876d9, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:18:55.924647 44055 tablets_channel.cpp:134] open tablets channel: (load_id=4fa378ea19be4a0c-ae3bb0f5a91df629, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:18:56.235958 76649 data_consumer.cpp:253] consumer meet partition eof: cd451f87bc122092-ff2ef73ec9152194 partition offset: 0
I20240601 10:18:56.236014 76649 data_consumer.cpp:274] kafka consumer done: cd451f87bc122092-ff2ef73ec9152194, grp: 1a4aff030aa3d3ea-cdd34958e72fafae. cancelled: 0, left time(ms): 29549, total cost(ms): 451, consume cost(ms): 451, received rows: 0, put rows: 0
I20240601 10:18:56.242924 43867 tablets_channel.cpp:226] close tablets channel: (load_id=6b75d61b4d3e4304-bdfcb95ab68097d6, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:18:56.243517 43867 load_channel.cpp:55] load channel removed load_id=6b75d61b4d3e4304-bdfcb95ab68097d6, is high priority=1, sender_ip=225.225.225.2, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:56.283126 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083284
I20240601 10:18:56.396978 76678 data_consumer.cpp:253] consumer meet partition eof: 0746d3fd9f19d3ec-23ac73dbfd8a5589 partition offset: 0
I20240601 10:18:56.397019 76679 data_consumer.cpp:253] consumer meet partition eof: 934a57c7cfeb18a4-3e692a0fbda987ba partition offset: 0
I20240601 10:18:56.397051 76679 data_consumer.cpp:274] kafka consumer done: 934a57c7cfeb18a4-3e692a0fbda987ba, grp: 6d4735db0b723a2b-83567732ebc41888. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:18:56.397019 76678 data_consumer.cpp:274] kafka consumer done: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: 6d4735db0b723a2b-83567732ebc41888. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:18:56.397069 76678 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 6d4735db0b723a2b-83567732ebc41888
I20240601 10:18:56.397087 42567 data_consumer_group.cpp:128] consumer group done: 6d4735db0b723a2b-83567732ebc41888. consume time(ms)=500, received rows=0, received bytes=0, eos: 1, left_time: 29500, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 500238, blocking put time(us): 0, id=476e47b6ce404fe5-bb433baa9706a1bd, job_id=25716, txn_id=2083287, label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, elapse(s)=0
I20240601 10:18:56.397178 42567 data_consumer.cpp:417] kafka consumer cancelled. 0746d3fd9f19d3ec-23ac73dbfd8a5589
I20240601 10:18:56.397190 42567 data_consumer.cpp:417] kafka consumer cancelled. 934a57c7cfeb18a4-3e692a0fbda987ba
I20240601 10:18:56.397466 76680 vtablet_writer.cpp:963] VNodeChannel[25388-10006], load_id=476e47b6ce404fe5-bb433baa9706a1bd, txn_id=2083287, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.397488 76680 vtablet_writer.cpp:963] VNodeChannel[25388-10005], load_id=476e47b6ce404fe5-bb433baa9706a1bd, txn_id=2083287, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.398322 43973 tablets_channel.cpp:226] close tablets channel: (load_id=476e47b6ce404fe5-bb433baa9706a1bd, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:18:56.398746 43973 load_channel.cpp:55] load channel removed load_id=476e47b6ce404fe5-bb433baa9706a1bd, is high priority=1, sender_ip=225.225.225.3, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:56.399188 44383 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 476e47b6ce404fe5-bb433baa9706a1bd
I20240601 10:18:56.400671 76680 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=102607, load id=476e47b6ce404fe5-bb433baa9706a1bd
I20240601 10:18:56.400699 76680 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=476e47b6ce404fe5-bb433baa9706a1bd, txn_id=2083287, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(1)(0)(3)(1)} {10006:(1)(0)(2)(1)} 
I20240601 10:18:56.400909 50839 fragment_mgr.cpp:588] Removing query 476e47b6ce404fe5-bb433baa9706a1bd instance 476e47b6ce404fe5-bb433baa9706a1be, all done? true
I20240601 10:18:56.400933 50839 fragment_mgr.cpp:594] Query 476e47b6ce404fe5-bb433baa9706a1bd finished
I20240601 10:18:56.400956 50839 stream_load_executor.cpp:152] finished to execute stream load. label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, txn_id=2083287, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=505
I20240601 10:18:56.401396 50839 query_context.cpp:114] Query 476e47b6ce404fe5-bb433baa9706a1bd deconstructed, , deregister query/load memory tracker, queryId=476e47b6ce404fe5-bb433baa9706a1bd, Limit=2.00 GB, CurrUsed=512.00 KB, PeakUsed=555.09 KB
I20240601 10:18:56.404336 76681 data_consumer.cpp:253] consumer meet partition eof: 284f78dce6aa57fa-a67ebfcab4715bbd partition offset: 0
I20240601 10:18:56.404410 76681 data_consumer.cpp:274] kafka consumer done: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: bb4d731fdb40fb9c-f1b115a43862f6ad. cancelled: 0, left time(ms): 29501, total cost(ms): 499, consume cost(ms): 499, received rows: 0, put rows: 0
I20240601 10:18:56.404708 76682 data_consumer.cpp:253] consumer meet partition eof: 874e44f576bc1a40-9f9c469aee9b4a82 partition offset: 0
I20240601 10:18:56.404739 76682 data_consumer.cpp:274] kafka consumer done: 874e44f576bc1a40-9f9c469aee9b4a82, grp: bb4d731fdb40fb9c-f1b115a43862f6ad. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:18:56.404752 76682 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: bb4d731fdb40fb9c-f1b115a43862f6ad
I20240601 10:18:56.404767 42564 data_consumer_group.cpp:128] consumer group done: bb4d731fdb40fb9c-f1b115a43862f6ad. consume time(ms)=500, received rows=0, received bytes=0, eos: 1, left_time: 29500, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 500619, blocking put time(us): 0, id=7da4489c380f4065-b333c4c8797fe432, job_id=25716, txn_id=2083288, label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, elapse(s)=0
I20240601 10:18:56.404801 42564 data_consumer.cpp:417] kafka consumer cancelled. 284f78dce6aa57fa-a67ebfcab4715bbd
I20240601 10:18:56.404811 42564 data_consumer.cpp:417] kafka consumer cancelled. 874e44f576bc1a40-9f9c469aee9b4a82
I20240601 10:18:56.405170 76683 vtablet_writer.cpp:963] VNodeChannel[25388-10006], load_id=7da4489c380f4065-b333c4c8797fe432, txn_id=2083288, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.405198 76683 vtablet_writer.cpp:963] VNodeChannel[25388-10005], load_id=7da4489c380f4065-b333c4c8797fe432, txn_id=2083288, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.405809 44006 tablets_channel.cpp:226] close tablets channel: (load_id=7da4489c380f4065-b333c4c8797fe432, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:18:56.406219 44006 load_channel.cpp:55] load channel removed load_id=7da4489c380f4065-b333c4c8797fe432, is high priority=1, sender_ip=225.225.225.3, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:56.406739 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 7da4489c380f4065-b333c4c8797fe432
I20240601 10:18:56.407363 76683 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=78345, load id=7da4489c380f4065-b333c4c8797fe432
I20240601 10:18:56.407414 76683 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=7da4489c380f4065-b333c4c8797fe432, txn_id=2083288, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(1)(0)(2)(1)} {10006:(0)(0)(2)(1)} 
I20240601 10:18:56.407657 50827 fragment_mgr.cpp:588] Removing query 7da4489c380f4065-b333c4c8797fe432 instance 7da4489c380f4065-b333c4c8797fe433, all done? true
I20240601 10:18:56.407689 50827 fragment_mgr.cpp:594] Query 7da4489c380f4065-b333c4c8797fe432 finished
I20240601 10:18:56.407727 50827 stream_load_executor.cpp:152] finished to execute stream load. label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, txn_id=2083288, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=504
I20240601 10:18:56.408310 50827 query_context.cpp:114] Query 7da4489c380f4065-b333c4c8797fe432 deconstructed, , deregister query/load memory tracker, queryId=7da4489c380f4065-b333c4c8797fe432, Limit=2.00 GB, CurrUsed=512.00 KB, PeakUsed=555.09 KB
I20240601 10:18:56.409140 43922 tablets_channel.cpp:226] close tablets channel: (load_id=16e27a21400e4e3f-a36efe089368fa28, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:18:56.409524 43922 load_channel.cpp:55] load channel removed load_id=16e27a21400e4e3f-a36efe089368fa28, is high priority=1, sender_ip=225.225.225.2, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:56.433629 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083287
I20240601 10:18:56.458359 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083289
I20240601 10:18:56.483280 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083288
I20240601 10:18:56.737517 76648 data_consumer.cpp:253] consumer meet partition eof: 81459f927072e126-e6552897c1c64bad partition offset: 0
I20240601 10:18:56.737550 76648 data_consumer.cpp:274] kafka consumer done: 81459f927072e126-e6552897c1c64bad, grp: 1a4aff030aa3d3ea-cdd34958e72fafae. cancelled: 0, left time(ms): 29047, total cost(ms): 953, consume cost(ms): 953, received rows: 0, put rows: 0
I20240601 10:18:56.737563 76648 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 1a4aff030aa3d3ea-cdd34958e72fafae
I20240601 10:18:56.737609 42559 data_consumer_group.cpp:128] consumer group done: 1a4aff030aa3d3ea-cdd34958e72fafae. consume time(ms)=953, received rows=0, received bytes=0, eos: 1, left_time: 29047, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 953526, blocking put time(us): 0, id=0f77c0df0bfe4274-bc84ce776877d7d4, job_id=25385, txn_id=2083283, label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, elapse(s)=1
I20240601 10:18:56.737637 42559 data_consumer.cpp:417] kafka consumer cancelled. cd451f87bc122092-ff2ef73ec9152194
I20240601 10:18:56.737686 42559 data_consumer.cpp:417] kafka consumer cancelled. 81459f927072e126-e6552897c1c64bad
I20240601 10:18:56.737941 72083 vtablet_writer.cpp:963] VNodeChannel[25057-10006], load_id=f77c0df0bfe4274-bc84ce776877d7d4, txn_id=2083283, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.737969 72083 vtablet_writer.cpp:963] VNodeChannel[25057-10005], load_id=f77c0df0bfe4274-bc84ce776877d7d4, txn_id=2083283, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.738471 43849 tablets_channel.cpp:226] close tablets channel: (load_id=0f77c0df0bfe4274-bc84ce776877d7d4, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:18:56.738987 43849 load_channel.cpp:55] load channel removed load_id=0f77c0df0bfe4274-bc84ce776877d7d4, is high priority=1, sender_ip=225.225.225.3, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:56.739382 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. f77c0df0bfe4274-bc84ce776877d7d4
I20240601 10:18:56.740089 72083 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=76766, load id=f77c0df0bfe4274-bc84ce776877d7d4
I20240601 10:18:56.740115 72083 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=f77c0df0bfe4274-bc84ce776877d7d4, txn_id=2083283, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(1)(0)(3)(1)} {10006:(1)(0)(3)(1)} 
I20240601 10:18:56.740285 50843 fragment_mgr.cpp:588] Removing query f77c0df0bfe4274-bc84ce776877d7d4 instance f77c0df0bfe4274-bc84ce776877d7d5, all done? true
I20240601 10:18:56.740309 50843 fragment_mgr.cpp:594] Query f77c0df0bfe4274-bc84ce776877d7d4 finished
I20240601 10:18:56.740327 50843 stream_load_executor.cpp:152] finished to execute stream load. label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, txn_id=2083283, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1005
I20240601 10:18:56.740693 50843 query_context.cpp:114] Query f77c0df0bfe4274-bc84ce776877d7d4 deconstructed, , deregister query/load memory tracker, queryId=f77c0df0bfe4274-bc84ce776877d7d4, Limit=2.00 GB, CurrUsed=304.00 KB, PeakUsed=337.78 KB
I20240601 10:18:56.767014 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083283
I20240601 10:18:56.859984 76662 data_consumer.cpp:253] consumer meet partition eof: 074bbf39c1c0d91d-c0880e0065b80091 partition offset: 1
I20240601 10:18:56.860028 76662 data_consumer.cpp:274] kafka consumer done: 074bbf39c1c0d91d-c0880e0065b80091, grp: 8f4b2fee10ad02a1-4bdb40020a9152ae. cancelled: 0, left time(ms): 29010, total cost(ms): 990, consume cost(ms): 990, received rows: 0, put rows: 0
I20240601 10:18:56.861268 76663 data_consumer.cpp:253] consumer meet partition eof: 0d452e72f3f94d92-ed1bfb82b59297a5 partition offset: 0
I20240601 10:18:56.861294 76663 data_consumer.cpp:274] kafka consumer done: 0d452e72f3f94d92-ed1bfb82b59297a5, grp: 8f4b2fee10ad02a1-4bdb40020a9152ae. cancelled: 0, left time(ms): 29009, total cost(ms): 991, consume cost(ms): 991, received rows: 0, put rows: 0
I20240601 10:18:56.861304 76663 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 8f4b2fee10ad02a1-4bdb40020a9152ae
I20240601 10:18:56.861320 42562 data_consumer_group.cpp:128] consumer group done: 8f4b2fee10ad02a1-4bdb40020a9152ae. consume time(ms)=991, received rows=0, received bytes=0, eos: 1, left_time: 29009, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 991508, blocking put time(us): 0, id=551a1cec71f74400-99d0c6dfd03e89c2, job_id=25052, txn_id=2083286, label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, elapse(s)=1
I20240601 10:18:56.861347 42562 data_consumer.cpp:417] kafka consumer cancelled. 074bbf39c1c0d91d-c0880e0065b80091
I20240601 10:18:56.861353 42562 data_consumer.cpp:417] kafka consumer cancelled. 0d452e72f3f94d92-ed1bfb82b59297a5
I20240601 10:18:56.861690 76677 vtablet_writer.cpp:963] VNodeChannel[17616-10006], load_id=551a1cec71f74400-99d0c6dfd03e89c2, txn_id=2083286, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.861706 76677 vtablet_writer.cpp:963] VNodeChannel[17616-10005], load_id=551a1cec71f74400-99d0c6dfd03e89c2, txn_id=2083286, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:18:56.862896 43913 tablets_channel.cpp:226] close tablets channel: (load_id=551a1cec71f74400-99d0c6dfd03e89c2, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:18:56.863790 44531 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 551a1cec71f74400-99d0c6dfd03e89c2
I20240601 10:18:56.870364 43913 load_channel.cpp:55] load channel removed load_id=551a1cec71f74400-99d0c6dfd03e89c2, is high priority=1, sender_ip=225.225.225.3, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:56.884058 76677 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=100100, load id=551a1cec71f74400-99d0c6dfd03e89c2
I20240601 10:18:56.884128 76677 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=551a1cec71f74400-99d0c6dfd03e89c2, txn_id=2083286, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(20)(0)(23)(1)} {10006:(14)(0)(17)(1)} 
I20240601 10:18:56.884394 50842 fragment_mgr.cpp:588] Removing query 551a1cec71f74400-99d0c6dfd03e89c2 instance 551a1cec71f74400-99d0c6dfd03e89c3, all done? true
I20240601 10:18:56.884429 50842 fragment_mgr.cpp:594] Query 551a1cec71f74400-99d0c6dfd03e89c2 finished
I20240601 10:18:56.884465 50842 stream_load_executor.cpp:152] finished to execute stream load. label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, txn_id=2083286, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1025
I20240601 10:18:56.887332 50842 query_context.cpp:114] Query 551a1cec71f74400-99d0c6dfd03e89c2 deconstructed, , deregister query/load memory tracker, queryId=551a1cec71f74400-99d0c6dfd03e89c2, Limit=2.00 GB, CurrUsed=736.00 KB, PeakUsed=824.97 KB
I20240601 10:18:56.908970 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083286
I20240601 10:18:56.917325 76685 data_consumer.cpp:242] kafka consume timeout: c64861c10bd4eeac-1a67fdc989cc238c
I20240601 10:18:56.917371 76684 data_consumer.cpp:242] kafka consume timeout: 8d4643df3b742a59-8b54f5415f3a34a7
I20240601 10:18:56.917850 76685 data_consumer.cpp:253] consumer meet partition eof: c64861c10bd4eeac-1a67fdc989cc238c partition offset: 0
I20240601 10:18:56.917862 76685 data_consumer.cpp:274] kafka consumer done: c64861c10bd4eeac-1a67fdc989cc238c, grp: e041991129caafe4-996c5cc61103c8ad. cancelled: 0, left time(ms): 29000, total cost(ms): 1000, consume cost(ms): 1000, received rows: 0, put rows: 0
I20240601 10:18:56.923454 43835 tablets_channel.cpp:226] close tablets channel: (load_id=4fa378ea19be4a0c-ae3bb0f5a91df629, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:18:56.924141 43835 load_channel.cpp:55] load channel removed load_id=4fa378ea19be4a0c-ae3bb0f5a91df629, is high priority=1, sender_ip=225.225.225.2, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:56.950338 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083291
I20240601 10:18:57.230310 43948 tablets_channel.cpp:226] close tablets channel: (load_id=dd3f8fff9f454457-9b06712024fc1402, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:18:57.243762 43948 load_channel.cpp:55] load channel removed load_id=dd3f8fff9f454457-9b06712024fc1402, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:57.279304 76695 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1363ms in state CONNECT)
I20240601 10:18:57.279518 76684 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1363ms in state CONNECT)
I20240601 10:18:57.283958 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083282
I20240601 10:18:57.288316 43962 tablets_channel.cpp:226] close tablets channel: (load_id=ddecd2e5715d4b56-bac6e32bc1d17c1d, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:18:57.295331 43962 load_channel.cpp:55] load channel removed load_id=ddecd2e5715d4b56-bac6e32bc1d17c1d, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:57.334703 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083285
I20240601 10:18:57.416024 76684 data_consumer.cpp:253] consumer meet partition eof: 8d4643df3b742a59-8b54f5415f3a34a7 partition offset: 0
I20240601 10:18:57.416069 76684 data_consumer.cpp:274] kafka consumer done: 8d4643df3b742a59-8b54f5415f3a34a7, grp: e041991129caafe4-996c5cc61103c8ad. cancelled: 0, left time(ms): 28502, total cost(ms): 1498, consume cost(ms): 1498, received rows: 0, put rows: 0
I20240601 10:18:57.416081 76684 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: e041991129caafe4-996c5cc61103c8ad
I20240601 10:18:57.416110 42558 data_consumer_group.cpp:128] consumer group done: e041991129caafe4-996c5cc61103c8ad. consume time(ms)=1498, received rows=0, received bytes=0, eos: 1, left_time: 28502, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 1498983, blocking put time(us): 0, id=e748d44e841940ec-ade81941e08876d9, job_id=25385, txn_id=2083290, label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, elapse(s)=1
I20240601 10:18:57.416186 42558 data_consumer.cpp:417] kafka consumer cancelled. c64861c10bd4eeac-1a67fdc989cc238c
I20240601 10:18:57.416198 42558 data_consumer.cpp:417] kafka consumer cancelled. 8d4643df3b742a59-8b54f5415f3a34a7
I20240601 10:18:57.416754 76698 vtablet_writer.cpp:963] VNodeChannel[25057-10006], load_id=e748d44e841940ec-ade81941e08876d9, txn_id=2083290, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:18:57.416780 76698 vtablet_writer.cpp:963] VNodeChannel[25057-10005], load_id=e748d44e841940ec-ade81941e08876d9, txn_id=2083290, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:18:57.417291 43878 tablets_channel.cpp:226] close tablets channel: (load_id=e748d44e841940ec-ade81941e08876d9, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:18:57.417896 43878 load_channel.cpp:55] load channel removed load_id=e748d44e841940ec-ade81941e08876d9, is high priority=1, sender_ip=225.225.225.3, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:18:57.418179 44410 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. e748d44e841940ec-ade81941e08876d9
I20240601 10:18:57.420035 76698 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=116526, load id=e748d44e841940ec-ade81941e08876d9
I20240601 10:18:57.420071 76698 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=e748d44e841940ec-ade81941e08876d9, txn_id=2083290, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(0)(0)(4)(1)} {10006:(1)(0)(4)(1)} 
I20240601 10:18:57.420286 50830 fragment_mgr.cpp:588] Removing query e748d44e841940ec-ade81941e08876d9 instance e748d44e841940ec-ade81941e08876da, all done? true
I20240601 10:18:57.420358 50830 fragment_mgr.cpp:594] Query e748d44e841940ec-ade81941e08876d9 finished
I20240601 10:18:57.420397 50830 stream_load_executor.cpp:152] finished to execute stream load. label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, txn_id=2083290, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1504
I20240601 10:18:57.420979 50830 query_context.cpp:114] Query e748d44e841940ec-ade81941e08876d9 deconstructed, , deregister query/load memory tracker, queryId=e748d44e841940ec-ade81941e08876d9, Limit=2.00 GB, CurrUsed=304.00 KB, PeakUsed=337.78 KB
I20240601 10:18:57.451279 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083290
W20240601 10:18:58.779242 44709 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=434997ae5f83dfd1-423d2adf3704219b, job_id=-1, txn_id=2083278, label=92d92b7c-a79c-4b13-9ca1-aa90e0ef7168, elapse(s)=30
I20240601 10:18:59.490336 44709 stream_load.cpp:198] new income streaming load request.id=b64c24ff28b50008-eebdb1d2bfb4c6b5, job_id=-1, txn_id=-1, label=8a3fb389-2aaa-42ac-95ce-7d52908de0df, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:18:59.506480 44709 stream_load_executor.cpp:71] begin to execute stream load. label=8a3fb389-2aaa-42ac-95ce-7d52908de0df, txn_id=2083292, query_id=0-0
I20240601 10:18:59.506660 44709 fragment_mgr.cpp:636] query_id: b64c24ff28b50008-eebdb1d2bfb4c6b5 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:18:59.506685 44709 fragment_mgr.cpp:661] Query/load id: b64c24ff28b50008-eebdb1d2bfb4c6b5, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:18:59.506714 44709 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: b64c24ff28b50008-eebdb1d2bfb4c6b5 limit: 0
I20240601 10:18:59.506742 44709 pipeline_fragment_context.cpp:244] Preparing instance b64c24ff28b50008-eebdb1d2bfb4c6b5|b64c24ff28b50008-eebdb1d2bfb4c6b6, backend_num 0
I20240601 10:18:59.510262 44709 stream_load.cpp:204] finished to handle HTTP header, id=b64c24ff28b50008-eebdb1d2bfb4c6b5, job_id=-1, txn_id=2083292, label=8a3fb389-2aaa-42ac-95ce-7d52908de0df, elapse(s)=0
I20240601 10:18:59.516909 44245 tablets_channel.cpp:134] open tablets channel: (load_id=b64c24ff28b50008-eebdb1d2bfb4c6b5, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:18:59.605676 76698 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=b64c24ff28b50008-eebdb1d2bfb4c6b5, txn_id=2083292, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:18:59.605762 76698 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=b64c24ff28b50008-eebdb1d2bfb4c6b5, txn_id=2083292, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:18:59.611729 44410 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. b64c24ff28b50008-eebdb1d2bfb4c6b5
I20240601 10:18:59.616370 43924 tablets_channel.cpp:226] close tablets channel: (load_id=b64c24ff28b50008-eebdb1d2bfb4c6b5, index_id=487076), sender id: 0, backend id: 10006
W20240601 10:18:59.691578 44715 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=544d49fb83bfd7b5-7f253cc65f9637ba, job_id=-1, txn_id=2083280, label=52e47fd8-326f-403a-bdf9-1788e0eb2d1b, elapse(s)=30
I20240601 10:18:59.863687 44177 tablets_channel.cpp:134] open tablets channel: (load_id=0e4b8a1a6e98d5b6-5451bd45d51ead95, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:18:59.952963 43834 tablets_channel.cpp:226] close tablets channel: (load_id=0e4b8a1a6e98d5b6-5451bd45d51ead95, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:00.103075 44715 stream_load.cpp:198] new income streaming load request.id=6e485058c293b657-f75db98194e4719b, job_id=-1, txn_id=-1, label=67ef1bbf-15bd-4075-8f3f-18022bb731ef, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:19:00.121829 44715 stream_load_executor.cpp:71] begin to execute stream load. label=67ef1bbf-15bd-4075-8f3f-18022bb731ef, txn_id=2083294, query_id=0-0
I20240601 10:19:00.121995 44715 fragment_mgr.cpp:636] query_id: 6e485058c293b657-f75db98194e4719b coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:00.122016 44715 fragment_mgr.cpp:661] Query/load id: 6e485058c293b657-f75db98194e4719b, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:00.122052 44715 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 6e485058c293b657-f75db98194e4719b limit: 0
I20240601 10:19:00.122089 44715 pipeline_fragment_context.cpp:244] Preparing instance 6e485058c293b657-f75db98194e4719b|6e485058c293b657-f75db98194e4719c, backend_num 0
I20240601 10:19:00.126143 44715 stream_load.cpp:204] finished to handle HTTP header, id=6e485058c293b657-f75db98194e4719b, job_id=-1, txn_id=2083294, label=67ef1bbf-15bd-4075-8f3f-18022bb731ef, elapse(s)=0
I20240601 10:19:00.133647 44024 tablets_channel.cpp:134] open tablets channel: (load_id=6e485058c293b657-f75db98194e4719b, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:19:00.184772 43924 load_channel.cpp:55] load channel removed load_id=b64c24ff28b50008-eebdb1d2bfb4c6b5, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:00.188918 76698 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=5702703, load id=b64c24ff28b50008-eebdb1d2bfb4c6b5
I20240601 10:19:00.188952 76698 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=b64c24ff28b50008-eebdb1d2bfb4c6b5, txn_id=2083292, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(80)(0)(583)(1)} {10006:(576)(0)(583)(1)} 
I20240601 10:19:00.189471 50831 fragment_mgr.cpp:588] Removing query b64c24ff28b50008-eebdb1d2bfb4c6b5 instance b64c24ff28b50008-eebdb1d2bfb4c6b6, all done? true
I20240601 10:19:00.189505 50831 fragment_mgr.cpp:594] Query b64c24ff28b50008-eebdb1d2bfb4c6b5 finished
I20240601 10:19:00.189538 50831 stream_load_executor.cpp:152] finished to execute stream load. label=8a3fb389-2aaa-42ac-95ce-7d52908de0df, txn_id=2083292, query_id=0-0, receive_data_cost_ms=54, read_data_cost_ms=2, write_data_cost_ms=683
I20240601 10:19:00.191181 50831 query_context.cpp:114] Query b64c24ff28b50008-eebdb1d2bfb4c6b5 deconstructed, , deregister query/load memory tracker, queryId=b64c24ff28b50008-eebdb1d2bfb4c6b5, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:19:00.227433 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083292
I20240601 10:19:00.243259 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=6e485058c293b657-f75db98194e4719b, txn_id=2083294, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:00.243309 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=6e485058c293b657-f75db98194e4719b, txn_id=2083294, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:00.247716 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 6e485058c293b657-f75db98194e4719b
I20240601 10:19:00.252190 43975 tablets_channel.cpp:226] close tablets channel: (load_id=6e485058c293b657-f75db98194e4719b, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:00.311647 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:19:00.541707 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264706252390 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264706252390 Bytes.];[/data5/storage/wal: limit 279283375718 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279283375718 Bytes.];[/data6/storage/wal: limit 277838830387 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277838830387 Bytes.];
I20240601 10:19:00.561125 43834 load_channel.cpp:55] load channel removed load_id=0e4b8a1a6e98d5b6-5451bd45d51ead95, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:00.594600 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083293
I20240601 10:19:00.767462 44241 tablets_channel.cpp:134] open tablets channel: (load_id=c3480ca1e4cda52d-1a4980fab0311391, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:19:00.812522 43975 load_channel.cpp:55] load channel removed load_id=6e485058c293b657-f75db98194e4719b, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:00.817335 77259 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=4879537, load id=6e485058c293b657-f75db98194e4719b
I20240601 10:19:00.817381 77259 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=6e485058c293b657-f75db98194e4719b, txn_id=2083294, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(72)(0)(574)(1)} {10006:(569)(0)(574)(1)} 
I20240601 10:19:00.817771 50829 fragment_mgr.cpp:588] Removing query 6e485058c293b657-f75db98194e4719b instance 6e485058c293b657-f75db98194e4719c, all done? true
I20240601 10:19:00.817799 50829 fragment_mgr.cpp:594] Query 6e485058c293b657-f75db98194e4719b finished
I20240601 10:19:00.817826 50829 stream_load_executor.cpp:152] finished to execute stream load. label=67ef1bbf-15bd-4075-8f3f-18022bb731ef, txn_id=2083294, query_id=0-0, receive_data_cost_ms=56, read_data_cost_ms=3, write_data_cost_ms=695
I20240601 10:19:00.819180 50829 query_context.cpp:114] Query 6e485058c293b657-f75db98194e4719b deconstructed, , deregister query/load memory tracker, queryId=6e485058c293b657-f75db98194e4719b, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:19:00.845505 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083294
I20240601 10:19:00.868651 43979 tablets_channel.cpp:226] close tablets channel: (load_id=c3480ca1e4cda52d-1a4980fab0311391, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:00.940027 44713 stream_load.cpp:198] new income streaming load request.id=d747004df467a6bb-c4685added70a2a2, job_id=-1, txn_id=-1, label=93e577fa-6439-4d18-8126-81075f19c21d, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:19:00.960186 44713 stream_load_executor.cpp:71] begin to execute stream load. label=93e577fa-6439-4d18-8126-81075f19c21d, txn_id=2083296, query_id=0-0
I20240601 10:19:00.960356 44713 fragment_mgr.cpp:636] query_id: d747004df467a6bb-c4685added70a2a2 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:00.960383 44713 fragment_mgr.cpp:661] Query/load id: d747004df467a6bb-c4685added70a2a2, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:00.960412 44713 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: d747004df467a6bb-c4685added70a2a2 limit: 0
I20240601 10:19:00.960438 44713 pipeline_fragment_context.cpp:244] Preparing instance d747004df467a6bb-c4685added70a2a2|d747004df467a6bb-c4685added70a2a3, backend_num 0
I20240601 10:19:00.963215 44713 stream_load.cpp:204] finished to handle HTTP header, id=d747004df467a6bb-c4685added70a2a2, job_id=-1, txn_id=2083296, label=93e577fa-6439-4d18-8126-81075f19c21d, elapse(s)=0
I20240601 10:19:00.974375 44206 tablets_channel.cpp:134] open tablets channel: (load_id=d747004df467a6bb-c4685added70a2a2, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:19:01.064177 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=d747004df467a6bb-c4685added70a2a2, txn_id=2083296, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:01.064433 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=d747004df467a6bb-c4685added70a2a2, txn_id=2083296, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:01.070384 44531 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. d747004df467a6bb-c4685added70a2a2
I20240601 10:19:01.076406 43845 tablets_channel.cpp:226] close tablets channel: (load_id=d747004df467a6bb-c4685added70a2a2, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:01.126391 48593 olap_meta.cpp:73] [Rocksdb] [db/db_impl_write.cc:1370] [meta] New memtable created with log file: #3676. Immutable memtables: 0.
I20240601 10:19:01.159726 43644 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:19:01.126492) [db/db_impl_compaction_flush.cc:1417] Calling FlushMemTableToOutputFile with column family [meta], flush slots available 4, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0
I20240601 10:19:01.159754 43644 olap_meta.cpp:73] [Rocksdb] [db/flush_job.cc:298] [meta] [JOB 2038] Flushing memtable with next log file: 3676
I20240601 10:19:01.159780 43644 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208341159765, "job": 2038, "event": "flush_started", "num_memtables": 1, "num_entries": 4335, "num_deletes": 4206, "memory_usage": 28328672, "flush_reason": "Write Buffer Full"}
I20240601 10:19:01.159786 43644 olap_meta.cpp:73] [Rocksdb] [db/flush_job.cc:328] [meta] [JOB 2038] Level-0 flush table #3677: started
I20240601 10:19:01.277168 43644 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208341277150, "cf_name": "meta", "job": 2038, "event": "table_file_creation", "file_number": 3677, "file_size": 1500639, "table_properties": {"data_size": 1498033, "index_size": 6492, "filter_size": 0, "raw_key_size": 402519, "raw_average_key_size": 93, "raw_value_size": 18997065, "raw_average_value_size": 4434, "num_data_blocks": 91, "num_entries": 4284, "filter_policy_name": "", "kDeletedKeys": "4206", "kMergeOperands": "0"}}
I20240601 10:19:01.277199 43644 olap_meta.cpp:73] [Rocksdb] [db/flush_job.cc:364] [meta] [JOB 2038] Level-0 flush table #3677: 1500639 bytes OK
I20240601 10:19:01.355127 43825 data_dir.cpp:882] path: /data4/storage total capacity: 3991941488640, available capacity: 2647060959232, usage: 0.336899, in_use: 1
I20240601 10:19:01.355204 43825 data_dir.cpp:882] path: /data5/storage total capacity: 3991941488640, available capacity: 2792833740800, usage: 0.300382, in_use: 1
I20240601 10:19:01.355232 43825 data_dir.cpp:882] path: /data6/storage total capacity: 3991941488640, available capacity: 2778387890176, usage: 0.304001, in_use: 1
I20240601 10:19:01.365803 43825 storage_engine.cpp:366] get root path info cost: 10 ms. tablet counter: 10659
I20240601 10:19:01.368899 43644 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:19:01.310258) [db/memtable_list.cc:375] [meta] Level-0 commit table #3677 started
I20240601 10:19:01.368916 43644 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:19:01.368831) [db/memtable_list.cc:407] [meta] Level-0 commit table #3677: memtable #1 done
I20240601 10:19:01.368921 43644 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:19:01.368850) EVENT_LOG_v1 {"time_micros": 1717208341368845, "job": 2038, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
I20240601 10:19:01.368927 43644 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:19:01.368878) [db/db_impl_compaction_flush.cc:175] [meta] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
I20240601 10:19:01.368935 43644 olap_meta.cpp:73] [Rocksdb] [db/db_impl_files.cc:337] [JOB 2038] Try to delete WAL files size 22005620, prev total WAL file size 22011212, number of live WAL files 2.
I20240601 10:19:01.506494 43979 load_channel.cpp:55] load channel removed load_id=c3480ca1e4cda52d-1a4980fab0311391, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:01.545655 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083295
I20240601 10:19:01.706516 43845 load_channel.cpp:55] load channel removed load_id=d747004df467a6bb-c4685added70a2a2, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:01.710271 77259 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=5477013, load id=d747004df467a6bb-c4685added70a2a2
I20240601 10:19:01.710300 77259 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=d747004df467a6bb-c4685added70a2a2, txn_id=2083296, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(69)(0)(646)(1)} {10006:(640)(0)(646)(1)} 
I20240601 10:19:01.710618 50835 fragment_mgr.cpp:588] Removing query d747004df467a6bb-c4685added70a2a2 instance d747004df467a6bb-c4685added70a2a3, all done? true
I20240601 10:19:01.710641 50835 fragment_mgr.cpp:594] Query d747004df467a6bb-c4685added70a2a2 finished
I20240601 10:19:01.710665 50835 stream_load_executor.cpp:152] finished to execute stream load. label=93e577fa-6439-4d18-8126-81075f19c21d, txn_id=2083296, query_id=0-0, receive_data_cost_ms=57, read_data_cost_ms=2, write_data_cost_ms=750
I20240601 10:19:01.711875 50835 query_context.cpp:114] Query d747004df467a6bb-c4685added70a2a2 deconstructed, , deregister query/load memory tracker, queryId=d747004df467a6bb-c4685added70a2a2, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:19:01.754801 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083296
I20240601 10:19:04.985711 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:19:04.985845 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:19:04.985920 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:19:04.985939 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:19:04.985960 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:19:04.985970 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:19:04.985985 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:19:04.985993 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:19:06.516850 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:19:10.583544 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264708299571 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264708299571 Bytes.];[/data5/storage/wal: limit 279283369164 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279283369164 Bytes.];[/data6/storage/wal: limit 277838518272 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277838518272 Bytes.];
I20240601 10:19:11.358742 43745 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083235, version=48299, num_rows=0, res=[OK], cost: 36273292(us) [Publish Statistics: schedule time(us): 38, lock wait time(us): 1, save meta time(us): 39128, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 36234112]
I20240601 10:19:11.358983 43751 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083247, version=48301, num_rows=0, res=[OK], cost: 36238348(us) [Publish Statistics: schedule time(us): 16, lock wait time(us): 2, save meta time(us): 29335, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 36208969]
I20240601 10:19:11.359189 43735 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083236, version=48300, num_rows=0, res=[OK], cost: 36240127(us) [Publish Statistics: schedule time(us): 52, lock wait time(us): 3, save meta time(us): 30972, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 36209087]
I20240601 10:19:11.359398 43757 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083249, version=48303, num_rows=0, res=[OK], cost: 36238595(us) [Publish Statistics: schedule time(us): 16225, lock wait time(us): 1, save meta time(us): 96428, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 36125927]
I20240601 10:19:11.359620 43746 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083248, version=48302, num_rows=0, res=[OK], cost: 36238804(us) [Publish Statistics: schedule time(us): 88250, lock wait time(us): 0, save meta time(us): 24394, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 36126147]
I20240601 10:19:11.485066 43753 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083251, version=48305, num_rows=0, res=[OK], cost: 36364164(us) [Publish Statistics: schedule time(us): 280945, lock wait time(us): 1, save meta time(us): 182938, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 35900270]
I20240601 10:19:11.485436 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083262, version=48306, num_rows=0, res=[OK], cost: 36361454(us) [Publish Statistics: schedule time(us): 386740, lock wait time(us): 1, save meta time(us): 74083, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 35900619]
I20240601 10:19:11.485520 43740 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083250, version=48304, num_rows=0, res=[OK], cost: 36364699(us) [Publish Statistics: schedule time(us): 142706, lock wait time(us): 1, save meta time(us): 137240, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 36084729]
I20240601 10:19:11.919340 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:19:11.919396 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:19:11.919430 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:19:11.919436 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:19:11.919445 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:19:11.943254 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:19:11.943297 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:19:11.943302 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:19:12.196444 14209 backend_service.cpp:785] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1
I20240601 10:19:12.800592 43932 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
W20240601 10:19:18.832069 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:19:20.324179 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:19:20.613996 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264708296294 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264708296294 Bytes.];[/data5/storage/wal: limit 279282306252 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282306252 Bytes.];[/data6/storage/wal: limit 277838210252 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277838210252 Bytes.];
I20240601 10:19:22.029271 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 2546
I20240601 10:19:22.031383 43681 storage_engine.cpp:1110] collected 2206 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:19:22.032212 43681 storage_engine.cpp:1126] removed all collected unused rowsets
I20240601 10:19:23.819981 43935 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
W20240601 10:19:26.409243 42564 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=7da4489c380f4065-b333c4c8797fe432, job_id=25716, txn_id=2083288, label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, elapse(s)=30
I20240601 10:19:26.409662 42564 routine_load_task_executor.cpp:262] finished routine load task id=7da4489c380f4065-b333c4c8797fe432, job_id=25716, txn_id=2083288, label=rr_service_kafka-25716-7da4489c380f4065-b333c4c8797fe432-2083288, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 4
W20240601 10:19:26.426901 42567 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=476e47b6ce404fe5-bb433baa9706a1bd, job_id=25716, txn_id=2083287, label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, elapse(s)=30
I20240601 10:19:26.427027 42567 routine_load_task_executor.cpp:262] finished routine load task id=476e47b6ce404fe5-bb433baa9706a1bd, job_id=25716, txn_id=2083287, label=rr_service_kafka-25716-476e47b6ce404fe5-bb433baa9706a1bd-2083287, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 3
W20240601 10:19:26.742074 42559 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=0f77c0df0bfe4274-bc84ce776877d7d4, job_id=25385, txn_id=2083283, label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, elapse(s)=31
I20240601 10:19:26.742192 42559 routine_load_task_executor.cpp:262] finished routine load task id=0f77c0df0bfe4274-bc84ce776877d7d4, job_id=25385, txn_id=2083283, label=rr_error_kafka-25385-f77c0df0bfe4274-bc84ce776877d7d4-2083283, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 2
W20240601 10:19:26.885555 42562 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=551a1cec71f74400-99d0c6dfd03e89c2, job_id=25052, txn_id=2083286, label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, elapse(s)=31
I20240601 10:19:26.885900 42562 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:19:26.886816 42562 routine_load_task_executor.cpp:262] finished routine load task id=551a1cec71f74400-99d0c6dfd03e89c2, job_id=25052, txn_id=2083286, label=ott_liveprepull_kafka-25052-551a1cec71f74400-99d0c6dfd03e89c2-2083286, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 1
W20240601 10:19:27.421481 42558 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=e748d44e841940ec-ade81941e08876d9, job_id=25385, txn_id=2083290, label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, elapse(s)=31
I20240601 10:19:27.421686 42558 routine_load_task_executor.cpp:262] finished routine load task id=e748d44e841940ec-ade81941e08876d9, job_id=25385, txn_id=2083290, label=rr_error_kafka-25385-e748d44e841940ec-ade81941e08876d9-2083290, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 0
W20240601 10:19:30.190420 44709 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=b64c24ff28b50008-eebdb1d2bfb4c6b5, job_id=-1, txn_id=2083292, label=8a3fb389-2aaa-42ac-95ce-7d52908de0df, elapse(s)=30
I20240601 10:19:30.641674 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264708293427 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264708293427 Bytes.];[/data5/storage/wal: limit 279282302156 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282302156 Bytes.];[/data6/storage/wal: limit 277837902643 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277837902643 Bytes.];
W20240601 10:19:30.819379 44715 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=6e485058c293b657-f75db98194e4719b, job_id=-1, txn_id=2083294, label=67ef1bbf-15bd-4075-8f3f-18022bb731ef, elapse(s)=30
W20240601 10:19:31.111052 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:19:31.312839 44080 tablets_channel.cpp:134] open tablets channel: (load_id=144397518533fea9-7dab97c2837d6591, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:19:31.416396 43898 tablets_channel.cpp:226] close tablets channel: (load_id=144397518533fea9-7dab97c2837d6591, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:31.633903 44709 stream_load.cpp:198] new income streaming load request.id=6b44bf5734c80bc6-cd38a264b3c1f58e, job_id=-1, txn_id=-1, label=0208f1e5-2c42-4797-8258-dbd4efe3944d, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:19:31.651676 44709 stream_load_executor.cpp:71] begin to execute stream load. label=0208f1e5-2c42-4797-8258-dbd4efe3944d, txn_id=2083298, query_id=0-0
I20240601 10:19:31.651826 44709 fragment_mgr.cpp:636] query_id: 6b44bf5734c80bc6-cd38a264b3c1f58e coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:31.651847 44709 fragment_mgr.cpp:661] Query/load id: 6b44bf5734c80bc6-cd38a264b3c1f58e, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:31.651867 44709 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 6b44bf5734c80bc6-cd38a264b3c1f58e limit: 0
I20240601 10:19:31.651891 44709 pipeline_fragment_context.cpp:244] Preparing instance 6b44bf5734c80bc6-cd38a264b3c1f58e|6b44bf5734c80bc6-cd38a264b3c1f58f, backend_num 0
I20240601 10:19:31.655422 44709 stream_load.cpp:204] finished to handle HTTP header, id=6b44bf5734c80bc6-cd38a264b3c1f58e, job_id=-1, txn_id=2083298, label=0208f1e5-2c42-4797-8258-dbd4efe3944d, elapse(s)=0
I20240601 10:19:31.664150 44200 tablets_channel.cpp:134] open tablets channel: (load_id=6b44bf5734c80bc6-cd38a264b3c1f58e, index_id=487076), tablets num: 1802, timeout(s): 259200
W20240601 10:19:31.711571 44713 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=d747004df467a6bb-c4685added70a2a2, job_id=-1, txn_id=2083296, label=93e577fa-6439-4d18-8126-81075f19c21d, elapse(s)=30
I20240601 10:19:31.768019 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=6b44bf5734c80bc6-cd38a264b3c1f58e, txn_id=2083298, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:31.768106 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=6b44bf5734c80bc6-cd38a264b3c1f58e, txn_id=2083298, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:31.773726 44383 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 6b44bf5734c80bc6-cd38a264b3c1f58e
I20240601 10:19:31.781428 43876 tablets_channel.cpp:226] close tablets channel: (load_id=6b44bf5734c80bc6-cd38a264b3c1f58e, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:31.891094 44047 tablets_channel.cpp:134] open tablets channel: (load_id=c945119d1407d282-2e26a357b129549b, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:19:31.988194 43981 tablets_channel.cpp:226] close tablets channel: (load_id=c945119d1407d282-2e26a357b129549b, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:32.046512 43898 load_channel.cpp:55] load channel removed load_id=144397518533fea9-7dab97c2837d6591, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:32.082304 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083297
I20240601 10:19:32.415407 43876 load_channel.cpp:55] load channel removed load_id=6b44bf5734c80bc6-cd38a264b3c1f58e, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:32.421517 77259 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=5809850, load id=6b44bf5734c80bc6-cd38a264b3c1f58e
I20240601 10:19:32.421591 77259 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=6b44bf5734c80bc6-cd38a264b3c1f58e, txn_id=2083298, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(67)(0)(653)(1)} {10006:(648)(0)(653)(1)} 
I20240601 10:19:32.421993 50834 fragment_mgr.cpp:588] Removing query 6b44bf5734c80bc6-cd38a264b3c1f58e instance 6b44bf5734c80bc6-cd38a264b3c1f58f, all done? true
I20240601 10:19:32.422052 50834 fragment_mgr.cpp:594] Query 6b44bf5734c80bc6-cd38a264b3c1f58e finished
I20240601 10:19:32.422088 50834 stream_load_executor.cpp:152] finished to execute stream load. label=0208f1e5-2c42-4797-8258-dbd4efe3944d, txn_id=2083298, query_id=0-0, receive_data_cost_ms=54, read_data_cost_ms=4, write_data_cost_ms=770
I20240601 10:19:32.423341 50834 query_context.cpp:114] Query 6b44bf5734c80bc6-cd38a264b3c1f58e deconstructed, , deregister query/load memory tracker, queryId=6b44bf5734c80bc6-cd38a264b3c1f58e, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:19:32.482779 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083298
I20240601 10:19:32.564662 44711 stream_load.cpp:198] new income streaming load request.id=664d292c1caab2e1-d791caa621b75997, job_id=-1, txn_id=-1, label=41efaa9a-672d-4577-b01e-99d93d649ff4, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:19:32.565518 43981 load_channel.cpp:55] load channel removed load_id=c945119d1407d282-2e26a357b129549b, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:32.588708 44711 stream_load_executor.cpp:71] begin to execute stream load. label=41efaa9a-672d-4577-b01e-99d93d649ff4, txn_id=2083300, query_id=0-0
I20240601 10:19:32.589035 44711 fragment_mgr.cpp:636] query_id: 664d292c1caab2e1-d791caa621b75997 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:32.589121 44711 fragment_mgr.cpp:661] Query/load id: 664d292c1caab2e1-d791caa621b75997, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:32.589213 44711 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 664d292c1caab2e1-d791caa621b75997 limit: 0
I20240601 10:19:32.589306 44711 pipeline_fragment_context.cpp:244] Preparing instance 664d292c1caab2e1-d791caa621b75997|664d292c1caab2e1-d791caa621b75998, backend_num 0
I20240601 10:19:32.598388 44711 stream_load.cpp:204] finished to handle HTTP header, id=664d292c1caab2e1-d791caa621b75997, job_id=-1, txn_id=2083300, label=41efaa9a-672d-4577-b01e-99d93d649ff4, elapse(s)=0
I20240601 10:19:32.601125 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083299
I20240601 10:19:32.606688 44097 tablets_channel.cpp:134] open tablets channel: (load_id=664d292c1caab2e1-d791caa621b75997, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:19:32.696079 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=664d292c1caab2e1-d791caa621b75997, txn_id=2083300, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:32.696203 77259 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=664d292c1caab2e1-d791caa621b75997, txn_id=2083300, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:32.702867 44531 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 664d292c1caab2e1-d791caa621b75997
I20240601 10:19:32.705814 43902 tablets_channel.cpp:226] close tablets channel: (load_id=664d292c1caab2e1-d791caa621b75997, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:32.792896 44068 tablets_channel.cpp:134] open tablets channel: (load_id=5d4a68998d72e010-dfdc5abd142104a3, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:19:32.891636 44007 tablets_channel.cpp:226] close tablets channel: (load_id=5d4a68998d72e010-dfdc5abd142104a3, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:19:33.567893 43902 load_channel.cpp:55] load channel removed load_id=664d292c1caab2e1-d791caa621b75997, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:33.571080 77259 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=7140419, load id=664d292c1caab2e1-d791caa621b75997
I20240601 10:19:33.571108 77259 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=664d292c1caab2e1-d791caa621b75997, txn_id=2083300, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(72)(0)(875)(1)} {10006:(869)(0)(875)(1)} 
I20240601 10:19:33.571475 50823 fragment_mgr.cpp:588] Removing query 664d292c1caab2e1-d791caa621b75997 instance 664d292c1caab2e1-d791caa621b75998, all done? true
I20240601 10:19:33.571502 50823 fragment_mgr.cpp:594] Query 664d292c1caab2e1-d791caa621b75997 finished
I20240601 10:19:33.571525 50823 stream_load_executor.cpp:152] finished to execute stream load. label=41efaa9a-672d-4577-b01e-99d93d649ff4, txn_id=2083300, query_id=0-0, receive_data_cost_ms=70, read_data_cost_ms=2, write_data_cost_ms=982
I20240601 10:19:33.573065 50823 query_context.cpp:114] Query 664d292c1caab2e1-d791caa621b75997 deconstructed, , deregister query/load memory tracker, queryId=664d292c1caab2e1-d791caa621b75997, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:19:33.591449 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083300
I20240601 10:19:33.728488 44007 load_channel.cpp:55] load channel removed load_id=5d4a68998d72e010-dfdc5abd142104a3, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:19:33.758859 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083301
I20240601 10:19:35.706112 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:19:35.706161 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:19:35.706202 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:19:35.706210 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:19:35.706223 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:19:35.706233 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:19:35.706240 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:19:35.706295 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:19:35.982168 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=fc68e5366aba4cf0-99b57f0f40db4983, job_id=25385, txn_id=2083303, label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, elapse(s)=0, current tasks num: 1
I20240601 10:19:35.982172 42563 routine_load_task_executor.cpp:290] begin to execute routine load task: id=fc68e5366aba4cf0-99b57f0f40db4983, job_id=25385, txn_id=2083303, label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, elapse(s)=0
I20240601 10:19:35.982451 42563 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:19:35.983000 42563 data_consumer_pool.cpp:103] get consumer group da4a0b468d8056a0-3a4b7bd533316dab with 2 consumers
I20240601 10:19:35.983018 42563 data_consumer.cpp:169] consumer: cd451f87bc122092-ff2ef73ec9152194, grp: da4a0b468d8056a0-3a4b7bd533316dab assign topic partitions: ott-rr-error, [2: -1] 
I20240601 10:19:35.983074 42563 data_consumer.cpp:169] consumer: a94f2fedc306def3-4f5eed019c841695, grp: da4a0b468d8056a0-3a4b7bd533316dab assign topic partitions: ott-rr-error, [7: -1] 
I20240601 10:19:35.983213 42563 stream_load_executor.cpp:71] begin to execute stream load. label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, txn_id=2083303, query_id=0-0
I20240601 10:19:35.983336 42563 fragment_mgr.cpp:636] query_id: fc68e5366aba4cf0-99b57f0f40db4983 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:35.983377 42563 fragment_mgr.cpp:661] Query/load id: fc68e5366aba4cf0-99b57f0f40db4983, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:35.983402 42563 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: fc68e5366aba4cf0-99b57f0f40db4983 limit: 0
I20240601 10:19:35.983431 42563 pipeline_fragment_context.cpp:244] Preparing instance fc68e5366aba4cf0-99b57f0f40db4983|fc68e5366aba4cf0-99b57f0f40db4984, backend_num 0
I20240601 10:19:35.984130 42563 data_consumer_group.cpp:108] start consumer group: da4a0b468d8056a0-3a4b7bd533316dab. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=fc68e5366aba4cf0-99b57f0f40db4983, job_id=25385, txn_id=2083303, label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, elapse(s)=0
I20240601 10:19:35.984192 86158 data_consumer.cpp:194] start kafka consumer: cd451f87bc122092-ff2ef73ec9152194, grp: da4a0b468d8056a0-3a4b7bd533316dab, max running time(ms): 30000
I20240601 10:19:35.984222 86159 data_consumer.cpp:194] start kafka consumer: a94f2fedc306def3-4f5eed019c841695, grp: da4a0b468d8056a0-3a4b7bd533316dab, max running time(ms): 30000
I20240601 10:19:35.985435 44157 tablets_channel.cpp:134] open tablets channel: (load_id=fc68e5366aba4cf0-99b57f0f40db4983, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:19:35.995414 44044 tablets_channel.cpp:134] open tablets channel: (load_id=f13506fc84254518-8c6c39b6490499f8, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:19:36.035717 44066 tablets_channel.cpp:134] open tablets channel: (load_id=627eba0c110a494c-a7f1c12fc24cb28d, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:19:36.037743 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=bfae1e62ce7340a9-84d4c4899c071b15, job_id=25385, txn_id=2083306, label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, elapse(s)=0, current tasks num: 2
I20240601 10:19:36.037773 42566 routine_load_task_executor.cpp:290] begin to execute routine load task: id=bfae1e62ce7340a9-84d4c4899c071b15, job_id=25385, txn_id=2083306, label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, elapse(s)=0
I20240601 10:19:36.038188 42566 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:19:36.038918 42566 data_consumer_pool.cpp:103] get consumer group 65498b758092d255-95102f3fcb32409f with 1 consumers
I20240601 10:19:36.038935 42566 data_consumer.cpp:169] consumer: 454710794125cccf-b8efde3f14bbe1a3, grp: 65498b758092d255-95102f3fcb32409f assign topic partitions: ott-rr-error, [4: -1] 
I20240601 10:19:36.039165 42566 stream_load_executor.cpp:71] begin to execute stream load. label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, txn_id=2083306, query_id=0-0
I20240601 10:19:36.039260 42566 fragment_mgr.cpp:636] query_id: bfae1e62ce7340a9-84d4c4899c071b15 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:36.039286 42566 fragment_mgr.cpp:661] Query/load id: bfae1e62ce7340a9-84d4c4899c071b15, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:36.039321 42566 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: bfae1e62ce7340a9-84d4c4899c071b15 limit: 0
I20240601 10:19:36.039345 42566 pipeline_fragment_context.cpp:244] Preparing instance bfae1e62ce7340a9-84d4c4899c071b15|bfae1e62ce7340a9-84d4c4899c071b16, backend_num 0
I20240601 10:19:36.040127 42566 data_consumer_group.cpp:108] start consumer group: 65498b758092d255-95102f3fcb32409f. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=bfae1e62ce7340a9-84d4c4899c071b15, job_id=25385, txn_id=2083306, label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, elapse(s)=0
I20240601 10:19:36.040200 86173 data_consumer.cpp:194] start kafka consumer: 454710794125cccf-b8efde3f14bbe1a3, grp: 65498b758092d255-95102f3fcb32409f, max running time(ms): 30000
I20240601 10:19:36.041503 44065 tablets_channel.cpp:134] open tablets channel: (load_id=bfae1e62ce7340a9-84d4c4899c071b15, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:19:36.043191 44240 tablets_channel.cpp:134] open tablets channel: (load_id=4c6bead4223c4f8d-abe7f1c51c7010e1, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:19:36.047412 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=092ff60b35a54267-a107e2845140cd41, job_id=384863, txn_id=2083307, label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, elapse(s)=0, current tasks num: 3
I20240601 10:19:36.047441 42560 routine_load_task_executor.cpp:290] begin to execute routine load task: id=092ff60b35a54267-a107e2845140cd41, job_id=384863, txn_id=2083307, label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, elapse(s)=0
I20240601 10:19:36.047785 42560 data_consumer_pool.cpp:103] get consumer group 5d4dafaf03b1ea1b-eac93ccffbd4529b with 2 consumers
I20240601 10:19:36.047803 42560 data_consumer.cpp:169] consumer: b140ee09bacd608e-0520aa292c304da5, grp: 5d4dafaf03b1ea1b-eac93ccffbd4529b assign topic partitions: doris-ott-ias-sessions, [1: 116872463] 
I20240601 10:19:36.047899 42560 data_consumer.cpp:169] consumer: c84beb370334c4b3-d15aa2123e53819d, grp: 5d4dafaf03b1ea1b-eac93ccffbd4529b assign topic partitions: doris-ott-ias-sessions, [6: 116878017] 
I20240601 10:19:36.047933 42560 stream_load_executor.cpp:71] begin to execute stream load. label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, txn_id=2083307, query_id=0-0
I20240601 10:19:36.048149 42560 fragment_mgr.cpp:636] query_id: 092ff60b35a54267-a107e2845140cd41 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:36.048174 42560 fragment_mgr.cpp:661] Query/load id: 92ff60b35a54267-a107e2845140cd41, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:36.048259 42560 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 92ff60b35a54267-a107e2845140cd41 limit: 0
I20240601 10:19:36.048292 42560 pipeline_fragment_context.cpp:244] Preparing instance 92ff60b35a54267-a107e2845140cd41|92ff60b35a54267-a107e2845140cd42, backend_num 0
I20240601 10:19:36.049180 42560 data_consumer_group.cpp:108] start consumer group: 5d4dafaf03b1ea1b-eac93ccffbd4529b. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=092ff60b35a54267-a107e2845140cd41, job_id=384863, txn_id=2083307, label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, elapse(s)=0
I20240601 10:19:36.049286 86181 data_consumer.cpp:194] start kafka consumer: b140ee09bacd608e-0520aa292c304da5, grp: 5d4dafaf03b1ea1b-eac93ccffbd4529b, max running time(ms): 30000
I20240601 10:19:36.049317 86182 data_consumer.cpp:194] start kafka consumer: c84beb370334c4b3-d15aa2123e53819d, grp: 5d4dafaf03b1ea1b-eac93ccffbd4529b, max running time(ms): 30000
I20240601 10:19:36.050565 44107 tablets_channel.cpp:134] open tablets channel: (load_id=092ff60b35a54267-a107e2845140cd41, index_id=353257), tablets num: 5, timeout(s): 60
I20240601 10:19:36.059293 44078 tablets_channel.cpp:134] open tablets channel: (load_id=510d770053344cc6-8a750e16a6f14722, index_id=353257), tablets num: 5, timeout(s): 60
I20240601 10:19:36.064208 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=92c882a449be49a5-8aff4846a6528068, job_id=384863, txn_id=2083309, label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, elapse(s)=0, current tasks num: 4
I20240601 10:19:36.064208 42565 routine_load_task_executor.cpp:290] begin to execute routine load task: id=92c882a449be49a5-8aff4846a6528068, job_id=384863, txn_id=2083309, label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, elapse(s)=0
I20240601 10:19:36.064620 42565 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-ias-sessions1
I20240601 10:19:36.065183 42565 data_consumer_pool.cpp:103] get consumer group cb4cddfe100168d7-ad9aef1090232e99 with 2 consumers
I20240601 10:19:36.065208 42565 data_consumer.cpp:169] consumer: 2b4c38d8daea42f7-97b816835a84eb81, grp: cb4cddfe100168d7-ad9aef1090232e99 assign topic partitions: doris-ott-ias-sessions, [2: 116877245] 
I20240601 10:19:36.065292 42565 data_consumer.cpp:169] consumer: b84e5340934e3d0e-ed7a9d483b325888, grp: cb4cddfe100168d7-ad9aef1090232e99 assign topic partitions: doris-ott-ias-sessions, [7: 116870127] 
I20240601 10:19:36.065537 42565 stream_load_executor.cpp:71] begin to execute stream load. label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, txn_id=2083309, query_id=0-0
I20240601 10:19:36.065729 42565 fragment_mgr.cpp:636] query_id: 92c882a449be49a5-8aff4846a6528068 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:36.065753 42565 fragment_mgr.cpp:661] Query/load id: 92c882a449be49a5-8aff4846a6528068, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:36.065789 42565 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 92c882a449be49a5-8aff4846a6528068 limit: 0
I20240601 10:19:36.065833 42565 pipeline_fragment_context.cpp:244] Preparing instance 92c882a449be49a5-8aff4846a6528068|92c882a449be49a5-8aff4846a6528069, backend_num 0
I20240601 10:19:36.066865 42565 data_consumer_group.cpp:108] start consumer group: cb4cddfe100168d7-ad9aef1090232e99. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=92c882a449be49a5-8aff4846a6528068, job_id=384863, txn_id=2083309, label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, elapse(s)=0
I20240601 10:19:36.066933 86185 data_consumer.cpp:194] start kafka consumer: 2b4c38d8daea42f7-97b816835a84eb81, grp: cb4cddfe100168d7-ad9aef1090232e99, max running time(ms): 30000
I20240601 10:19:36.066984 86184 data_consumer.cpp:194] start kafka consumer: b84e5340934e3d0e-ed7a9d483b325888, grp: cb4cddfe100168d7-ad9aef1090232e99, max running time(ms): 30000
I20240601 10:19:36.068553 44125 tablets_channel.cpp:134] open tablets channel: (load_id=92c882a449be49a5-8aff4846a6528068, index_id=353257), tablets num: 5, timeout(s): 60
I20240601 10:19:36.079219 43943 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-ias-sessions1
I20240601 10:19:36.080219 44185 tablets_channel.cpp:134] open tablets channel: (load_id=c3c60334eb904f00-bf7cbd43ee09ef77, index_id=353257), tablets num: 5, timeout(s): 60
I20240601 10:19:36.484866 86158 data_consumer.cpp:253] consumer meet partition eof: cd451f87bc122092-ff2ef73ec9152194 partition offset: 0
I20240601 10:19:36.484944 86158 data_consumer.cpp:274] kafka consumer done: cd451f87bc122092-ff2ef73ec9152194, grp: da4a0b468d8056a0-3a4b7bd533316dab. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:19:36.535437 43875 tablets_channel.cpp:226] close tablets channel: (load_id=627eba0c110a494c-a7f1c12fc24cb28d, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:19:36.535912 43875 load_channel.cpp:55] load channel removed load_id=627eba0c110a494c-a7f1c12fc24cb28d, is high priority=1, sender_ip=225.225.225.2, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:19:36.548226 86182 data_consumer.cpp:253] consumer meet partition eof: c84beb370334c4b3-d15aa2123e53819d partition offset: 116878033
I20240601 10:19:36.548255 86182 data_consumer.cpp:274] kafka consumer done: c84beb370334c4b3-d15aa2123e53819d, grp: 5d4dafaf03b1ea1b-eac93ccffbd4529b. cancelled: 0, left time(ms): 29502, total cost(ms): 498, consume cost(ms): 498, received rows: 16, put rows: 16
I20240601 10:19:36.549077 86181 data_consumer.cpp:253] consumer meet partition eof: b140ee09bacd608e-0520aa292c304da5 partition offset: 116872484
I20240601 10:19:36.549105 86181 data_consumer.cpp:274] kafka consumer done: b140ee09bacd608e-0520aa292c304da5, grp: 5d4dafaf03b1ea1b-eac93ccffbd4529b. cancelled: 0, left time(ms): 29501, total cost(ms): 499, consume cost(ms): 499, received rows: 21, put rows: 21
I20240601 10:19:36.549117 86181 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 5d4dafaf03b1ea1b-eac93ccffbd4529b
I20240601 10:19:36.549134 42560 data_consumer_group.cpp:128] consumer group done: 5d4dafaf03b1ea1b-eac93ccffbd4529b. consume time(ms)=499, received rows=37, received bytes=44316, eos: 1, left_time: 29501, left_rows: 199963, left_bytes: 209670884, blocking get time(us): 499709, blocking put time(us): 52, id=092ff60b35a54267-a107e2845140cd41, job_id=384863, txn_id=2083307, label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, elapse(s)=0
I20240601 10:19:36.549160 42560 data_consumer.cpp:417] kafka consumer cancelled. b140ee09bacd608e-0520aa292c304da5
I20240601 10:19:36.549165 42560 data_consumer.cpp:417] kafka consumer cancelled. c84beb370334c4b3-d15aa2123e53819d
I20240601 10:19:36.552039 86183 vtablet_writer.cpp:963] VNodeChannel[353257-10006], load_id=92ff60b35a54267-a107e2845140cd41, txn_id=2083307, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:36.552157 86183 vtablet_writer.cpp:963] VNodeChannel[353257-10005], load_id=92ff60b35a54267-a107e2845140cd41, txn_id=2083307, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:36.553858 43914 tablets_channel.cpp:226] close tablets channel: (load_id=092ff60b35a54267-a107e2845140cd41, index_id=353257), sender id: 0, backend id: 10006
I20240601 10:19:36.554023 44383 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 92ff60b35a54267-a107e2845140cd41
I20240601 10:19:36.561000 43964 tablets_channel.cpp:226] close tablets channel: (load_id=510d770053344cc6-8a750e16a6f14722, index_id=353257), sender id: 0, backend id: 10006
I20240601 10:19:36.566519 86185 data_consumer.cpp:253] consumer meet partition eof: 2b4c38d8daea42f7-97b816835a84eb81 partition offset: 116877271
I20240601 10:19:36.566622 86185 data_consumer.cpp:274] kafka consumer done: 2b4c38d8daea42f7-97b816835a84eb81, grp: cb4cddfe100168d7-ad9aef1090232e99. cancelled: 0, left time(ms): 29501, total cost(ms): 499, consume cost(ms): 499, received rows: 26, put rows: 26
I20240601 10:19:36.568382 86184 data_consumer.cpp:253] consumer meet partition eof: b84e5340934e3d0e-ed7a9d483b325888 partition offset: 116870150
I20240601 10:19:36.568415 86184 data_consumer.cpp:274] kafka consumer done: b84e5340934e3d0e-ed7a9d483b325888, grp: cb4cddfe100168d7-ad9aef1090232e99. cancelled: 0, left time(ms): 29499, total cost(ms): 501, consume cost(ms): 501, received rows: 23, put rows: 23
I20240601 10:19:36.568431 86184 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: cb4cddfe100168d7-ad9aef1090232e99
I20240601 10:19:36.568447 42565 data_consumer_group.cpp:128] consumer group done: cb4cddfe100168d7-ad9aef1090232e99. consume time(ms)=501, received rows=49, received bytes=58690, eos: 1, left_time: 29499, left_rows: 199951, left_bytes: 209656510, blocking get time(us): 501388, blocking put time(us): 13, id=92c882a449be49a5-8aff4846a6528068, job_id=384863, txn_id=2083309, label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, elapse(s)=0
I20240601 10:19:36.568487 42565 data_consumer.cpp:417] kafka consumer cancelled. 2b4c38d8daea42f7-97b816835a84eb81
I20240601 10:19:36.568499 42565 data_consumer.cpp:417] kafka consumer cancelled. b84e5340934e3d0e-ed7a9d483b325888
I20240601 10:19:36.571679 86192 vtablet_writer.cpp:963] VNodeChannel[353257-10006], load_id=92c882a449be49a5-8aff4846a6528068, txn_id=2083309, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:36.571805 86192 vtablet_writer.cpp:963] VNodeChannel[353257-10005], load_id=92c882a449be49a5-8aff4846a6528068, txn_id=2083309, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:36.573122 44008 tablets_channel.cpp:226] close tablets channel: (load_id=92c882a449be49a5-8aff4846a6528068, index_id=353257), sender id: 0, backend id: 10006
I20240601 10:19:36.573200 44546 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 92c882a449be49a5-8aff4846a6528068
I20240601 10:19:36.576151 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083305
I20240601 10:19:36.581874 43994 tablets_channel.cpp:226] close tablets channel: (load_id=c3c60334eb904f00-bf7cbd43ee09ef77, index_id=353257), sender id: 0, backend id: 10006
I20240601 10:19:36.589401 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=5354379612124c9d-b6a13d1601055fd7, job_id=384863, txn_id=2083311, label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, elapse(s)=0, current tasks num: 5
I20240601 10:19:36.589403 42561 routine_load_task_executor.cpp:290] begin to execute routine load task: id=5354379612124c9d-b6a13d1601055fd7, job_id=384863, txn_id=2083311, label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, elapse(s)=0
I20240601 10:19:36.589717 42561 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-ias-sessions1
I20240601 10:19:36.590287 42561 data_consumer_pool.cpp:103] get consumer group 8a466b31f46cfa92-b0af79758914d29d with 2 consumers
I20240601 10:19:36.590306 42561 data_consumer.cpp:169] consumer: b34ff9c97b0f0ae9-e04c0e8fc83046a0, grp: 8a466b31f46cfa92-b0af79758914d29d assign topic partitions: doris-ott-ias-sessions, [3: 116883271] 
I20240601 10:19:36.590484 42561 data_consumer.cpp:169] consumer: 464d1a1a45163746-0db6ff6a24d63190, grp: 8a466b31f46cfa92-b0af79758914d29d assign topic partitions: doris-ott-ias-sessions, [8: 116896300] 
I20240601 10:19:36.590663 42561 stream_load_executor.cpp:71] begin to execute stream load. label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, txn_id=2083311, query_id=0-0
I20240601 10:19:36.590881 42561 fragment_mgr.cpp:636] query_id: 5354379612124c9d-b6a13d1601055fd7 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:19:36.590907 42561 fragment_mgr.cpp:661] Query/load id: 5354379612124c9d-b6a13d1601055fd7, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:19:36.590938 42561 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 5354379612124c9d-b6a13d1601055fd7 limit: 0
I20240601 10:19:36.590965 42561 pipeline_fragment_context.cpp:244] Preparing instance 5354379612124c9d-b6a13d1601055fd7|5354379612124c9d-b6a13d1601055fd8, backend_num 0
I20240601 10:19:36.592094 42561 data_consumer_group.cpp:108] start consumer group: 8a466b31f46cfa92-b0af79758914d29d. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=5354379612124c9d-b6a13d1601055fd7, job_id=384863, txn_id=2083311, label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, elapse(s)=0
I20240601 10:19:36.592134 86218 data_consumer.cpp:194] start kafka consumer: b34ff9c97b0f0ae9-e04c0e8fc83046a0, grp: 8a466b31f46cfa92-b0af79758914d29d, max running time(ms): 30000
I20240601 10:19:36.592191 86219 data_consumer.cpp:194] start kafka consumer: 464d1a1a45163746-0db6ff6a24d63190, grp: 8a466b31f46cfa92-b0af79758914d29d, max running time(ms): 30000
I20240601 10:19:36.593429 44227 tablets_channel.cpp:134] open tablets channel: (load_id=5354379612124c9d-b6a13d1601055fd7, index_id=353257), tablets num: 5, timeout(s): 60
I20240601 10:19:36.691462 43914 load_channel.cpp:55] load channel removed load_id=092ff60b35a54267-a107e2845140cd41, is high priority=1, sender_ip=225.225.225.3, index id: 353257, total_received_rows: 37, num_rows_filtered: 0
I20240601 10:19:36.692620 86183 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=365653, load id=92ff60b35a54267-a107e2845140cd41
I20240601 10:19:36.692679 86183 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=92ff60b35a54267-a107e2845140cd41, txn_id=2083307, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(51)(0)(140)(1)} {10006:(138)(0)(140)(1)} 
I20240601 10:19:36.693064 50833 fragment_mgr.cpp:588] Removing query 92ff60b35a54267-a107e2845140cd41 instance 92ff60b35a54267-a107e2845140cd42, all done? true
I20240601 10:19:36.693097 50833 fragment_mgr.cpp:594] Query 92ff60b35a54267-a107e2845140cd41 finished
I20240601 10:19:36.693130 50833 stream_load_executor.cpp:152] finished to execute stream load. label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, txn_id=2083307, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=645
I20240601 10:19:36.693864 50833 query_context.cpp:114] Query 92ff60b35a54267-a107e2845140cd41 deconstructed, , deregister query/load memory tracker, queryId=92ff60b35a54267-a107e2845140cd41, Limit=2.00 GB, CurrUsed=1.07 MB, PeakUsed=2.35 MB
I20240601 10:19:36.725028 43964 load_channel.cpp:55] load channel removed load_id=510d770053344cc6-8a750e16a6f14722, is high priority=1, sender_ip=225.225.225.2, index id: 353257, total_received_rows: 35, num_rows_filtered: 0
I20240601 10:19:36.725432 43994 load_channel.cpp:55] load channel removed load_id=c3c60334eb904f00-bf7cbd43ee09ef77, is high priority=1, sender_ip=225.225.225.2, index id: 353257, total_received_rows: 11, num_rows_filtered: 0
I20240601 10:19:36.726059 44008 load_channel.cpp:55] load channel removed load_id=92c882a449be49a5-8aff4846a6528068, is high priority=1, sender_ip=225.225.225.3, index id: 353257, total_received_rows: 49, num_rows_filtered: 0
I20240601 10:19:36.729107 86192 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=428611, load id=92c882a449be49a5-8aff4846a6528068
I20240601 10:19:36.729218 86192 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=92c882a449be49a5-8aff4846a6528068, txn_id=2083309, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(51)(0)(158)(1)} {10006:(153)(0)(158)(1)} 
I20240601 10:19:36.729854 50822 fragment_mgr.cpp:588] Removing query 92c882a449be49a5-8aff4846a6528068 instance 92c882a449be49a5-8aff4846a6528069, all done? true
I20240601 10:19:36.729897 50822 fragment_mgr.cpp:594] Query 92c882a449be49a5-8aff4846a6528068 finished
I20240601 10:19:36.729959 50822 stream_load_executor.cpp:152] finished to execute stream load. label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, txn_id=2083309, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=664
I20240601 10:19:36.730734 50822 query_context.cpp:114] Query 92c882a449be49a5-8aff4846a6528068 deconstructed, , deregister query/load memory tracker, queryId=92c882a449be49a5-8aff4846a6528068, Limit=2.00 GB, CurrUsed=1.06 MB, PeakUsed=2.35 MB
I20240601 10:19:36.759807 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083307
I20240601 10:19:36.784368 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083310
I20240601 10:19:36.809800 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083308
I20240601 10:19:36.834777 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083309
I20240601 10:19:36.975672 43959 tablets_channel.cpp:226] close tablets channel: (load_id=f13506fc84254518-8c6c39b6490499f8, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:19:36.983294 43959 load_channel.cpp:55] load channel removed load_id=f13506fc84254518-8c6c39b6490499f8, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:19:36.984333 86159 data_consumer.cpp:242] kafka consume timeout: a94f2fedc306def3-4f5eed019c841695
I20240601 10:19:36.987907 86159 data_consumer.cpp:253] consumer meet partition eof: a94f2fedc306def3-4f5eed019c841695 partition offset: 0
I20240601 10:19:36.987933 86159 data_consumer.cpp:274] kafka consumer done: a94f2fedc306def3-4f5eed019c841695, grp: da4a0b468d8056a0-3a4b7bd533316dab. cancelled: 0, left time(ms): 28997, total cost(ms): 1003, consume cost(ms): 1003, received rows: 0, put rows: 0
I20240601 10:19:36.987949 86159 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: da4a0b468d8056a0-3a4b7bd533316dab
I20240601 10:19:36.987962 42563 data_consumer_group.cpp:128] consumer group done: da4a0b468d8056a0-3a4b7bd533316dab. consume time(ms)=1003, received rows=0, received bytes=0, eos: 1, left_time: 28997, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 1003804, blocking put time(us): 0, id=fc68e5366aba4cf0-99b57f0f40db4983, job_id=25385, txn_id=2083303, label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, elapse(s)=1
I20240601 10:19:36.987993 42563 data_consumer.cpp:417] kafka consumer cancelled. cd451f87bc122092-ff2ef73ec9152194
I20240601 10:19:36.988000 42563 data_consumer.cpp:417] kafka consumer cancelled. a94f2fedc306def3-4f5eed019c841695
I20240601 10:19:36.988262 77259 vtablet_writer.cpp:963] VNodeChannel[25057-10006], load_id=fc68e5366aba4cf0-99b57f0f40db4983, txn_id=2083303, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:36.988294 77259 vtablet_writer.cpp:963] VNodeChannel[25057-10005], load_id=fc68e5366aba4cf0-99b57f0f40db4983, txn_id=2083303, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:36.989459 43950 tablets_channel.cpp:226] close tablets channel: (load_id=fc68e5366aba4cf0-99b57f0f40db4983, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:19:36.989871 43950 load_channel.cpp:55] load channel removed load_id=fc68e5366aba4cf0-99b57f0f40db4983, is high priority=1, sender_ip=225.225.225.3, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:19:36.990332 44383 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. fc68e5366aba4cf0-99b57f0f40db4983
I20240601 10:19:36.992630 77259 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=88376, load id=fc68e5366aba4cf0-99b57f0f40db4983
I20240601 10:19:36.992671 77259 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=fc68e5366aba4cf0-99b57f0f40db4983, txn_id=2083303, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(1)(0)(4)(1)} {10006:(0)(0)(2)(1)} 
I20240601 10:19:36.992820 50850 fragment_mgr.cpp:588] Removing query fc68e5366aba4cf0-99b57f0f40db4983 instance fc68e5366aba4cf0-99b57f0f40db4984, all done? true
I20240601 10:19:36.992844 50850 fragment_mgr.cpp:594] Query fc68e5366aba4cf0-99b57f0f40db4983 finished
I20240601 10:19:36.992866 50850 stream_load_executor.cpp:152] finished to execute stream load. label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, txn_id=2083303, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1009
I20240601 10:19:36.993248 50850 query_context.cpp:114] Query fc68e5366aba4cf0-99b57f0f40db4983 deconstructed, , deregister query/load memory tracker, queryId=fc68e5366aba4cf0-99b57f0f40db4983, Limit=2.00 GB, CurrUsed=304.00 KB, PeakUsed=337.78 KB
I20240601 10:19:37.035154 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083303
I20240601 10:19:37.039211 86173 data_consumer.cpp:253] consumer meet partition eof: 454710794125cccf-b8efde3f14bbe1a3 partition offset: 0
I20240601 10:19:37.039255 86173 data_consumer.cpp:274] kafka consumer done: 454710794125cccf-b8efde3f14bbe1a3, grp: 65498b758092d255-95102f3fcb32409f. cancelled: 0, left time(ms): 29001, total cost(ms): 999, consume cost(ms): 998, received rows: 0, put rows: 0
I20240601 10:19:37.039268 86173 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 65498b758092d255-95102f3fcb32409f
I20240601 10:19:37.039278 42566 data_consumer_group.cpp:128] consumer group done: 65498b758092d255-95102f3fcb32409f. consume time(ms)=999, received rows=0, received bytes=0, eos: 1, left_time: 29001, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 999124, blocking put time(us): 0, id=bfae1e62ce7340a9-84d4c4899c071b15, job_id=25385, txn_id=2083306, label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, elapse(s)=1
I20240601 10:19:37.039305 42566 data_consumer.cpp:417] kafka consumer cancelled. 454710794125cccf-b8efde3f14bbe1a3
I20240601 10:19:37.039568 86180 vtablet_writer.cpp:963] VNodeChannel[25057-10006], load_id=bfae1e62ce7340a9-84d4c4899c071b15, txn_id=2083306, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:37.039599 86180 vtablet_writer.cpp:963] VNodeChannel[25057-10005], load_id=bfae1e62ce7340a9-84d4c4899c071b15, txn_id=2083306, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:37.040191 43842 tablets_channel.cpp:226] close tablets channel: (load_id=bfae1e62ce7340a9-84d4c4899c071b15, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:19:37.040634 43842 load_channel.cpp:55] load channel removed load_id=bfae1e62ce7340a9-84d4c4899c071b15, is high priority=1, sender_ip=225.225.225.3, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:19:37.041107 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. bfae1e62ce7340a9-84d4c4899c071b15
I20240601 10:19:37.041785 86180 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=133767, load id=bfae1e62ce7340a9-84d4c4899c071b15
I20240601 10:19:37.041803 86180 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=bfae1e62ce7340a9-84d4c4899c071b15, txn_id=2083306, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(0)(0)(2)(1)} {10006:(0)(0)(2)(1)} 
I20240601 10:19:37.042029 50841 fragment_mgr.cpp:588] Removing query bfae1e62ce7340a9-84d4c4899c071b15 instance bfae1e62ce7340a9-84d4c4899c071b16, all done? true
I20240601 10:19:37.042119 50841 fragment_mgr.cpp:594] Query bfae1e62ce7340a9-84d4c4899c071b15 finished
I20240601 10:19:37.042148 50841 stream_load_executor.cpp:152] finished to execute stream load. label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, txn_id=2083306, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1002
I20240601 10:19:37.042693 50841 query_context.cpp:114] Query bfae1e62ce7340a9-84d4c4899c071b15 deconstructed, , deregister query/load memory tracker, queryId=bfae1e62ce7340a9-84d4c4899c071b15, Limit=2.00 GB, CurrUsed=304.00 KB, PeakUsed=337.78 KB
I20240601 10:19:37.060259 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083302
I20240601 10:19:37.085146 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083306
I20240601 10:19:37.091670 86218 data_consumer.cpp:253] consumer meet partition eof: b34ff9c97b0f0ae9-e04c0e8fc83046a0 partition offset: 116883290
I20240601 10:19:37.091703 86218 data_consumer.cpp:274] kafka consumer done: b34ff9c97b0f0ae9-e04c0e8fc83046a0, grp: 8a466b31f46cfa92-b0af79758914d29d. cancelled: 0, left time(ms): 29501, total cost(ms): 499, consume cost(ms): 499, received rows: 19, put rows: 19
I20240601 10:19:37.094604 86219 data_consumer.cpp:253] consumer meet partition eof: 464d1a1a45163746-0db6ff6a24d63190 partition offset: 116896318
I20240601 10:19:37.094638 86219 data_consumer.cpp:274] kafka consumer done: 464d1a1a45163746-0db6ff6a24d63190, grp: 8a466b31f46cfa92-b0af79758914d29d. cancelled: 0, left time(ms): 29498, total cost(ms): 502, consume cost(ms): 502, received rows: 18, put rows: 18
I20240601 10:19:37.094655 86219 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 8a466b31f46cfa92-b0af79758914d29d
I20240601 10:19:37.094679 42561 data_consumer_group.cpp:128] consumer group done: 8a466b31f46cfa92-b0af79758914d29d. consume time(ms)=502, received rows=37, received bytes=44316, eos: 1, left_time: 29498, left_rows: 199963, left_bytes: 209670884, blocking get time(us): 502372, blocking put time(us): 3, id=5354379612124c9d-b6a13d1601055fd7, job_id=384863, txn_id=2083311, label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, elapse(s)=0
I20240601 10:19:37.094709 42561 data_consumer.cpp:417] kafka consumer cancelled. b34ff9c97b0f0ae9-e04c0e8fc83046a0
I20240601 10:19:37.094720 42561 data_consumer.cpp:417] kafka consumer cancelled. 464d1a1a45163746-0db6ff6a24d63190
I20240601 10:19:37.096915 86226 vtablet_writer.cpp:963] VNodeChannel[353257-10006], load_id=5354379612124c9d-b6a13d1601055fd7, txn_id=2083311, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:19:37.096983 86226 vtablet_writer.cpp:963] VNodeChannel[353257-10005], load_id=5354379612124c9d-b6a13d1601055fd7, txn_id=2083311, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:19:37.098762 43976 tablets_channel.cpp:226] close tablets channel: (load_id=5354379612124c9d-b6a13d1601055fd7, index_id=353257), sender id: 0, backend id: 10006
I20240601 10:19:37.098945 44383 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 5354379612124c9d-b6a13d1601055fd7
I20240601 10:19:37.214277 86196 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1134ms in state CONNECT)
I20240601 10:19:37.243876 43976 load_channel.cpp:55] load channel removed load_id=5354379612124c9d-b6a13d1601055fd7, is high priority=1, sender_ip=225.225.225.3, index id: 353257, total_received_rows: 37, num_rows_filtered: 0
I20240601 10:19:37.244704 86226 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=367236, load id=5354379612124c9d-b6a13d1601055fd7
I20240601 10:19:37.244732 86226 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=5354379612124c9d-b6a13d1601055fd7, txn_id=2083311, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(52)(0)(148)(1)} {10006:(145)(0)(148)(1)} 
I20240601 10:19:37.245325 50826 fragment_mgr.cpp:588] Removing query 5354379612124c9d-b6a13d1601055fd7 instance 5354379612124c9d-b6a13d1601055fd8, all done? true
I20240601 10:19:37.245414 50826 fragment_mgr.cpp:594] Query 5354379612124c9d-b6a13d1601055fd7 finished
I20240601 10:19:37.245463 50826 stream_load_executor.cpp:152] finished to execute stream load. label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, txn_id=2083311, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=654
I20240601 10:19:37.246248 50826 query_context.cpp:114] Query 5354379612124c9d-b6a13d1601055fd7 deconstructed, , deregister query/load memory tracker, queryId=5354379612124c9d-b6a13d1601055fd7, Limit=2.00 GB, CurrUsed=1.07 MB, PeakUsed=2.35 MB
I20240601 10:19:37.277313 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083311
I20240601 10:19:37.526398 43903 tablets_channel.cpp:226] close tablets channel: (load_id=4c6bead4223c4f8d-abe7f1c51c7010e1, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:19:37.533891 43903 load_channel.cpp:55] load channel removed load_id=4c6bead4223c4f8d-abe7f1c51c7010e1, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:19:37.585381 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083304
I20240601 10:19:38.874806 43411 load_channel_mgr.cpp:224] cleaning timed out load channels
I20240601 10:19:40.336171 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:19:40.670465 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264708276224 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264708276224 Bytes.];[/data5/storage/wal: limit 279282292736 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282292736 Bytes.];[/data6/storage/wal: limit 277837558988 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277837558988 Bytes.];
I20240601 10:19:42.639364 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:19:42.639422 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:19:42.639461 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:19:42.639467 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:19:42.639477 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:19:42.639482 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:19:42.639492 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:19:42.639554 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:19:43.382889 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:19:43.854110 43911 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:19:50.699012 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264708273356 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264708273356 Bytes.];[/data5/storage/wal: limit 279282288640 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282288640 Bytes.];[/data6/storage/wal: limit 277837269811 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277837269811 Bytes.];
I20240601 10:19:50.972615 43826 tablet_manager.cpp:1013] find expired transactions for 0 tablets
I20240601 10:19:50.992820 43826 tablet_manager.cpp:1044] success to build all report tablets info. tablet_count=10659
I20240601 10:19:52.036732 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 340
I20240601 10:19:52.037087 43681 storage_engine.cpp:1110] collected 0 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:19:52.037096 43681 storage_engine.cpp:1126] removed all collected unused rowsets
I20240601 10:19:55.662406 43858 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
W20240601 10:19:55.672818 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:20:00.351469 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:20:00.727990 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264708270489 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264708270489 Bytes.];[/data5/storage/wal: limit 279282284544 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282284544 Bytes.];[/data6/storage/wal: limit 277836962611 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277836962611 Bytes.];
I20240601 10:20:02.366495 43825 data_dir.cpp:882] path: /data4/storage total capacity: 3991941488640, available capacity: 2647156137984, usage: 0.336875, in_use: 1
I20240601 10:20:02.366560 43825 data_dir.cpp:882] path: /data5/storage total capacity: 3991941488640, available capacity: 2792822841344, usage: 0.300385, in_use: 1
I20240601 10:20:02.366581 43825 data_dir.cpp:882] path: /data6/storage total capacity: 3991941488640, available capacity: 2778369146880, usage: 0.304006, in_use: 1
I20240601 10:20:02.377548 43825 storage_engine.cpp:366] get root path info cost: 11 ms. tablet counter: 10659
W20240601 10:20:02.424139 44709 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=6b44bf5734c80bc6-cd38a264b3c1f58e, job_id=-1, txn_id=2083298, label=0208f1e5-2c42-4797-8258-dbd4efe3944d, elapse(s)=30
I20240601 10:20:03.174019 44715 stream_load.cpp:198] new income streaming load request.id=80410c4f9538a558-236a12f342811888, job_id=-1, txn_id=-1, label=6a50529a-41c8-4812-a041-3cf56cd48c99, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:20:03.194667 44715 stream_load_executor.cpp:71] begin to execute stream load. label=6a50529a-41c8-4812-a041-3cf56cd48c99, txn_id=2083312, query_id=0-0
I20240601 10:20:03.195029 44715 fragment_mgr.cpp:636] query_id: 80410c4f9538a558-236a12f342811888 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:03.195072 44715 fragment_mgr.cpp:661] Query/load id: 80410c4f9538a558-236a12f342811888, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:03.195114 44715 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 80410c4f9538a558-236a12f342811888 limit: 0
I20240601 10:20:03.195161 44715 pipeline_fragment_context.cpp:244] Preparing instance 80410c4f9538a558-236a12f342811888|80410c4f9538a558-236a12f342811889, backend_num 0
I20240601 10:20:03.203181 44715 stream_load.cpp:204] finished to handle HTTP header, id=80410c4f9538a558-236a12f342811888, job_id=-1, txn_id=2083312, label=6a50529a-41c8-4812-a041-3cf56cd48c99, elapse(s)=0
I20240601 10:20:03.214455 44224 tablets_channel.cpp:134] open tablets channel: (load_id=80410c4f9538a558-236a12f342811888, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:03.321350 86226 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=80410c4f9538a558-236a12f342811888, txn_id=2083312, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:03.321431 86226 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=80410c4f9538a558-236a12f342811888, txn_id=2083312, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:03.328601 44546 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 80410c4f9538a558-236a12f342811888
I20240601 10:20:03.334555 43847 tablets_channel.cpp:226] close tablets channel: (load_id=80410c4f9538a558-236a12f342811888, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:03.557015 44050 tablets_channel.cpp:134] open tablets channel: (load_id=d8495696f5f781f8-6abc3c218ab839a9, index_id=487076), tablets num: 1802, timeout(s): 259200
W20240601 10:20:03.572487 44711 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=664d292c1caab2e1-d791caa621b75997, job_id=-1, txn_id=2083300, label=41efaa9a-672d-4577-b01e-99d93d649ff4, elapse(s)=31
I20240601 10:20:03.630573 44704 stream_load.cpp:198] new income streaming load request.id=e442d93fa6cffe1f-b313ebfce0719bb1, job_id=-1, txn_id=-1, label=c187740f-e3cc-4687-8ce8-9465b0bc4688, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:20:03.651693 44704 stream_load_executor.cpp:71] begin to execute stream load. label=c187740f-e3cc-4687-8ce8-9465b0bc4688, txn_id=2083314, query_id=0-0
I20240601 10:20:03.651909 44704 fragment_mgr.cpp:636] query_id: e442d93fa6cffe1f-b313ebfce0719bb1 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:03.651940 44704 fragment_mgr.cpp:661] Query/load id: e442d93fa6cffe1f-b313ebfce0719bb1, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:03.651986 44704 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: e442d93fa6cffe1f-b313ebfce0719bb1 limit: 0
I20240601 10:20:03.652037 44704 pipeline_fragment_context.cpp:244] Preparing instance e442d93fa6cffe1f-b313ebfce0719bb1|e442d93fa6cffe1f-b313ebfce0719bb2, backend_num 0
I20240601 10:20:03.657402 44704 stream_load.cpp:204] finished to handle HTTP header, id=e442d93fa6cffe1f-b313ebfce0719bb1, job_id=-1, txn_id=2083314, label=c187740f-e3cc-4687-8ce8-9465b0bc4688, elapse(s)=0
I20240601 10:20:03.662946 44225 tablets_channel.cpp:134] open tablets channel: (load_id=e442d93fa6cffe1f-b313ebfce0719bb1, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:03.788789  3556 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=e442d93fa6cffe1f-b313ebfce0719bb1, txn_id=2083314, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:03.788828  3556 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=e442d93fa6cffe1f-b313ebfce0719bb1, txn_id=2083314, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:03.794946 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. e442d93fa6cffe1f-b313ebfce0719bb1
I20240601 10:20:03.801242 43836 tablets_channel.cpp:226] close tablets channel: (load_id=e442d93fa6cffe1f-b313ebfce0719bb1, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:03.910454 43960 tablets_channel.cpp:226] close tablets channel: (load_id=d8495696f5f781f8-6abc3c218ab839a9, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:04.186131 43847 load_channel.cpp:55] load channel removed load_id=80410c4f9538a558-236a12f342811888, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:04.189648 86226 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=7487833, load id=80410c4f9538a558-236a12f342811888
I20240601 10:20:04.189687 86226 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=80410c4f9538a558-236a12f342811888, txn_id=2083312, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(82)(0)(868)(1)} {10006:(861)(0)(868)(1)} 
I20240601 10:20:04.190079 50824 fragment_mgr.cpp:588] Removing query 80410c4f9538a558-236a12f342811888 instance 80410c4f9538a558-236a12f342811889, all done? true
I20240601 10:20:04.190104 50824 fragment_mgr.cpp:594] Query 80410c4f9538a558-236a12f342811888 finished
I20240601 10:20:04.190129 50824 stream_load_executor.cpp:152] finished to execute stream load. label=6a50529a-41c8-4812-a041-3cf56cd48c99, txn_id=2083312, query_id=0-0, receive_data_cost_ms=65, read_data_cost_ms=3, write_data_cost_ms=995
I20240601 10:20:04.191570 50824 query_context.cpp:114] Query 80410c4f9538a558-236a12f342811888 deconstructed, , deregister query/load memory tracker, queryId=80410c4f9538a558-236a12f342811888, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:20:04.267321 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083312
I20240601 10:20:04.454207 43836 load_channel.cpp:55] load channel removed load_id=e442d93fa6cffe1f-b313ebfce0719bb1, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:04.457855  3556 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=6339559, load id=e442d93fa6cffe1f-b313ebfce0719bb1
I20240601 10:20:04.457883  3556 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=e442d93fa6cffe1f-b313ebfce0719bb1, txn_id=2083314, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(74)(0)(669)(1)} {10006:(663)(0)(669)(1)} 
I20240601 10:20:04.458293 50818 fragment_mgr.cpp:588] Removing query e442d93fa6cffe1f-b313ebfce0719bb1 instance e442d93fa6cffe1f-b313ebfce0719bb2, all done? true
I20240601 10:20:04.458323 50818 fragment_mgr.cpp:594] Query e442d93fa6cffe1f-b313ebfce0719bb1 finished
I20240601 10:20:04.458344 50818 stream_load_executor.cpp:152] finished to execute stream load. label=c187740f-e3cc-4687-8ce8-9465b0bc4688, txn_id=2083314, query_id=0-0, receive_data_cost_ms=75, read_data_cost_ms=3, write_data_cost_ms=806
I20240601 10:20:04.459757 50818 query_context.cpp:114] Query e442d93fa6cffe1f-b313ebfce0719bb1 deconstructed, , deregister query/load memory tracker, queryId=e442d93fa6cffe1f-b313ebfce0719bb1, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:20:04.524647 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083314
I20240601 10:20:04.726269 44031 tablets_channel.cpp:134] open tablets channel: (load_id=7840b09ac6eea4f2-c5499d2813f719b2, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:04.780205 43960 load_channel.cpp:55] load channel removed load_id=d8495696f5f781f8-6abc3c218ab839a9, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:04.807737 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083313
I20240601 10:20:04.813108 44711 stream_load.cpp:198] new income streaming load request.id=4e4335d504747a2b-792ae5690c73699b, job_id=-1, txn_id=-1, label=d453b47c-6d77-428e-a03f-6f14a7f2c8e6, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:20:04.836416 44711 stream_load_executor.cpp:71] begin to execute stream load. label=d453b47c-6d77-428e-a03f-6f14a7f2c8e6, txn_id=2083316, query_id=0-0
I20240601 10:20:04.836582 44711 fragment_mgr.cpp:636] query_id: 4e4335d504747a2b-792ae5690c73699b coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:04.836604 44711 fragment_mgr.cpp:661] Query/load id: 4e4335d504747a2b-792ae5690c73699b, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:04.836627 44711 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 4e4335d504747a2b-792ae5690c73699b limit: 0
I20240601 10:20:04.836647 44711 pipeline_fragment_context.cpp:244] Preparing instance 4e4335d504747a2b-792ae5690c73699b|4e4335d504747a2b-792ae5690c73699c, backend_num 0
I20240601 10:20:04.840530 43828 tablets_channel.cpp:226] close tablets channel: (load_id=7840b09ac6eea4f2-c5499d2813f719b2, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:04.841116 44711 stream_load.cpp:204] finished to handle HTTP header, id=4e4335d504747a2b-792ae5690c73699b, job_id=-1, txn_id=2083316, label=d453b47c-6d77-428e-a03f-6f14a7f2c8e6, elapse(s)=0
I20240601 10:20:04.846997 44215 tablets_channel.cpp:134] open tablets channel: (load_id=4e4335d504747a2b-792ae5690c73699b, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:04.932221  3556 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=4e4335d504747a2b-792ae5690c73699b, txn_id=2083316, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:05.121783  3556 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=4e4335d504747a2b-792ae5690c73699b, txn_id=2083316, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:05.127382 44410 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 4e4335d504747a2b-792ae5690c73699b
I20240601 10:20:05.130254 43946 tablets_channel.cpp:226] close tablets channel: (load_id=4e4335d504747a2b-792ae5690c73699b, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:05.465931 43828 load_channel.cpp:55] load channel removed load_id=7840b09ac6eea4f2-c5499d2813f719b2, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:05.500010 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083315
I20240601 10:20:05.679697 43919 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:20:05.833424 43946 load_channel.cpp:55] load channel removed load_id=4e4335d504747a2b-792ae5690c73699b, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:05.837131  3556 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=194036234, load id=4e4335d504747a2b-792ae5690c73699b
I20240601 10:20:05.837157  3556 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=4e4335d504747a2b-792ae5690c73699b, txn_id=2083316, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(72)(0)(716)(1)} {10006:(710)(0)(905)(1)} 
I20240601 10:20:05.837684 50817 fragment_mgr.cpp:588] Removing query 4e4335d504747a2b-792ae5690c73699b instance 4e4335d504747a2b-792ae5690c73699c, all done? true
I20240601 10:20:05.837761 50817 fragment_mgr.cpp:594] Query 4e4335d504747a2b-792ae5690c73699b finished
I20240601 10:20:05.837796 50817 stream_load_executor.cpp:152] finished to execute stream load. label=d453b47c-6d77-428e-a03f-6f14a7f2c8e6, txn_id=2083316, query_id=0-0, receive_data_cost_ms=61, read_data_cost_ms=3, write_data_cost_ms=1001
I20240601 10:20:05.839604 50817 query_context.cpp:114] Query 4e4335d504747a2b-792ae5690c73699b deconstructed, , deregister query/load memory tracker, queryId=4e4335d504747a2b-792ae5690c73699b, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:20:05.866993 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083316
I20240601 10:20:06.426322 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:20:06.426414 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:20:06.426479 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:20:06.426491 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:20:06.426522 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:20:06.426532 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:20:06.426544 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:20:06.426553 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:20:06.694725 42560 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=092ff60b35a54267-a107e2845140cd41, job_id=384863, txn_id=2083307, label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, elapse(s)=30
I20240601 10:20:06.694947 42560 routine_load_task_executor.cpp:262] finished routine load task id=092ff60b35a54267-a107e2845140cd41, job_id=384863, txn_id=2083307, label=ott_ias_sessions_kafka-384863-92ff60b35a54267-a107e2845140cd41-2083307, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 4
W20240601 10:20:06.731616 42565 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=92c882a449be49a5-8aff4846a6528068, job_id=384863, txn_id=2083309, label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, elapse(s)=30
I20240601 10:20:06.731827 42565 routine_load_task_executor.cpp:262] finished routine load task id=92c882a449be49a5-8aff4846a6528068, job_id=384863, txn_id=2083309, label=ott_ias_sessions_kafka-384863-92c882a449be49a5-8aff4846a6528068-2083309, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 3
W20240601 10:20:07.018896 42563 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=fc68e5366aba4cf0-99b57f0f40db4983, job_id=25385, txn_id=2083303, label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, elapse(s)=31
I20240601 10:20:07.019026 42563 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:20:07.019940 42563 routine_load_task_executor.cpp:262] finished routine load task id=fc68e5366aba4cf0-99b57f0f40db4983, job_id=25385, txn_id=2083303, label=rr_error_kafka-25385-fc68e5366aba4cf0-99b57f0f40db4983-2083303, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 2
W20240601 10:20:07.042856 42566 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=bfae1e62ce7340a9-84d4c4899c071b15, job_id=25385, txn_id=2083306, label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, elapse(s)=31
I20240601 10:20:07.042974 42566 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:20:07.043758 42566 routine_load_task_executor.cpp:262] finished routine load task id=bfae1e62ce7340a9-84d4c4899c071b15, job_id=25385, txn_id=2083306, label=rr_error_kafka-25385-bfae1e62ce7340a9-84d4c4899c071b15-2083306, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 1
W20240601 10:20:07.247098 42561 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=5354379612124c9d-b6a13d1601055fd7, job_id=384863, txn_id=2083311, label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, elapse(s)=30
I20240601 10:20:07.247352 42561 routine_load_task_executor.cpp:262] finished routine load task id=5354379612124c9d-b6a13d1601055fd7, job_id=384863, txn_id=2083311, label=ott_ias_sessions_kafka-384863-5354379612124c9d-b6a13d1601055fd7-2083311, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 0
I20240601 10:20:07.247414 42561 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1134ms in state CONNECT)
W20240601 10:20:07.959829 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:20:10.757376 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264715597004 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264715597004 Bytes.];[/data5/storage/wal: limit 279282274713 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282274713 Bytes.];[/data6/storage/wal: limit 277836649676 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277836649676 Bytes.];
I20240601 10:20:13.359206 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:20:13.359239 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:20:13.359261 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:20:13.359266 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:20:13.359274 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:20:13.359279 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:20:13.359287 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:20:13.359290 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:20:15.712335 43906 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:20:16.603953 44217 tablets_channel.cpp:134] open tablets channel: (load_id=80b6b2f1ff4e4f13-b30d4a11e99778eb, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:20:16.607450 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=b4ac8ec80eee45f9-80be8c07a95cd827, job_id=25716, txn_id=2083318, label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, elapse(s)=0, current tasks num: 1
I20240601 10:20:16.607460 42564 routine_load_task_executor.cpp:290] begin to execute routine load task: id=b4ac8ec80eee45f9-80be8c07a95cd827, job_id=25716, txn_id=2083318, label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, elapse(s)=0
I20240601 10:20:16.607758 42564 data_consumer_pool.cpp:103] get consumer group 0b41086f7419440a-dd153d22e8c6a8b9 with 2 consumers
I20240601 10:20:16.607792 42564 data_consumer.cpp:169] consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 0b41086f7419440a-dd153d22e8c6a8b9 assign topic partitions: ott-rr, [3: -1] 
I20240601 10:20:16.607836 42564 data_consumer.cpp:169] consumer: 874e44f576bc1a40-9f9c469aee9b4a82, grp: 0b41086f7419440a-dd153d22e8c6a8b9 assign topic partitions: ott-rr, [8: -1] 
I20240601 10:20:16.607874 42564 stream_load_executor.cpp:71] begin to execute stream load. label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, txn_id=2083318, query_id=0-0
I20240601 10:20:16.607993 42564 fragment_mgr.cpp:636] query_id: b4ac8ec80eee45f9-80be8c07a95cd827 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:16.608013 42564 fragment_mgr.cpp:661] Query/load id: b4ac8ec80eee45f9-80be8c07a95cd827, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:16.608054 42564 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: b4ac8ec80eee45f9-80be8c07a95cd827 limit: 0
I20240601 10:20:16.608125 42564 pipeline_fragment_context.cpp:244] Preparing instance b4ac8ec80eee45f9-80be8c07a95cd827|b4ac8ec80eee45f9-80be8c07a95cd828, backend_num 0
I20240601 10:20:16.608868 42564 data_consumer_group.cpp:108] start consumer group: 0b41086f7419440a-dd153d22e8c6a8b9. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=b4ac8ec80eee45f9-80be8c07a95cd827, job_id=25716, txn_id=2083318, label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, elapse(s)=0
I20240601 10:20:16.608932 10045 data_consumer.cpp:194] start kafka consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 0b41086f7419440a-dd153d22e8c6a8b9, max running time(ms): 30000
I20240601 10:20:16.608963 10046 data_consumer.cpp:194] start kafka consumer: 874e44f576bc1a40-9f9c469aee9b4a82, grp: 0b41086f7419440a-dd153d22e8c6a8b9, max running time(ms): 30000
I20240601 10:20:16.610173 44122 tablets_channel.cpp:134] open tablets channel: (load_id=b4ac8ec80eee45f9-80be8c07a95cd827, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:20:16.615330 44042 tablets_channel.cpp:134] open tablets channel: (load_id=fb035e1c6eee4bd9-ae9ce70cd9598960, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:20:16.619074 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=6f00afe687e14d0d-8d10698cfcd1cc94, job_id=25716, txn_id=2083320, label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, elapse(s)=0, current tasks num: 2
I20240601 10:20:16.619109 42567 routine_load_task_executor.cpp:290] begin to execute routine load task: id=6f00afe687e14d0d-8d10698cfcd1cc94, job_id=25716, txn_id=2083320, label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, elapse(s)=0
I20240601 10:20:16.619294 42567 data_consumer_pool.cpp:103] get consumer group f1424758ff9ee70b-91acca07e86c33ad with 2 consumers
I20240601 10:20:16.619310 42567 data_consumer.cpp:169] consumer: 2241ee10c66d49c4-3e61fbc6333d9e88, grp: f1424758ff9ee70b-91acca07e86c33ad assign topic partitions: ott-rr, [2: -1] 
I20240601 10:20:16.619349 42567 data_consumer.cpp:169] consumer: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: f1424758ff9ee70b-91acca07e86c33ad assign topic partitions: ott-rr, [7: -1] 
I20240601 10:20:16.619414 42567 stream_load_executor.cpp:71] begin to execute stream load. label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, txn_id=2083320, query_id=0-0
I20240601 10:20:16.619503 42567 fragment_mgr.cpp:636] query_id: 6f00afe687e14d0d-8d10698cfcd1cc94 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:16.619525 42567 fragment_mgr.cpp:661] Query/load id: 6f00afe687e14d0d-8d10698cfcd1cc94, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:16.619552 42567 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 6f00afe687e14d0d-8d10698cfcd1cc94 limit: 0
I20240601 10:20:16.619571 42567 pipeline_fragment_context.cpp:244] Preparing instance 6f00afe687e14d0d-8d10698cfcd1cc94|6f00afe687e14d0d-8d10698cfcd1cc95, backend_num 0
I20240601 10:20:16.620157 42567 data_consumer_group.cpp:108] start consumer group: f1424758ff9ee70b-91acca07e86c33ad. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=6f00afe687e14d0d-8d10698cfcd1cc94, job_id=25716, txn_id=2083320, label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, elapse(s)=0
I20240601 10:20:16.620229 10047 data_consumer.cpp:194] start kafka consumer: 2241ee10c66d49c4-3e61fbc6333d9e88, grp: f1424758ff9ee70b-91acca07e86c33ad, max running time(ms): 30000
I20240601 10:20:16.620266 10048 data_consumer.cpp:194] start kafka consumer: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: f1424758ff9ee70b-91acca07e86c33ad, max running time(ms): 30000
I20240601 10:20:16.621508 44033 tablets_channel.cpp:134] open tablets channel: (load_id=6f00afe687e14d0d-8d10698cfcd1cc94, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:20:16.629160 44192 tablets_channel.cpp:134] open tablets channel: (load_id=c249d7e14aed4e07-b705983076eae244, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:20:17.102900 43933 tablets_channel.cpp:226] close tablets channel: (load_id=80b6b2f1ff4e4f13-b30d4a11e99778eb, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:20:17.103313 43933 load_channel.cpp:55] load channel removed load_id=80b6b2f1ff4e4f13-b30d4a11e99778eb, is high priority=1, sender_ip=225.225.225.2, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:17.108705 10046 data_consumer.cpp:253] consumer meet partition eof: 874e44f576bc1a40-9f9c469aee9b4a82 partition offset: 0
I20240601 10:20:17.108737 10046 data_consumer.cpp:274] kafka consumer done: 874e44f576bc1a40-9f9c469aee9b4a82, grp: 0b41086f7419440a-dd153d22e8c6a8b9. cancelled: 0, left time(ms): 29501, total cost(ms): 499, consume cost(ms): 499, received rows: 0, put rows: 0
I20240601 10:20:17.108738 10045 data_consumer.cpp:253] consumer meet partition eof: 284f78dce6aa57fa-a67ebfcab4715bbd partition offset: 0
I20240601 10:20:17.108772 10045 data_consumer.cpp:274] kafka consumer done: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 0b41086f7419440a-dd153d22e8c6a8b9. cancelled: 0, left time(ms): 29501, total cost(ms): 499, consume cost(ms): 499, received rows: 0, put rows: 0
I20240601 10:20:17.108784 10045 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 0b41086f7419440a-dd153d22e8c6a8b9
I20240601 10:20:17.108798 42564 data_consumer_group.cpp:128] consumer group done: 0b41086f7419440a-dd153d22e8c6a8b9. consume time(ms)=499, received rows=0, received bytes=0, eos: 1, left_time: 29501, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 499905, blocking put time(us): 0, id=b4ac8ec80eee45f9-80be8c07a95cd827, job_id=25716, txn_id=2083318, label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, elapse(s)=0
I20240601 10:20:17.108829 42564 data_consumer.cpp:417] kafka consumer cancelled. 284f78dce6aa57fa-a67ebfcab4715bbd
I20240601 10:20:17.108837 42564 data_consumer.cpp:417] kafka consumer cancelled. 874e44f576bc1a40-9f9c469aee9b4a82
I20240601 10:20:17.109037  3556 vtablet_writer.cpp:963] VNodeChannel[25388-10006], load_id=b4ac8ec80eee45f9-80be8c07a95cd827, txn_id=2083318, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:17.109067  3556 vtablet_writer.cpp:963] VNodeChannel[25388-10005], load_id=b4ac8ec80eee45f9-80be8c07a95cd827, txn_id=2083318, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:17.109297 43846 tablets_channel.cpp:226] close tablets channel: (load_id=b4ac8ec80eee45f9-80be8c07a95cd827, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:20:17.109843 43846 load_channel.cpp:55] load channel removed load_id=b4ac8ec80eee45f9-80be8c07a95cd827, is high priority=1, sender_ip=225.225.225.3, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:17.110224 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. b4ac8ec80eee45f9-80be8c07a95cd827
I20240601 10:20:17.111189  3556 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=82695, load id=b4ac8ec80eee45f9-80be8c07a95cd827
I20240601 10:20:17.111213  3556 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=b4ac8ec80eee45f9-80be8c07a95cd827, txn_id=2083318, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(0)(0)(2)(1)} {10006:(1)(0)(2)(1)} 
I20240601 10:20:17.111390 50821 fragment_mgr.cpp:588] Removing query b4ac8ec80eee45f9-80be8c07a95cd827 instance b4ac8ec80eee45f9-80be8c07a95cd828, all done? true
I20240601 10:20:17.111414 50821 fragment_mgr.cpp:594] Query b4ac8ec80eee45f9-80be8c07a95cd827 finished
I20240601 10:20:17.111480 50821 stream_load_executor.cpp:152] finished to execute stream load. label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, txn_id=2083318, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=503
I20240601 10:20:17.111899 50821 query_context.cpp:114] Query b4ac8ec80eee45f9-80be8c07a95cd827 deconstructed, , deregister query/load memory tracker, queryId=b4ac8ec80eee45f9-80be8c07a95cd827, Limit=2.00 GB, CurrUsed=512.00 KB, PeakUsed=555.09 KB
I20240601 10:20:17.116103 43989 tablets_channel.cpp:226] close tablets channel: (load_id=fb035e1c6eee4bd9-ae9ce70cd9598960, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:20:17.116478 43989 load_channel.cpp:55] load channel removed load_id=fb035e1c6eee4bd9-ae9ce70cd9598960, is high priority=1, sender_ip=225.225.225.2, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:17.120378 10048 data_consumer.cpp:253] consumer meet partition eof: 0746d3fd9f19d3ec-23ac73dbfd8a5589 partition offset: 0
I20240601 10:20:17.120404 10048 data_consumer.cpp:274] kafka consumer done: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: f1424758ff9ee70b-91acca07e86c33ad. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:20:17.120972 10047 data_consumer.cpp:253] consumer meet partition eof: 2241ee10c66d49c4-3e61fbc6333d9e88 partition offset: 0
I20240601 10:20:17.120996 10047 data_consumer.cpp:274] kafka consumer done: 2241ee10c66d49c4-3e61fbc6333d9e88, grp: f1424758ff9ee70b-91acca07e86c33ad. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:20:17.121007 10047 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: f1424758ff9ee70b-91acca07e86c33ad
I20240601 10:20:17.121017 42567 data_consumer_group.cpp:128] consumer group done: f1424758ff9ee70b-91acca07e86c33ad. consume time(ms)=500, received rows=0, received bytes=0, eos: 1, left_time: 29500, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 500840, blocking put time(us): 0, id=6f00afe687e14d0d-8d10698cfcd1cc94, job_id=25716, txn_id=2083320, label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, elapse(s)=0
I20240601 10:20:17.121047 42567 data_consumer.cpp:417] kafka consumer cancelled. 2241ee10c66d49c4-3e61fbc6333d9e88
I20240601 10:20:17.121055 42567 data_consumer.cpp:417] kafka consumer cancelled. 0746d3fd9f19d3ec-23ac73dbfd8a5589
I20240601 10:20:17.121246 10049 vtablet_writer.cpp:963] VNodeChannel[25388-10006], load_id=6f00afe687e14d0d-8d10698cfcd1cc94, txn_id=2083320, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:17.121268 10049 vtablet_writer.cpp:963] VNodeChannel[25388-10005], load_id=6f00afe687e14d0d-8d10698cfcd1cc94, txn_id=2083320, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:17.121389 43918 tablets_channel.cpp:226] close tablets channel: (load_id=6f00afe687e14d0d-8d10698cfcd1cc94, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:20:17.121745 43918 load_channel.cpp:55] load channel removed load_id=6f00afe687e14d0d-8d10698cfcd1cc94, is high priority=1, sender_ip=225.225.225.3, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:17.122418 44410 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 6f00afe687e14d0d-8d10698cfcd1cc94
I20240601 10:20:17.123394 10049 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=49621, load id=6f00afe687e14d0d-8d10698cfcd1cc94
I20240601 10:20:17.123416 10049 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=6f00afe687e14d0d-8d10698cfcd1cc94, txn_id=2083320, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(0)(0)(2)(1)} {10006:(0)(0)(1)(1)} 
I20240601 10:20:17.123579 50816 fragment_mgr.cpp:588] Removing query 6f00afe687e14d0d-8d10698cfcd1cc94 instance 6f00afe687e14d0d-8d10698cfcd1cc95, all done? true
I20240601 10:20:17.123625 50816 fragment_mgr.cpp:594] Query 6f00afe687e14d0d-8d10698cfcd1cc94 finished
I20240601 10:20:17.123641 50816 stream_load_executor.cpp:152] finished to execute stream load. label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, txn_id=2083320, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=504
I20240601 10:20:17.123998 50816 query_context.cpp:114] Query 6f00afe687e14d0d-8d10698cfcd1cc94 deconstructed, , deregister query/load memory tracker, queryId=6f00afe687e14d0d-8d10698cfcd1cc94, Limit=2.00 GB, CurrUsed=512.00 KB, PeakUsed=555.09 KB
I20240601 10:20:17.139014 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083317
I20240601 10:20:17.189661 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083319
I20240601 10:20:17.214581 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083318
I20240601 10:20:17.239969 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083320
I20240601 10:20:17.630118 44013 tablets_channel.cpp:226] close tablets channel: (load_id=c249d7e14aed4e07-b705983076eae244, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:20:17.630704 44013 load_channel.cpp:55] load channel removed load_id=c249d7e14aed4e07-b705983076eae244, is high priority=1, sender_ip=225.225.225.2, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:17.656620 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083321
I20240601 10:20:20.252388 89401 heartbeat_server.cpp:61] get heartbeat from FE.host:225.225.225.2, port:9020, cluster id:875414020, frontend_info:TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.2, port=9020), process_uuid=1716195276797) TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.3, port=9020), process_uuid=1716195357252) TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) , counter:123193, BE start time: 1715945768527
W20240601 10:20:20.252513 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:20:20.363775 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:20:20.785907 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264715592499 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264715592499 Bytes.];[/data5/storage/wal: limit 279282269388 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282269388 Bytes.];[/data6/storage/wal: limit 277836329369 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277836329369 Bytes.];
I20240601 10:20:21.962479 43743 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083235, version=48299, num_rows=0, res=[OK], cost: 106877011(us) [Publish Statistics: schedule time(us): 26, lock wait time(us): 1, save meta time(us): 50620, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106826356]
I20240601 10:20:21.962684 43734 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083247, version=48301, num_rows=0, res=[OK], cost: 106842013(us) [Publish Statistics: schedule time(us): 34, lock wait time(us): 1, save meta time(us): 48593, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106793378]
I20240601 10:20:21.964177 43759 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083236, version=48300, num_rows=0, res=[OK], cost: 106845091(us) [Publish Statistics: schedule time(us): 86, lock wait time(us): 1, save meta time(us): 50164, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106794829]
I20240601 10:20:21.964375 43758 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083249, version=48303, num_rows=0, res=[OK], cost: 106843557(us) [Publish Statistics: schedule time(us): 89207, lock wait time(us): 1, save meta time(us): 84632, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106669704]
I20240601 10:20:21.964592 43739 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083248, version=48302, num_rows=0, res=[OK], cost: 106843751(us) [Publish Statistics: schedule time(us): 89307, lock wait time(us): 1, save meta time(us): 84515, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106669911]
I20240601 10:20:21.964787 43737 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083250, version=48304, num_rows=0, res=[OK], cost: 106843896(us) [Publish Statistics: schedule time(us): 267546, lock wait time(us): 1, save meta time(us): 65175, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106511159]
I20240601 10:20:21.965010 43742 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083251, version=48305, num_rows=0, res=[OK], cost: 106844110(us) [Publish Statistics: schedule time(us): 319643, lock wait time(us): 1, save meta time(us): 46498, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106477946]
I20240601 10:20:21.965209 43750 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083262, version=48306, num_rows=0, res=[OK], cost: 106841239(us) [Publish Statistics: schedule time(us): 430134, lock wait time(us): 3, save meta time(us): 66902, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 106344181]
I20240601 10:20:22.037191 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 340
I20240601 10:20:22.037623 43681 storage_engine.cpp:1110] collected 0 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:20:22.037635 43681 storage_engine.cpp:1126] removed all collected unused rowsets
I20240601 10:20:25.726776 43863 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:20:25.740330 43993 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:20:30.813851 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707389849 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707389849 Bytes.];[/data5/storage/wal: limit 279282264064 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279282264064 Bytes.];[/data6/storage/wal: limit 277836003328 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277836003328 Bytes.];
W20240601 10:20:32.549427 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
W20240601 10:20:34.191140 44715 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=80410c4f9538a558-236a12f342811888, job_id=-1, txn_id=2083312, label=6a50529a-41c8-4812-a041-3cf56cd48c99, elapse(s)=31
W20240601 10:20:34.460004 44704 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=e442d93fa6cffe1f-b313ebfce0719bb1, job_id=-1, txn_id=2083314, label=c187740f-e3cc-4687-8ce8-9465b0bc4688, elapse(s)=30
I20240601 10:20:35.288463 44039 tablets_channel.cpp:134] open tablets channel: (load_id=6841906169a07338-852a1d57a43857af, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:35.378253 43851 tablets_channel.cpp:226] close tablets channel: (load_id=6841906169a07338-852a1d57a43857af, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:35.508630 44704 stream_load.cpp:198] new income streaming load request.id=9a4349e1dd9325b5-cacc9b140cacc98d, job_id=-1, txn_id=-1, label=ffe24dee-6b7a-462b-97a4-1c58311d22e6, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:20:35.536499 44704 stream_load_executor.cpp:71] begin to execute stream load. label=ffe24dee-6b7a-462b-97a4-1c58311d22e6, txn_id=2083323, query_id=0-0
I20240601 10:20:35.536685 44704 fragment_mgr.cpp:636] query_id: 9a4349e1dd9325b5-cacc9b140cacc98d coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:35.536705 44704 fragment_mgr.cpp:661] Query/load id: 9a4349e1dd9325b5-cacc9b140cacc98d, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:35.536726 44704 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 9a4349e1dd9325b5-cacc9b140cacc98d limit: 0
I20240601 10:20:35.536749 44704 pipeline_fragment_context.cpp:244] Preparing instance 9a4349e1dd9325b5-cacc9b140cacc98d|9a4349e1dd9325b5-cacc9b140cacc98e, backend_num 0
I20240601 10:20:35.540230 44704 stream_load.cpp:204] finished to handle HTTP header, id=9a4349e1dd9325b5-cacc9b140cacc98d, job_id=-1, txn_id=2083323, label=ffe24dee-6b7a-462b-97a4-1c58311d22e6, elapse(s)=0
I20240601 10:20:35.546994 44095 tablets_channel.cpp:134] open tablets channel: (load_id=9a4349e1dd9325b5-cacc9b140cacc98d, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:35.630976 10049 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=9a4349e1dd9325b5-cacc9b140cacc98d, txn_id=2083323, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:35.631031 10049 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=9a4349e1dd9325b5-cacc9b140cacc98d, txn_id=2083323, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:35.637859 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 9a4349e1dd9325b5-cacc9b140cacc98d
I20240601 10:20:35.641152 43832 tablets_channel.cpp:226] close tablets channel: (load_id=9a4349e1dd9325b5-cacc9b140cacc98d, index_id=487076), sender id: 0, backend id: 10006
W20240601 10:20:35.838860 44711 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=4e4335d504747a2b-792ae5690c73699b, job_id=-1, txn_id=2083316, label=d453b47c-6d77-428e-a03f-6f14a7f2c8e6, elapse(s)=31
I20240601 10:20:35.886726 44101 tablets_channel.cpp:134] open tablets channel: (load_id=90469ebcd0f9454b-785a4bfd96908bb0, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:35.988373 43885 tablets_channel.cpp:226] close tablets channel: (load_id=90469ebcd0f9454b-785a4bfd96908bb0, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:36.040568 43851 load_channel.cpp:55] load channel removed load_id=6841906169a07338-852a1d57a43857af, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:36.080220 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083322
I20240601 10:20:36.291253 43832 load_channel.cpp:55] load channel removed load_id=9a4349e1dd9325b5-cacc9b140cacc98d, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:36.296006 10049 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=6967396, load id=9a4349e1dd9325b5-cacc9b140cacc98d
I20240601 10:20:36.296037 10049 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=9a4349e1dd9325b5-cacc9b140cacc98d, txn_id=2083323, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(68)(0)(664)(1)} {10006:(658)(0)(665)(1)} 
I20240601 10:20:36.296471 50819 fragment_mgr.cpp:588] Removing query 9a4349e1dd9325b5-cacc9b140cacc98d instance 9a4349e1dd9325b5-cacc9b140cacc98e, all done? true
I20240601 10:20:36.296499 50819 fragment_mgr.cpp:594] Query 9a4349e1dd9325b5-cacc9b140cacc98d finished
I20240601 10:20:36.296522 50819 stream_load_executor.cpp:152] finished to execute stream load. label=ffe24dee-6b7a-462b-97a4-1c58311d22e6, txn_id=2083323, query_id=0-0, receive_data_cost_ms=65, read_data_cost_ms=2, write_data_cost_ms=760
I20240601 10:20:36.297808 50819 query_context.cpp:114] Query 9a4349e1dd9325b5-cacc9b140cacc98d deconstructed, , deregister query/load memory tracker, queryId=9a4349e1dd9325b5-cacc9b140cacc98d, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:20:36.321847 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083323
I20240601 10:20:36.534353 44715 stream_load.cpp:198] new income streaming load request.id=d94c427b3e697457-9812351838e415a9, job_id=-1, txn_id=-1, label=035317fc-1419-4440-a4a0-6e764161fa47, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:20:36.549933 44715 stream_load_executor.cpp:71] begin to execute stream load. label=035317fc-1419-4440-a4a0-6e764161fa47, txn_id=2083325, query_id=0-0
I20240601 10:20:36.550094 44715 fragment_mgr.cpp:636] query_id: d94c427b3e697457-9812351838e415a9 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:36.550122 44715 fragment_mgr.cpp:661] Query/load id: d94c427b3e697457-9812351838e415a9, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:36.550148 44715 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: d94c427b3e697457-9812351838e415a9 limit: 0
I20240601 10:20:36.550171 44715 pipeline_fragment_context.cpp:244] Preparing instance d94c427b3e697457-9812351838e415a9|d94c427b3e697457-9812351838e415aa, backend_num 0
I20240601 10:20:36.553874 44715 stream_load.cpp:204] finished to handle HTTP header, id=d94c427b3e697457-9812351838e415a9, job_id=-1, txn_id=2083325, label=035317fc-1419-4440-a4a0-6e764161fa47, elapse(s)=0
I20240601 10:20:36.558343 44073 tablets_channel.cpp:134] open tablets channel: (load_id=d94c427b3e697457-9812351838e415a9, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:36.650686 10049 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=d94c427b3e697457-9812351838e415a9, txn_id=2083325, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:36.650784 10049 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=d94c427b3e697457-9812351838e415a9, txn_id=2083325, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:36.654929 44531 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. d94c427b3e697457-9812351838e415a9
I20240601 10:20:36.660099 43840 tablets_channel.cpp:226] close tablets channel: (load_id=d94c427b3e697457-9812351838e415a9, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:36.699759 43885 load_channel.cpp:55] load channel removed load_id=90469ebcd0f9454b-785a4bfd96908bb0, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:36.739363 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083324
I20240601 10:20:36.949723 44248 tablets_channel.cpp:134] open tablets channel: (load_id=834e36192905cffe-b04db1b09aec3a9a, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:20:37.033192 43999 tablets_channel.cpp:226] close tablets channel: (load_id=834e36192905cffe-b04db1b09aec3a9a, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:20:37.146565 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:20:37.146636 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:20:37.146672 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:20:37.146677 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:20:37.146692 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:20:37.146698 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:20:37.146705 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:20:37.146714 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:20:37.251175 43840 load_channel.cpp:55] load channel removed load_id=d94c427b3e697457-9812351838e415a9, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:37.254985 10049 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=4395527, load id=d94c427b3e697457-9812351838e415a9
I20240601 10:20:37.255012 10049 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=d94c427b3e697457-9812351838e415a9, txn_id=2083325, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(66)(0)(604)(1)} {10006:(598)(0)(604)(1)} 
I20240601 10:20:37.255416 50820 fragment_mgr.cpp:588] Removing query d94c427b3e697457-9812351838e415a9 instance d94c427b3e697457-9812351838e415aa, all done? true
I20240601 10:20:37.255439 50820 fragment_mgr.cpp:594] Query d94c427b3e697457-9812351838e415a9 finished
I20240601 10:20:37.255460 50820 stream_load_executor.cpp:152] finished to execute stream load. label=035317fc-1419-4440-a4a0-6e764161fa47, txn_id=2083325, query_id=0-0, receive_data_cost_ms=55, read_data_cost_ms=2, write_data_cost_ms=705
I20240601 10:20:37.256793 50820 query_context.cpp:114] Query d94c427b3e697457-9812351838e415a9 deconstructed, , deregister query/load memory tracker, queryId=d94c427b3e697457-9812351838e415a9, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:20:37.280596 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083325
I20240601 10:20:37.645118 43999 load_channel.cpp:55] load channel removed load_id=834e36192905cffe-b04db1b09aec3a9a, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:20:37.672590 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083326
I20240601 10:20:38.874938 43411 load_channel_mgr.cpp:224] cleaning timed out load channels
I20240601 10:20:40.375627 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:20:40.844663 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707375923 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707375923 Bytes.];[/data5/storage/wal: limit 279281446092 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279281446092 Bytes.];[/data6/storage/wal: limit 277835722752 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277835722752 Bytes.];
I20240601 10:20:44.079288 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:20:44.079320 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:20:44.079344 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:20:44.079350 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:20:44.079360 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:20:44.079365 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:20:44.079372 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:20:44.079376 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:20:44.829241 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:20:45.783103 43886 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
W20240601 10:20:47.112633 42564 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=b4ac8ec80eee45f9-80be8c07a95cd827, job_id=25716, txn_id=2083318, label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, elapse(s)=30
I20240601 10:20:47.112850 42564 routine_load_task_executor.cpp:262] finished routine load task id=b4ac8ec80eee45f9-80be8c07a95cd827, job_id=25716, txn_id=2083318, label=rr_service_kafka-25716-b4ac8ec80eee45f9-80be8c07a95cd827-2083318, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 1
W20240601 10:20:47.124956 42567 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=6f00afe687e14d0d-8d10698cfcd1cc94, job_id=25716, txn_id=2083320, label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, elapse(s)=30
I20240601 10:20:47.125098 42567 routine_load_task_executor.cpp:262] finished routine load task id=6f00afe687e14d0d-8d10698cfcd1cc94, job_id=25716, txn_id=2083320, label=rr_service_kafka-25716-6f00afe687e14d0d-8d10698cfcd1cc94-2083320, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 0
I20240601 10:20:49.351758 43760 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083235, version=48299, num_rows=0, res=[OK], cost: 134266302(us) [Publish Statistics: schedule time(us): 37, lock wait time(us): 6, save meta time(us): 89347, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 134176899]
I20240601 10:20:49.352030 43748 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083247, version=48301, num_rows=0, res=[OK], cost: 134231387(us) [Publish Statistics: schedule time(us): 51, lock wait time(us): 1, save meta time(us): 87714, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 134143612]
I20240601 10:20:49.352790 43752 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083236, version=48300, num_rows=0, res=[OK], cost: 134233711(us) [Publish Statistics: schedule time(us): 49, lock wait time(us): 1, save meta time(us): 89294, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 134144358]
I20240601 10:20:49.352982 43754 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083249, version=48303, num_rows=0, res=[OK], cost: 134232174(us) [Publish Statistics: schedule time(us): 49697, lock wait time(us): 0, save meta time(us): 37898, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 134144558]
I20240601 10:20:49.353062 43801 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083249, cost(us): 134232374, error_tablet_size=0, res=[OK]
I20240601 10:20:49.353116 43801 task_worker_pool.cpp:1589] successfully publish version|signature=2083249|transaction_id=2083249|tablets_num=10|cost(s)=204
W20240601 10:20:49.353264 43701 cumulative_compaction.cpp:113] There are missed versions among rowsets. prev rowset verison=[48301-48301], next rowset version=[48303-48303], tablet=557607
I20240601 10:20:49.353396 43733 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083248, version=48302, num_rows=0, res=[OK], cost: 134232563(us) [Publish Statistics: schedule time(us): 88931, lock wait time(us): 1, save meta time(us): 258032, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 133885588]
I20240601 10:20:49.353610 43749 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083251, version=48305, num_rows=0, res=[OK], cost: 134232712(us) [Publish Statistics: schedule time(us): 319313, lock wait time(us): 2, save meta time(us): 69386, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 133843990]
I20240601 10:20:49.353811 43756 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083262, version=48306, num_rows=0, res=[OK], cost: 134229845(us) [Publish Statistics: schedule time(us): 397423, lock wait time(us): 1, save meta time(us): 138677, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 133693729]
W20240601 10:20:49.353941 43682 tablet.cpp:747] tablet:557607, missed version for version:48306
W20240601 10:20:49.353971 43682 tablet.cpp:1273] 557607 has 1 missed version:[48304-48304],
I20240601 10:20:49.354234 43747 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083250, version=48304, num_rows=0, res=[OK], cost: 134233346(us) [Publish Statistics: schedule time(us): 174479, lock wait time(us): 1, save meta time(us): 172388, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 133886461]
I20240601 10:20:49.354682 43688 compaction.cpp:207] start to do ordered data compaction, tablet=557607, output_version=[2-48301]
I20240601 10:20:49.387466 43797 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083235, cost(us): 134302108, error_tablet_size=0, res=[OK]
I20240601 10:20:49.387471 43800 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083236, cost(us): 134268525, error_tablet_size=0, res=[OK]
I20240601 10:20:49.387522 43804 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083250, cost(us): 134266795, error_tablet_size=0, res=[OK]
I20240601 10:20:49.387501 43803 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083262, cost(us): 134263659, error_tablet_size=0, res=[OK]
I20240601 10:20:49.387544 43799 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083247, cost(us): 134267033, error_tablet_size=0, res=[OK]
I20240601 10:20:49.387547 43797 task_worker_pool.cpp:1589] successfully publish version|signature=2083235|transaction_id=2083235|tablets_num=10|cost(s)=235
I20240601 10:20:49.387501 43802 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083248, cost(us): 134266952, error_tablet_size=0, res=[OK]
I20240601 10:20:49.387547 43800 task_worker_pool.cpp:1589] successfully publish version|signature=2083236|transaction_id=2083236|tablets_num=10|cost(s)=235
I20240601 10:20:49.387622 43803 task_worker_pool.cpp:1589] successfully publish version|signature=2083262|transaction_id=2083262|tablets_num=10|cost(s)=173
I20240601 10:20:49.387567 43798 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083251, cost(us): 134266839, error_tablet_size=0, res=[OK]
I20240601 10:20:49.387621 43804 task_worker_pool.cpp:1589] successfully publish version|signature=2083250|transaction_id=2083250|tablets_num=10|cost(s)=203
I20240601 10:20:49.387640 43799 task_worker_pool.cpp:1589] successfully publish version|signature=2083247|transaction_id=2083247|tablets_num=10|cost(s)=205
I20240601 10:20:49.387725 43798 task_worker_pool.cpp:1589] successfully publish version|signature=2083251|transaction_id=2083251|tablets_num=10|cost(s)=203
I20240601 10:20:49.387658 43802 task_worker_pool.cpp:1589] successfully publish version|signature=2083248|transaction_id=2083248|tablets_num=10|cost(s)=204
I20240601 10:20:49.388111 43799 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083271, cost(us): 22, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388134 43799 task_worker_pool.cpp:1589] successfully publish version|signature=2083271|transaction_id=2083271|tablets_num=0|cost(s)=153
I20240601 10:20:49.388132 43804 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083268, cost(us): 35, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388124 43798 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083274, cost(us): 43, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388177 43800 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083272, cost(us): 28, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388193 43798 task_worker_pool.cpp:1589] successfully publish version|signature=2083274|transaction_id=2083274|tablets_num=0|cost(s)=153
I20240601 10:20:49.388180 43804 task_worker_pool.cpp:1589] successfully publish version|signature=2083268|transaction_id=2083268|tablets_num=0|cost(s)=153
I20240601 10:20:49.388231 43800 task_worker_pool.cpp:1589] successfully publish version|signature=2083272|transaction_id=2083272|tablets_num=0|cost(s)=153
I20240601 10:20:49.388535 43800 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083273, cost(us): 18, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388537 43804 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083267, cost(us): 25, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388573 43800 task_worker_pool.cpp:1589] successfully publish version|signature=2083273|transaction_id=2083273|tablets_num=0|cost(s)=153
I20240601 10:20:49.388589 43799 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083270, cost(us): 13, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388630 43798 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083269, cost(us): 17, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388640 43799 task_worker_pool.cpp:1589] successfully publish version|signature=2083270|transaction_id=2083270|tablets_num=0|cost(s)=152
I20240601 10:20:49.388635 43804 task_worker_pool.cpp:1589] successfully publish version|signature=2083267|transaction_id=2083267|tablets_num=0|cost(s)=152
I20240601 10:20:49.388651 43798 task_worker_pool.cpp:1589] successfully publish version|signature=2083269|transaction_id=2083269|tablets_num=0|cost(s)=152
I20240601 10:20:49.388911 43800 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083275, cost(us): 14, error_tablet_size=0, res=[OK]
I20240601 10:20:49.388928 43800 task_worker_pool.cpp:1589] successfully publish version|signature=2083275|transaction_id=2083275|tablets_num=0|cost(s)=152
I20240601 10:20:49.388999 43804 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083276, cost(us): 11, error_tablet_size=0, res=[OK]
I20240601 10:20:49.389012 43804 task_worker_pool.cpp:1589] successfully publish version|signature=2083276|transaction_id=2083276|tablets_num=0|cost(s)=152
I20240601 10:20:49.393460 43754 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 39948(us) 
I20240601 10:20:49.397465 43733 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 43963(us) 
I20240601 10:20:49.397462 43748 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 43936(us) 
I20240601 10:20:49.397799 43755 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 44249(us) 
I20240601 10:20:49.408886 43752 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 55366(us) 
I20240601 10:20:49.422791 43741 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 34716(us) 
I20240601 10:20:49.422797 43742 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 34638(us) 
I20240601 10:20:49.422861 43745 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 34897(us) 
I20240601 10:20:49.422883 43756 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 34891(us) 
I20240601 10:20:49.422930 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 34834(us) 
I20240601 10:20:49.423210 43739 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 35005(us) 
I20240601 10:20:49.423426 43761 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 35414(us) 
I20240601 10:20:49.435461 43743 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 47381(us) 
I20240601 10:20:49.435650 43740 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 47539(us) 
I20240601 10:20:49.435824 43751 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 47851(us) 
I20240601 10:20:49.447795 43733 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 59223(us) 
I20240601 10:20:49.448140 43752 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 59565(us) 
I20240601 10:20:49.450683 43754 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 62117(us) 
I20240601 10:20:49.450752 43735 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 62768(us) 
I20240601 10:20:49.451297 43753 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 63128(us) 
I20240601 10:20:49.472944 43756 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 83910(us) 
I20240601 10:20:49.472944 43761 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 83904(us) 
I20240601 10:20:49.473284 43751 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 84241(us) 
I20240601 10:20:49.477655 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 88606(us) 
I20240601 10:20:49.498173 43735 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 109058(us) 
I20240601 10:20:49.501336 43760 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 147793(us) 
I20240601 10:20:49.501538 43747 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 113529(us) 
I20240601 10:20:49.501736 43750 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 113552(us) 
I20240601 10:20:49.501793 43755 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 113218(us) 
I20240601 10:20:49.502051 43689 compaction.cpp:207] start to do ordered data compaction, tablet=557610, output_version=[2-48307]
I20240601 10:20:49.502249 43690 compaction.cpp:207] start to do ordered data compaction, tablet=557604, output_version=[2-48311]
I20240601 10:20:49.542685 43739 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 153646(us) 
I20240601 10:20:49.542742 43756 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 153626(us) 
I20240601 10:20:49.548383 43755 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 159128(us) 
I20240601 10:20:49.616953 43690 compaction.cpp:327] succeed to do ordered data cumulative compaction. tablet=557604, output_version=[2-48311], disk=/data5/storage, segments=0, input_row_num=0, output_row_num=0, input_rowset_size=0, output_rowset_size=0. elapsed time=0.114877s. cumulative_compaction_policy=size_based
I20240601 10:20:49.617180 43761 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 228059(us) 
I20240601 10:20:49.634583 43689 compaction.cpp:327] succeed to do ordered data cumulative compaction. tablet=557610, output_version=[2-48307], disk=/data4/storage, segments=0, input_row_num=0, output_row_num=0, input_rowset_size=0, output_rowset_size=0. elapsed time=0.132704s. cumulative_compaction_policy=size_based
I20240601 10:20:49.634682 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 245560(us) 
I20240601 10:20:49.634737 43740 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 245679(us) 
I20240601 10:20:49.648809 43755 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 259549(us) 
I20240601 10:20:49.676406 43756 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 287148(us) 
I20240601 10:20:49.691375 43735 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 302249(us) 
I20240601 10:20:49.691574 48594 olap_meta.cpp:73] [Rocksdb] [db/db_impl_write.cc:1370] [meta] New memtable created with log file: #3734. Immutable memtables: 0.
I20240601 10:20:49.718142 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 328876(us) 
I20240601 10:20:49.723978 43642 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:20:49.691697) [db/db_impl_compaction_flush.cc:1417] Calling FlushMemTableToOutputFile with column family [meta], flush slots available 4, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0
I20240601 10:20:49.723994 43642 olap_meta.cpp:73] [Rocksdb] [db/flush_job.cc:298] [meta] [JOB 2070] Flushing memtable with next log file: 3734
I20240601 10:20:49.724015 43642 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208449724007, "job": 2070, "event": "flush_started", "num_memtables": 1, "num_entries": 5069, "num_deletes": 4938, "memory_usage": 33675456, "flush_reason": "Write Buffer Full"}
I20240601 10:20:49.724023 43642 olap_meta.cpp:73] [Rocksdb] [db/flush_job.cc:328] [meta] [JOB 2070] Level-0 flush table #3735: started
I20240601 10:20:49.724153 43740 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 334890(us) 
I20240601 10:20:49.728814 43753 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 339691(us) 
I20240601 10:20:49.801913 43753 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 412474(us) 
I20240601 10:20:49.807828 43642 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208449807813, "cf_name": "meta", "job": 2070, "event": "table_file_creation", "file_number": 3735, "file_size": 1016546, "table_properties": {"data_size": 1013409, "index_size": 8666, "filter_size": 0, "raw_key_size": 474993, "raw_average_key_size": 93, "raw_value_size": 12237678, "raw_average_value_size": 2420, "num_data_blocks": 120, "num_entries": 5055, "filter_policy_name": "", "kDeletedKeys": "4938", "kMergeOperands": "0"}}
I20240601 10:20:49.807863 43642 olap_meta.cpp:73] [Rocksdb] [db/flush_job.cc:364] [meta] [JOB 2070] Level-0 flush table #3735: 1016546 bytes OK
I20240601 10:20:49.807907 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 418478(us) 
I20240601 10:20:49.849795 43753 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 460356(us) 
I20240601 10:20:49.874537 43642 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:20:49.849349) [db/memtable_list.cc:375] [meta] Level-0 commit table #3735 started
I20240601 10:20:49.874563 43642 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:20:49.874460) [db/memtable_list.cc:407] [meta] Level-0 commit table #3735: memtable #1 done
I20240601 10:20:49.874569 43642 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:20:49.874479) EVENT_LOG_v1 {"time_micros": 1717208449874473, "job": 2070, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [4, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
I20240601 10:20:49.874574 43642 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:20:49.874515) [db/db_impl_compaction_flush.cc:175] [meta] Level summary: base level 1 max bytes base 268435456 files[4 1 0 0 0 0 0] max score 1.00
I20240601 10:20:49.874583 43642 olap_meta.cpp:73] [Rocksdb] [db/db_impl_files.cc:337] [JOB 2070] Try to delete WAL files size 31457025, prev total WAL file size 31467925, number of live WAL files 2.
I20240601 10:20:49.874918 43431 olap_meta.cpp:73] [Rocksdb] [WARN] [db/db_impl.cc:490] ------- DUMPING STATS -------
I20240601 10:20:49.874980 43431 olap_meta.cpp:73] [Rocksdb] [WARN] [db/db_impl.cc:492] 
** DB Stats **
Uptime(secs): 1262681.8 total, 992.6 interval
Cumulative writes: 4885K writes, 4885K keys, 3914K commit groups, 1.2 writes per commit group, ingest: 32.72 GB, 0.03 MB/s
Cumulative WAL: 4885K writes, 3914K syncs, 1.25 writes per sync, written: 32.72 GB, 0.03 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 50K writes, 50K keys, 41K commit groups, 1.2 writes per commit group, ingest: 290.11 MB, 0.29 MB/s
Interval WAL: 50K writes, 41K syncs, 1.21 writes per sync, written: 0.28 MB, 0.29 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0
I20240601 10:20:49.883594 43688 compaction.cpp:327] succeed to do ordered data cumulative compaction. tablet=557607, output_version=[2-48301], disk=/data6/storage, segments=0, input_row_num=0, output_row_num=0, input_rowset_size=0, output_rowset_size=0. elapsed time=0.52916s. cumulative_compaction_policy=size_based
I20240601 10:20:49.884285 43737 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 496115(us) 
I20240601 10:20:49.884470 43757 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 496471(us) 
I20240601 10:20:49.884681 43762 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 531149(us) [Publish Statistics: schedule time(us): 37, lock wait time(us): 0, save meta time(us): 81307, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 449797]
I20240601 10:20:49.884884 43748 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 496306(us) 
I20240601 10:20:49.885056 43743 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 496016(us) 
I20240601 10:20:49.885236 43751 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 496115(us) 
I20240601 10:20:49.893738 43753 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 504290(us) [Publish Statistics: schedule time(us): 460420, lock wait time(us): 1, save meta time(us): 43679, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 170]
I20240601 10:20:49.920660 43740 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 531219(us) [Publish Statistics: schedule time(us): 335262, lock wait time(us): 0, save meta time(us): 195341, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 593]
I20240601 10:20:49.920686 43761 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 531424(us) [Publish Statistics: schedule time(us): 227967, lock wait time(us): 0, save meta time(us): 302868, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 575]
I20240601 10:20:49.920853 43739 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 531595(us) [Publish Statistics: schedule time(us): 153485, lock wait time(us): 7, save meta time(us): 377300, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 783]
I20240601 10:20:49.920895 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 531461(us) [Publish Statistics: schedule time(us): 418504, lock wait time(us): 1, save meta time(us): 112112, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 197]
I20240601 10:20:49.958389 43737 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 568949(us) [Publish Statistics: schedule time(us): 494879, lock wait time(us): 0, save meta time(us): 73911, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 148]
I20240601 10:20:50.167912 43431 olap_meta.cpp:73] [Rocksdb] [db/compaction_job.cc:1206] [meta] [JOB 2071] Generated table #3736: 6472 keys, 5751213 bytes
I20240601 10:20:50.167961 43431 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208450167950, "cf_name": "meta", "job": 2071, "event": "table_file_creation", "file_number": 3736, "file_size": 5751213, "table_properties": {"data_size": 5691734, "index_size": 194913, "filter_size": 0, "raw_key_size": 394033, "raw_average_key_size": 60, "raw_value_size": 35691921, "raw_average_value_size": 5514, "num_data_blocks": 3905, "num_entries": 6472, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
I20240601 10:20:50.192683 43431 olap_meta.cpp:73] [Rocksdb] [db/compaction_job.cc:1284] [meta] [JOB 2071] Compacted 4@0 + 1@1 files to L1 => 5751213 bytes
I20240601 10:20:50.247416 43431 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:20:50.247336) [db/compaction_job.cc:668] [meta] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.02, MB/sec: 52.3 rd, 18.1 wr, level 1, files in(4, 1) out(1) MB in(6.9, 9.0) out(5.5), read-write-amplify(3.1) write-amplify(0.8) OK, records in: 25539, records dropped: 19067 output_compression: Snappy
I20240601 10:20:50.247443 43431 olap_meta.cpp:73] [Rocksdb] (Original Log Time 2024/06/01-10:20:50.247361) EVENT_LOG_v1 {"time_micros": 1717208450247349, "job": 2071, "event": "compaction_finished", "compaction_time_micros": 317645, "output_level": 1, "num_output_files": 1, "total_output_size": 5751213, "num_input_records": 25539, "num_output_records": 6472, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
I20240601 10:20:50.247726 43431 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208450247724, "job": 2071, "event": "table_file_deletion", "file_number": 3735}
I20240601 10:20:50.248051 43431 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208450248049, "job": 2071, "event": "table_file_deletion", "file_number": 3733}
I20240601 10:20:50.248416 43431 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208450248415, "job": 2071, "event": "table_file_deletion", "file_number": 3731}
I20240601 10:20:50.248977 43431 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208450248976, "job": 2071, "event": "table_file_deletion", "file_number": 3729}
I20240601 10:20:50.250701 43431 olap_meta.cpp:73] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1717208450250693, "job": 2071, "event": "table_file_deletion", "file_number": 3727}
I20240601 10:20:50.872499 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707146956 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707146956 Bytes.];[/data5/storage/wal: limit 279285189017 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285189017 Bytes.];[/data6/storage/wal: limit 277833785344 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277833785344 Bytes.];
I20240601 10:20:52.037703 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 5731
I20240601 10:20:52.041290 43681 storage_engine.cpp:1110] collected 5391 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:20:52.043099 43681 storage_engine.cpp:1126] removed all collected unused rowsets
I20240601 10:20:54.017328 43826 tablet_manager.cpp:1013] find expired transactions for 0 tablets
I20240601 10:20:54.038597 43826 tablet_manager.cpp:1044] success to build all report tablets info. tablet_count=10659
I20240601 10:20:55.801970 43900 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:20:56.715178 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=ead7560414de4493-8021c363265ba47f, job_id=25716, txn_id=2083328, label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, elapse(s)=0, current tasks num: 1
I20240601 10:20:56.715181 42559 routine_load_task_executor.cpp:290] begin to execute routine load task: id=ead7560414de4493-8021c363265ba47f, job_id=25716, txn_id=2083328, label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, elapse(s)=0
I20240601 10:20:56.715477 42559 data_consumer_pool.cpp:103] get consumer group 0f4499479b3477ba-215fad4e11d427a8 with 2 consumers
I20240601 10:20:56.715495 42559 data_consumer.cpp:169] consumer: 934a57c7cfeb18a4-3e692a0fbda987ba, grp: 0f4499479b3477ba-215fad4e11d427a8 assign topic partitions: ott-rr, [0: -1] 
I20240601 10:20:56.715526 42559 data_consumer.cpp:169] consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 0f4499479b3477ba-215fad4e11d427a8 assign topic partitions: ott-rr, [5: -1] 
I20240601 10:20:56.715562 42559 stream_load_executor.cpp:71] begin to execute stream load. label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, txn_id=2083328, query_id=0-0
I20240601 10:20:56.715667 42559 fragment_mgr.cpp:636] query_id: ead7560414de4493-8021c363265ba47f coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:56.715685 42559 fragment_mgr.cpp:661] Query/load id: ead7560414de4493-8021c363265ba47f, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:56.715705 42559 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: ead7560414de4493-8021c363265ba47f limit: 0
I20240601 10:20:56.715725 42559 pipeline_fragment_context.cpp:244] Preparing instance ead7560414de4493-8021c363265ba47f|ead7560414de4493-8021c363265ba480, backend_num 0
I20240601 10:20:56.716338 42559 data_consumer_group.cpp:108] start consumer group: 0f4499479b3477ba-215fad4e11d427a8. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=ead7560414de4493-8021c363265ba47f, job_id=25716, txn_id=2083328, label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, elapse(s)=0
I20240601 10:20:56.716398 14822 data_consumer.cpp:194] start kafka consumer: 934a57c7cfeb18a4-3e692a0fbda987ba, grp: 0f4499479b3477ba-215fad4e11d427a8, max running time(ms): 30000
I20240601 10:20:56.716439 14821 data_consumer.cpp:194] start kafka consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 0f4499479b3477ba-215fad4e11d427a8, max running time(ms): 30000
I20240601 10:20:56.717667 44111 tablets_channel.cpp:134] open tablets channel: (load_id=ead7560414de4493-8021c363265ba47f, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:20:56.731974 44231 tablets_channel.cpp:134] open tablets channel: (load_id=7027ea361d9e4bad-b3eb7595e1245e19, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:20:56.788643 44193 tablets_channel.cpp:134] open tablets channel: (load_id=ac830d391fb54f77-8ba365a53ec40428, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:20:56.816745 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=5087775120d74679-810e75b295742bf9, job_id=25052, txn_id=2083330, label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, elapse(s)=0, current tasks num: 2
I20240601 10:20:56.816757 42562 routine_load_task_executor.cpp:290] begin to execute routine load task: id=5087775120d74679-810e75b295742bf9, job_id=25052, txn_id=2083330, label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, elapse(s)=0
I20240601 10:20:56.817104 42562 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:20:56.817562 42562 data_consumer_pool.cpp:103] get consumer group 9841b260c203b3fd-eefb813ef9532fa6 with 2 consumers
I20240601 10:20:56.817636 42562 data_consumer.cpp:169] consumer: 4643462f33c4cfcb-9e50b955d51de08e, grp: 9841b260c203b3fd-eefb813ef9532fa6 assign topic partitions: doris-ott-liveprepull, [2: -1] 
I20240601 10:20:56.817693 42562 data_consumer.cpp:169] consumer: 374270df3ab32636-b5b23120341433b6, grp: 9841b260c203b3fd-eefb813ef9532fa6 assign topic partitions: doris-ott-liveprepull, [7: -1] 
I20240601 10:20:56.817834 42562 stream_load_executor.cpp:71] begin to execute stream load. label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, txn_id=2083330, query_id=0-0
I20240601 10:20:56.817956 42562 fragment_mgr.cpp:636] query_id: 5087775120d74679-810e75b295742bf9 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:20:56.817989 42562 fragment_mgr.cpp:661] Query/load id: 5087775120d74679-810e75b295742bf9, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:20:56.818019 42562 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 5087775120d74679-810e75b295742bf9 limit: 0
I20240601 10:20:56.818053 42562 pipeline_fragment_context.cpp:244] Preparing instance 5087775120d74679-810e75b295742bf9|5087775120d74679-810e75b295742bfa, backend_num 0
I20240601 10:20:56.826583 42562 data_consumer_group.cpp:108] start consumer group: 9841b260c203b3fd-eefb813ef9532fa6. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=5087775120d74679-810e75b295742bf9, job_id=25052, txn_id=2083330, label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, elapse(s)=0
I20240601 10:20:56.826635 14841 data_consumer.cpp:194] start kafka consumer: 4643462f33c4cfcb-9e50b955d51de08e, grp: 9841b260c203b3fd-eefb813ef9532fa6, max running time(ms): 30000
I20240601 10:20:56.826678 14842 data_consumer.cpp:194] start kafka consumer: 374270df3ab32636-b5b23120341433b6, grp: 9841b260c203b3fd-eefb813ef9532fa6, max running time(ms): 30000
I20240601 10:20:56.827342 44135 tablets_channel.cpp:134] open tablets channel: (load_id=dc2cfde98de047b6-a3199548b6e651d5, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:20:56.838310 44030 tablets_channel.cpp:134] open tablets channel: (load_id=5087775120d74679-810e75b295742bf9, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:20:57.087210 14809 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1284ms in state CONNECT)
I20240601 10:20:57.087299 14841 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 1284ms in state CONNECT)
W20240601 10:20:57.117931 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:20:57.216674 14821 data_consumer.cpp:253] consumer meet partition eof: 284f78dce6aa57fa-a67ebfcab4715bbd partition offset: 0
I20240601 10:20:57.216759 14821 data_consumer.cpp:274] kafka consumer done: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 0f4499479b3477ba-215fad4e11d427a8. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:20:57.216881 14822 data_consumer.cpp:253] consumer meet partition eof: 934a57c7cfeb18a4-3e692a0fbda987ba partition offset: 0
I20240601 10:20:57.216905 14822 data_consumer.cpp:274] kafka consumer done: 934a57c7cfeb18a4-3e692a0fbda987ba, grp: 0f4499479b3477ba-215fad4e11d427a8. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:20:57.217504 14822 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 0f4499479b3477ba-215fad4e11d427a8
I20240601 10:20:57.217515 42559 data_consumer_group.cpp:128] consumer group done: 0f4499479b3477ba-215fad4e11d427a8. consume time(ms)=501, received rows=0, received bytes=0, eos: 1, left_time: 29499, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 501155, blocking put time(us): 0, id=ead7560414de4493-8021c363265ba47f, job_id=25716, txn_id=2083328, label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, elapse(s)=0
I20240601 10:20:57.217545 42559 data_consumer.cpp:417] kafka consumer cancelled. 934a57c7cfeb18a4-3e692a0fbda987ba
I20240601 10:20:57.217551 42559 data_consumer.cpp:417] kafka consumer cancelled. 284f78dce6aa57fa-a67ebfcab4715bbd
I20240601 10:20:57.217763 10049 vtablet_writer.cpp:963] VNodeChannel[25388-10006], load_id=ead7560414de4493-8021c363265ba47f, txn_id=2083328, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:57.217787 10049 vtablet_writer.cpp:963] VNodeChannel[25388-10005], load_id=ead7560414de4493-8021c363265ba47f, txn_id=2083328, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:57.218205 43872 tablets_channel.cpp:226] close tablets channel: (load_id=ead7560414de4493-8021c363265ba47f, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:20:57.218873 43872 load_channel.cpp:55] load channel removed load_id=ead7560414de4493-8021c363265ba47f, is high priority=1, sender_ip=225.225.225.3, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:57.219098 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. ead7560414de4493-8021c363265ba47f
I20240601 10:20:57.219918 10049 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=104045, load id=ead7560414de4493-8021c363265ba47f
I20240601 10:20:57.219940 10049 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=ead7560414de4493-8021c363265ba47f, txn_id=2083328, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(0)(0)(2)(1)} {10006:(1)(0)(2)(1)} 
I20240601 10:20:57.220156 50815 fragment_mgr.cpp:588] Removing query ead7560414de4493-8021c363265ba47f instance ead7560414de4493-8021c363265ba480, all done? true
I20240601 10:20:57.220180 50815 fragment_mgr.cpp:594] Query ead7560414de4493-8021c363265ba47f finished
I20240601 10:20:57.220196 50815 stream_load_executor.cpp:152] finished to execute stream load. label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, txn_id=2083328, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=504
I20240601 10:20:57.220636 50815 query_context.cpp:114] Query ead7560414de4493-8021c363265ba47f deconstructed, , deregister query/load memory tracker, queryId=ead7560414de4493-8021c363265ba47f, Limit=2.00 GB, CurrUsed=512.00 KB, PeakUsed=555.09 KB
I20240601 10:20:57.249321 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083328
I20240601 10:20:57.319856 14841 data_consumer.cpp:253] consumer meet partition eof: 4643462f33c4cfcb-9e50b955d51de08e partition offset: 0
I20240601 10:20:57.319897 14841 data_consumer.cpp:274] kafka consumer done: 4643462f33c4cfcb-9e50b955d51de08e, grp: 9841b260c203b3fd-eefb813ef9532fa6. cancelled: 0, left time(ms): 29507, total cost(ms): 493, consume cost(ms): 493, received rows: 0, put rows: 0
I20240601 10:20:57.327287 43873 tablets_channel.cpp:226] close tablets channel: (load_id=dc2cfde98de047b6-a3199548b6e651d5, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:20:57.327906 43873 load_channel.cpp:55] load channel removed load_id=dc2cfde98de047b6-a3199548b6e651d5, is high priority=1, sender_ip=225.225.225.2, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:57.366278 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083331
I20240601 10:20:57.710350 43988 tablets_channel.cpp:226] close tablets channel: (load_id=7027ea361d9e4bad-b3eb7595e1245e19, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:20:57.724519 43988 load_channel.cpp:55] load channel removed load_id=7027ea361d9e4bad-b3eb7595e1245e19, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:57.766106 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083327
I20240601 10:20:57.818593 14842 data_consumer.cpp:253] consumer meet partition eof: 374270df3ab32636-b5b23120341433b6 partition offset: 0
I20240601 10:20:57.818634 14842 data_consumer.cpp:274] kafka consumer done: 374270df3ab32636-b5b23120341433b6, grp: 9841b260c203b3fd-eefb813ef9532fa6. cancelled: 0, left time(ms): 29009, total cost(ms): 991, consume cost(ms): 991, received rows: 0, put rows: 0
I20240601 10:20:57.818646 14842 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 9841b260c203b3fd-eefb813ef9532fa6
I20240601 10:20:57.818684 42562 data_consumer_group.cpp:128] consumer group done: 9841b260c203b3fd-eefb813ef9532fa6. consume time(ms)=992, received rows=0, received bytes=0, eos: 1, left_time: 29008, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 992075, blocking put time(us): 0, id=5087775120d74679-810e75b295742bf9, job_id=25052, txn_id=2083330, label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, elapse(s)=1
I20240601 10:20:57.818717 42562 data_consumer.cpp:417] kafka consumer cancelled. 4643462f33c4cfcb-9e50b955d51de08e
I20240601 10:20:57.818723 42562 data_consumer.cpp:417] kafka consumer cancelled. 374270df3ab32636-b5b23120341433b6
I20240601 10:20:57.819021 14849 vtablet_writer.cpp:963] VNodeChannel[17616-10006], load_id=5087775120d74679-810e75b295742bf9, txn_id=2083330, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:20:57.819039 14849 vtablet_writer.cpp:963] VNodeChannel[17616-10005], load_id=5087775120d74679-810e75b295742bf9, txn_id=2083330, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:20:57.819351 43928 tablets_channel.cpp:226] close tablets channel: (load_id=5087775120d74679-810e75b295742bf9, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:20:57.820258 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 5087775120d74679-810e75b295742bf9
I20240601 10:20:57.826920 43928 load_channel.cpp:55] load channel removed load_id=5087775120d74679-810e75b295742bf9, is high priority=1, sender_ip=225.225.225.3, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:57.834934 14849 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=91544, load id=5087775120d74679-810e75b295742bf9
I20240601 10:20:57.834969 14849 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=5087775120d74679-810e75b295742bf9, txn_id=2083330, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(15)(0)(15)(1)} {10006:(14)(0)(15)(1)} 
I20240601 10:20:57.835264 50813 fragment_mgr.cpp:588] Removing query 5087775120d74679-810e75b295742bf9 instance 5087775120d74679-810e75b295742bfa, all done? true
I20240601 10:20:57.835291 50813 fragment_mgr.cpp:594] Query 5087775120d74679-810e75b295742bf9 finished
I20240601 10:20:57.835319 50813 stream_load_executor.cpp:152] finished to execute stream load. label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, txn_id=2083330, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1017
I20240601 10:20:57.837153 50813 query_context.cpp:114] Query 5087775120d74679-810e75b295742bf9 deconstructed, , deregister query/load memory tracker, queryId=5087775120d74679-810e75b295742bf9, Limit=2.00 GB, CurrUsed=736.00 KB, PeakUsed=824.97 KB
I20240601 10:20:57.866291 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083330
I20240601 10:20:58.266238 43929 tablets_channel.cpp:226] close tablets channel: (load_id=ac830d391fb54f77-8ba365a53ec40428, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:20:58.274003 43929 load_channel.cpp:55] load channel removed load_id=ac830d391fb54f77-8ba365a53ec40428, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:20:58.317030 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083329
I20240601 10:21:00.387591 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:21:00.899940 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707144089 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707144089 Bytes.];[/data5/storage/wal: limit 279285184921 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285184921 Bytes.];[/data6/storage/wal: limit 277833468723 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277833468723 Bytes.];
I20240601 10:21:04.380018 43825 data_dir.cpp:882] path: /data4/storage total capacity: 3991941488640, available capacity: 2647071428608, usage: 0.336896, in_use: 1
I20240601 10:21:04.380088 43825 data_dir.cpp:882] path: /data5/storage total capacity: 3991941488640, available capacity: 2792851832832, usage: 0.300378, in_use: 1
I20240601 10:21:04.380115 43825 data_dir.cpp:882] path: /data6/storage total capacity: 3991941488640, available capacity: 2778333822976, usage: 0.304014, in_use: 1
I20240601 10:21:04.390602 43825 storage_engine.cpp:366] get root path info cost: 10 ms. tablet counter: 10659
I20240601 10:21:05.169214 44219 fragment_mgr.cpp:636] query_id: 6755a90a722e44e4-9815f776878344e1 coord_addr TNetworkAddress(hostname=225.225.225.3, port=9020) total fragment num on current host: 1 fe process uuid: 1716195357252
I20240601 10:21:05.169261 44219 fragment_mgr.cpp:661] Query/load id: 6755a90a722e44e4-9815f776878344e1, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:05.169293 44219 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 6755a90a722e44e4-9815f776878344e1 limit: 0
I20240601 10:21:05.169312 44219 pipeline_x_fragment_context.cpp:174] PipelineXFragmentContext::prepare|query_id=6755a90a722e44e4-9815f776878344e1|fragment_id=0|pthread_id=140428637746944
I20240601 10:21:05.169639 50814 fragment_mgr.cpp:588] Removing query 6755a90a722e44e4-9815f776878344e1 instance 6755a90a722e44e4-9815f776878344e2, all done? true
I20240601 10:21:05.169661 50814 fragment_mgr.cpp:594] Query 6755a90a722e44e4-9815f776878344e1 finished
I20240601 10:21:05.169715 50814 query_context.cpp:114] Query 6755a90a722e44e4-9815f776878344e1 deconstructed, , deregister query/load memory tracker, queryId=6755a90a722e44e4-9815f776878344e1, Limit=2.00 GB, CurrUsed=4.38 KB, PeakUsed=4.38 KB
W20240601 10:21:06.297703 44704 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=9a4349e1dd9325b5-cacc9b140cacc98d, job_id=-1, txn_id=2083323, label=ffe24dee-6b7a-462b-97a4-1c58311d22e6, elapse(s)=30
I20240601 10:21:06.812515 43829 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:21:07.109635 44711 stream_load.cpp:198] new income streaming load request.id=fe4df9e730d729dd-8e09c9824f614cb9, job_id=-1, txn_id=-1, label=b8f247cf-8406-487e-ba61-64173d2e3aac, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:21:07.127441 44711 stream_load_executor.cpp:71] begin to execute stream load. label=b8f247cf-8406-487e-ba61-64173d2e3aac, txn_id=2083332, query_id=0-0
I20240601 10:21:07.127678 44711 fragment_mgr.cpp:636] query_id: fe4df9e730d729dd-8e09c9824f614cb9 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:21:07.127702 44711 fragment_mgr.cpp:661] Query/load id: fe4df9e730d729dd-8e09c9824f614cb9, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:07.127732 44711 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: fe4df9e730d729dd-8e09c9824f614cb9 limit: 0
I20240601 10:21:07.127761 44711 pipeline_fragment_context.cpp:244] Preparing instance fe4df9e730d729dd-8e09c9824f614cb9|fe4df9e730d729dd-8e09c9824f614cba, backend_num 0
I20240601 10:21:07.134336 44711 stream_load.cpp:204] finished to handle HTTP header, id=fe4df9e730d729dd-8e09c9824f614cb9, job_id=-1, txn_id=2083332, label=b8f247cf-8406-487e-ba61-64173d2e3aac, elapse(s)=0
I20240601 10:21:07.141106 44123 tablets_channel.cpp:134] open tablets channel: (load_id=fe4df9e730d729dd-8e09c9824f614cb9, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:07.252053 14849 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=fe4df9e730d729dd-8e09c9824f614cb9, txn_id=2083332, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:21:07.252122 14849 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=fe4df9e730d729dd-8e09c9824f614cb9, txn_id=2083332, node=225.225.225.2:8060 mark closed, left pending batch size: 1
W20240601 10:21:07.256623 44715 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=d94c427b3e697457-9812351838e415a9, job_id=-1, txn_id=2083325, label=035317fc-1419-4440-a4a0-6e764161fa47, elapse(s)=30
I20240601 10:21:07.259229 44546 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. fe4df9e730d729dd-8e09c9824f614cb9
I20240601 10:21:07.264765 43843 tablets_channel.cpp:226] close tablets channel: (load_id=fe4df9e730d729dd-8e09c9824f614cb9, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:07.382685 44102 tablets_channel.cpp:134] open tablets channel: (load_id=2f4c006859c76313-a753e5d95de1b9a9, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:07.461257 43984 tablets_channel.cpp:226] close tablets channel: (load_id=2f4c006859c76313-a753e5d95de1b9a9, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:07.761893 44704 stream_load.cpp:198] new income streaming load request.id=934e76afa202d7fb-d0032bdffe5e6fbe, job_id=-1, txn_id=-1, label=2e8de8fb-89d0-4110-b14a-ecb4afb91a32, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:21:07.777351 44704 stream_load_executor.cpp:71] begin to execute stream load. label=2e8de8fb-89d0-4110-b14a-ecb4afb91a32, txn_id=2083334, query_id=0-0
I20240601 10:21:07.777511 44704 fragment_mgr.cpp:636] query_id: 934e76afa202d7fb-d0032bdffe5e6fbe coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:21:07.777531 44704 fragment_mgr.cpp:661] Query/load id: 934e76afa202d7fb-d0032bdffe5e6fbe, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:07.777559 44704 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 934e76afa202d7fb-d0032bdffe5e6fbe limit: 0
I20240601 10:21:07.777585 44704 pipeline_fragment_context.cpp:244] Preparing instance 934e76afa202d7fb-d0032bdffe5e6fbe|934e76afa202d7fb-d0032bdffe5e6fbf, backend_num 0
I20240601 10:21:07.781020 44704 stream_load.cpp:204] finished to handle HTTP header, id=934e76afa202d7fb-d0032bdffe5e6fbe, job_id=-1, txn_id=2083334, label=2e8de8fb-89d0-4110-b14a-ecb4afb91a32, elapse(s)=0
I20240601 10:21:07.786967 44194 tablets_channel.cpp:134] open tablets channel: (load_id=934e76afa202d7fb-d0032bdffe5e6fbe, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:07.823403 43883 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:21:07.839665 43843 load_channel.cpp:55] load channel removed load_id=fe4df9e730d729dd-8e09c9824f614cb9, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:07.845790 14849 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=6803576, load id=fe4df9e730d729dd-8e09c9824f614cb9
I20240601 10:21:07.845818 14849 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=fe4df9e730d729dd-8e09c9824f614cb9, txn_id=2083332, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(65)(0)(593)(1)} {10006:(587)(0)(593)(1)} 
I20240601 10:21:07.846257 50812 fragment_mgr.cpp:588] Removing query fe4df9e730d729dd-8e09c9824f614cb9 instance fe4df9e730d729dd-8e09c9824f614cba, all done? true
I20240601 10:21:07.846287 50812 fragment_mgr.cpp:594] Query fe4df9e730d729dd-8e09c9824f614cb9 finished
I20240601 10:21:07.846312 50812 stream_load_executor.cpp:152] finished to execute stream load. label=b8f247cf-8406-487e-ba61-64173d2e3aac, txn_id=2083332, query_id=0-0, receive_data_cost_ms=71, read_data_cost_ms=2, write_data_cost_ms=718
I20240601 10:21:07.847661 50812 query_context.cpp:114] Query fe4df9e730d729dd-8e09c9824f614cb9 deconstructed, , deregister query/load memory tracker, queryId=fe4df9e730d729dd-8e09c9824f614cb9, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:21:07.867295 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:21:07.867365 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:21:07.867409 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:21:07.867415 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:21:07.867427 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:21:07.867434 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:21:07.867444 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:21:07.867448 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:21:07.870718 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083332
I20240601 10:21:07.876842 20621 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=934e76afa202d7fb-d0032bdffe5e6fbe, txn_id=2083334, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:21:07.876909 20621 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=934e76afa202d7fb-d0032bdffe5e6fbe, txn_id=2083334, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:21:07.883496 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 934e76afa202d7fb-d0032bdffe5e6fbe
I20240601 10:21:07.886456 43890 tablets_channel.cpp:226] close tablets channel: (load_id=934e76afa202d7fb-d0032bdffe5e6fbe, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:08.064991 43984 load_channel.cpp:55] load channel removed load_id=2f4c006859c76313-a753e5d95de1b9a9, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:08.096311 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083333
I20240601 10:21:08.328161 44094 tablets_channel.cpp:134] open tablets channel: (load_id=ad441607423eb7aa-bbad79c24fd053a1, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:08.401203 43899 tablets_channel.cpp:226] close tablets channel: (load_id=ad441607423eb7aa-bbad79c24fd053a1, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:08.555408 43890 load_channel.cpp:55] load channel removed load_id=934e76afa202d7fb-d0032bdffe5e6fbe, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:08.558738 20621 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=7877109, load id=934e76afa202d7fb-d0032bdffe5e6fbe
I20240601 10:21:08.558821 20621 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=934e76afa202d7fb-d0032bdffe5e6fbe, txn_id=2083334, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(65)(0)(682)(1)} {10006:(675)(0)(682)(1)} 
I20240601 10:21:08.559161 50809 fragment_mgr.cpp:588] Removing query 934e76afa202d7fb-d0032bdffe5e6fbe instance 934e76afa202d7fb-d0032bdffe5e6fbf, all done? true
I20240601 10:21:08.559186 50809 fragment_mgr.cpp:594] Query 934e76afa202d7fb-d0032bdffe5e6fbe finished
I20240601 10:21:08.559211 50809 stream_load_executor.cpp:152] finished to execute stream load. label=2e8de8fb-89d0-4110-b14a-ecb4afb91a32, txn_id=2083334, query_id=0-0, receive_data_cost_ms=53, read_data_cost_ms=2, write_data_cost_ms=781
I20240601 10:21:08.560572 50809 query_context.cpp:114] Query 934e76afa202d7fb-d0032bdffe5e6fbe deconstructed, , deregister query/load memory tracker, queryId=934e76afa202d7fb-d0032bdffe5e6fbe, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:21:08.587838 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083334
I20240601 10:21:08.694710 44724 stream_load.cpp:198] new income streaming load request.id=8c437c865d68a690-de27ce08e4cc07be, job_id=-1, txn_id=-1, label=1b05435f-67f7-438e-bd0e-46751306fb0b, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:21:08.723767 44724 stream_load_executor.cpp:71] begin to execute stream load. label=1b05435f-67f7-438e-bd0e-46751306fb0b, txn_id=2083336, query_id=0-0
I20240601 10:21:08.723899 44724 fragment_mgr.cpp:636] query_id: 8c437c865d68a690-de27ce08e4cc07be coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:21:08.723922 44724 fragment_mgr.cpp:661] Query/load id: 8c437c865d68a690-de27ce08e4cc07be, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:08.723937 44724 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 8c437c865d68a690-de27ce08e4cc07be limit: 0
I20240601 10:21:08.723963 44724 pipeline_fragment_context.cpp:244] Preparing instance 8c437c865d68a690-de27ce08e4cc07be|8c437c865d68a690-de27ce08e4cc07bf, backend_num 0
I20240601 10:21:08.726459 44724 stream_load.cpp:204] finished to handle HTTP header, id=8c437c865d68a690-de27ce08e4cc07be, job_id=-1, txn_id=2083336, label=1b05435f-67f7-438e-bd0e-46751306fb0b, elapse(s)=0
I20240601 10:21:08.731724 44132 tablets_channel.cpp:134] open tablets channel: (load_id=8c437c865d68a690-de27ce08e4cc07be, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:08.821308 20621 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=8c437c865d68a690-de27ce08e4cc07be, txn_id=2083336, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:21:08.821358 20621 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=8c437c865d68a690-de27ce08e4cc07be, txn_id=2083336, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:21:08.825768 44410 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 8c437c865d68a690-de27ce08e4cc07be
I20240601 10:21:08.829566 43844 tablets_channel.cpp:226] close tablets channel: (load_id=8c437c865d68a690-de27ce08e4cc07be, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:09.001464 43899 load_channel.cpp:55] load channel removed load_id=ad441607423eb7aa-bbad79c24fd053a1, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:09.030247 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083335
W20240601 10:21:09.400241 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:21:09.462133 43844 load_channel.cpp:55] load channel removed load_id=8c437c865d68a690-de27ce08e4cc07be, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:09.466981 20621 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=5121050, load id=8c437c865d68a690-de27ce08e4cc07be
I20240601 10:21:09.467008 20621 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=8c437c865d68a690-de27ce08e4cc07be, txn_id=2083336, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(65)(0)(645)(1)} {10006:(640)(0)(645)(1)} 
I20240601 10:21:09.467372 50810 fragment_mgr.cpp:588] Removing query 8c437c865d68a690-de27ce08e4cc07be instance 8c437c865d68a690-de27ce08e4cc07bf, all done? true
I20240601 10:21:09.467397 50810 fragment_mgr.cpp:594] Query 8c437c865d68a690-de27ce08e4cc07be finished
I20240601 10:21:09.467422 50810 stream_load_executor.cpp:152] finished to execute stream load. label=1b05435f-67f7-438e-bd0e-46751306fb0b, txn_id=2083336, query_id=0-0, receive_data_cost_ms=66, read_data_cost_ms=2, write_data_cost_ms=743
I20240601 10:21:09.468645 50810 query_context.cpp:114] Query 8c437c865d68a690-de27ce08e4cc07be deconstructed, , deregister query/load memory tracker, queryId=8c437c865d68a690-de27ce08e4cc07be, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:21:09.488258 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083336
I20240601 10:21:10.929096 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707126886 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707126886 Bytes.];[/data5/storage/wal: limit 279285175500 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285175500 Bytes.];[/data6/storage/wal: limit 277833159065 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277833159065 Bytes.];
I20240601 10:21:12.198343 14209 backend_service.cpp:785] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1
I20240601 10:21:14.799589 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:21:14.799649 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:21:14.799682 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:21:14.799690 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:21:14.799698 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:21:14.799705 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:21:14.799712 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:21:14.799716 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:21:17.839195 43869 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:21:18.590399 21490 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 749ms in state CONNECT)
I20240601 10:21:18.592991 43869 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 749ms in state CONNECT)
I20240601 10:21:20.400257 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:21:20.956624 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707124019 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707124019 Bytes.];[/data5/storage/wal: limit 279285171404 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285171404 Bytes.];[/data6/storage/wal: limit 277832840806 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277832840806 Bytes.];
W20240601 10:21:21.697085 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:21:22.054397 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 340
I20240601 10:21:22.054683 43681 storage_engine.cpp:1110] collected 0 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:21:22.054692 43681 storage_engine.cpp:1126] removed all collected unused rowsets
W20240601 10:21:27.221489 42559 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=ead7560414de4493-8021c363265ba47f, job_id=25716, txn_id=2083328, label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, elapse(s)=30
I20240601 10:21:27.221724 42559 routine_load_task_executor.cpp:262] finished routine load task id=ead7560414de4493-8021c363265ba47f, job_id=25716, txn_id=2083328, label=rr_service_kafka-25716-ead7560414de4493-8021c363265ba47f-2083328, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 1
W20240601 10:21:27.836169 42562 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=5087775120d74679-810e75b295742bf9, job_id=25052, txn_id=2083330, label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, elapse(s)=31
I20240601 10:21:27.836354 42562 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:21:27.837203 42562 routine_load_task_executor.cpp:262] finished routine load task id=5087775120d74679-810e75b295742bf9, job_id=25052, txn_id=2083330, label=ott_liveprepull_kafka-25052-5087775120d74679-810e75b295742bf9-2083330, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 0
I20240601 10:21:30.987823 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707121152 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707121152 Bytes.];[/data5/storage/wal: limit 279285167308 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285167308 Bytes.];[/data6/storage/wal: limit 277832551628 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277832551628 Bytes.];
I20240601 10:21:31.514729 43715 lru_cache_policy.h:154] [MemoryGC] MowDeleteBitmapAggCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514778 43715 lru_cache_policy.h:154] [MemoryGC] CreateTabletRRIdxCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514787 43715 lru_cache_policy.h:154] [MemoryGC] DataPageCache not need prune stale, consumption 8777000 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514793 43715 lru_cache_policy.h:154] [MemoryGC] IndexPageCache not need prune stale, consumption 21255917 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514806 43715 lru_cache_policy.h:154] [MemoryGC] TabletSchemaCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514812 43715 lru_cache_policy.h:154] [MemoryGC] PKIndexPageCache not need prune stale, consumption 22976 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514819 43715 lru_cache_policy.h:154] [MemoryGC] PointQueryRowCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514827 43715 lru_cache_policy.h:154] [MemoryGC] SegmentCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514834 43715 lru_cache_policy.h:154] [MemoryGC] SchemaCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514843 43715 lru_cache_policy.h:142] [MemoryGC] CommonObjLRUCache prune stale start, consumption 0
I20240601 10:21:31.514854 43715 lru_cache_policy.h:149] [MemoryGC] CommonObjLRUCache prune stale 0 entries, 0 bytes, 4209 times prune
I20240601 10:21:31.514861 43715 lru_cache_policy.h:154] [MemoryGC] PointQueryLookupConnectionCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514873 43715 lru_cache_policy.h:154] [MemoryGC] InvertedIndexSearcherCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
I20240601 10:21:31.514883 43715 lru_cache_policy.h:154] [MemoryGC] InvertedIndexQueryCache not need prune stale, consumption 0 less than CACHE_MIN_FREE_SIZE 67108864
W20240601 10:21:33.984702 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:21:36.855301 44051 tablets_channel.cpp:134] open tablets channel: (load_id=a632f72558a1424a-a9743465718af3d1, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:21:36.860520 42558 routine_load_task_executor.cpp:290] begin to execute routine load task: id=4e3fb4a08f284614-a51f37a4eed2130d, job_id=25385, txn_id=2083338, label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, elapse(s)=0
I20240601 10:21:36.860489 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=4e3fb4a08f284614-a51f37a4eed2130d, job_id=25385, txn_id=2083338, label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, elapse(s)=0, current tasks num: 1
I20240601 10:21:36.860778 42558 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:21:36.861375 42558 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:21:36.861790 42558 data_consumer_pool.cpp:103] get consumer group 02430d3e192d5ce2-b7c9cc8cef992391 with 2 consumers
I20240601 10:21:36.861807 42558 data_consumer.cpp:169] consumer: 0f47554fcc2a53b3-b04d8a25377de7aa, grp: 02430d3e192d5ce2-b7c9cc8cef992391 assign topic partitions: ott-rr-error, [2: -1] 
I20240601 10:21:36.861941 42558 data_consumer.cpp:169] consumer: 8844ff59732f56dd-8faf86bdb6776893, grp: 02430d3e192d5ce2-b7c9cc8cef992391 assign topic partitions: ott-rr-error, [7: -1] 
I20240601 10:21:36.862088 42558 stream_load_executor.cpp:71] begin to execute stream load. label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, txn_id=2083338, query_id=0-0
I20240601 10:21:36.862169 42558 fragment_mgr.cpp:636] query_id: 4e3fb4a08f284614-a51f37a4eed2130d coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:21:36.862248 42558 fragment_mgr.cpp:661] Query/load id: 4e3fb4a08f284614-a51f37a4eed2130d, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:36.862275 42558 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 4e3fb4a08f284614-a51f37a4eed2130d limit: 0
I20240601 10:21:36.862301 42558 pipeline_fragment_context.cpp:244] Preparing instance 4e3fb4a08f284614-a51f37a4eed2130d|4e3fb4a08f284614-a51f37a4eed2130e, backend_num 0
I20240601 10:21:36.863054 42558 data_consumer_group.cpp:108] start consumer group: 02430d3e192d5ce2-b7c9cc8cef992391. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=4e3fb4a08f284614-a51f37a4eed2130d, job_id=25385, txn_id=2083338, label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, elapse(s)=0
I20240601 10:21:36.863126 23941 data_consumer.cpp:194] start kafka consumer: 0f47554fcc2a53b3-b04d8a25377de7aa, grp: 02430d3e192d5ce2-b7c9cc8cef992391, max running time(ms): 30000
I20240601 10:21:36.863168 23940 data_consumer.cpp:194] start kafka consumer: 8844ff59732f56dd-8faf86bdb6776893, grp: 02430d3e192d5ce2-b7c9cc8cef992391, max running time(ms): 30000
I20240601 10:21:36.864459 44237 tablets_channel.cpp:134] open tablets channel: (load_id=4e3fb4a08f284614-a51f37a4eed2130d, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:21:36.922025 44076 tablets_channel.cpp:134] open tablets channel: (load_id=32d6f55aac374e94-826a83901e1792c2, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:21:36.937142 44071 tablets_channel.cpp:134] open tablets channel: (load_id=61ef1e6a03854edc-8afda52c5bd8ed37, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:21:36.997184 42560 routine_load_task_executor.cpp:290] begin to execute routine load task: id=dc01f4799a2e4135-920cd0a61d40c592, job_id=25052, txn_id=2083341, label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, elapse(s)=0
I20240601 10:21:36.997206 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=dc01f4799a2e4135-920cd0a61d40c592, job_id=25052, txn_id=2083341, label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, elapse(s)=0, current tasks num: 2
I20240601 10:21:36.997442 42560 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:21:36.997946 42560 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:21:36.998358 42560 data_consumer_pool.cpp:103] get consumer group 0a462574a4f1f94b-83c413e3774200bb with 2 consumers
I20240601 10:21:36.998378 42560 data_consumer.cpp:169] consumer: 1d414a36d9e35349-57f180696d8319b4, grp: 0a462574a4f1f94b-83c413e3774200bb assign topic partitions: doris-ott-liveprepull, [0: -1] 
I20240601 10:21:36.998497 42560 data_consumer.cpp:169] consumer: 8343cf255ebc49be-e1c697f95b7cbaae, grp: 0a462574a4f1f94b-83c413e3774200bb assign topic partitions: doris-ott-liveprepull, [5: -1] 
I20240601 10:21:36.998611 42560 stream_load_executor.cpp:71] begin to execute stream load. label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, txn_id=2083341, query_id=0-0
I20240601 10:21:36.998713 42560 fragment_mgr.cpp:636] query_id: dc01f4799a2e4135-920cd0a61d40c592 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:21:36.998733 42560 fragment_mgr.cpp:661] Query/load id: dc01f4799a2e4135-920cd0a61d40c592, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:36.998796 42560 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: dc01f4799a2e4135-920cd0a61d40c592 limit: 0
I20240601 10:21:36.998817 42560 pipeline_fragment_context.cpp:244] Preparing instance dc01f4799a2e4135-920cd0a61d40c592|dc01f4799a2e4135-920cd0a61d40c593, backend_num 0
I20240601 10:21:37.008162 42560 data_consumer_group.cpp:108] start consumer group: 0a462574a4f1f94b-83c413e3774200bb. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=dc01f4799a2e4135-920cd0a61d40c592, job_id=25052, txn_id=2083341, label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, elapse(s)=0
I20240601 10:21:37.008229 23954 data_consumer.cpp:194] start kafka consumer: 1d414a36d9e35349-57f180696d8319b4, grp: 0a462574a4f1f94b-83c413e3774200bb, max running time(ms): 30000
I20240601 10:21:37.008285 23956 data_consumer.cpp:194] start kafka consumer: 8343cf255ebc49be-e1c697f95b7cbaae, grp: 0a462574a4f1f94b-83c413e3774200bb, max running time(ms): 30000
I20240601 10:21:37.020473 44098 tablets_channel.cpp:134] open tablets channel: (load_id=dc01f4799a2e4135-920cd0a61d40c592, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:21:37.022225 23966 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 23ms in state CONNECT)
I20240601 10:21:37.022294 23956 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 23ms in state CONNECT)
I20240601 10:21:37.022306 23945 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 160ms in state CONNECT)
I20240601 10:21:37.022467 23941 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 160ms in state CONNECT)
I20240601 10:21:37.355342 43966 tablets_channel.cpp:226] close tablets channel: (load_id=a632f72558a1424a-a9743465718af3d1, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:21:37.356002 43966 load_channel.cpp:55] load channel removed load_id=a632f72558a1424a-a9743465718af3d1, is high priority=1, sender_ip=225.225.225.2, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:21:37.398490 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083337
I20240601 10:21:37.420965 43995 tablets_channel.cpp:226] close tablets channel: (load_id=32d6f55aac374e94-826a83901e1792c2, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:21:37.421353 43995 load_channel.cpp:55] load channel removed load_id=32d6f55aac374e94-826a83901e1792c2, is high priority=1, sender_ip=225.225.225.2, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:21:37.448711 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083340
W20240601 10:21:37.847703 44711 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=fe4df9e730d729dd-8e09c9824f614cb9, job_id=-1, txn_id=2083332, label=b8f247cf-8406-487e-ba61-64173d2e3aac, elapse(s)=30
I20240601 10:21:37.863265 23941 data_consumer.cpp:242] kafka consume timeout: 0f47554fcc2a53b3-b04d8a25377de7aa
I20240601 10:21:37.863281 23940 data_consumer.cpp:242] kafka consume timeout: 8844ff59732f56dd-8faf86bdb6776893
I20240601 10:21:37.864749 23940 data_consumer.cpp:253] consumer meet partition eof: 8844ff59732f56dd-8faf86bdb6776893 partition offset: 0
I20240601 10:21:37.864795 23940 data_consumer.cpp:274] kafka consumer done: 8844ff59732f56dd-8faf86bdb6776893, grp: 02430d3e192d5ce2-b7c9cc8cef992391. cancelled: 0, left time(ms): 28999, total cost(ms): 1001, consume cost(ms): 1001, received rows: 0, put rows: 0
I20240601 10:21:37.864830 23941 data_consumer.cpp:253] consumer meet partition eof: 0f47554fcc2a53b3-b04d8a25377de7aa partition offset: 0
I20240601 10:21:37.864886 23941 data_consumer.cpp:274] kafka consumer done: 0f47554fcc2a53b3-b04d8a25377de7aa, grp: 02430d3e192d5ce2-b7c9cc8cef992391. cancelled: 0, left time(ms): 28999, total cost(ms): 1001, consume cost(ms): 1001, received rows: 0, put rows: 0
I20240601 10:21:37.864917 23941 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 02430d3e192d5ce2-b7c9cc8cef992391
I20240601 10:21:37.864938 42558 data_consumer_group.cpp:128] consumer group done: 02430d3e192d5ce2-b7c9cc8cef992391. consume time(ms)=1001, received rows=0, received bytes=0, eos: 1, left_time: 28999, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 1001848, blocking put time(us): 0, id=4e3fb4a08f284614-a51f37a4eed2130d, job_id=25385, txn_id=2083338, label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, elapse(s)=1
I20240601 10:21:37.864971 42558 data_consumer.cpp:417] kafka consumer cancelled. 0f47554fcc2a53b3-b04d8a25377de7aa
I20240601 10:21:37.864977 42558 data_consumer.cpp:417] kafka consumer cancelled. 8844ff59732f56dd-8faf86bdb6776893
I20240601 10:21:37.865228 20621 vtablet_writer.cpp:963] VNodeChannel[25057-10006], load_id=4e3fb4a08f284614-a51f37a4eed2130d, txn_id=2083338, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:21:37.865253 20621 vtablet_writer.cpp:963] VNodeChannel[25057-10005], load_id=4e3fb4a08f284614-a51f37a4eed2130d, txn_id=2083338, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:21:37.865679 43986 tablets_channel.cpp:226] close tablets channel: (load_id=4e3fb4a08f284614-a51f37a4eed2130d, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:21:37.866077 43986 load_channel.cpp:55] load channel removed load_id=4e3fb4a08f284614-a51f37a4eed2130d, is high priority=1, sender_ip=225.225.225.3, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:21:37.866616 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 4e3fb4a08f284614-a51f37a4eed2130d
I20240601 10:21:37.867377 20621 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=106341, load id=4e3fb4a08f284614-a51f37a4eed2130d
I20240601 10:21:37.867400 20621 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=4e3fb4a08f284614-a51f37a4eed2130d, txn_id=2083338, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(0)(0)(2)(1)} {10006:(0)(0)(2)(1)} 
I20240601 10:21:37.867518 50808 fragment_mgr.cpp:588] Removing query 4e3fb4a08f284614-a51f37a4eed2130d instance 4e3fb4a08f284614-a51f37a4eed2130e, all done? true
I20240601 10:21:37.867547 50808 fragment_mgr.cpp:594] Query 4e3fb4a08f284614-a51f37a4eed2130d finished
I20240601 10:21:37.867565 50808 stream_load_executor.cpp:152] finished to execute stream load. label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, txn_id=2083338, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1005
I20240601 10:21:37.867911 50808 query_context.cpp:114] Query 4e3fb4a08f284614-a51f37a4eed2130d deconstructed, , deregister query/load memory tracker, queryId=4e3fb4a08f284614-a51f37a4eed2130d, Limit=2.00 GB, CurrUsed=304.00 KB, PeakUsed=337.78 KB
I20240601 10:21:37.915484 43991 tablets_channel.cpp:226] close tablets channel: (load_id=61ef1e6a03854edc-8afda52c5bd8ed37, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:21:37.922725 43991 load_channel.cpp:55] load channel removed load_id=61ef1e6a03854edc-8afda52c5bd8ed37, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:21:37.923856 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083338
I20240601 10:21:37.957548 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083339
I20240601 10:21:37.999430 23954 data_consumer.cpp:253] consumer meet partition eof: 1d414a36d9e35349-57f180696d8319b4 partition offset: 1
I20240601 10:21:37.999471 23954 data_consumer.cpp:274] kafka consumer done: 1d414a36d9e35349-57f180696d8319b4, grp: 0a462574a4f1f94b-83c413e3774200bb. cancelled: 0, left time(ms): 29009, total cost(ms): 991, consume cost(ms): 991, received rows: 0, put rows: 0
I20240601 10:21:38.008385 23956 data_consumer.cpp:242] kafka consume timeout: 8343cf255ebc49be-e1c697f95b7cbaae
I20240601 10:21:38.500804 23956 data_consumer.cpp:253] consumer meet partition eof: 8343cf255ebc49be-e1c697f95b7cbaae partition offset: 1
I20240601 10:21:38.500849 23956 data_consumer.cpp:274] kafka consumer done: 8343cf255ebc49be-e1c697f95b7cbaae, grp: 0a462574a4f1f94b-83c413e3774200bb. cancelled: 0, left time(ms): 28508, total cost(ms): 1492, consume cost(ms): 1492, received rows: 0, put rows: 0
I20240601 10:21:38.500870 23956 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 0a462574a4f1f94b-83c413e3774200bb
I20240601 10:21:38.500911 42560 data_consumer_group.cpp:128] consumer group done: 0a462574a4f1f94b-83c413e3774200bb. consume time(ms)=1492, received rows=0, received bytes=0, eos: 1, left_time: 28508, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 1492712, blocking put time(us): 0, id=dc01f4799a2e4135-920cd0a61d40c592, job_id=25052, txn_id=2083341, label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, elapse(s)=1
I20240601 10:21:38.500944 42560 data_consumer.cpp:417] kafka consumer cancelled. 1d414a36d9e35349-57f180696d8319b4
I20240601 10:21:38.500959 42560 data_consumer.cpp:417] kafka consumer cancelled. 8343cf255ebc49be-e1c697f95b7cbaae
I20240601 10:21:38.501266 23973 vtablet_writer.cpp:963] VNodeChannel[17616-10006], load_id=dc01f4799a2e4135-920cd0a61d40c592, txn_id=2083341, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:21:38.501286 23973 vtablet_writer.cpp:963] VNodeChannel[17616-10005], load_id=dc01f4799a2e4135-920cd0a61d40c592, txn_id=2083341, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:21:38.501602 43831 tablets_channel.cpp:226] close tablets channel: (load_id=dc01f4799a2e4135-920cd0a61d40c592, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:21:38.502532 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. dc01f4799a2e4135-920cd0a61d40c592
I20240601 10:21:38.508458 43831 load_channel.cpp:55] load channel removed load_id=dc01f4799a2e4135-920cd0a61d40c592, is high priority=1, sender_ip=225.225.225.3, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:21:38.516228 23973 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=110681, load id=dc01f4799a2e4135-920cd0a61d40c592
I20240601 10:21:38.516258 23973 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=dc01f4799a2e4135-920cd0a61d40c592, txn_id=2083341, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(14)(0)(15)(1)} {10006:(13)(0)(15)(1)} 
I20240601 10:21:38.516511 50811 fragment_mgr.cpp:588] Removing query dc01f4799a2e4135-920cd0a61d40c592 instance dc01f4799a2e4135-920cd0a61d40c593, all done? true
I20240601 10:21:38.516535 50811 fragment_mgr.cpp:594] Query dc01f4799a2e4135-920cd0a61d40c592 finished
I20240601 10:21:38.516556 50811 stream_load_executor.cpp:152] finished to execute stream load. label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, txn_id=2083341, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1517
I20240601 10:21:38.518417 50811 query_context.cpp:114] Query dc01f4799a2e4135-920cd0a61d40c592 deconstructed, , deregister query/load memory tracker, queryId=dc01f4799a2e4135-920cd0a61d40c592, Limit=2.00 GB, CurrUsed=736.00 KB, PeakUsed=824.97 KB
I20240601 10:21:38.549086 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083341
W20240601 10:21:38.560770 44704 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=934e76afa202d7fb-d0032bdffe5e6fbe, job_id=-1, txn_id=2083334, label=2e8de8fb-89d0-4110-b14a-ecb4afb91a32, elapse(s)=30
I20240601 10:21:38.586143 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:21:38.586225 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:21:38.586278 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:21:38.586292 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:21:38.586311 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:21:38.586323 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:21:38.586333 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:21:38.586339 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:21:38.875098 43411 load_channel_mgr.cpp:224] cleaning timed out load channels
I20240601 10:21:38.938359 44249 tablets_channel.cpp:134] open tablets channel: (load_id=96411bc9ea8cd335-9622bb7db92705b5, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:39.044782 43901 tablets_channel.cpp:226] close tablets channel: (load_id=96411bc9ea8cd335-9622bb7db92705b5, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:39.134378 44709 stream_load.cpp:198] new income streaming load request.id=884161dc1f605040-e828ed95ec815faf, job_id=-1, txn_id=-1, label=4637c690-4e58-4e70-b358-5d4d4ca142cd, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:21:39.152194 44709 stream_load_executor.cpp:71] begin to execute stream load. label=4637c690-4e58-4e70-b358-5d4d4ca142cd, txn_id=2083343, query_id=0-0
I20240601 10:21:39.152413 44709 fragment_mgr.cpp:636] query_id: 884161dc1f605040-e828ed95ec815faf coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:21:39.152437 44709 fragment_mgr.cpp:661] Query/load id: 884161dc1f605040-e828ed95ec815faf, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:39.152462 44709 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 884161dc1f605040-e828ed95ec815faf limit: 0
I20240601 10:21:39.152485 44709 pipeline_fragment_context.cpp:244] Preparing instance 884161dc1f605040-e828ed95ec815faf|884161dc1f605040-e828ed95ec815fb0, backend_num 0
I20240601 10:21:39.158265 44709 stream_load.cpp:204] finished to handle HTTP header, id=884161dc1f605040-e828ed95ec815faf, job_id=-1, txn_id=2083343, label=4637c690-4e58-4e70-b358-5d4d4ca142cd, elapse(s)=0
I20240601 10:21:39.165390 44178 tablets_channel.cpp:134] open tablets channel: (load_id=884161dc1f605040-e828ed95ec815faf, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:39.254487 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=884161dc1f605040-e828ed95ec815faf, txn_id=2083343, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:21:39.254606 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=884161dc1f605040-e828ed95ec815faf, txn_id=2083343, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:21:39.260182 44531 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 884161dc1f605040-e828ed95ec815faf
I20240601 10:21:39.264518 43951 tablets_channel.cpp:226] close tablets channel: (load_id=884161dc1f605040-e828ed95ec815faf, index_id=487076), sender id: 0, backend id: 10006
W20240601 10:21:39.468350 44724 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=8c437c865d68a690-de27ce08e4cc07be, job_id=-1, txn_id=2083336, label=1b05435f-67f7-438e-bd0e-46751306fb0b, elapse(s)=30
I20240601 10:21:39.632913 43877 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:21:39.649173 44112 tablets_channel.cpp:134] open tablets channel: (load_id=6f4956d537e6d095-4b3707b7bc9f44a2, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:39.728348 43838 tablets_channel.cpp:226] close tablets channel: (load_id=6f4956d537e6d095-4b3707b7bc9f44a2, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:39.745617 43901 load_channel.cpp:55] load channel removed load_id=96411bc9ea8cd335-9622bb7db92705b5, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:39.775246 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083342
I20240601 10:21:39.946218 43951 load_channel.cpp:55] load channel removed load_id=884161dc1f605040-e828ed95ec815faf, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:39.949613 23973 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=5973797, load id=884161dc1f605040-e828ed95ec815faf
I20240601 10:21:39.949640 23973 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=884161dc1f605040-e828ed95ec815faf, txn_id=2083343, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(76)(0)(695)(1)} {10006:(689)(0)(695)(1)} 
I20240601 10:21:39.950098 50807 fragment_mgr.cpp:588] Removing query 884161dc1f605040-e828ed95ec815faf instance 884161dc1f605040-e828ed95ec815fb0, all done? true
I20240601 10:21:39.950129 50807 fragment_mgr.cpp:594] Query 884161dc1f605040-e828ed95ec815faf finished
I20240601 10:21:39.950158 50807 stream_load_executor.cpp:152] finished to execute stream load. label=4637c690-4e58-4e70-b358-5d4d4ca142cd, txn_id=2083343, query_id=0-0, receive_data_cost_ms=57, read_data_cost_ms=3, write_data_cost_ms=797
I20240601 10:21:39.951989 50807 query_context.cpp:114] Query 884161dc1f605040-e828ed95ec815faf deconstructed, , deregister query/load memory tracker, queryId=884161dc1f605040-e828ed95ec815faf, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:21:39.975129 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083343
I20240601 10:21:40.045692 44711 stream_load.cpp:198] new income streaming load request.id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, job_id=-1, txn_id=-1, label=5e8ed013-d247-400f-b7cb-e2e88a5cd442, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:21:40.063450 44711 stream_load_executor.cpp:71] begin to execute stream load. label=5e8ed013-d247-400f-b7cb-e2e88a5cd442, txn_id=2083345, query_id=0-0
I20240601 10:21:40.063660 44711 fragment_mgr.cpp:636] query_id: 5d4c6fea96d5ffb1-8a5964fc5b9baa92 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:21:40.063689 44711 fragment_mgr.cpp:661] Query/load id: 5d4c6fea96d5ffb1-8a5964fc5b9baa92, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:21:40.063771 44711 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 5d4c6fea96d5ffb1-8a5964fc5b9baa92 limit: 0
I20240601 10:21:40.063810 44711 pipeline_fragment_context.cpp:244] Preparing instance 5d4c6fea96d5ffb1-8a5964fc5b9baa92|5d4c6fea96d5ffb1-8a5964fc5b9baa93, backend_num 0
I20240601 10:21:40.068755 44711 stream_load.cpp:204] finished to handle HTTP header, id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, job_id=-1, txn_id=2083345, label=5e8ed013-d247-400f-b7cb-e2e88a5cd442, elapse(s)=0
I20240601 10:21:40.073962 44035 tablets_channel.cpp:134] open tablets channel: (load_id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:40.094223 24110 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 460ms in state CONNECT)
I20240601 10:21:40.104940 43877 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 460ms in state CONNECT)
I20240601 10:21:40.164865 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, txn_id=2083345, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:21:40.164968 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, txn_id=2083345, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:21:40.171666 44383 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 5d4c6fea96d5ffb1-8a5964fc5b9baa92
I20240601 10:21:40.174733 43841 tablets_channel.cpp:226] close tablets channel: (load_id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:40.413944 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:21:40.498941 43838 load_channel.cpp:55] load channel removed load_id=6f4956d537e6d095-4b3707b7bc9f44a2, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:40.533596 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083344
I20240601 10:21:40.576850 44226 tablets_channel.cpp:134] open tablets channel: (load_id=f249b6663596cdf2-b625d5f195a226a4, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:21:40.689078 43905 tablets_channel.cpp:226] close tablets channel: (load_id=f249b6663596cdf2-b625d5f195a226a4, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:21:40.833233 43841 load_channel.cpp:55] load channel removed load_id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:40.836349 23973 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=7051380, load id=5d4c6fea96d5ffb1-8a5964fc5b9baa92
I20240601 10:21:40.836387 23973 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, txn_id=2083345, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(72)(0)(672)(1)} {10006:(665)(0)(672)(1)} 
I20240601 10:21:40.836753 50806 fragment_mgr.cpp:588] Removing query 5d4c6fea96d5ffb1-8a5964fc5b9baa92 instance 5d4c6fea96d5ffb1-8a5964fc5b9baa93, all done? true
I20240601 10:21:40.836779 50806 fragment_mgr.cpp:594] Query 5d4c6fea96d5ffb1-8a5964fc5b9baa92 finished
I20240601 10:21:40.836802 50806 stream_load_executor.cpp:152] finished to execute stream load. label=5e8ed013-d247-400f-b7cb-e2e88a5cd442, txn_id=2083345, query_id=0-0, receive_data_cost_ms=58, read_data_cost_ms=2, write_data_cost_ms=773
I20240601 10:21:40.838109 50806 query_context.cpp:114] Query 5d4c6fea96d5ffb1-8a5964fc5b9baa92 deconstructed, , deregister query/load memory tracker, queryId=5d4c6fea96d5ffb1-8a5964fc5b9baa92, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:21:40.867187 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083345
I20240601 10:21:41.014789 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707104768 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707104768 Bytes.];[/data5/storage/wal: limit 279285158707 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285158707 Bytes.];[/data6/storage/wal: limit 277832233369 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277832233369 Bytes.];
I20240601 10:21:41.389250 43905 load_channel.cpp:55] load channel removed load_id=f249b6663596cdf2-b625d5f195a226a4, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:21:41.433686 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083346
I20240601 10:21:45.520637 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:21:45.520681 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:21:45.520720 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:21:45.520731 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:21:45.520745 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 1ms, deleted group size:0
I20240601 10:21:45.520754 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:21:45.520766 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:21:45.520777 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:21:46.264288 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:21:50.131453 44016 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:21:51.042955 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707101491 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707101491 Bytes.];[/data5/storage/wal: limit 279285153792 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285153792 Bytes.];[/data6/storage/wal: limit 277831921254 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277831921254 Bytes.];
I20240601 10:21:52.054778 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 340
I20240601 10:21:52.055132 43681 storage_engine.cpp:1110] collected 0 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:21:52.055145 43681 storage_engine.cpp:1126] removed all collected unused rowsets
I20240601 10:21:57.072945 43826 tablet_manager.cpp:1013] find expired transactions for 0 tablets
I20240601 10:21:57.095484 43826 tablet_manager.cpp:1044] success to build all report tablets info. tablet_count=10659
W20240601 10:21:58.553980 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:22:00.143615 43978 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:22:00.426360 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:22:01.069608 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264707098624 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264707098624 Bytes.];[/data5/storage/wal: limit 279285149696 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285149696 Bytes.];[/data6/storage/wal: limit 277831614873 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277831614873 Bytes.];
I20240601 10:22:01.153555 43983 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:22:04.429392 48594 tablet_manager.cpp:1288] finish to do meta checkpoint on dir: /data5/storage, number: 4, cost(ms): 343432
I20240601 10:22:04.429440 43732 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 75075844(us) [Publish Statistics: schedule time(us): 21, lock wait time(us): 1, save meta time(us): 43644, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 75032171]
I20240601 10:22:04.429698 43758 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 75041454(us) [Publish Statistics: schedule time(us): 78, lock wait time(us): 2, save meta time(us): 34196, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 75007135]
I20240601 10:22:04.429910 43746 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 75041879(us) [Publish Statistics: schedule time(us): 53, lock wait time(us): 1, save meta time(us): 34440, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 75007343]
I20240601 10:22:04.430117 43745 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 75041533(us) [Publish Statistics: schedule time(us): 34305, lock wait time(us): 0, save meta time(us): 49809, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 74957403]
I20240601 10:22:04.430308 43754 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 75041252(us) [Publish Statistics: schedule time(us): 61655, lock wait time(us): 1, save meta time(us): 47170, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 74932408]
I20240601 10:22:04.431131 43750 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 75041983(us) [Publish Statistics: schedule time(us): 112674, lock wait time(us): 2, save meta time(us): 46416, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 74882872]
I20240601 10:22:04.431315 43735 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 75042042(us) [Publish Statistics: schedule time(us): 302146, lock wait time(us): 1, save meta time(us): 32601, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 74707285]
I20240601 10:22:04.431502 43748 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 75042057(us) [Publish Statistics: schedule time(us): 495474, lock wait time(us): 1, save meta time(us): 132108, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 74414462]
W20240601 10:22:07.868820 42558 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=4e3fb4a08f284614-a51f37a4eed2130d, job_id=25385, txn_id=2083338, label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, elapse(s)=31
I20240601 10:22:07.868999 42558 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:22:07.869865 42558 routine_load_task_executor.cpp:262] finished routine load task id=4e3fb4a08f284614-a51f37a4eed2130d, job_id=25385, txn_id=2083338, label=rr_error_kafka-25385-4e3fb4a08f284614-a51f37a4eed2130d-2083338, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 1
I20240601 10:22:08.391350 43825 data_dir.cpp:882] path: /data4/storage total capacity: 3991941488640, available capacity: 2647288242176, usage: 0.336842, in_use: 1
I20240601 10:22:08.391400 43825 data_dir.cpp:882] path: /data5/storage total capacity: 3991941488640, available capacity: 2792851484672, usage: 0.300378, in_use: 1
I20240601 10:22:08.391412 43825 data_dir.cpp:882] path: /data6/storage total capacity: 3991941488640, available capacity: 2778313932800, usage: 0.304019, in_use: 1
I20240601 10:22:08.401859 43825 storage_engine.cpp:366] get root path info cost: 10 ms. tablet counter: 10659
W20240601 10:22:08.518154 42560 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=dc01f4799a2e4135-920cd0a61d40c592, job_id=25052, txn_id=2083341, label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, elapse(s)=31
I20240601 10:22:08.518397 42560 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:22:08.519654 42560 routine_load_task_executor.cpp:262] finished routine load task id=dc01f4799a2e4135-920cd0a61d40c592, job_id=25052, txn_id=2083341, label=ott_liveprepull_kafka-25052-dc01f4799a2e4135-920cd0a61d40c592-2083341, elapse(s)=31, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 0
I20240601 10:22:09.306713 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:22:09.306784 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:22:09.306826 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:22:09.306833 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:22:09.306844 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:22:09.306851 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:22:09.306859 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:22:09.306864 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:22:09.951598 44709 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=884161dc1f605040-e828ed95ec815faf, job_id=-1, txn_id=2083343, label=4637c690-4e58-4e70-b358-5d4d4ca142cd, elapse(s)=30
I20240601 10:22:10.809429 44709 stream_load.cpp:198] new income streaming load request.id=cd440ddf126f97b9-01a1cdaf9c26e190, job_id=-1, txn_id=-1, label=eff8c98e-8d26-4f6b-b58c-c3ecefcf47b0, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:22:10.825928 44709 stream_load_executor.cpp:71] begin to execute stream load. label=eff8c98e-8d26-4f6b-b58c-c3ecefcf47b0, txn_id=2083347, query_id=0-0
I20240601 10:22:10.826109 44709 fragment_mgr.cpp:636] query_id: cd440ddf126f97b9-01a1cdaf9c26e190 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:10.826131 44709 fragment_mgr.cpp:661] Query/load id: cd440ddf126f97b9-1a1cdaf9c26e190, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:10.826208 44709 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: cd440ddf126f97b9-1a1cdaf9c26e190 limit: 0
I20240601 10:22:10.826236 44709 pipeline_fragment_context.cpp:244] Preparing instance cd440ddf126f97b9-1a1cdaf9c26e190|cd440ddf126f97b9-1a1cdaf9c26e191, backend_num 0
I20240601 10:22:10.829711 44709 stream_load.cpp:204] finished to handle HTTP header, id=cd440ddf126f97b9-01a1cdaf9c26e190, job_id=-1, txn_id=2083347, label=eff8c98e-8d26-4f6b-b58c-c3ecefcf47b0, elapse(s)=0
I20240601 10:22:10.835311 44236 tablets_channel.cpp:134] open tablets channel: (load_id=cd440ddf126f97b9-01a1cdaf9c26e190, index_id=487076), tablets num: 1802, timeout(s): 259200
W20240601 10:22:10.839016 44711 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=5d4c6fea96d5ffb1-8a5964fc5b9baa92, job_id=-1, txn_id=2083345, label=5e8ed013-d247-400f-b7cb-e2e88a5cd442, elapse(s)=30
W20240601 10:22:10.883659 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:22:10.923983 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=cd440ddf126f97b9-1a1cdaf9c26e190, txn_id=2083347, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:10.924062 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=cd440ddf126f97b9-1a1cdaf9c26e190, txn_id=2083347, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:10.932947 44546 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. cd440ddf126f97b9-1a1cdaf9c26e190
I20240601 10:22:10.937690 43871 tablets_channel.cpp:226] close tablets channel: (load_id=cd440ddf126f97b9-01a1cdaf9c26e190, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:11.049765 44099 tablets_channel.cpp:134] open tablets channel: (load_id=df4f98bd7d12fb2b-8e5863e6109a618f, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:11.097548 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264728820940 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264728820940 Bytes.];[/data5/storage/wal: limit 279285148057 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285148057 Bytes.];[/data6/storage/wal: limit 277831297843 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277831297843 Bytes.];
I20240601 10:22:11.134065 43963 tablets_channel.cpp:226] close tablets channel: (load_id=df4f98bd7d12fb2b-8e5863e6109a618f, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:11.171774 44010 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:22:11.566077 44704 stream_load.cpp:198] new income streaming load request.id=8f4562d1899c3932-def2768f3a8c5c95, job_id=-1, txn_id=-1, label=1da05441-487e-48ea-a289-712a3c0bf4e7, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:22:11.571265 43871 load_channel.cpp:55] load channel removed load_id=cd440ddf126f97b9-01a1cdaf9c26e190, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:11.574483 23973 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=9369496, load id=cd440ddf126f97b9-1a1cdaf9c26e190
I20240601 10:22:11.574512 23973 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=cd440ddf126f97b9-1a1cdaf9c26e190, txn_id=2083347, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(68)(0)(650)(1)} {10006:(642)(0)(651)(1)} 
I20240601 10:22:11.575009 50803 fragment_mgr.cpp:588] Removing query cd440ddf126f97b9-1a1cdaf9c26e190 instance cd440ddf126f97b9-1a1cdaf9c26e191, all done? true
I20240601 10:22:11.575035 50803 fragment_mgr.cpp:594] Query cd440ddf126f97b9-1a1cdaf9c26e190 finished
I20240601 10:22:11.575075 50803 stream_load_executor.cpp:152] finished to execute stream load. label=eff8c98e-8d26-4f6b-b58c-c3ecefcf47b0, txn_id=2083347, query_id=0-0, receive_data_cost_ms=54, read_data_cost_ms=2, write_data_cost_ms=749
I20240601 10:22:11.576870 50803 query_context.cpp:114] Query cd440ddf126f97b9-1a1cdaf9c26e190 deconstructed, , deregister query/load memory tracker, queryId=cd440ddf126f97b9-1a1cdaf9c26e190, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:22:11.582376 44704 stream_load_executor.cpp:71] begin to execute stream load. label=1da05441-487e-48ea-a289-712a3c0bf4e7, txn_id=2083349, query_id=0-0
I20240601 10:22:11.582518 44704 fragment_mgr.cpp:636] query_id: 8f4562d1899c3932-def2768f3a8c5c95 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:11.582540 44704 fragment_mgr.cpp:661] Query/load id: 8f4562d1899c3932-def2768f3a8c5c95, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:11.582554 44704 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 8f4562d1899c3932-def2768f3a8c5c95 limit: 0
I20240601 10:22:11.582581 44704 pipeline_fragment_context.cpp:244] Preparing instance 8f4562d1899c3932-def2768f3a8c5c95|8f4562d1899c3932-def2768f3a8c5c96, backend_num 0
I20240601 10:22:11.584481 44704 stream_load.cpp:204] finished to handle HTTP header, id=8f4562d1899c3932-def2768f3a8c5c95, job_id=-1, txn_id=2083349, label=1da05441-487e-48ea-a289-712a3c0bf4e7, elapse(s)=0
I20240601 10:22:11.593230 44058 tablets_channel.cpp:134] open tablets channel: (load_id=8f4562d1899c3932-def2768f3a8c5c95, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:11.605912 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083347
I20240601 10:22:11.685158 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=8f4562d1899c3932-def2768f3a8c5c95, txn_id=2083349, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:11.685228 23973 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=8f4562d1899c3932-def2768f3a8c5c95, txn_id=2083349, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:11.691864 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 8f4562d1899c3932-def2768f3a8c5c95
I20240601 10:22:11.704483 44001 tablets_channel.cpp:226] close tablets channel: (load_id=8f4562d1899c3932-def2768f3a8c5c95, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:11.827070 43963 load_channel.cpp:55] load channel removed load_id=df4f98bd7d12fb2b-8e5863e6109a618f, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:11.855620 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083348
I20240601 10:22:11.921423 44201 tablets_channel.cpp:134] open tablets channel: (load_id=1444c2babef51d6e-9f99ba83b23dc1aa, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:12.038838 43974 tablets_channel.cpp:226] close tablets channel: (load_id=1444c2babef51d6e-9f99ba83b23dc1aa, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:12.454366 44711 stream_load.cpp:198] new income streaming load request.id=8241293482a6168b-33c31e0664cff880, job_id=-1, txn_id=-1, label=fdcd4d04-48f4-4ce7-b8f1-37753a8f21ef, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:22:12.480571 44711 stream_load_executor.cpp:71] begin to execute stream load. label=fdcd4d04-48f4-4ce7-b8f1-37753a8f21ef, txn_id=2083351, query_id=0-0
I20240601 10:22:12.480773 44711 fragment_mgr.cpp:636] query_id: 8241293482a6168b-33c31e0664cff880 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:12.480796 44711 fragment_mgr.cpp:661] Query/load id: 8241293482a6168b-33c31e0664cff880, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:12.480821 44711 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 8241293482a6168b-33c31e0664cff880 limit: 0
I20240601 10:22:12.480849 44711 pipeline_fragment_context.cpp:244] Preparing instance 8241293482a6168b-33c31e0664cff880|8241293482a6168b-33c31e0664cff881, backend_num 0
I20240601 10:22:12.484791 44001 load_channel.cpp:55] load channel removed load_id=8f4562d1899c3932-def2768f3a8c5c95, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:12.485865 44711 stream_load.cpp:204] finished to handle HTTP header, id=8241293482a6168b-33c31e0664cff880, job_id=-1, txn_id=2083351, label=fdcd4d04-48f4-4ce7-b8f1-37753a8f21ef, elapse(s)=0
I20240601 10:22:12.489534 23973 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=7501602, load id=8f4562d1899c3932-def2768f3a8c5c95
I20240601 10:22:12.489583 23973 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=8f4562d1899c3932-def2768f3a8c5c95, txn_id=2083349, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(69)(0)(804)(1)} {10006:(797)(0)(804)(1)} 
I20240601 10:22:12.490229 50802 fragment_mgr.cpp:588] Removing query 8f4562d1899c3932-def2768f3a8c5c95 instance 8f4562d1899c3932-def2768f3a8c5c96, all done? true
I20240601 10:22:12.490303 50802 fragment_mgr.cpp:594] Query 8f4562d1899c3932-def2768f3a8c5c95 finished
I20240601 10:22:12.490358 50802 stream_load_executor.cpp:152] finished to execute stream load. label=1da05441-487e-48ea-a289-712a3c0bf4e7, txn_id=2083349, query_id=0-0, receive_data_cost_ms=51, read_data_cost_ms=4, write_data_cost_ms=907
I20240601 10:22:12.492857 50802 query_context.cpp:114] Query 8f4562d1899c3932-def2768f3a8c5c95 deconstructed, , deregister query/load memory tracker, queryId=8f4562d1899c3932-def2768f3a8c5c95, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:22:12.493388 44197 tablets_channel.cpp:134] open tablets channel: (load_id=8241293482a6168b-33c31e0664cff880, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:12.522961 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083349
I20240601 10:22:12.574831 33700 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=8241293482a6168b-33c31e0664cff880, txn_id=2083351, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:12.574892 33700 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=8241293482a6168b-33c31e0664cff880, txn_id=2083351, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:12.579350 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 8241293482a6168b-33c31e0664cff880
I20240601 10:22:12.582181 43837 tablets_channel.cpp:226] close tablets channel: (load_id=8241293482a6168b-33c31e0664cff880, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:12.800462 43974 load_channel.cpp:55] load channel removed load_id=1444c2babef51d6e-9f99ba83b23dc1aa, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:12.839262 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083350
I20240601 10:22:13.244942 43837 load_channel.cpp:55] load channel removed load_id=8241293482a6168b-33c31e0664cff880, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:13.248025 33700 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=4203563, load id=8241293482a6168b-33c31e0664cff880
I20240601 10:22:13.248113 33700 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=8241293482a6168b-33c31e0664cff880, txn_id=2083351, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(64)(0)(674)(1)} {10006:(669)(0)(673)(1)} 
I20240601 10:22:13.248479 50805 fragment_mgr.cpp:588] Removing query 8241293482a6168b-33c31e0664cff880 instance 8241293482a6168b-33c31e0664cff881, all done? true
I20240601 10:22:13.248507 50805 fragment_mgr.cpp:594] Query 8241293482a6168b-33c31e0664cff880 finished
I20240601 10:22:13.248528 50805 stream_load_executor.cpp:152] finished to execute stream load. label=fdcd4d04-48f4-4ce7-b8f1-37753a8f21ef, txn_id=2083351, query_id=0-0, receive_data_cost_ms=65, read_data_cost_ms=2, write_data_cost_ms=767
I20240601 10:22:13.249877 50805 query_context.cpp:114] Query 8241293482a6168b-33c31e0664cff880 deconstructed, , deregister query/load memory tracker, queryId=8241293482a6168b-33c31e0664cff880, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:22:13.273342 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083351
I20240601 10:22:16.239320 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:22:16.239357 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:22:16.239383 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:22:16.239389 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:22:16.239398 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:22:16.239403 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:22:16.239409 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:22:16.239413 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:22:17.015126 44063 tablets_channel.cpp:134] open tablets channel: (load_id=759d05dab7c74ac4-8afbb23ae071bfc1, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:22:17.020563 44077 tablets_channel.cpp:134] open tablets channel: (load_id=f586aa4b2ff04e57-92b91f5b1cc1be76, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:22:17.022940 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=d1a9fcc0320d4125-9d7256ef642a4f47, job_id=25716, txn_id=2083354, label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, elapse(s)=0, current tasks num: 1
I20240601 10:22:17.022948 42565 routine_load_task_executor.cpp:290] begin to execute routine load task: id=d1a9fcc0320d4125-9d7256ef642a4f47, job_id=25716, txn_id=2083354, label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, elapse(s)=0
I20240601 10:22:17.023221 42565 data_consumer_pool.cpp:103] get consumer group 804a1b8cf83cced1-147fd33f56a3cdb9 with 2 consumers
I20240601 10:22:17.023288 42565 data_consumer.cpp:169] consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 804a1b8cf83cced1-147fd33f56a3cdb9 assign topic partitions: ott-rr, [3: -1] 
I20240601 10:22:17.023332 42565 data_consumer.cpp:169] consumer: 874e44f576bc1a40-9f9c469aee9b4a82, grp: 804a1b8cf83cced1-147fd33f56a3cdb9 assign topic partitions: ott-rr, [8: -1] 
I20240601 10:22:17.023365 42565 stream_load_executor.cpp:71] begin to execute stream load. label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, txn_id=2083354, query_id=0-0
I20240601 10:22:17.023458 42565 fragment_mgr.cpp:636] query_id: d1a9fcc0320d4125-9d7256ef642a4f47 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:17.023474 42565 fragment_mgr.cpp:661] Query/load id: d1a9fcc0320d4125-9d7256ef642a4f47, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:17.023495 42565 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: d1a9fcc0320d4125-9d7256ef642a4f47 limit: 0
I20240601 10:22:17.023514 42565 pipeline_fragment_context.cpp:244] Preparing instance d1a9fcc0320d4125-9d7256ef642a4f47|d1a9fcc0320d4125-9d7256ef642a4f48, backend_num 0
I20240601 10:22:17.024027 42565 data_consumer_group.cpp:108] start consumer group: 804a1b8cf83cced1-147fd33f56a3cdb9. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=d1a9fcc0320d4125-9d7256ef642a4f47, job_id=25716, txn_id=2083354, label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, elapse(s)=0
I20240601 10:22:17.024093 34453 data_consumer.cpp:194] start kafka consumer: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 804a1b8cf83cced1-147fd33f56a3cdb9, max running time(ms): 30000
I20240601 10:22:17.024142 34454 data_consumer.cpp:194] start kafka consumer: 874e44f576bc1a40-9f9c469aee9b4a82, grp: 804a1b8cf83cced1-147fd33f56a3cdb9, max running time(ms): 30000
I20240601 10:22:17.025267 44090 tablets_channel.cpp:134] open tablets channel: (load_id=d1a9fcc0320d4125-9d7256ef642a4f47, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:22:17.029049 42563 routine_load_task_executor.cpp:290] begin to execute routine load task: id=4ebc236dfbe44e4a-b878b82481ae343d, job_id=25716, txn_id=2083355, label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, elapse(s)=0
I20240601 10:22:17.029047 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=4ebc236dfbe44e4a-b878b82481ae343d, job_id=25716, txn_id=2083355, label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, elapse(s)=0, current tasks num: 2
I20240601 10:22:17.029255 42563 data_consumer_pool.cpp:103] get consumer group 6e4f39ae97450a5d-16488b29c831d5b2 with 2 consumers
I20240601 10:22:17.029273 42563 data_consumer.cpp:169] consumer: 2241ee10c66d49c4-3e61fbc6333d9e88, grp: 6e4f39ae97450a5d-16488b29c831d5b2 assign topic partitions: ott-rr, [2: -1] 
I20240601 10:22:17.029309 42563 data_consumer.cpp:169] consumer: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: 6e4f39ae97450a5d-16488b29c831d5b2 assign topic partitions: ott-rr, [7: -1] 
I20240601 10:22:17.029345 42563 stream_load_executor.cpp:71] begin to execute stream load. label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, txn_id=2083355, query_id=0-0
I20240601 10:22:17.029443 42563 fragment_mgr.cpp:636] query_id: 4ebc236dfbe44e4a-b878b82481ae343d coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:17.029462 42563 fragment_mgr.cpp:661] Query/load id: 4ebc236dfbe44e4a-b878b82481ae343d, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:17.030150 42563 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 4ebc236dfbe44e4a-b878b82481ae343d limit: 0
I20240601 10:22:17.030174 42563 pipeline_fragment_context.cpp:244] Preparing instance 4ebc236dfbe44e4a-b878b82481ae343d|4ebc236dfbe44e4a-b878b82481ae343e, backend_num 0
I20240601 10:22:17.030745 42563 data_consumer_group.cpp:108] start consumer group: 6e4f39ae97450a5d-16488b29c831d5b2. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=4ebc236dfbe44e4a-b878b82481ae343d, job_id=25716, txn_id=2083355, label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, elapse(s)=0
I20240601 10:22:17.030789 34455 data_consumer.cpp:194] start kafka consumer: 2241ee10c66d49c4-3e61fbc6333d9e88, grp: 6e4f39ae97450a5d-16488b29c831d5b2, max running time(ms): 30000
I20240601 10:22:17.030833 34456 data_consumer.cpp:194] start kafka consumer: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: 6e4f39ae97450a5d-16488b29c831d5b2, max running time(ms): 30000
I20240601 10:22:17.031963 44196 tablets_channel.cpp:134] open tablets channel: (load_id=4ebc236dfbe44e4a-b878b82481ae343d, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:22:17.038203 44075 tablets_channel.cpp:134] open tablets channel: (load_id=d8bda8b4c3b64f54-9d5a1dacdf75e098, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:22:17.514869 43958 tablets_channel.cpp:226] close tablets channel: (load_id=759d05dab7c74ac4-8afbb23ae071bfc1, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:22:17.515515 43958 load_channel.cpp:55] load channel removed load_id=759d05dab7c74ac4-8afbb23ae071bfc1, is high priority=1, sender_ip=225.225.225.2, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:17.521200 43864 tablets_channel.cpp:226] close tablets channel: (load_id=f586aa4b2ff04e57-92b91f5b1cc1be76, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:22:17.521632 43864 load_channel.cpp:55] load channel removed load_id=f586aa4b2ff04e57-92b91f5b1cc1be76, is high priority=1, sender_ip=225.225.225.2, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:17.524698 34453 data_consumer.cpp:253] consumer meet partition eof: 284f78dce6aa57fa-a67ebfcab4715bbd partition offset: 0
I20240601 10:22:17.524736 34453 data_consumer.cpp:274] kafka consumer done: 284f78dce6aa57fa-a67ebfcab4715bbd, grp: 804a1b8cf83cced1-147fd33f56a3cdb9. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:22:17.524737 34454 data_consumer.cpp:253] consumer meet partition eof: 874e44f576bc1a40-9f9c469aee9b4a82 partition offset: 0
I20240601 10:22:17.524793 34454 data_consumer.cpp:274] kafka consumer done: 874e44f576bc1a40-9f9c469aee9b4a82, grp: 804a1b8cf83cced1-147fd33f56a3cdb9. cancelled: 0, left time(ms): 29500, total cost(ms): 500, consume cost(ms): 500, received rows: 0, put rows: 0
I20240601 10:22:17.524813 34454 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 804a1b8cf83cced1-147fd33f56a3cdb9
I20240601 10:22:17.524829 42565 data_consumer_group.cpp:128] consumer group done: 804a1b8cf83cced1-147fd33f56a3cdb9. consume time(ms)=500, received rows=0, received bytes=0, eos: 1, left_time: 29500, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 500773, blocking put time(us): 0, id=d1a9fcc0320d4125-9d7256ef642a4f47, job_id=25716, txn_id=2083354, label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, elapse(s)=0
I20240601 10:22:17.524868 42565 data_consumer.cpp:417] kafka consumer cancelled. 284f78dce6aa57fa-a67ebfcab4715bbd
I20240601 10:22:17.524880 42565 data_consumer.cpp:417] kafka consumer cancelled. 874e44f576bc1a40-9f9c469aee9b4a82
I20240601 10:22:17.525126 33700 vtablet_writer.cpp:963] VNodeChannel[25388-10006], load_id=d1a9fcc0320d4125-9d7256ef642a4f47, txn_id=2083354, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:17.525215 33700 vtablet_writer.cpp:963] VNodeChannel[25388-10005], load_id=d1a9fcc0320d4125-9d7256ef642a4f47, txn_id=2083354, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:17.525871 43907 tablets_channel.cpp:226] close tablets channel: (load_id=d1a9fcc0320d4125-9d7256ef642a4f47, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:22:17.526458 43907 load_channel.cpp:55] load channel removed load_id=d1a9fcc0320d4125-9d7256ef642a4f47, is high priority=1, sender_ip=225.225.225.3, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:17.526818 44546 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. d1a9fcc0320d4125-9d7256ef642a4f47
I20240601 10:22:17.528407 33700 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=96953, load id=d1a9fcc0320d4125-9d7256ef642a4f47
I20240601 10:22:17.528437 33700 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=d1a9fcc0320d4125-9d7256ef642a4f47, txn_id=2083354, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(1)(0)(3)(1)} {10006:(1)(0)(2)(1)} 
I20240601 10:22:17.528604 50801 fragment_mgr.cpp:588] Removing query d1a9fcc0320d4125-9d7256ef642a4f47 instance d1a9fcc0320d4125-9d7256ef642a4f48, all done? true
I20240601 10:22:17.528627 50801 fragment_mgr.cpp:594] Query d1a9fcc0320d4125-9d7256ef642a4f47 finished
I20240601 10:22:17.528646 50801 stream_load_executor.cpp:152] finished to execute stream load. label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, txn_id=2083354, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=505
I20240601 10:22:17.529049 50801 query_context.cpp:114] Query d1a9fcc0320d4125-9d7256ef642a4f47 deconstructed, , deregister query/load memory tracker, queryId=d1a9fcc0320d4125-9d7256ef642a4f47, Limit=2.00 GB, CurrUsed=512.00 KB, PeakUsed=555.09 KB
I20240601 10:22:17.529618 34456 data_consumer.cpp:253] consumer meet partition eof: 0746d3fd9f19d3ec-23ac73dbfd8a5589 partition offset: 0
I20240601 10:22:17.529641 34456 data_consumer.cpp:274] kafka consumer done: 0746d3fd9f19d3ec-23ac73dbfd8a5589, grp: 6e4f39ae97450a5d-16488b29c831d5b2. cancelled: 0, left time(ms): 29502, total cost(ms): 498, consume cost(ms): 498, received rows: 0, put rows: 0
I20240601 10:22:17.530750 34455 data_consumer.cpp:253] consumer meet partition eof: 2241ee10c66d49c4-3e61fbc6333d9e88 partition offset: 0
I20240601 10:22:17.530776 34455 data_consumer.cpp:274] kafka consumer done: 2241ee10c66d49c4-3e61fbc6333d9e88, grp: 6e4f39ae97450a5d-16488b29c831d5b2. cancelled: 0, left time(ms): 29501, total cost(ms): 499, consume cost(ms): 499, received rows: 0, put rows: 0
I20240601 10:22:17.530787 34455 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 6e4f39ae97450a5d-16488b29c831d5b2
I20240601 10:22:17.530799 42563 data_consumer_group.cpp:128] consumer group done: 6e4f39ae97450a5d-16488b29c831d5b2. consume time(ms)=500, received rows=0, received bytes=0, eos: 1, left_time: 29500, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 500031, blocking put time(us): 0, id=4ebc236dfbe44e4a-b878b82481ae343d, job_id=25716, txn_id=2083355, label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, elapse(s)=0
I20240601 10:22:17.530830 42563 data_consumer.cpp:417] kafka consumer cancelled. 2241ee10c66d49c4-3e61fbc6333d9e88
I20240601 10:22:17.530843 42563 data_consumer.cpp:417] kafka consumer cancelled. 0746d3fd9f19d3ec-23ac73dbfd8a5589
I20240601 10:22:17.531069 34457 vtablet_writer.cpp:963] VNodeChannel[25388-10006], load_id=4ebc236dfbe44e4a-b878b82481ae343d, txn_id=2083355, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:17.531087 34457 vtablet_writer.cpp:963] VNodeChannel[25388-10005], load_id=4ebc236dfbe44e4a-b878b82481ae343d, txn_id=2083355, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:17.531440 43848 tablets_channel.cpp:226] close tablets channel: (load_id=4ebc236dfbe44e4a-b878b82481ae343d, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:22:17.532315 44545 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 4ebc236dfbe44e4a-b878b82481ae343d
I20240601 10:22:17.532395 43848 load_channel.cpp:55] load channel removed load_id=4ebc236dfbe44e4a-b878b82481ae343d, is high priority=1, sender_ip=225.225.225.3, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:17.533921 34457 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=653411, load id=4ebc236dfbe44e4a-b878b82481ae343d
I20240601 10:22:17.533946 34457 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=4ebc236dfbe44e4a-b878b82481ae343d, txn_id=2083355, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(1)(0)(2)(1)} {10006:(1)(0)(2)(1)} 
I20240601 10:22:17.534125 50820 fragment_mgr.cpp:588] Removing query 4ebc236dfbe44e4a-b878b82481ae343d instance 4ebc236dfbe44e4a-b878b82481ae343e, all done? true
I20240601 10:22:17.534152 50820 fragment_mgr.cpp:594] Query 4ebc236dfbe44e4a-b878b82481ae343d finished
I20240601 10:22:17.534168 50820 stream_load_executor.cpp:152] finished to execute stream load. label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, txn_id=2083355, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=504
I20240601 10:22:17.534583 50820 query_context.cpp:114] Query 4ebc236dfbe44e4a-b878b82481ae343d deconstructed, , deregister query/load memory tracker, queryId=4ebc236dfbe44e4a-b878b82481ae343d, Limit=2.00 GB, CurrUsed=512.00 KB, PeakUsed=555.09 KB
I20240601 10:22:17.557917 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083352
I20240601 10:22:17.607810 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083353
I20240601 10:22:17.641495 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083354
I20240601 10:22:17.666606 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083355
I20240601 10:22:18.539368 43953 tablets_channel.cpp:226] close tablets channel: (load_id=d8bda8b4c3b64f54-9d5a1dacdf75e098, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:22:18.539937 43953 load_channel.cpp:55] load channel removed load_id=d8bda8b4c3b64f54-9d5a1dacdf75e098, is high priority=1, sender_ip=225.225.225.2, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:18.575346 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083356
I20240601 10:22:20.439299 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:22:21.125919 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264728804556 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264728804556 Bytes.];[/data5/storage/wal: limit 279285141504 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285141504 Bytes.];[/data6/storage/wal: limit 277831003340 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277831003340 Bytes.];
I20240601 10:22:21.200335 43927 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:22:22.055228 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 340
I20240601 10:22:22.055656 43681 storage_engine.cpp:1110] collected 0 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:22:22.055670 43681 storage_engine.cpp:1126] removed all collected unused rowsets
W20240601 10:22:23.122496 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:22:23.498018 48593 tablet_manager.cpp:1288] finish to do meta checkpoint on dir: /data4/storage, number: 3, cost(ms): 362500
I20240601 10:22:23.498193 43763 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083263, version=48307, num_rows=5000, res=[OK], cost: 94144615(us) [Publish Statistics: schedule time(us): 30, lock wait time(us): 2, save meta time(us): 55093, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 94089485]
I20240601 10:22:23.498436 43744 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083264, version=48308, num_rows=5000, res=[OK], cost: 94110410(us) [Publish Statistics: schedule time(us): 43, lock wait time(us): 1, save meta time(us): 62442, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 94047917]
I20240601 10:22:23.498625 43759 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083266, version=48310, num_rows=5000, res=[OK], cost: 94110391(us) [Publish Statistics: schedule time(us): 35, lock wait time(us): 2, save meta time(us): 62260, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 94048083]
I20240601 10:22:23.498814 43752 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083277, version=48311, num_rows=5000, res=[OK], cost: 94109766(us) [Publish Statistics: schedule time(us): 59122, lock wait time(us): 1, save meta time(us): 94298, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 93956338]
I20240601 10:22:23.499014 43742 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083265, version=48309, num_rows=5000, res=[OK], cost: 94110416(us) [Publish Statistics: schedule time(us): 34281, lock wait time(us): 1, save meta time(us): 119604, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 93956516]
I20240601 10:22:23.499193 43747 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083278, version=48312, num_rows=5000, res=[OK], cost: 94110069(us) [Publish Statistics: schedule time(us): 112442, lock wait time(us): 1, save meta time(us): 82599, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 93915018]
I20240601 10:22:23.499382 43756 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083279, version=48313, num_rows=5000, res=[OK], cost: 94110113(us) [Publish Statistics: schedule time(us): 287187, lock wait time(us): 1, save meta time(us): 83261, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 93739651]
I20240601 10:22:23.499563 43762 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083280, version=48314, num_rows=5000, res=[OK], cost: 94110120(us) [Publish Statistics: schedule time(us): 495269, lock wait time(us): 1, save meta time(us): 50458, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 93564384]
I20240601 10:22:31.152839 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264717920665 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264717920665 Bytes.];[/data5/storage/wal: limit 279285143142 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285143142 Bytes.];[/data6/storage/wal: limit 277830686720 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277830686720 Bytes.];
W20240601 10:22:35.443905 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:22:38.875278 43411 load_channel_mgr.cpp:224] cleaning timed out load channels
I20240601 10:22:40.026996 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:22:40.027063 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:22:40.027099 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:22:40.027107 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:22:40.027117 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:22:40.027122 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:22:40.027128 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:22:40.027133 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:22:40.451025 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:22:41.181592 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264717920665 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264717920665 Bytes.];[/data5/storage/wal: limit 279285143142 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285143142 Bytes.];[/data6/storage/wal: limit 277830369689 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277830369689 Bytes.];
I20240601 10:22:41.236980 44003 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:22:41.534250 37800 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 296ms in state CONNECT)
I20240601 10:22:41.537465 44003 data_consumer.h:94] kafka error: Local: Broker transport failure, event: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 296ms in state CONNECT)
I20240601 10:22:41.543262 43915 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
W20240601 10:22:41.576133 44709 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=cd440ddf126f97b9-01a1cdaf9c26e190, job_id=-1, txn_id=2083347, label=eff8c98e-8d26-4f6b-b58c-c3ecefcf47b0, elapse(s)=30
W20240601 10:22:42.492136 44704 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=8f4562d1899c3932-def2768f3a8c5c95, job_id=-1, txn_id=2083349, label=1da05441-487e-48ea-a289-712a3c0bf4e7, elapse(s)=30
I20240601 10:22:42.675818 44176 tablets_channel.cpp:134] open tablets channel: (load_id=8244b58d89270c24-261e18eea3eb1f96, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:42.789882 43830 tablets_channel.cpp:226] close tablets channel: (load_id=8244b58d89270c24-261e18eea3eb1f96, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:42.886626 44704 stream_load.cpp:198] new income streaming load request.id=924c910bc5353f8e-af9663936a922086, job_id=-1, txn_id=-1, label=cf7a53df-0d7a-4942-a642-a8d17eada993, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:22:42.901939 44704 stream_load_executor.cpp:71] begin to execute stream load. label=cf7a53df-0d7a-4942-a642-a8d17eada993, txn_id=2083358, query_id=0-0
I20240601 10:22:42.902141 44704 fragment_mgr.cpp:636] query_id: 924c910bc5353f8e-af9663936a922086 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:42.902166 44704 fragment_mgr.cpp:661] Query/load id: 924c910bc5353f8e-af9663936a922086, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:42.902189 44704 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 924c910bc5353f8e-af9663936a922086 limit: 0
I20240601 10:22:42.902218 44704 pipeline_fragment_context.cpp:244] Preparing instance 924c910bc5353f8e-af9663936a922086|924c910bc5353f8e-af9663936a922087, backend_num 0
I20240601 10:22:42.905686 44704 stream_load.cpp:204] finished to handle HTTP header, id=924c910bc5353f8e-af9663936a922086, job_id=-1, txn_id=2083358, label=cf7a53df-0d7a-4942-a642-a8d17eada993, elapse(s)=0
I20240601 10:22:42.911880 44126 tablets_channel.cpp:134] open tablets channel: (load_id=924c910bc5353f8e-af9663936a922086, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:42.996647 34457 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=924c910bc5353f8e-af9663936a922086, txn_id=2083358, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:42.996697 34457 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=924c910bc5353f8e-af9663936a922086, txn_id=2083358, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:43.003562 44546 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 924c910bc5353f8e-af9663936a922086
I20240601 10:22:43.008163 43942 tablets_channel.cpp:226] close tablets channel: (load_id=924c910bc5353f8e-af9663936a922086, index_id=487076), sender id: 0, backend id: 10006
W20240601 10:22:43.250152 44711 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=8241293482a6168b-33c31e0664cff880, job_id=-1, txn_id=2083351, label=fdcd4d04-48f4-4ce7-b8f1-37753a8f21ef, elapse(s)=30
I20240601 10:22:43.350040 43830 load_channel.cpp:55] load channel removed load_id=8244b58d89270c24-261e18eea3eb1f96, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:43.392674 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083357
I20240601 10:22:43.496431 43942 load_channel.cpp:55] load channel removed load_id=924c910bc5353f8e-af9663936a922086, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:43.499366 34457 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=7900719, load id=924c910bc5353f8e-af9663936a922086
I20240601 10:22:43.499399 34457 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=924c910bc5353f8e-af9663936a922086, txn_id=2083358, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(68)(0)(503)(1)} {10006:(496)(0)(503)(1)} 
I20240601 10:22:43.499830 50849 fragment_mgr.cpp:588] Removing query 924c910bc5353f8e-af9663936a922086 instance 924c910bc5353f8e-af9663936a922087, all done? true
I20240601 10:22:43.499855 50849 fragment_mgr.cpp:594] Query 924c910bc5353f8e-af9663936a922086 finished
I20240601 10:22:43.499879 50849 stream_load_executor.cpp:152] finished to execute stream load. label=cf7a53df-0d7a-4942-a642-a8d17eada993, txn_id=2083358, query_id=0-0, receive_data_cost_ms=53, read_data_cost_ms=2, write_data_cost_ms=597
I20240601 10:22:43.501096 50849 query_context.cpp:114] Query 924c910bc5353f8e-af9663936a922086 deconstructed, , deregister query/load memory tracker, queryId=924c910bc5353f8e-af9663936a922086, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:22:43.534663 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083358
I20240601 10:22:43.590377 44062 tablets_channel.cpp:134] open tablets channel: (load_id=af4ae12ec0ece5fd-45db12f93d1c0d8c, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:43.691730 43891 tablets_channel.cpp:226] close tablets channel: (load_id=af4ae12ec0ece5fd-45db12f93d1c0d8c, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:43.852618 44709 stream_load.cpp:198] new income streaming load request.id=6f4819ac950056c2-ac739e051bc31b88, job_id=-1, txn_id=-1, label=a2bb895a-b65f-473a-b56d-22841fcc5b84, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:22:43.881381 44709 stream_load_executor.cpp:71] begin to execute stream load. label=a2bb895a-b65f-473a-b56d-22841fcc5b84, txn_id=2083360, query_id=0-0
I20240601 10:22:43.881632 44709 fragment_mgr.cpp:636] query_id: 6f4819ac950056c2-ac739e051bc31b88 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:43.881659 44709 fragment_mgr.cpp:661] Query/load id: 6f4819ac950056c2-ac739e051bc31b88, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:43.881690 44709 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 6f4819ac950056c2-ac739e051bc31b88 limit: 0
I20240601 10:22:43.881800 44709 pipeline_fragment_context.cpp:244] Preparing instance 6f4819ac950056c2-ac739e051bc31b88|6f4819ac950056c2-ac739e051bc31b89, backend_num 0
I20240601 10:22:43.886610 44709 stream_load.cpp:204] finished to handle HTTP header, id=6f4819ac950056c2-ac739e051bc31b88, job_id=-1, txn_id=2083360, label=a2bb895a-b65f-473a-b56d-22841fcc5b84, elapse(s)=0
I20240601 10:22:43.892539 44096 tablets_channel.cpp:134] open tablets channel: (load_id=6f4819ac950056c2-ac739e051bc31b88, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:43.980757 34457 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=6f4819ac950056c2-ac739e051bc31b88, txn_id=2083360, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:43.980865 34457 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=6f4819ac950056c2-ac739e051bc31b88, txn_id=2083360, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:43.987847 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 6f4819ac950056c2-ac739e051bc31b88
I20240601 10:22:43.990406 43987 tablets_channel.cpp:226] close tablets channel: (load_id=6f4819ac950056c2-ac739e051bc31b88, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:44.236155 43891 load_channel.cpp:55] load channel removed load_id=af4ae12ec0ece5fd-45db12f93d1c0d8c, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:44.318233 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083359
I20240601 10:22:44.342939 44174 tablets_channel.cpp:134] open tablets channel: (load_id=99413fb9b2860fef-96f6b09abc382da1, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:22:44.442230 43987 load_channel.cpp:55] load channel removed load_id=6f4819ac950056c2-ac739e051bc31b88, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:44.446385 34457 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=7203367, load id=6f4819ac950056c2-ac739e051bc31b88
I20240601 10:22:44.446463 34457 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=6f4819ac950056c2-ac739e051bc31b88, txn_id=2083360, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(82)(0)(466)(1)} {10006:(458)(0)(466)(1)} 
I20240601 10:22:44.446941 50846 fragment_mgr.cpp:588] Removing query 6f4819ac950056c2-ac739e051bc31b88 instance 6f4819ac950056c2-ac739e051bc31b89, all done? true
I20240601 10:22:44.446969 50846 fragment_mgr.cpp:594] Query 6f4819ac950056c2-ac739e051bc31b88 finished
I20240601 10:22:44.446992 50846 stream_load_executor.cpp:152] finished to execute stream load. label=a2bb895a-b65f-473a-b56d-22841fcc5b84, txn_id=2083360, query_id=0-0, receive_data_cost_ms=68, read_data_cost_ms=2, write_data_cost_ms=565
I20240601 10:22:44.448659 50846 query_context.cpp:114] Query 6f4819ac950056c2-ac739e051bc31b88 deconstructed, , deregister query/load memory tracker, queryId=6f4819ac950056c2-ac739e051bc31b88, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
I20240601 10:22:44.478331 43868 tablets_channel.cpp:226] close tablets channel: (load_id=99413fb9b2860fef-96f6b09abc382da1, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:22:44.484923 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083360
I20240601 10:22:44.951429 43868 load_channel.cpp:55] load channel removed load_id=99413fb9b2860fef-96f6b09abc382da1, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:22:44.985379 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083361
I20240601 10:22:46.960294 23749 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:22:46.960340 23749 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:22:46.960376 23749 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:22:46.960382 23749 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:22:46.960393 23749 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:22:46.960398 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:22:46.960407 23749 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:22:46.960410 23749 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
W20240601 10:22:47.530115 42565 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=d1a9fcc0320d4125-9d7256ef642a4f47, job_id=25716, txn_id=2083354, label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, elapse(s)=30
I20240601 10:22:47.530283 42565 routine_load_task_executor.cpp:262] finished routine load task id=d1a9fcc0320d4125-9d7256ef642a4f47, job_id=25716, txn_id=2083354, label=rr_service_kafka-25716-d1a9fcc0320d4125-9d7256ef642a4f47-2083354, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 1
W20240601 10:22:47.535282 42563 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=4ebc236dfbe44e4a-b878b82481ae343d, job_id=25716, txn_id=2083355, label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, elapse(s)=30
I20240601 10:22:47.535410 42563 routine_load_task_executor.cpp:262] finished routine load task id=4ebc236dfbe44e4a-b878b82481ae343d, job_id=25716, txn_id=2083355, label=rr_service_kafka-25716-4ebc236dfbe44e4a-b878b82481ae343d-2083355, elapse(s)=30, status: [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, current tasks num: 0
I20240601 10:22:47.700860 89401 heartbeat_server.cpp:61] get heartbeat from FE.host:225.225.225.2, port:9020, cluster id:875414020, frontend_info:TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.2, port=9020), process_uuid=1716195276797) TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.3, port=9020), process_uuid=1716195357252) TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) , counter:123205, BE start time: 1715945768527
W20240601 10:22:47.700928 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:22:51.210321 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264717903872 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264717903872 Bytes.];[/data5/storage/wal: limit 279285137817 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285137817 Bytes.];[/data6/storage/wal: limit 277830065356 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277830065356 Bytes.];
I20240601 10:22:52.055752 43681 storage_engine.cpp:1077] start to delete unused rowset, size: 340
I20240601 10:22:52.056152 43681 storage_engine.cpp:1110] collected 0 unused rowsets to remove, skipped 340 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240601 10:22:52.056164 43681 storage_engine.cpp:1126] removed all collected unused rowsets
I20240601 10:22:52.560765 43926 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:22:57.049427 44083 tablets_channel.cpp:134] open tablets channel: (load_id=102f8647598649c9-85226f4a10eb29cf, index_id=25388), tablets num: 210, timeout(s): 60
I20240601 10:22:57.051766 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=a2d2b6e53b5f41c9-a04c5aa268a2579f, job_id=25385, txn_id=2083363, label=rr_error_kafka-25385-a2d2b6e53b5f41c9-a04c5aa268a2579f-2083363, elapse(s)=0, current tasks num: 1
I20240601 10:22:57.051803 42566 routine_load_task_executor.cpp:290] begin to execute routine load task: id=a2d2b6e53b5f41c9-a04c5aa268a2579f, job_id=25385, txn_id=2083363, label=rr_error_kafka-25385-a2d2b6e53b5f41c9-a04c5aa268a2579f-2083363, elapse(s)=0
I20240601 10:22:57.051987 42566 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:22:57.052429 42566 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:22:57.052793 42566 data_consumer_pool.cpp:103] get consumer group ef47eb7752efe160-2341263f90fc069a with 2 consumers
I20240601 10:22:57.052809 42566 data_consumer.cpp:169] consumer: d74ab87eb9d07339-225a6608f9e7fc91, grp: ef47eb7752efe160-2341263f90fc069a assign topic partitions: ott-rr-error, [0: -1] 
I20240601 10:22:57.052913 42566 data_consumer.cpp:169] consumer: d345bd7b483edabe-a04d839303d7eca5, grp: ef47eb7752efe160-2341263f90fc069a assign topic partitions: ott-rr-error, [5: -1] 
I20240601 10:22:57.053061 42566 stream_load_executor.cpp:71] begin to execute stream load. label=rr_error_kafka-25385-a2d2b6e53b5f41c9-a04c5aa268a2579f-2083363, txn_id=2083363, query_id=0-0
I20240601 10:22:57.053141 42566 fragment_mgr.cpp:636] query_id: a2d2b6e53b5f41c9-a04c5aa268a2579f coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:57.053159 42566 fragment_mgr.cpp:661] Query/load id: a2d2b6e53b5f41c9-a04c5aa268a2579f, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:57.053225 42566 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: a2d2b6e53b5f41c9-a04c5aa268a2579f limit: 0
I20240601 10:22:57.053246 42566 pipeline_fragment_context.cpp:244] Preparing instance a2d2b6e53b5f41c9-a04c5aa268a2579f|a2d2b6e53b5f41c9-a04c5aa268a257a0, backend_num 0
I20240601 10:22:57.053725 42566 data_consumer_group.cpp:108] start consumer group: ef47eb7752efe160-2341263f90fc069a. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=a2d2b6e53b5f41c9-a04c5aa268a2579f, job_id=25385, txn_id=2083363, label=rr_error_kafka-25385-a2d2b6e53b5f41c9-a04c5aa268a2579f-2083363, elapse(s)=0
I20240601 10:22:57.053766 38899 data_consumer.cpp:194] start kafka consumer: d74ab87eb9d07339-225a6608f9e7fc91, grp: ef47eb7752efe160-2341263f90fc069a, max running time(ms): 30000
I20240601 10:22:57.053802 38900 data_consumer.cpp:194] start kafka consumer: d345bd7b483edabe-a04d839303d7eca5, grp: ef47eb7752efe160-2341263f90fc069a, max running time(ms): 30000
I20240601 10:22:57.054926 44032 tablets_channel.cpp:134] open tablets channel: (load_id=a2d2b6e53b5f41c9-a04c5aa268a2579f, index_id=25057), tablets num: 210, timeout(s): 60
I20240601 10:22:57.119671 44218 tablets_channel.cpp:134] open tablets channel: (load_id=d2c1f1a2f83e4e82-b1f7fd42cb6f3f64, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:22:57.182592 44021 tablets_channel.cpp:134] open tablets channel: (load_id=d4221a5242d047e6-b96a169b6abea58f, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:22:57.206233 14209 routine_load_task_executor.cpp:272] submit a new routine load task: id=a49cde01e19146b5-bb75cc1aa294edfd, job_id=25052, txn_id=2083366, label=ott_liveprepull_kafka-25052-a49cde01e19146b5-bb75cc1aa294edfd-2083366, elapse(s)=0, current tasks num: 2
I20240601 10:22:57.206236 42561 routine_load_task_executor.cpp:290] begin to execute routine load task: id=a49cde01e19146b5-bb75cc1aa294edfd, job_id=25052, txn_id=2083366, label=ott_liveprepull_kafka-25052-a49cde01e19146b5-bb75cc1aa294edfd-2083366, elapse(s)=0
I20240601 10:22:57.206624 42561 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:22:57.207311 42561 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-liveprepull1
I20240601 10:22:57.207839 42561 data_consumer_pool.cpp:103] get consumer group a44e422b7c8c340d-ea648f8e4933cdbb with 2 consumers
I20240601 10:22:57.207870 42561 data_consumer.cpp:169] consumer: 4c4d39a1cb54de6f-2db47b9521bd81b4, grp: a44e422b7c8c340d-ea648f8e4933cdbb assign topic partitions: doris-ott-liveprepull, [1: -1] 
I20240601 10:22:57.208020 42561 data_consumer.cpp:169] consumer: 11441eb6a90b9bc9-7272e3c021f3098b, grp: a44e422b7c8c340d-ea648f8e4933cdbb assign topic partitions: doris-ott-liveprepull, [6: -1] 
I20240601 10:22:57.208192 42561 stream_load_executor.cpp:71] begin to execute stream load. label=ott_liveprepull_kafka-25052-a49cde01e19146b5-bb75cc1aa294edfd-2083366, txn_id=2083366, query_id=0-0
I20240601 10:22:57.208392 42561 fragment_mgr.cpp:636] query_id: a49cde01e19146b5-bb75cc1aa294edfd coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:22:57.208421 42561 fragment_mgr.cpp:661] Query/load id: a49cde01e19146b5-bb75cc1aa294edfd, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:22:57.208446 42561 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: a49cde01e19146b5-bb75cc1aa294edfd limit: 0
I20240601 10:22:57.208539 42561 pipeline_fragment_context.cpp:244] Preparing instance a49cde01e19146b5-bb75cc1aa294edfd|a49cde01e19146b5-bb75cc1aa294edfe, backend_num 0
I20240601 10:22:57.219543 42561 data_consumer_group.cpp:108] start consumer group: a44e422b7c8c340d-ea648f8e4933cdbb. max time(ms): 30000, batch rows: 200000, batch size: 209715200. id=a49cde01e19146b5-bb75cc1aa294edfd, job_id=25052, txn_id=2083366, label=ott_liveprepull_kafka-25052-a49cde01e19146b5-bb75cc1aa294edfd-2083366, elapse(s)=0
I20240601 10:22:57.219599 38915 data_consumer.cpp:194] start kafka consumer: 4c4d39a1cb54de6f-2db47b9521bd81b4, grp: a44e422b7c8c340d-ea648f8e4933cdbb, max running time(ms): 30000
I20240601 10:22:57.219636 38914 data_consumer.cpp:194] start kafka consumer: 11441eb6a90b9bc9-7272e3c021f3098b, grp: a44e422b7c8c340d-ea648f8e4933cdbb, max running time(ms): 30000
I20240601 10:22:57.230404 44043 tablets_channel.cpp:134] open tablets channel: (load_id=a49cde01e19146b5-bb75cc1aa294edfd, index_id=17616), tablets num: 4800, timeout(s): 60
I20240601 10:22:57.549770 43892 tablets_channel.cpp:226] close tablets channel: (load_id=102f8647598649c9-85226f4a10eb29cf, index_id=25388), sender id: 0, backend id: 10006
I20240601 10:22:57.550302 43892 load_channel.cpp:55] load channel removed load_id=102f8647598649c9-85226f4a10eb29cf, is high priority=1, sender_ip=225.225.225.2, index id: 25388, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:57.583004 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083362
I20240601 10:22:58.053903 38899 data_consumer.cpp:242] kafka consume timeout: d74ab87eb9d07339-225a6608f9e7fc91
I20240601 10:22:58.053921 38900 data_consumer.cpp:242] kafka consume timeout: d345bd7b483edabe-a04d839303d7eca5
I20240601 10:22:58.054229 38899 data_consumer.cpp:253] consumer meet partition eof: d74ab87eb9d07339-225a6608f9e7fc91 partition offset: 0
I20240601 10:22:58.054248 38899 data_consumer.cpp:274] kafka consumer done: d74ab87eb9d07339-225a6608f9e7fc91, grp: ef47eb7752efe160-2341263f90fc069a. cancelled: 0, left time(ms): 29000, total cost(ms): 1000, consume cost(ms): 1000, received rows: 0, put rows: 0
I20240601 10:22:58.219707 38915 data_consumer.cpp:242] kafka consume timeout: 4c4d39a1cb54de6f-2db47b9521bd81b4
I20240601 10:22:58.219744 38914 data_consumer.cpp:242] kafka consume timeout: 11441eb6a90b9bc9-7272e3c021f3098b
I20240601 10:22:58.555003 38900 data_consumer.cpp:253] consumer meet partition eof: d345bd7b483edabe-a04d839303d7eca5 partition offset: 0
I20240601 10:22:58.555066 38900 data_consumer.cpp:274] kafka consumer done: d345bd7b483edabe-a04d839303d7eca5, grp: ef47eb7752efe160-2341263f90fc069a. cancelled: 0, left time(ms): 28499, total cost(ms): 1501, consume cost(ms): 1501, received rows: 0, put rows: 0
I20240601 10:22:58.555083 38900 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: ef47eb7752efe160-2341263f90fc069a
I20240601 10:22:58.555097 42566 data_consumer_group.cpp:128] consumer group done: ef47eb7752efe160-2341263f90fc069a. consume time(ms)=1501, received rows=0, received bytes=0, eos: 1, left_time: 28499, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 1501353, blocking put time(us): 0, id=a2d2b6e53b5f41c9-a04c5aa268a2579f, job_id=25385, txn_id=2083363, label=rr_error_kafka-25385-a2d2b6e53b5f41c9-a04c5aa268a2579f-2083363, elapse(s)=1
I20240601 10:22:58.555126 42566 data_consumer.cpp:417] kafka consumer cancelled. d74ab87eb9d07339-225a6608f9e7fc91
I20240601 10:22:58.555132 42566 data_consumer.cpp:417] kafka consumer cancelled. d345bd7b483edabe-a04d839303d7eca5
I20240601 10:22:58.555387 34457 vtablet_writer.cpp:963] VNodeChannel[25057-10006], load_id=a2d2b6e53b5f41c9-a04c5aa268a2579f, txn_id=2083363, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:58.555418 34457 vtablet_writer.cpp:963] VNodeChannel[25057-10005], load_id=a2d2b6e53b5f41c9-a04c5aa268a2579f, txn_id=2083363, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:58.556429 44019 tablets_channel.cpp:226] close tablets channel: (load_id=a2d2b6e53b5f41c9-a04c5aa268a2579f, index_id=25057), sender id: 0, backend id: 10006
I20240601 10:22:58.556943 44019 load_channel.cpp:55] load channel removed load_id=a2d2b6e53b5f41c9-a04c5aa268a2579f, is high priority=1, sender_ip=225.225.225.3, index id: 25057, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:58.557317 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. a2d2b6e53b5f41c9-a04c5aa268a2579f
I20240601 10:22:58.558595 34457 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=115089, load id=a2d2b6e53b5f41c9-a04c5aa268a2579f
I20240601 10:22:58.558624 34457 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=a2d2b6e53b5f41c9-a04c5aa268a2579f, txn_id=2083363, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(0)(0)(3)(1)} {10006:(1)(0)(3)(1)} 
I20240601 10:22:58.558763 50845 fragment_mgr.cpp:588] Removing query a2d2b6e53b5f41c9-a04c5aa268a2579f instance a2d2b6e53b5f41c9-a04c5aa268a257a0, all done? true
I20240601 10:22:58.558792 50845 fragment_mgr.cpp:594] Query a2d2b6e53b5f41c9-a04c5aa268a2579f finished
I20240601 10:22:58.558811 50845 stream_load_executor.cpp:152] finished to execute stream load. label=rr_error_kafka-25385-a2d2b6e53b5f41c9-a04c5aa268a2579f-2083363, txn_id=2083363, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1505
I20240601 10:22:58.559248 50845 query_context.cpp:114] Query a2d2b6e53b5f41c9-a04c5aa268a2579f deconstructed, , deregister query/load memory tracker, queryId=a2d2b6e53b5f41c9-a04c5aa268a2579f, Limit=2.00 GB, CurrUsed=304.00 KB, PeakUsed=337.78 KB
I20240601 10:22:58.591454 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083363
I20240601 10:22:58.604259 43968 tablets_channel.cpp:226] close tablets channel: (load_id=d2c1f1a2f83e4e82-b1f7fd42cb6f3f64, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:22:58.611675 43968 load_channel.cpp:55] load channel removed load_id=d2c1f1a2f83e4e82-b1f7fd42cb6f3f64, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:58.650031 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083364
I20240601 10:22:58.653079 43955 tablets_channel.cpp:226] close tablets channel: (load_id=d4221a5242d047e6-b96a169b6abea58f, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:22:58.660054 43955 load_channel.cpp:55] load channel removed load_id=d4221a5242d047e6-b96a169b6abea58f, is high priority=1, sender_ip=225.225.225.2, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:58.692171 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083365
I20240601 10:22:58.709342 38915 data_consumer.cpp:253] consumer meet partition eof: 4c4d39a1cb54de6f-2db47b9521bd81b4 partition offset: 1
I20240601 10:22:58.709369 38914 data_consumer.cpp:253] consumer meet partition eof: 11441eb6a90b9bc9-7272e3c021f3098b partition offset: 0
I20240601 10:22:58.709390 38915 data_consumer.cpp:274] kafka consumer done: 4c4d39a1cb54de6f-2db47b9521bd81b4, grp: a44e422b7c8c340d-ea648f8e4933cdbb. cancelled: 0, left time(ms): 28511, total cost(ms): 1489, consume cost(ms): 1489, received rows: 0, put rows: 0
I20240601 10:22:58.709398 38914 data_consumer.cpp:274] kafka consumer done: 11441eb6a90b9bc9-7272e3c021f3098b, grp: a44e422b7c8c340d-ea648f8e4933cdbb. cancelled: 0, left time(ms): 28511, total cost(ms): 1489, consume cost(ms): 1489, received rows: 0, put rows: 0
I20240601 10:22:58.709411 38914 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: a44e422b7c8c340d-ea648f8e4933cdbb
I20240601 10:22:58.709432 42561 data_consumer_group.cpp:128] consumer group done: a44e422b7c8c340d-ea648f8e4933cdbb. consume time(ms)=1489, received rows=0, received bytes=0, eos: 1, left_time: 28511, left_rows: 200000, left_bytes: 209715200, blocking get time(us): 1489848, blocking put time(us): 0, id=a49cde01e19146b5-bb75cc1aa294edfd, job_id=25052, txn_id=2083366, label=ott_liveprepull_kafka-25052-a49cde01e19146b5-bb75cc1aa294edfd-2083366, elapse(s)=1
I20240601 10:22:58.709524 42561 data_consumer.cpp:417] kafka consumer cancelled. 4c4d39a1cb54de6f-2db47b9521bd81b4
I20240601 10:22:58.709544 42561 data_consumer.cpp:417] kafka consumer cancelled. 11441eb6a90b9bc9-7272e3c021f3098b
I20240601 10:22:58.709780 38928 vtablet_writer.cpp:963] VNodeChannel[17616-10006], load_id=a49cde01e19146b5-bb75cc1aa294edfd, txn_id=2083366, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:22:58.709805 38928 vtablet_writer.cpp:963] VNodeChannel[17616-10005], load_id=a49cde01e19146b5-bb75cc1aa294edfd, txn_id=2083366, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:22:58.710494 44012 tablets_channel.cpp:226] close tablets channel: (load_id=a49cde01e19146b5-bb75cc1aa294edfd, index_id=17616), sender id: 0, backend id: 10006
I20240601 10:22:58.711297 44334 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. a49cde01e19146b5-bb75cc1aa294edfd
I20240601 10:22:58.724433 44012 load_channel.cpp:55] load channel removed load_id=a49cde01e19146b5-bb75cc1aa294edfd, is high priority=1, sender_ip=225.225.225.3, index id: 17616, total_received_rows: 0, num_rows_filtered: 0
I20240601 10:22:58.736440 38928 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=102174, load id=a49cde01e19146b5-bb75cc1aa294edfd
I20240601 10:22:58.736464 38928 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=a49cde01e19146b5-bb75cc1aa294edfd, txn_id=2083366, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(15)(0)(27)(1)} {10006:(25)(0)(27)(1)} 
I20240601 10:22:58.736692 50848 fragment_mgr.cpp:588] Removing query a49cde01e19146b5-bb75cc1aa294edfd instance a49cde01e19146b5-bb75cc1aa294edfe, all done? true
I20240601 10:22:58.736716 50848 fragment_mgr.cpp:594] Query a49cde01e19146b5-bb75cc1aa294edfd finished
I20240601 10:22:58.736735 50848 stream_load_executor.cpp:152] finished to execute stream load. label=ott_liveprepull_kafka-25052-a49cde01e19146b5-bb75cc1aa294edfd-2083366, txn_id=2083366, query_id=0-0, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=1528
I20240601 10:22:58.738835 50848 query_context.cpp:114] Query a49cde01e19146b5-bb75cc1aa294edfd deconstructed, , deregister query/load memory tracker, queryId=a49cde01e19146b5-bb75cc1aa294edfd, Limit=2.00 GB, CurrUsed=736.00 KB, PeakUsed=824.97 KB
I20240601 10:22:58.758749 14209 task_worker_pool.cpp:329] successfully submit task|type=PUBLISH_VERSION|signature=2083366
I20240601 10:22:59.967173 38925 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 2758ms in state CONNECT)
I20240601 10:22:59.967185 38910 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 2914ms in state CONNECT)
I20240601 10:22:59.967190 38919 data_consumer.h:102] kafka log-3-FAIL, event: [thrd:225.225.225.1:9092/bootstrap]: 225.225.225.1:9092/bootstrap: Connect to ipv4#225.225.225.1:9092 failed: 没有到主机的路由 (after 2759ms in state CONNECT)
W20240601 10:22:59.988008 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
I20240601 10:23:00.133708 43826 tablet_manager.cpp:1013] find expired transactions for 0 tablets
I20240601 10:23:00.155843 43826 tablet_manager.cpp:1044] success to build all report tablets info. tablet_count=10659
I20240601 10:23:00.463135 43729 olap_server.cpp:1109] cooldown producer get tablet num: 0
I20240601 10:23:01.239460 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264717903872 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264717903872 Bytes.];[/data5/storage/wal: limit 279285137817 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285137817 Bytes.];[/data6/storage/wal: limit 277829740134 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277829740134 Bytes.];
I20240601 10:23:03.574398 43982 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:23:09.402570 43825 data_dir.cpp:882] path: /data4/storage total capacity: 3991941488640, available capacity: 2647179038720, usage: 0.336869, in_use: 1
I20240601 10:23:09.402640 43825 data_dir.cpp:882] path: /data5/storage total capacity: 3991941488640, available capacity: 2792851378176, usage: 0.300378, in_use: 1
I20240601 10:23:09.402659 43825 data_dir.cpp:882] path: /data6/storage total capacity: 3991941488640, available capacity: 2778294980608, usage: 0.304024, in_use: 1
I20240601 10:23:09.412482 43825 storage_engine.cpp:366] get root path info cost: 9 ms. tablet counter: 10659
I20240601 10:23:10.747318 14209 topic_subscriber.cpp:43] begin handle topic info
I20240601 10:23:10.747381 14209 workload_group_listener.cpp:56] update workload group finish, tg info=TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], enable_cpu_hard_limit=false, cgroup cpu_shares=0, cgroup cpu_hard_limit=0, enable_cgroup_cpu_soft_limit=true, cgroup home path=
I20240601 10:23:10.747419 14209 cgroup_cpu_ctl.cpp:32] doris cgroup cpu path is not specify, path=
I20240601 10:23:10.747427 14209 workload_group_manager.cpp:123] init workload group mgr cpu ctl failed, [INTERNAL_ERROR]doris cgroup cpu path  is not specify.
I20240601 10:23:10.747437 14209 workload_group_manager.cpp:134] finish clear unused workload group, time cost: 0ms, deleted group size:0
I20240601 10:23:10.747445 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_GROUP successfully
I20240601 10:23:10.747452 14209 workload_sched_policy_listener.cpp:73] [workload_schedule]finish update workload schedule policy, size=0
I20240601 10:23:10.747457 14209 topic_subscriber.cpp:48] handle topic WORKLOAD_SCHED_POLICY successfully
I20240601 10:23:11.268029 43412 wal_manager.cpp:481] Scheduled(every 10s) WAL info: [/data4/storage/wal: limit 264717903872 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 264717903872 Bytes.];[/data5/storage/wal: limit 279285137817 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 279285137817 Bytes.];[/data6/storage/wal: limit 277829448499 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 277829448499 Bytes.];
I20240601 10:23:12.200444 14209 backend_service.cpp:785] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1
W20240601 10:23:12.294097 89401 exec_env.cpp:94] Frontend TFrontendInfo(coordinator_address=TNetworkAddress(hostname=225.225.225.1, port=9020), process_uuid=0) is in an unknown state.
W20240601 10:23:13.501560 44704 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=924c910bc5353f8e-af9663936a922086, job_id=-1, txn_id=2083358, label=cf7a53df-0d7a-4942-a642-a8d17eada993, elapse(s)=30
I20240601 10:23:14.399971 44711 stream_load.cpp:198] new income streaming load request.id=00430900ea6cb1a3-b8a9ca3c99be3c85, job_id=-1, txn_id=-1, label=0f0dd16b-6bcd-4ff0-82af-81db1c1c6d36, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:23:14.414584 44711 stream_load_executor.cpp:71] begin to execute stream load. label=0f0dd16b-6bcd-4ff0-82af-81db1c1c6d36, txn_id=2083367, query_id=0-0
I20240601 10:23:14.414722 44711 fragment_mgr.cpp:636] query_id: 00430900ea6cb1a3-b8a9ca3c99be3c85 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:23:14.414742 44711 fragment_mgr.cpp:661] Query/load id: 430900ea6cb1a3-b8a9ca3c99be3c85, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:23:14.415401 44711 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 430900ea6cb1a3-b8a9ca3c99be3c85 limit: 0
I20240601 10:23:14.415441 44711 pipeline_fragment_context.cpp:244] Preparing instance 430900ea6cb1a3-b8a9ca3c99be3c85|430900ea6cb1a3-b8a9ca3c99be3c86, backend_num 0
I20240601 10:23:14.419278 44711 stream_load.cpp:204] finished to handle HTTP header, id=00430900ea6cb1a3-b8a9ca3c99be3c85, job_id=-1, txn_id=2083367, label=0f0dd16b-6bcd-4ff0-82af-81db1c1c6d36, elapse(s)=0
I20240601 10:23:14.429018 44092 tablets_channel.cpp:134] open tablets channel: (load_id=00430900ea6cb1a3-b8a9ca3c99be3c85, index_id=487076), tablets num: 1802, timeout(s): 259200
W20240601 10:23:14.449232 44709 stream_load_executor.cpp:349] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, id=6f4819ac950056c2-ac739e051bc31b88, job_id=-1, txn_id=2083360, label=a2bb895a-b65f-473a-b56d-22841fcc5b84, elapse(s)=30
I20240601 10:23:14.514807 38928 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=430900ea6cb1a3-b8a9ca3c99be3c85, txn_id=2083367, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:23:14.514886 38928 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=430900ea6cb1a3-b8a9ca3c99be3c85, txn_id=2083367, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:23:14.523731 44410 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 430900ea6cb1a3-b8a9ca3c99be3c85
I20240601 10:23:14.529035 43852 tablets_channel.cpp:226] close tablets channel: (load_id=00430900ea6cb1a3-b8a9ca3c99be3c85, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:23:14.587841 44118 tablets_channel.cpp:134] open tablets channel: (load_id=f7468fd63d0ab176-d073f4df2030b283, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:23:14.596730 43904 data_consumer.cpp:132] init kafka consumer with group id: doris-ott-rr-error1
I20240601 10:23:14.674013 43930 tablets_channel.cpp:226] close tablets channel: (load_id=f7468fd63d0ab176-d073f4df2030b283, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:23:15.043152 43852 load_channel.cpp:55] load channel removed load_id=00430900ea6cb1a3-b8a9ca3c99be3c85, is high priority=0, sender_ip=225.225.225.3, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:23:15.047029 38928 vtablet_writer.cpp:1506] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=8477888, load id=430900ea6cb1a3-b8a9ca3c99be3c85
I20240601 10:23:15.047112 38928 vtablet_writer.cpp:1553] finished to close olap table sink. load_id=430900ea6cb1a3-b8a9ca3c99be3c85, txn_id=2083367, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10005:(72)(0)(533)(1)} {10006:(522)(0)(532)(1)} 
I20240601 10:23:15.047892 50847 fragment_mgr.cpp:588] Removing query 430900ea6cb1a3-b8a9ca3c99be3c85 instance 430900ea6cb1a3-b8a9ca3c99be3c86, all done? true
I20240601 10:23:15.047937 50847 fragment_mgr.cpp:594] Query 430900ea6cb1a3-b8a9ca3c99be3c85 finished
I20240601 10:23:15.047986 50847 stream_load_executor.cpp:152] finished to execute stream load. label=0f0dd16b-6bcd-4ff0-82af-81db1c1c6d36, txn_id=2083367, query_id=0-0, receive_data_cost_ms=53, read_data_cost_ms=2, write_data_cost_ms=633
I20240601 10:23:15.050915 50847 query_context.cpp:114] Query 430900ea6cb1a3-b8a9ca3c99be3c85 deconstructed, , deregister query/load memory tracker, queryId=430900ea6cb1a3-b8a9ca3c99be3c85, Limit=2.00 GB, CurrUsed=-3.32 MB, PeakUsed=5.81 MB
W20240601 10:23:15.055142 44711 status.h:399] meet error status: [ANALYSIS_ERROR]TStatus: errCode = 2, detailMessage = Failed to commit txn 2083367, cause tablet 557616 succ replica num 1 < load required replica num 2. table 487075, partition: [ id=557594, commit version 48355, visible version 48310 ], this tablet detail: 1 replicas final succ: { [replicaId=557618, backendId=10005, backendAlive=true, version=48355, state=NORMAL] }; 1 replicas write data succ but miss previous version: { [replicaId=557617, backendId=10006, backendAlive=true, version=48306, lastFailedVersion=48310, lastSuccessVersion=48306, lastFailedTimestamp=1717208577486, state=NORMAL] }.

	0#  doris::Status doris::Status::create<true>(doris::TStatus const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187
	1#  doris::StreamLoadExecutor::commit_txn(doris::StreamLoadContext*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
	2#  doris::StreamLoadAction::_handle(std::shared_ptr<doris::StreamLoadContext>) at /home/zcp/repo_center/doris_release/doris/be/src/http/action/stream_load.cpp:0
	3#  doris::StreamLoadAction::handle(doris::HttpRequest*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291
	4#  ?
	5#  bufferevent_run_readcb_
	6#  ?
	7#  ?
	8#  ?
	9#  ?
	10# std::_Function_handler<void (), doris::EvHttpServer::start()::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/ext/atomicity.h:98
	11# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
	12# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
	13# start_thread
	14# clone
W20240601 10:23:15.055255 44711 stream_load_executor.cpp:349] commit transaction failed, errmsg=[ANALYSIS_ERROR]TStatus: errCode = 2, detailMessage = Failed to commit txn 2083367, cause tablet 557616 succ replica num 1 < load required replica num 2. table 487075, partition: [ id=557594, commit version 48355, visible version 48310 ], this tablet detail: 1 replicas final succ: { [replicaId=557618, backendId=10005, backendAlive=true, version=48355, state=NORMAL] }; 1 replicas write data succ but miss previous version: { [replicaId=557617, backendId=10006, backendAlive=true, version=48306, lastFailedVersion=48310, lastSuccessVersion=48306, lastFailedTimestamp=1717208577486, state=NORMAL] }.

	0#  doris::Status doris::Status::create<true>(doris::TStatus const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187
	1#  doris::StreamLoadExecutor::commit_txn(doris::StreamLoadContext*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
	2#  doris::StreamLoadAction::_handle(std::shared_ptr<doris::StreamLoadContext>) at /home/zcp/repo_center/doris_release/doris/be/src/http/action/stream_load.cpp:0
	3#  doris::StreamLoadAction::handle(doris::HttpRequest*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291
	4#  ?
	5#  bufferevent_run_readcb_
	6#  ?
	7#  ?
	8#  ?
	9#  ?
	10# std::_Function_handler<void (), doris::EvHttpServer::start()::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/ext/atomicity.h:98
	11# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
	12# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
	13# start_thread
	14# clone
, id=00430900ea6cb1a3-b8a9ca3c99be3c85, job_id=-1, txn_id=2083367, label=0f0dd16b-6bcd-4ff0-82af-81db1c1c6d36, elapse(s)=0
W20240601 10:23:15.055334 44711 stream_load.cpp:112] handle streaming load failed, id=00430900ea6cb1a3-b8a9ca3c99be3c85, errmsg=[ANALYSIS_ERROR]TStatus: errCode = 2, detailMessage = Failed to commit txn 2083367, cause tablet 557616 succ replica num 1 < load required replica num 2. table 487075, partition: [ id=557594, commit version 48355, visible version 48310 ], this tablet detail: 1 replicas final succ: { [replicaId=557618, backendId=10005, backendAlive=true, version=48355, state=NORMAL] }; 1 replicas write data succ but miss previous version: { [replicaId=557617, backendId=10006, backendAlive=true, version=48306, lastFailedVersion=48310, lastSuccessVersion=48306, lastFailedTimestamp=1717208577486, state=NORMAL] }.

	0#  doris::Status doris::Status::create<true>(doris::TStatus const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187
	1#  doris::StreamLoadExecutor::commit_txn(doris::StreamLoadContext*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
	2#  doris::StreamLoadAction::_handle(std::shared_ptr<doris::StreamLoadContext>) at /home/zcp/repo_center/doris_release/doris/be/src/http/action/stream_load.cpp:0
	3#  doris::StreamLoadAction::handle(doris::HttpRequest*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291
	4#  ?
	5#  bufferevent_run_readcb_
	6#  ?
	7#  ?
	8#  ?
	9#  ?
	10# std::_Function_handler<void (), doris::EvHttpServer::start()::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/ext/atomicity.h:98
	11# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
	12# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
	13# start_thread
	14# clone
I20240601 10:23:15.209765 43930 load_channel.cpp:55] load channel removed load_id=f7468fd63d0ab176-d073f4df2030b283, is high priority=0, sender_ip=225.225.225.2, index id: 487076, total_received_rows: 5000, num_rows_filtered: 0
I20240601 10:23:15.304466 44715 stream_load.cpp:198] new income streaming load request.id=7043f19a1805c87f-d5c819cb667235ac, job_id=-1, txn_id=-1, label=e05ca1bc-f796-4f99-aa61-7f793e30c65c, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:23:15.324417 44715 stream_load_executor.cpp:71] begin to execute stream load. label=e05ca1bc-f796-4f99-aa61-7f793e30c65c, txn_id=2083369, query_id=0-0
I20240601 10:23:15.324915 44715 fragment_mgr.cpp:636] query_id: 7043f19a1805c87f-d5c819cb667235ac coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:23:15.324980 44715 fragment_mgr.cpp:661] Query/load id: 7043f19a1805c87f-d5c819cb667235ac, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:23:15.325058 44715 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: 7043f19a1805c87f-d5c819cb667235ac limit: 0
I20240601 10:23:15.325134 44715 pipeline_fragment_context.cpp:244] Preparing instance 7043f19a1805c87f-d5c819cb667235ac|7043f19a1805c87f-d5c819cb667235ad, backend_num 0
I20240601 10:23:15.334600 44715 stream_load.cpp:204] finished to handle HTTP header, id=7043f19a1805c87f-d5c819cb667235ac, job_id=-1, txn_id=2083369, label=e05ca1bc-f796-4f99-aa61-7f793e30c65c, elapse(s)=0
I20240601 10:23:15.343936 44210 tablets_channel.cpp:134] open tablets channel: (load_id=7043f19a1805c87f-d5c819cb667235ac, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:23:15.427376 38928 vtablet_writer.cpp:963] VNodeChannel[487076-10006], load_id=7043f19a1805c87f-d5c819cb667235ac, txn_id=2083369, node=225.225.225.3:8060 mark closed, left pending batch size: 1
I20240601 10:23:15.427423 38928 vtablet_writer.cpp:963] VNodeChannel[487076-10005], load_id=7043f19a1805c87f-d5c819cb667235ac, txn_id=2083369, node=225.225.225.2:8060 mark closed, left pending batch size: 1
I20240601 10:23:15.435024 44410 vtablet_writer.cpp:1008] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 7043f19a1805c87f-d5c819cb667235ac
I20240601 10:23:15.440320 43917 tablets_channel.cpp:226] close tablets channel: (load_id=7043f19a1805c87f-d5c819cb667235ac, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:23:15.558998 44049 tablets_channel.cpp:134] open tablets channel: (load_id=d747ca513907e366-42a236a6f4ec57af, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:23:15.643424 43941 tablets_channel.cpp:226] close tablets channel: (load_id=d747ca513907e366-42a236a6f4ec57af, index_id=487076), sender id: 0, backend id: 10006
I20240601 10:23:15.677874 43749 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083264, version=48308, num_rows=0, res=[OK], cost: 146289854(us) [Publish Statistics: schedule time(us): 44, lock wait time(us): 1, save meta time(us): 46789, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 146243000]
I20240601 10:23:15.678114 43736 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083263, version=48307, num_rows=0, res=[OK], cost: 146324552(us) [Publish Statistics: schedule time(us): 44, lock wait time(us): 1, save meta time(us): 81263, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 146243235]
I20240601 10:23:15.678305 43734 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083266, version=48310, num_rows=0, res=[OK], cost: 146290081(us) [Publish Statistics: schedule time(us): 46, lock wait time(us): 2, save meta time(us): 46627, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 146243380]
I20240601 10:23:15.678488 43741 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083265, version=48309, num_rows=0, res=[OK], cost: 146289905(us) [Publish Statistics: schedule time(us): 34281, lock wait time(us): 1, save meta time(us): 53874, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 146201739]
I20240601 10:23:15.678596 43803 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083265, cost(us): 146290588, error_tablet_size=0, res=[OK]
I20240601 10:23:15.678649 43803 task_worker_pool.cpp:1589] successfully publish version|signature=2083265|transaction_id=2083265|tablets_num=10|cost(s)=318
I20240601 10:23:15.708446 43741 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 29138(us) 
I20240601 10:23:15.720163 43742 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 40835(us) 
I20240601 10:23:15.720211 43736 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 40895(us) 
I20240601 10:23:15.721175 43752 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083281, version=48315, num_rows=5000, res=[OK], cost: 41818(us) 
I20240601 10:23:15.741974 43756 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 62640(us) 
I20240601 10:23:15.742071 43762 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 62752(us) 
I20240601 10:23:15.742439 43763 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557622, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 63069(us) 
I20240601 10:23:15.795290 43734 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557598, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 115977(us) 
I20240601 10:23:15.795302 43749 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557607, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 115969(us) 
I20240601 10:23:15.920894 43755 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083279, version=48313, num_rows=0, res=[OK], cost: 146531614(us) [Publish Statistics: schedule time(us): 259574, lock wait time(us): 8, save meta time(us): 271213, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 146000810]
I20240601 10:23:15.920940 43757 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083280, version=48314, num_rows=0, res=[OK], cost: 146531491(us) [Publish Statistics: schedule time(us): 495058, lock wait time(us): 1, save meta time(us): 68942, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 145967483]
I20240601 10:23:15.920987 43733 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083277, version=48311, num_rows=0, res=[OK], cost: 146531941(us) [Publish Statistics: schedule time(us): 58804, lock wait time(us): 1, save meta time(us): 70991, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 146402135]
I20240601 10:23:15.921237 43760 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083278, version=48312, num_rows=0, res=[OK], cost: 146532099(us) [Publish Statistics: schedule time(us): 112240, lock wait time(us): 0, save meta time(us): 226612, calc delete bitmap time(us): 0, partial update write segment time(us): 0, add inc rowset time(us): 146193236]
I20240601 10:23:15.921324 43747 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083281, version=48315, num_rows=0, res=[OK], cost: 241975(us) 
I20240601 10:23:15.921752 43688 compaction.cpp:207] start to do ordered data compaction, tablet=557616, output_version=[2-48310]
I20240601 10:23:15.967662 43804 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083280, cost(us): 146578276, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967665 43799 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083277, cost(us): 146578689, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967715 43804 task_worker_pool.cpp:1589] successfully publish version|signature=2083280|transaction_id=2083280|tablets_num=10|cost(s)=286
I20240601 10:23:15.967723 43797 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083264, cost(us): 146579867, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967730 43799 task_worker_pool.cpp:1589] successfully publish version|signature=2083277|transaction_id=2083277|tablets_num=10|cost(s)=287
I20240601 10:23:15.967854 43797 task_worker_pool.cpp:1589] successfully publish version|signature=2083264|transaction_id=2083264|tablets_num=10|cost(s)=318
I20240601 10:23:15.967730 43803 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083281, cost(us): 288594, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967728 43801 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083263, cost(us): 146614411, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967723 43802 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083266, cost(us): 146579873, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967919 43801 task_worker_pool.cpp:1589] successfully publish version|signature=2083263|transaction_id=2083263|tablets_num=10|cost(s)=319
I20240601 10:23:15.967723 43798 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083278, cost(us): 146578848, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967942 43803 task_worker_pool.cpp:1589] successfully publish version|signature=2083281|transaction_id=2083281|tablets_num=10|cost(s)=286
I20240601 10:23:15.968034 43799 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083287, cost(us): 23, error_tablet_size=0, res=[OK]
I20240601 10:23:15.967742 43800 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083279, cost(us): 146578765, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968068 43798 task_worker_pool.cpp:1589] successfully publish version|signature=2083278|transaction_id=2083278|tablets_num=10|cost(s)=287
I20240601 10:23:15.967958 43802 task_worker_pool.cpp:1589] successfully publish version|signature=2083266|transaction_id=2083266|tablets_num=10|cost(s)=317
I20240601 10:23:15.968067 43799 task_worker_pool.cpp:1589] successfully publish version|signature=2083287|transaction_id=2083287|tablets_num=0|cost(s)=259
I20240601 10:23:15.967998 43804 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083284, cost(us): 10, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968111 43800 task_worker_pool.cpp:1589] successfully publish version|signature=2083279|transaction_id=2083279|tablets_num=10|cost(s)=286
I20240601 10:23:15.968135 43804 task_worker_pool.cpp:1589] successfully publish version|signature=2083284|transaction_id=2083284|tablets_num=0|cost(s)=259
I20240601 10:23:15.968322 43803 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083289, cost(us): 23, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968351 43803 task_worker_pool.cpp:1589] successfully publish version|signature=2083289|transaction_id=2083289|tablets_num=0|cost(s)=259
I20240601 10:23:15.968340 43797 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083288, cost(us): 21, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968353 43798 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083286, cost(us): 31, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968365 43800 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083291, cost(us): 27, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968394 43800 task_worker_pool.cpp:1589] successfully publish version|signature=2083291|transaction_id=2083291|tablets_num=0|cost(s)=259
I20240601 10:23:15.968372 43797 task_worker_pool.cpp:1589] successfully publish version|signature=2083288|transaction_id=2083288|tablets_num=0|cost(s)=259
I20240601 10:23:15.968349 43801 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083283, cost(us): 67, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968391 43798 task_worker_pool.cpp:1589] successfully publish version|signature=2083286|transaction_id=2083286|tablets_num=0|cost(s)=259
I20240601 10:23:15.968420 43801 task_worker_pool.cpp:1589] successfully publish version|signature=2083283|transaction_id=2083283|tablets_num=0|cost(s)=259
I20240601 10:23:15.968465 43804 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083282, cost(us): 15, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968483 43802 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083285, cost(us): 23, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968485 43804 task_worker_pool.cpp:1589] successfully publish version|signature=2083282|transaction_id=2083282|tablets_num=0|cost(s)=258
I20240601 10:23:15.968511 43802 task_worker_pool.cpp:1589] successfully publish version|signature=2083285|transaction_id=2083285|tablets_num=0|cost(s)=258
I20240601 10:23:15.968521 43799 engine_publish_version_task.cpp:319] finish to publish version on transaction.transaction_id=2083290, cost(us): 12, error_tablet_size=0, res=[OK]
I20240601 10:23:15.968561 43799 task_worker_pool.cpp:1589] successfully publish version|signature=2083290|transaction_id=2083290|tablets_num=0|cost(s)=258
I20240601 10:23:15.972965 43689 compaction.cpp:207] start to do ordered data compaction, tablet=557622, output_version=[2-48315]
I20240601 10:23:15.995374 43732 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083292, version=48316, num_rows=0, res=[OK], cost: 26745(us) 
I20240601 10:23:16.000562 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083292, version=48316, num_rows=0, res=[OK], cost: 31940(us) 
I20240601 10:23:16.028885 43755 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083292, version=48316, num_rows=0, res=[OK], cost: 60183(us) 
I20240601 10:23:16.028923 43739 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083295, version=48319, num_rows=0, res=[OK], cost: 60169(us) 
I20240601 10:23:16.028973 43737 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083297, version=48321, num_rows=0, res=[OK], cost: 60048(us) 
I20240601 10:23:16.029053 43763 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083293, version=48317, num_rows=0, res=[OK], cost: 60385(us) 
I20240601 10:23:16.029110 43752 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083296, version=48320, num_rows=0, res=[OK], cost: 60285(us) 
I20240601 10:23:16.029168 43748 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083295, version=48319, num_rows=0, res=[OK], cost: 60487(us) 
I20240601 10:23:16.029722 44709 stream_load.cpp:198] new income streaming load request.id=e84382f96d96c965-7c27d880dc9a8987, job_id=-1, txn_id=-1, label=549c59e7-0dd0-4c91-bc56-4b46ee4bdec1, elapse(s)=0, db=zs, tbl=vstb_metric, group_commit=0
I20240601 10:23:16.034150 43758 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083296, version=48320, num_rows=0, res=[OK], cost: 65337(us) 
I20240601 10:23:16.034158 43759 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083297, version=48321, num_rows=0, res=[OK], cost: 65228(us) 
I20240601 10:23:16.034194 43743 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083292, version=48316, num_rows=0, res=[OK], cost: 65480(us) 
I20240601 10:23:16.034240 43749 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083298, version=48322, num_rows=0, res=[OK], cost: 65461(us) 
I20240601 10:23:16.034243 43747 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083296, version=48320, num_rows=0, res=[OK], cost: 65409(us) 
I20240601 10:23:16.034303 43750 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083292, version=48316, num_rows=0, res=[OK], cost: 65660(us) 
I20240601 10:23:16.034302 43740 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083295, version=48319, num_rows=0, res=[OK], cost: 65633(us) 
I20240601 10:23:16.034291 43751 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083295, version=48319, num_rows=0, res=[OK], cost: 65535(us) 
I20240601 10:23:16.034364 43762 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083297, version=48321, num_rows=0, res=[OK], cost: 65607(us) 
I20240601 10:23:16.034372 43745 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083295, version=48319, num_rows=0, res=[OK], cost: 65650(us) 
I20240601 10:23:16.034451 43746 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083294, version=48318, num_rows=0, res=[OK], cost: 65777(us) 
I20240601 10:23:16.034513 43735 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083293, version=48317, num_rows=0, res=[OK], cost: 65872(us) 
I20240601 10:23:16.038030 43688 compaction.cpp:327] succeed to do ordered data cumulative compaction. tablet=557616, output_version=[2-48310], disk=/data6/storage, segments=0, input_row_num=0, output_row_num=0, input_rowset_size=0, output_rowset_size=0. elapsed time=0.116531s. cumulative_compaction_policy=size_based
I20240601 10:23:16.045663 44709 stream_load_executor.cpp:71] begin to execute stream load. label=549c59e7-0dd0-4c91-bc56-4b46ee4bdec1, txn_id=2083371, query_id=0-0
I20240601 10:23:16.046015 44709 fragment_mgr.cpp:636] query_id: e84382f96d96c965-7c27d880dc9a8987 coord_addr TNetworkAddress(hostname=225.225.225.2, port=9020) total fragment num on current host: 0 fe process uuid: 0
I20240601 10:23:16.046129 44709 fragment_mgr.cpp:661] Query/load id: e84382f96d96c965-7c27d880dc9a8987, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 33.83 GB, enable_memory_overcommit = true, version = 0, cpu_hard_limit = -1, scan_thread_num = 96, max_remote_scan_thread_num = 96, min_remote_scan_thread_num = 96, spill_low_watermark=50, spill_high_watermark=80], is pipeline: 1, enable cgroup soft limit: 1
I20240601 10:23:16.046159 44709 fragment_mgr.cpp:674] Register query/load memory tracker, query/load id: e84382f96d96c965-7c27d880dc9a8987 limit: 0
I20240601 10:23:16.046188 44709 pipeline_fragment_context.cpp:244] Preparing instance e84382f96d96c965-7c27d880dc9a8987|e84382f96d96c965-7c27d880dc9a8988, backend_num 0
I20240601 10:23:16.051245 44709 stream_load.cpp:204] finished to handle HTTP header, id=e84382f96d96c965-7c27d880dc9a8987, job_id=-1, txn_id=2083371, label=549c59e7-0dd0-4c91-bc56-4b46ee4bdec1, elapse(s)=0
I20240601 10:23:16.056643 44173 tablets_channel.cpp:134] open tablets channel: (load_id=e84382f96d96c965-7c27d880dc9a8987, index_id=487076), tablets num: 1802, timeout(s): 259200
I20240601 10:23:16.062367 43738 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083295, version=48319, num_rows=5000, res=[OK], cost: 93457(us) 
I20240601 10:23:16.062458 43688 compaction.cpp:343] start cumulative compaction. tablet=557619, output_version=[48253-48315], permits: 63
I20240601 10:23:16.062685 43688 merger.cpp:357] Start to do vertical compaction, tablet_id: 557619
I20240601 10:23:16.067456 43739 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083297, version=48321, num_rows=0, res=[OK], cost: 98505(us) 
I20240601 10:23:16.101267 43743 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083294, version=48318, num_rows=0, res=[OK], cost: 132301(us) 
I20240601 10:23:16.101281 43745 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557595, transaction_id=2083299, version=48323, num_rows=0, res=[OK], cost: 132443(us) 
I20240601 10:23:16.101351 43750 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083298, version=48322, num_rows=0, res=[OK], cost: 132388(us) 
I20240601 10:23:16.101419 43740 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557604, transaction_id=2083293, version=48317, num_rows=0, res=[OK], cost: 132628(us) 
I20240601 10:23:16.101457 43751 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557613, transaction_id=2083294, version=48318, num_rows=0, res=[OK], cost: 132469(us) 
W20240601 10:23:16.103391 43701 cumulative_compaction.cpp:113] There are missed versions among rowsets. prev rowset verison=[48317-48317], next rowset version=[48319-48319], tablet=557601
I20240601 10:23:16.103451 43690 compaction.cpp:207] start to do ordered data compaction, tablet=557598, output_version=[2-48315]
I20240601 10:23:16.112627 43762 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083292, version=48316, num_rows=5000, res=[OK], cost: 143745(us) 
I20240601 10:23:16.112638 43763 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557619, transaction_id=2083297, version=48321, num_rows=5000, res=[OK], cost: 143683(us) 
I20240601 10:23:16.112715 43747 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557610, transaction_id=2083294, version=48318, num_rows=0, res=[OK], cost: 143754(us) 
I20240601 10:23:16.112828 43752 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557601, transaction_id=2083294, version=48318, num_rows=0, res=[OK], cost: 144142(us) 
I20240601 10:23:16.112829 43737 engine_publish_version_task.cpp:395] publish version successfully on tablet, table_id=487075, tablet=557616, transaction_id=2083297, version=48321, num_rows=0, res=[OK], cost: 143878(us)