Já estou usando "*" para topic_regex para fazer backup de todos os tópicos no cluster atual. Alguma ajuda para isso? Obrigado @itadventurer
Olá @ huyngopt1994 , que tipo de problema você está enfrentando? Existe alguma semelhança com # 116?
backup-standalone.sh --bootstrap-server broker:9092 --target-dir /kafka-backup --topics-regex .+
@ogurskiy Obrigado. Isso deve funcionar.
Obrigado cara, funciona, mas eu tenho outro problema com o looping para sempre ao executar o backup no último branch master
comando em execução
Olá @itadventurer
backup-standalone.sh --snapshot --bootstrap-server http://kafka-stg.default.svc.cluster.local:9092 --target-dir kafka-backup-2020-12-02-05-47 --topics sms_stgwechat_user --debug
[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
Parece que o consumidor não pode consumir a mensagem
kafka-topics --zookeeper kafka-stg-zookeeper:2181 --topic sms_stgwechat_user --describe
Topic:sms_stgwechat_user PartitionCount:1 ReplicationFactor:1 Configs:
Topic: sms_stgwechat_user Partition: 0 Leader: 2 Replicas: 2 Isr: 2
Alguma dica obrigado pessoal
Olá @ huyngopt1994 , que tipo de problema você está enfrentando? Existe alguma semelhança com # 116?
Ah não é diferente