Kafka-backup: 정규식을 사용하여 모든 주제를 백업하는 방법

안녕하세요 @huyngopt1994님 , 어떤 문제를 겪고 계십니까? #116과 유사점이 있나요?

backup-standalone.sh --bootstrap-server broker:9092 --target-dir /kafka-backup --topics-regex .+

@ogurskiy 감사합니다. 작동해야 합니다.

고마워요, 작동하지만 마지막 마스터 분기에서 백업을 실행할 때 영원히 반복되는 또 다른 문제가 있습니다.
명령 실행
안녕하세요 @itadventurer

backup-standalone.sh --snapshot --bootstrap-server http://kafka-stg.default.svc.cluster.local:9092 --target-dir kafka-backup-2020-12-02-05-47 --topics sms_stgwechat_user --debug

[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)

소비자가 메시지를 소비할 수 없는 것 같습니다.

kafka-topics --zookeeper kafka-stg-zookeeper:2181 --topic sms_stgwechat_user --describe
Topic:sms_stgwechat_user    PartitionCount:1    ReplicationFactor:1 Configs:
    Topic: sms_stgwechat_user   Partition: 0    Leader: 2   Replicas: 2 Isr: 2

어떤 팁이라도 감사합니다.

안녕하세요 @huyngopt1994님 , 어떤 문제를 겪고 계십니까? #116과 유사점이 있나요?

아 아니야 다르다