Kafka-backup: Bagaimana cara mencadangkan semua topik menggunakan regex

Dibuat pada 1 Des 2020  ·  5Komentar  ·  Sumber: itadventurer/kafka-backup

Saya sudah menggunakan "*" untuk topic_regex untuk mencadangkan semua topik di cluster saat ini. Adakah bantuan untuk itu? Terima kasih @itadventurer

picture huyngopt1994

Semua 5 komentar

Hai @huyngopt1994 , masalah seperti apa yang Anda alami? Apakah ada kesamaan dengan #116 ?

paoloyx picture paoloyx pada 1 Des 2020
👍1

backup-standalone.sh --bootstrap-server broker:9092 --target-dir /kafka-backup --topics-regex .+

ogurskiy picture ogurskiy pada 1 Des 2020
👍1

@ogurskiy Terima kasih. Itu harus bekerja.

itadventurer picture itadventurer pada 1 Des 2020
👍1

Terima kasih kawan, ini berfungsi tetapi saya mendapat masalah lain dengan perulangan selamanya ketika menjalankan cadangan di cabang master terbaru
perintah berjalan
Hai @itadventurer

backup-standalone.sh --snapshot --bootstrap-server http://kafka-stg.default.svc.cluster.local:9092 --target-dir kafka-backup-2020-12-02-05-47 --topics sms_stgwechat_user --debug

[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)

Tampaknya konsumen tidak dapat mengkonsumsi pesannya

Screen Shot 2020-12-02 at 2 46 42 PM

kafka-topics --zookeeper kafka-stg-zookeeper:2181 --topic sms_stgwechat_user --describe
Topic:sms_stgwechat_user    PartitionCount:1    ReplicationFactor:1 Configs:
    Topic: sms_stgwechat_user   Partition: 0    Leader: 2   Replicas: 2 Isr: 2

Ada tips terima kasih guys

huyngopt1994 picture huyngopt1994 pada 2 Des 2020

Hai @huyngopt1994 , masalah seperti apa yang Anda alami? Apakah ada kesamaan dengan #116 ?

Ah tidak, itu berbeda

huyngopt1994 picture huyngopt1994 pada 2 Des 2020
Apakah halaman ini membantu?
0 / 5 - 0 peringkat

Masalah terkait

jay7x picture jay7x  ·  18Komentar
ipochi picture ipochi  ·  3Komentar
itadventurer picture itadventurer  ·  5Komentar
jay7x picture jay7x  ·  16Komentar
akamensky picture akamensky  ·  13Komentar