Kafka-backup: рд░реЗрдЧреЗрдХреНрд╕ рдХрд╛ рдЙрдкрдпреЛрдЧ рдХрд░рдХреЗ рд╕рднреА рд╡рд┐рд╖рдпреЛрдВ рдХрд╛ рдмреИрдХрдЕрдк рдХреИрд╕реЗ рд▓реЗ рд╕рдХрддреЗ рд╣реИрдВ
рдХреЛ рдирд┐рд░реНрдорд┐рдд 1 рджрд┐рд╕ре░ 2020
┬╖
5рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ
┬╖
рд╕реНрд░реЛрдд: itadventurer/kafka-backup
рдореИрдВ рд╡рд░реНрддрдорд╛рди рдХреНрд▓рд╕реНрдЯрд░ рдореЗрдВ рд╕рднреА рд╡рд┐рд╖рдпреЛрдВ рдХрд╛ рдмреИрдХ рдЕрдк рд▓реЗрдиреЗ рдХреЗ рд▓рд┐рдП topic_regex рдХреЗ рд▓рд┐рдП рдкрд╣рд▓реЗ рд╕реЗ рд╣реА "*" рдХрд╛ рдЙрдкрдпреЛрдЧ рдХрд░ рд░рд╣рд╛ рд╣реВрдВред рдЗрд╕рдХреЗ рд▓рд┐рдП рдХреЛрдИ рдорджрдж рдХрд░рддрд╛ рд╣реИ? рдзрдиреНрдпрд╡рд╛рдж @itaadventurer
huyngopt1994
рд╕рднреА 5 рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ
рд╣рд╛рдп @ huyngopt1994 , рдЖрдк рдХрд┐рд╕ рддрд░рд╣ рдХреА рд╕рдорд╕реНрдпрд╛ рдХрд╛ рд╕рд╛рдордирд╛ рдХрд░ рд░рд╣реЗ рд╣реИрдВ? рдХреНрдпрд╛ #116 рд╕реЗ рдХреЛрдИ рд╕рдорд╛рдирддрд╛ рд╣реИ?
paoloyx
1 рджрд┐рд╕ре░ 2020
👍1
backup-standalone.sh --bootstrap-server broker:9092 --target-dir /kafka-backup --topics-regex .+
ogurskiy
1 рджрд┐рд╕ре░ 2020
👍1
@ogurskiy рдзрдиреНрдпрд╡рд╛рджред рдпрд╣ рдХрд╛рдо рдХрд░рдирд╛ рдЪрд╛рд╣рд┐рдПред
itadventurer
1 рджрд┐рд╕ре░ 2020
👍1
рдзрдиреНрдпрд╡рд╛рдж рд▓рдбрд╝рдХрд╛, рдпрд╣ рдХрд╛рдо рдХрд░рддрд╛ рд╣реИ рд▓реЗрдХрд┐рди рдЖрдЦрд┐рд░реА рдорд╛рд╕реНрдЯрд░ рд╢рд╛рдЦрд╛ рдореЗрдВ рдмреИрдХрдЕрдк рдЪрд▓рд╛рддреЗ рд╕рдордп рдореБрдЭреЗ рд╣рдореЗрд╢рд╛ рдХреЗ рд▓рд┐рдП рд▓реВрдкрд┐рдВрдЧ рдХреЗ рд╕рд╛рде рдПрдХ рдФрд░ рд╕рдорд╕реНрдпрд╛ рдорд┐рд▓реА
рдЖрджреЗрд╢ рдЪрд▓ рд░рд╣рд╛ рд╣реИ
рдирдорд╕реНрддреЗ @itadventurer
backup-standalone.sh --snapshot --bootstrap-server http://kafka-stg.default.svc.cluster.local:9092 --target-dir kafka-backup-2020-12-02-05-47 --topics sms_stgwechat_user --debug
[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)[2020-12-02 07:38:50,469] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:00,506] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:10,546] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:20,581] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:30,617] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:40,669] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:39:50,709] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:00,765] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:10,806] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:20,842] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:30,896] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:40,934] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:40:50,972] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:01,012] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:11,053] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:21,094] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:31,135] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:41,168] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:41:51,207] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:01,261] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:11,296] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:21,337] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:31,378] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:41,416] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:42:51,454] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:01,496] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:11,536] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
[2020-12-02 07:43:21,582] DEBUG Flushed Topic sms_stgwechat_user, Partition 0 (de.azapps.kafkabackup.sink.BackupSinkTask)
рд▓рдЧрддрд╛ рд╣реИ рдХрд┐ рдЙрдкрднреЛрдХреНрддрд╛ рд╕рдВрджреЗрд╢ рдХрд╛ рдЙрдкрднреЛрдЧ рдирд╣реАрдВ рдХрд░ рд╕рдХрддрд╛
kafka-topics --zookeeper kafka-stg-zookeeper:2181 --topic sms_stgwechat_user --describe
Topic:sms_stgwechat_user PartitionCount:1 ReplicationFactor:1 Configs:
Topic: sms_stgwechat_user Partition: 0 Leader: 2 Replicas: 2 Isr: 2
рдХреЛрдИ рд╕реБрдЭрд╛рд╡ рдзрдиреНрдпрд╡рд╛рдж рджреЛрд╕реНрддреЛрдВ
huyngopt1994
2 рджрд┐рд╕ре░ 2020
рд╣рд╛рдп @ huyngopt1994 , рдЖрдк рдХрд┐рд╕ рддрд░рд╣ рдХреА рд╕рдорд╕реНрдпрд╛ рдХрд╛ рд╕рд╛рдордирд╛ рдХрд░ рд░рд╣реЗ рд╣реИрдВ? рдХреНрдпрд╛ #116 рд╕реЗ рдХреЛрдИ рд╕рдорд╛рдирддрд╛ рд╣реИ?
рдЖрд╣ рдирд╣реАрдВ рдпрд╣ рдЕрд▓рдЧ рд╣реИ
huyngopt1994
2 рджрд┐рд╕ре░ 2020
рдХреНрдпрд╛ рдпрд╣ рдкреГрд╖реНрда рдЙрдкрдпреЛрдЧреА рдерд╛?
0 / 5 - 0 рд░реЗрдЯрд┐рдВрдЧреНрд╕
рд╕рдВрдмрдВрдзрд┐рдд рдореБрджреНрджреЛрдВ
jay7x
┬╖
15рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ
jay7x
┬╖
18рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ
ipochi
┬╖
3рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ
itadventurer
┬╖
5рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ
akamensky
┬╖
13рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ