Kafka-backup: Provide examples for different configurations

Created on 17 Jan 2020  ·  5Comments  ·  Source: itadventurer/kafka-backup

  • [ ] Plaintext
  • [ ] TLS
documentation help wanted

Most helpful comment

Here is an example on how to connect to an encrypted cluster using SASL_SCRAM:

name = ConnectorName
connector.class = de.azapps.kafkabackup.sink.BackupSinkConnector
tasks.max = 1
key.converter = org.apache.kafka.connect.converters.ByteArrayConverter
value.converter = org.apache.kafka.connect.converters.ByteArrayConverter
header.converter = org.apache.kafka.connect.converters.ByteArrayConverter
target.dir = /backups
max.segment.size.bytes = 1073741824
cluster.bootstrap.servers = hostname-1.domain:9092,hostname-2.domain:9092,hostname-3.domain:9092
cluster.sasl.jaas.config = org.apache.kafka.common.security.scram.ScramLoginModule required username="REDACTED" password="REDACTED";
cluster.sasl_mechanism = SCRAM-SHA-256
cluster.security.protocol = SASL_SSL
cluster.sasl.mechanism = SCRAM-SHA-256
cluster.ssl.keystore.location = /path/to/ss/kafka.server.keystore.jks
cluster.ssl.keystore.password = REDACTED
cluster.ssl.key.password = REDACTED
cluster.ssl.truststore.location = /path/to/ss/kafka.server.truststore.jks
cluster.ssl.truststore.password = REDACTED

I'll be removing the jaas config from that line and putting it elsewhere, but I felt it was right to share the configuration to help lead others down the right path.

All 5 comments

Example of configuration for connect-standalone?

I have the sample settings for connecting to a secured cluster with sasl_scram using docker as well. I know it's referenced in #10 , but I can provide my configurations.

Yes please, feel free to just paste it here in the issue :)

Here is an example on how to connect to an encrypted cluster using SASL_SCRAM:

name = ConnectorName
connector.class = de.azapps.kafkabackup.sink.BackupSinkConnector
tasks.max = 1
key.converter = org.apache.kafka.connect.converters.ByteArrayConverter
value.converter = org.apache.kafka.connect.converters.ByteArrayConverter
header.converter = org.apache.kafka.connect.converters.ByteArrayConverter
target.dir = /backups
max.segment.size.bytes = 1073741824
cluster.bootstrap.servers = hostname-1.domain:9092,hostname-2.domain:9092,hostname-3.domain:9092
cluster.sasl.jaas.config = org.apache.kafka.common.security.scram.ScramLoginModule required username="REDACTED" password="REDACTED";
cluster.sasl_mechanism = SCRAM-SHA-256
cluster.security.protocol = SASL_SSL
cluster.sasl.mechanism = SCRAM-SHA-256
cluster.ssl.keystore.location = /path/to/ss/kafka.server.keystore.jks
cluster.ssl.keystore.password = REDACTED
cluster.ssl.key.password = REDACTED
cluster.ssl.truststore.location = /path/to/ss/kafka.server.truststore.jks
cluster.ssl.truststore.password = REDACTED

I'll be removing the jaas config from that line and putting it elsewhere, but I felt it was right to share the configuration to help lead others down the right path.

Moving it to the next release to finish v0.1 tonight. But This is something I want to do very soon.

Was this page helpful?
0 / 5 - 0 ratings