Skip to content
This repository has been archived by the owner on Jun 30, 2023. It is now read-only.

Sink connector with protobuf is not working! #38

Open
oviyan opened this issue Jan 7, 2020 · 0 comments
Open

Sink connector with protobuf is not working! #38

oviyan opened this issue Jan 7, 2020 · 0 comments

Comments

@oviyan
Copy link

oviyan commented Jan 7, 2020

I have been trying to produce data using Javaclient and store data in postgres using sink-connector. i can post data into topic in protobuf format, but sink-connector seems not working. Just make sure that data being posted and available in topic, i built consumer in Java-client, and i can see data.

So data is there in topic, but something wrong with my sink-connector config. please find config details below, any help much appreciated!

connect-standalone.properties:
bootstrap.servers=localhost:9092
key.converter=com.blueapron.connect.protobuf.ProtobufConverter
value.converter=com.blueapron.connect.protobuf.ProtobufConverter
key.converter.schemas.enable=false
value.converter.schemas.enable=true
offset.storage.file.filename=/tmp/connect.offsets
offset.flush.interval.ms=10000

connect-postgres-protobuf.properties:

name=sink-postgres
connector.class=io.confluent.connect.jdbc.JdbcSinkConnector
tasks.max=2
topics=docker-proto-topic
connection.url=jdbc:postgresql://localhost:5432/kafka-test
connection.user=postgres
connection.password=***
insert.mode=insert
value.converter=com.blueapron.connect.protobuf.ProtobufConverter
value.converter.protoClassName=com.test.extraction.model.protobuf.AlbumOuterClass$Album
key.converter=com.blueapron.connect.protobuf.ProtobufConverter
auto.create=true
auto.evolve=false
offset.storage.file.filename=/tmp/post-sink.offsets

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Development

No branches or pull requests

1 participant