{"id":748,"date":"2020-04-29T21:17:05","date_gmt":"2020-04-29T20:17:05","guid":{"rendered":"http:\/\/www.igfasouza.com\/blog\/?p=748"},"modified":"2021-05-20T14:21:04","modified_gmt":"2021-05-20T13:21:04","slug":"source-kafka-connect","status":"publish","type":"post","link":"http:\/\/www.igfasouza.com\/blog\/source-kafka-connect\/","title":{"rendered":"Source Kafka connect"},"content":{"rendered":"

\"\"<\/p>\n

How\u2019s the man?<\/b><\/p>\n

This blog post is part of my series of posts regarding Kafka Connect.
\nIf you’re not familiar with Kafka, I suggest you have a look at some of my previous post;<\/p>\n

What is Kafka?<\/a>
\nKafka Connect Overview<\/a>
\nKafka Connector Architecture<\/a>
\nKafka Connect<\/a><\/p>\n

This post is a collection of links, videos, tutorials, blogs and books that I found mixed with my opinion. <\/p>\n

TL;DR<\/b><\/p>\n

This post is about code, I\u2019ll show all steps to develop your own Source Kafka Connector, and in the end, I\u2019ll show an easy way to deploy your code.
\nOpenweathermap<\/a> source kafka Connector.<\/p>\n

Table of contents<\/h2>\n

1. Get Started
\n2. Use Case
\n3. Shema
\n4. AbstractConfig
\n5. Connector
\n6. Task
\n7. Code
\n8. SMTs
\n9. Converter
\n10. Transformation
\n11. Deploy
\n12. Links<\/p>\n

1. Get Started<\/h2>\n

Kafka Connect aims to reduce the burden of connecting Kafka with external systems such as databases, key-value stores, search indexes, and even file systems. Connectors are the high-level abstractions that manage the streaming of data from and to Kafka. Each connector speaks the language of the external system it connects to, hiding this complexity from the application developer who can focus on more valuable business logic.<\/p>\n