Kafka Connect

This section describes Kafka Connect, a component of open source Apache Kafka. Kafka Connect is a framework for scalably and reliably connecting Kafka with external systems such as databases, key-value stores, search indexes, and file systems.

Contents:

• Kafka Connect
  • Quickstart
  • Requirements
• System Design
  • Motivation
  • Architecture
• User Guide
  • Getting Started
  • Connectors, Tasks, and Workers
    • Offsets
    • Workers
  • Configuring Connectors
  • Configuring Workers
    • Common Worker Configs
    • Standalone Worker Configuration
    • Distributed Worker Configuration
    • Overriding Producer & Consumer Settings
  • Connect Administration
  • REST Interface
    • Content Types
    • Statuses & Errors
    • Connectors
    • Connector Plugins
  • Installing Connector Plugins
• Connectors
  • Confluent JDBC Connector
    • JDBC Connector
    • Configuration Options
    • Changelog
  • Confluent HDFS Connector
    • HDFS Connector
    • Configuration Options
    • Changelog
• Developer Guide
  • Core Concepts and APIs
    • Connectors and Tasks
    • Partitions and Records
    • Dynamic Connectors
  • Developing a Simple Connector
    • Connector Example
    • Task Example - Source Task
    • Sink Tasks
    • Resuming from Previous Offsets
  • Dynamic Input/Output Partitions
  • Configuration Validation
  • Working with Schemas
  • Schema Evolution
  • Testing
• Security
• Javadocs