Install Confluent Platform¶
You can install the Confluent Platform using a variety of formats, including Docker, ZIP, TAR, APT, and YUM.
Contents
System Requirements¶
Operating Systems
Operating System | 1.0.0 | 2.0.x | 3.0.x | 3.1.x | 3.2.x | 3.3.x | 4.0.x |
---|---|---|---|---|---|---|---|
Red Hat Enterprise Linux/CentOS 6.x | yes | yes | yes | no | no | no | no |
Red Hat Enterprise Linux/CentOS 7.x | yes | yes | yes | yes | yes | yes | yes |
Debian 7 | yes | yes | yes | no | no | no | no |
Debian 8 | yes | yes | yes | yes | yes | yes | yes |
Ubuntu 12.04 LTS | yes | yes | yes | no | no | no | no |
Ubuntu 14.04 LTS | yes | yes | yes | yes | yes | yes | yes |
Ubuntu 16.04 LTS | no | no | no | yes | yes | yes | yes |
- Windows is not currently supported. Windows users can download and use the ZIP and TAR archives, but must run the JAR files directly.
- macOS is supported for testing and development purposes onlyy.
Software
Oracle Java 1.7 or later.
Tip: You can check your Java version with this command:
$ java -version
Optional: Docker version 1.11 or later. This is required if you are installing Confluent Platform by using the Docker images.
Port Configuration
By default the Confluent Platform components use these ports to communicate. The following ports must be open:
Component | Port |
---|---|
Apache Kafka brokers (plain text) | 9092 |
Confluent Control Center | 9021 |
Kafka Connect REST API | 8083 |
REST Proxy | 8082 |
Schema Registry REST API | 8081 |
ZooKeeper | 2181 |
Installation Formats¶
Docker¶
You can install the Confluent Platform using Docker images. For instructions on how to install using Docker, see the documentation.
Important: You can install the entire platform or the individual component packages using Docker images.
ZIP and TAR archives¶
Important: You can install only the entire platform with the ZIP or TAR archives.
Download the archive. You can get the ZIP and TAR files from the downloads page. These archives contain the JARs, driver scripts, and configuration files in ZIP and TAR archives.
Uncompress the archive file.
Install Confluent Platform using one of these methods based on your needs.
Production Environment
Start each Confluent Platform service in its own terminal:
# Start ZooKeeper. Run this command in its own terminal. $ <path-to-confluent>/bin/zookeeper-server-start <path-to-confluent>/etc/kafka/zookeeper.properties # Start Kafka. Run this command in its own terminal. $ <path-to-confluent>/bin/kafka-server-start <path-to-confluent>/etc/kafka/server.properties # Start Schema Registry. Run this command in its own terminal. $ <path-to-confluent>/bin/schema-registry-start \ <path-to-confluent>/etc/schema-registry/schema-registry.properties # Start Connect in distributed mode. Run this command in its own terminal. $ <path-to-confluent>/bin/connect-distributed \ <path-to-confluent>/etc/schema-registry/connect-avro-distributed.properties
Development or Test Environment
Important
The Confluent CLI is meant for development purposes only and is not suitable for a production environment. The data that are produced are transient and are intended to be temporary.
Run this command to start all Confluent Platform services by using the CLI.
$ <path-to-confluent>/bin/confluent start
Your output should resemble this.
Starting zookeeper zookeeper is [UP] Starting kafka kafka is [UP] Starting schema-registry schema-registry is [UP] Starting kafka-rest kafka-rest is [UP] Starting connect connect is [UP]
Next, try the Quickstart to test out the Confluent Platform locally.
Debian and Ubuntu¶
The APT repositories provide packages for Debian-based Linux distributions such as Debian and Ubuntu.
Important: You can install the entire platform or the individual component packages with the APT repositories.
Install the Confluent public key, which is used to sign the packages in the APT repository.
$ wget -qO - https://packages.confluent.io/deb/4.0/archive.key | sudo apt-key add -
Add the repository to your
/etc/apt/sources.list
:$ sudo add-apt-repository "deb [arch=amd64] https://packages.confluent.io/deb/4.0 stable main"
Run apt-get update and install Confluent Platform.
Confluent Enterprise:
$ sudo apt-get update && sudo apt-get install confluent-platform-2.11
Confluent Open Source:
$ sudo apt-get update && sudo apt-get install confluent-platform-oss-2.11
Important: The number at the end of the package name specifies the Scala version. Currently supported versions are 2.11 (recommended) and 2.10. Individual components of the Confluent Platform are also available as standalone packages. See the Available Packages section for a listing of packages.
Next, try the Quickstart to test out the Confluent Platform locally.
RHEL and CentOS¶
The YUM repositories provide packages for RHEL, CentOS, and Fedora-based distributions.
Important: You can install the entire platform or the individual component packages with the YUM repositories.
Install the Confluent public key, which is used to sign packages in the YUM repository.
$ sudo rpm --import https://packages.confluent.io/rpm/4.0/archive.key
Add the repository to your
/etc/yum.repos.d/
directory in a file namedconfluent.repo
.If you are using RHEL/CentOS 6.8
[Confluent.dist] name=Confluent repository (dist) baseurl=https://packages.confluent.io/rpm/4.0/6 gpgcheck=1 gpgkey=https://packages.confluent.io/rpm/4.0/archive.keyt enabled=1 [Confluent] name=Confluent repository baseurl=https://packages.confluent.io/rpm/4.0 gpgcheck=1 gpgkey=https://packages.confluent.io/rpm/4.0/archive.key enabled=1
If you are using RHEL/CentOS 7.2
[Confluent.dist] name=Confluent repository (dist) baseurl=https://packages.confluent.io/rpm/4.0/7 gpgcheck=1 gpgkey=https://packages.confluent.io/rpm/4.0/archive.key enabled=1 [Confluent] name=Confluent repository baseurl=https://packages.confluent.io/rpm/4.0 gpgcheck=1 gpgkey=https://packages.confluent.io/rpm/4.0/archive.key enabled=1
Recommended: Clear the YUM caches.
$ sudo yum clean all
The repository is now ready for use.
Install Confluent Platform.
Confluent Enterprise:
$ sudo yum install confluent-platform-2.11
Confluent Open Source:
$ sudo yum install confluent-platform-oss-2.11
Important: The number at the end of the package name specifies the Scala version. Currently supported versions are 2.11 (recommended) and 2.10. Individual components of the Confluent Platform are also available as standalone packages. See the Available Packages section for a listing of packages.
Next, try the Quickstart to test out the Confluent Platform locally.