CentOS 7에서 Docker Compose를 이용한 Kafka 및 Zookeeper 설치 가이드

환경 구성

• OS: CentOS 7 (Core)
• Docker Version: 18.03.1-ce, build 9ee9f40
• Docker Compose Version: v2.27.0
• Zookeeper: zookeeper:3.4.10
• Kafka: docker.io/bitnami/kafka:2.5.0
• JDK: Java version "1.8.0_202"

설치 개요

이 가이드는 CentOS 7 환경에서 Docker Compose를 사용하여 Kafka와 Zookeeper를 설치하는 방법을 설명합니다.

 

Docker 설치
필수 패키지 설치 및 Docker 저장소 추가

$ yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo

 

Docker 최신 버전 설치

$ yum install docker-ce docker-ce-cli containerd.io

 

특정 Docker 버전 설치

$ yum install docker-ce-18.03.1.ce-1.el7.centos docker-ce-cli-18.03.1.ce-1.el7.centos containerd.io

 

자동 업데이트 중지

$ vi /etc/yum.repos.d/docker-ce.repo
[docker-ce-stable] 섹션의 enabled=1을 enabled=0으로 변경

 

Docker 서비스 시작

$ service docker start
$ systemctl status docker

 

root 외 사용자의 Docker 권한 부여

usermod -aG docker <your-user>

 

Docker Compose 설치

$ sudo curl -L "https://github.com/docker/compose/releases/download/1.27.4/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
chmod +x /usr/local/bin/docker-compose

 

Docker Compose를 이용한 Kafka 및 Zookeeper 설정

$ vi docker-compose.yml
version: '3.7'

services:
  zookeeper:
    image: zookeeper:3.4.10
    environment:
      - ZOOKEEPER_SERVER_ID=1
      - ZOOKEEPER_CLIENT_PORT=2181
      - ZOOKEEPER_TICK_TIME=2000
      - ZOOKEEPER_INIT_LIMIT=5
      - ZOOKEEPER_SYNC_LIMIT=2
    ports:
      - "22181:2181"

  kafka:
    image: docker.io/bitnami/kafka:2.5.0
    depends_on:
      - zookeeper
    ports:
      - "29092:9092"
    environment:
      - ALLOW_PLAINTEXT_LISTENER=yes
      - KAFKA_BROKER_ID=1
      - KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181
      - KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092,PLAINTEXT_HOST://0.0.0.0:29092
      - KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://10.100.11.107:29092
      - KAFKA_LISTENER_SECURITY_PROTOCOL_MAP=PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT
      - KAFKA_INTER_BROKER_LISTENER_NAME=PLAINTEXT
      - KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR=1
      - KAFKA_GROUP_INITIAL_REBALANCE_DELAY_MS=0

 

Docker Compose 실행

$ cd /appstore/docker-compose/
$ docker-compose up -d