[kafka] 카프카 시작 안되는 경우

배경설명

AWS EC2에 카프카와 주키퍼를 single-node로 셋팅해서 로컬에서 접속테스트 이것저것하고

다른날 다시 연결해보니 연결이 안되는 현상 발생.

버전: kafka_2.12-2.5.0

급한 마음에 kill -9로 프로세스를 죽이고

다시 띄우니 아래 로그가 kafkaServer.log에 남아서 올라오지 않는다.

[2021-08-01 00:57:20,141] INFO [SocketServer brokerId=0] Started 1 acceptor threads for data-plane (kafka.network.SocketServer)
[2021-08-01 00:57:20,178] INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2021-08-01 00:57:20,178] INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2021-08-01 00:57:20,179] INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2021-08-01 00:57:20,189] INFO [ExpirationReaper-0-ElectLeader]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2021-08-01 00:57:20,209] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler)
[2021-08-01 00:57:20,283] INFO Creating /brokers/ids/0 (is it secure? false) (kafka.zk.KafkaZkClient)
[2021-08-01 00:57:20,310] ERROR Error while creating ephemeral at /brokers/ids/0, node already exists and owner '세션아이디A' does not match current session '세션아이디B' (kafka.zk.KafkaZkClient$CheckedEphemeral)
[2021-08-01 00:57:20,319] ERROR [KafkaServer id=0] Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
	at kafka.zk.KafkaZkClient$CheckedEphemeral.getAfterNodeExists(KafkaZkClient.scala:1819)
	at kafka.zk.KafkaZkClient$CheckedEphemeral.create(KafkaZkClient.scala:1757)
	at kafka.zk.KafkaZkClient.checkedEphemeralCreate(KafkaZkClient.scala:1724)
	at kafka.zk.KafkaZkClient.registerBroker(KafkaZkClient.scala:95)
	at kafka.server.KafkaServer.startup(KafkaServer.scala:273)
	at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
	at kafka.Kafka$.main(Kafka.scala:82)
	at kafka.Kafka.main(Kafka.scala)
[2021-08-01 00:57:20,322] INFO [KafkaServer id=0] shutting down (kafka.server.KafkaServer)
[2021-08-01 00:57:20,323] INFO [SocketServer brokerId=0] Stopping socket server request processors (kafka.network.SocketServer)
[2021-08-01 00:57:20,328] INFO [SocketServer brokerId=0] Stopped socket server request processors (kafka.network.SocketServer)
[2021-08-01 00:57:20,339] INFO [ReplicaManager broker=0] Shutting down (kafka.server.ReplicaManager)
[2021-08-01 00:57:20,342] INFO [LogDirFailureHandler]: Shutting down (kafka.server.ReplicaManager$LogDirFailureHandler)
[2021-08-01 00:57:20,343] INFO [LogDirFailureHandler]: Stopped (kafka.server.ReplicaManager$LogDirFailureHandler)
[2021-08-01 00:57:20,343] INFO [LogDirFailureHandler]: Shutdown completed (kafka.server.ReplicaManager$LogDirFailureHandler)

 

해결 방법

https://stackoverflow.com/questions/34393837/zookeeper-kafka-error-keepererrorcode-nodeexists

Zookeeper & Kafka error KeeperErrorCode=NodeExists

cd /tmp/kafka-logs
rm -rf *

 

이유는 검색해도 모르겠네.

주키퍼 키고 30초 딜레이해서 카프카를 켜라는 얘기도 있다. 좀 더 테스트 해볼 예정