java.util.NoSuchElementException: key not found: PLAINTEXT #479

thammuio · 2018-03-07T22:27:21Z

I am using JDK8, Kafka 0.10.2.0 with SASL_SSL only. Any pointers on this issue?

Can not get the Latest Offset and Leader Size for each topic
Consumers can not get LogSize and lag

I have updated the code to throw correct error from this thread
#471

thammuio · 2018-03-07T22:33:56Z

DavidLiuXh · 2018-03-12T02:24:42Z

@thammuio Can you help me test it? Thanks~

1389 line :
val port: Int = broker.endpoints(PLAINTEXT) -> val port : Int = broker.endpoints(config.clusterContext.config.securityProtocol)

thammuio · 2018-03-12T03:25:39Z

@DavidLiuXh Thanks for the reply. I have tried that and it did not work. In fact I have also tried replacing PLAINTEXT to SASL_SSL since i'm using only that protocol. There seems to be more code needs to be changed to make it work with only SASL_SSL.

DavidLiuXh · 2018-03-12T06:13:33Z

@thammuio show your error log. Thanks~

thammuio · 2018-03-12T17:21:05Z

I have masked the IP and FQDN's...

[info] o.a.z.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[info] o.a.z.ZooKeeper - Client environment:java.io.tmpdir=/tmp
[info] o.a.z.ZooKeeper - Client environment:java.compiler=
[info] o.a.z.ZooKeeper - Client environment:os.name=Linux
[info] o.a.z.ZooKeeper - Client environment:os.arch=amd64
[info] o.a.z.ZooKeeper - Client environment:os.version=3.10.0-693.2.2.el7.x86_64
[info] o.a.z.ZooKeeper - Client environment:user.name=thammuio
[info] o.a.z.ZooKeeper - Client environment:user.home=/home/thammuio
[info] o.a.z.ZooKeeper - Client environment:user.dir=/home/thammuio/kafka-manager/kafka-manager-1.3.3.16
[info] o.a.z.ZooKeeper - Initiating client connection, connectString=vhostname0002.node-fqdn:2181,vhostname0001.node-fqdn:2181,vhostname0003.node-fqdn:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@63176515
[info] k.m.a.KafkaManagerActor - zk=vhostname0002.node-fqdn:2181,vhostname0001.node-fqdn:2181,vhostname0003.node-fqdn:2181
[info] k.m.a.KafkaManagerActor - baseZkPath=/kafka-manager
[info] o.a.z.Login - successfully logged in.
[info] o.a.z.Login - TGT refresh thread started.
[info] o.a.z.c.ZooKeeperSaslClient - Client will use GSSAPI as SASL mechanism.
[info] o.a.z.ClientCnxn - Opening socket connection to server vhostname0002.node-fqdn/x.x.x.5:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
[info] o.a.z.Login - TGT valid starting at: Mon Mar 12 17:16:20 UTC 2018
[info] o.a.z.Login - TGT expires: Tue Mar 13 03:16:20 UTC 2018
[info] o.a.z.Login - TGT refresh sleeping until: Tue Mar 13 01:23:03 UTC 2018
[info] o.a.z.ClientCnxn - Socket connection established to vhostname0002.node-fqdn/x.x.x.5:2181, initiating session
[info] o.a.z.ClientCnxn - Session establishment complete on server vhostname0002.node-fqdn/x.x.x.5:2181, sessionid = 0x261fd4c2f980024, negotiated timeout = 60000
[info] k.m.a.KafkaManagerActor - Started actor akka://kafka-manager-system/user/kafka-manager
[info] k.m.a.DeleteClusterActor - Started actor akka://kafka-manager-system/user/kafka-manager/delete-cluster
[info] k.m.a.DeleteClusterActor - Starting delete clusters path cache...
[info] k.m.a.KafkaManagerActor - Starting delete clusters path cache...
[info] k.m.a.KafkaManagerActor - Starting kafka manager path cache...
[info] k.m.a.DeleteClusterActor - Adding kafka manager path cache listener...
[info] k.m.a.DeleteClusterActor - Scheduling updater for 10 seconds
[info] k.m.a.KafkaManagerActor - Adding kafka manager path cache listener...
[info] play.api.Play - Application started (Prod)
[info] p.c.s.NettyServer - Listening for HTTP on /0.0.0.0:8080
[info] k.m.a.KafkaManagerActor - Updating internal state...
[info] k.m.a.KafkaManagerActor - Adding new cluster manager for cluster : DEV
[warn] o.a.c.r.ExponentialBackoffRetry - maxRetries too large (100). Pinning to 29
[info] k.m.a.c.ClusterManagerActor - Starting curator...
[info] o.a.z.ZooKeeper - Initiating client connection, connectString=vhostname0002.node-fqdn:2181,vhostname0001.node-fqdn:2181,vhostname0003.node-fqdn:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@769019a3
[info] o.a.z.c.ZooKeeperSaslClient - Client will use GSSAPI as SASL mechanism.
[info] o.a.z.ClientCnxn - Opening socket connection to server vhostname0002.node-fqdn/x.x.x.5:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
[info] o.a.z.ClientCnxn - Socket connection established to vhostname0002.node-fqdn/x.x.x.5:2181, initiating session
[warn] o.a.c.r.ExponentialBackoffRetry - maxRetries too large (100). Pinning to 29
[info] k.m.a.c.ClusterManagerActor - Starting shared curator...
[info] o.a.z.ZooKeeper - Initiating client connection, connectString=vhostname0002.node-fqdn:2181,vhostname0001.node-fqdn:2181,vhostname0003.node-fqdn:2181/kafka sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@2772a03
[info] o.a.z.ClientCnxn - Session establishment complete on server vhostname0002.node-fqdn/x.x.x.5:2181, sessionid = 0x261fd4c2f980025, negotiated timeout = 60000
[info] o.a.z.c.ZooKeeperSaslClient - Client will use GSSAPI as SASL mechanism.
[info] o.a.z.ClientCnxn - Opening socket connection to server vhostname0003.node-fqdn/x.x.x.6:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
[info] o.a.z.ClientCnxn - Socket connection established to vhostname0003.node-fqdn/x.x.x.6:2181, initiating session
[info] o.a.z.ClientCnxn - Session establishment complete on server vhostname0003.node-fqdn/x.x.x.6:2181, sessionid = 0x361fd4c2f8e002c, negotiated timeout = 60000
[info] k.m.a.c.KafkaAdminClientActor - KafkaAdminClientActorConfig(ClusterContext(ClusterFeatures(Set(KMJMXMetricsFeature, KMDisplaySizeFeature, KMDeleteTopicFeature, KMPollConsumersFeature)),ClusterConfig(DEV,CuratorConfig(vhostname0002.node-fqdn:2181,vhostname0001.node-fqdn:2181,vhostname0003.node-fqdn:2181/kafka,100,100,1000),true,0.10.2.0,true,None,None,false,true,false,false,true,true,Some(ClusterTuning(Some(30),Some(2),Some(100),Some(2),Some(100),Some(2),Some(100),Some(30),Some(5),Some(8),Some(1000),Some(8),Some(1000),Some(8),Some(1000))),SASL_SSL)),LongRunningPoolConfig(8,1000),akka://kafka-manager-system/user/kafka-manager/DEV/kafka-state,None)
[info] k.m.a.c.KafkaCommandActor - Started actor akka://kafka-manager-system/user/kafka-manager/DEV/kafka-command
[info] k.m.a.c.BrokerViewCacheActor - Started actor akka://kafka-manager-system/user/kafka-manager/DEV/broker-view
[info] k.m.a.c.BrokerViewCacheActor - Scheduling updater for 30 seconds
[info] k.m.a.c.ClusterManagerActor - Started actor akka://kafka-manager-system/user/kafka-manager/DEV
[info] k.m.a.c.ClusterManagerActor - Starting cluster manager topics path cache...
[info] k.m.a.c.BrokerViewCacheActor - Updating broker view...
[info] k.m.a.c.KafkaStateActor - KafkaStateActorConfig(org.apache.curator.framework.imps.CuratorFrameworkImpl@75f14743,pinned-dispatcher,ClusterContext(ClusterFeatures(Set(KMJMXMetricsFeature, KMDisplaySizeFeature, KMDeleteTopicFeature, KMPollConsumersFeature)),ClusterConfig(DEV,CuratorConfig(vhostname0002.node-fqdn:2181,vhostname0001.node-fqdn:2181,vhostname0003.node-fqdn:2181/kafka,100,100,1000),true,0.10.2.0,true,None,None,false,true,false,false,true,true,Some(ClusterTuning(Some(30),Some(2),Some(100),Some(2),Some(100),Some(2),Some(100),Some(30),Some(5),Some(8),Some(1000),Some(8),Some(1000),Some(8),Some(1000))),SASL_SSL)),LongRunningPoolConfig(8,1000),LongRunningPoolConfig(8,1000),5,10000,None)
[info] k.m.a.c.KafkaStateActor - Started actor akka://kafka-manager-system/user/kafka-manager/DEV/kafka-state
[info] k.m.a.c.KafkaStateActor - Starting topics tree cache...
[info] k.m.a.c.KafkaStateActor - Starting topics config path cache...
[info] k.m.a.c.KafkaStateActor - Starting brokers path cache...
[info] k.m.a.c.KafkaStateActor - Starting admin path cache...
[info] k.m.a.c.KafkaStateActor - Starting delete topics path cache...
[info] k.m.a.c.KafkaStateActor - Adding topics tree cache listener...
[info] k.m.a.c.KafkaStateActor - Adding admin path cache listener...
[info] k.m.a.c.KafkaStateActor - Starting offset cache...
[info] k.m.a.c.OffsetCacheActive - Starting kafka managed offset cache ...
[info] k.m.a.c.OffsetCacheActive - Starting consumers tree cache...
[info] k.m.a.c.OffsetCacheActive - Adding consumers tree cache listener...
[info] k.m.a.c.KafkaStateActor - Starting kafka managed Topic Offset Getter ...
[info] k.m.a.c.KafkaManagedOffsetCache - Constructing new kafka consumer client using these properties:
[info] k.m.a.c.KafkaManagedOffsetCache - key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer
[info] k.m.a.c.KafkaManagedOffsetCache - auto.offset.reset=latest
[info] k.m.a.c.KafkaManagedOffsetCache - bootstrap.servers=vhostname0001.node-fqdn:6668,vhostname0002.node-fqdn:6668,vhostname0003.node-fqdn:6668,vhostname0004.node-fqdn:6668,vhostname0005.node-fqdn:6668
[info] k.m.a.c.KafkaManagedOffsetCache - enable.auto.commit=false
[info] k.m.a.c.KafkaManagedOffsetCache - group.id=KMOffsetCache-vhostname0001.node-fqdn
[info] k.m.a.c.KafkaManagedOffsetCache - value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer
[info] k.m.a.c.KafkaManagedOffsetCache - exclude.internal.topics=false
[info] k.m.a.c.KafkaManagedOffsetCache - security.protocol=SASL_SSL
[info] k.m.a.c.KafkaManagedOffsetCache - Consumer created for kafka offset topic consumption for cluster DEV
[error] k.m.a.c.KafkaStateActor - KafkaTopicOffsetGetter exception |
java.io.EOFException: null
at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:99) ~[org.apache.kafka.kafka-clients-0.10.0.1.jar:na]
at kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:129) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.network.BlockingChannel.receive(BlockingChannel.scala:120) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:99) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:149) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$11$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1393) ~[kafka-manager.kafka-manager-1.3.3.16-sans-externalized.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$11$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1383) ~[kafka-manager.kafka-manager-1.3.3.16-sans-externalized.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:893) ~[org.scala-lang.scala-library-2.11.8.jar:na]
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336) ~[org.scala-lang.scala-library-2.11.8.jar:na]
[error] k.m.a.c.KafkaStateActor - KafkaTopicOffsetGetter exception |
java.io.EOFException: null
at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:99) ~[org.apache.kafka.kafka-clients-0.10.0.1.jar:na]
at kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:129) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.network.BlockingChannel.receive(BlockingChannel.scala:120) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:99) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:149) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$11$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1393) ~[kafka-manager.kafka-manager-1.3.3.16-sans-externalized.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$11$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1383) ~[kafka-manager.kafka-manager-1.3.3.16-sans-externalized.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:893) ~[org.scala-lang.scala-library-2.11.8.jar:na]
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336) ~[org.scala-lang.scala-library-2.11.8.jar:na]
[info] k.m.a.KafkaManagerActor - Updating internal state...
[error] k.m.a.c.KafkaStateActor - KafkaTopicOffsetGetter exception |
java.io.EOFException: null
at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:99) ~[org.apache.kafka.kafka-clients-0.10.0.1.jar:na]
at kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:129) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.network.BlockingChannel.receive(BlockingChannel.scala:120) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:99) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:149) ~[org.apache.kafka.kafka_2.11-0.10.0.1.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$11$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1393) ~[kafka-manager.kafka-manager-1.3.3.16-sans-externalized.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$11$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1383) ~[kafka-manager.kafka-manager-1.3.3.16-sans-externalized.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:893) ~[org.scala-lang.scala-library-2.11.8.jar:na]
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336) ~[org.scala-lang.scala-library-2.11.8.jar:na]

wadhwasam · 2018-04-03T03:19:03Z

I am facing the same issue, how can we fix it?

thammuio · 2018-04-12T19:40:40Z

I was trying to develop this.. let you know if I have luck.

tyutlt · 2018-04-14T15:05:32Z

@thammuio Have you fixed it?

lllewellyn · 2018-05-16T13:12:31Z

I commented on #495 with some possibly useful info; saw that issue before this one.

…o#471. update add/update cluster page, add sasl.machenisam and sasl.jaas.config inputs.

thammuio · 2018-07-17T16:38:15Z

Thank you @kingmorning. can I clone on the master to have these changes ?

…o#471. update add/update cluster page, add sasl.machenisam and sasl.jaas.config inputs.

I added sasl.mechanism, and sasl.jaas.config for each cluster. and fix some bugs [#528, #513,#502,#479,#477,#471]

kingmorning · 2018-07-31T01:36:03Z

I tested it , This issue has been fix on the master branch. version:1.3.3.21

jia2 · 2018-08-08T13:57:44Z

Hi kingmorning,
is the version 1.3.3.21 already released? I could not find it under release https://github.com/yahoo/kafka-manager/releases.

Thanks
Dingjun

Gavin-An · 2018-08-16T23:21:15Z

Can anyone advise where I can download version: 1.3.3.21? I had the same issue. Below is the error log. Hope it has been fixed by newer version.

[error] k.m.a.c.KafkaStateActor - KafkaTopicOffsetGetter exception
java.util.NoSuchElementException: key not found: PLAINTEXT
at scala.collection.MapLike$class.default(MapLike.scala:228) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at scala.collection.AbstractMap.default(Map.scala:59) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at scala.collection.MapLike$class.apply(MapLike.scala:141) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at scala.collection.AbstractMap.apply(Map.scala:59) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$10$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1456) ~[kafka-manager.kafka-manager-1.3.3.18-sans-externalized.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$10$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1450) ~[kafka-manager.kafka-manager-1.3.3.18-sans-externalized.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:891) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at scala.collection.MapLike$DefaultKeySet.foreach(MapLike.scala:174) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$10.apply$mcV$sp(KafkaStateActor.scala:1450) ~[kafka-manager.kafka-manager-1.3.3.18-sans-externalized.jar:na]

jsargiot · 2018-08-17T03:28:43Z

Can anyone advise where I can download version: 1.3.3.21

@Gavin-An It's currently the HEAD of master (commit: 63c5804).

Gavin-An · 2018-08-17T04:50:26Z

@jsargiot Thanks a lot for the information. I am new about it. I will try and see if I can build a new docker image with it. Cheers

jsargiot · 2018-08-17T12:37:18Z

@Gavin-An If you are building a docker image check: https://github.com/hleb-albau/kafka-manager-docker

You can use KAFKA_MANAGER_VERSION=master here: https://github.com/hleb-albau/kafka-manager-docker/blob/master/Dockerfile#L5

Gavin-An · 2018-08-17T20:34:21Z

@jsargiot Thanks for the suggestion. I tried to build a docker image using the sheepkiller Dockerfile yesterday. Looks like that Kafka-manager-1.3.3.21 fixed the issue. I am going to do more tests on it in next few days and advise. Have a good weekend. Cheers Gavin

thammuio · 2018-08-18T16:15:11Z

I built the version 1.3.3.21, but i am still getting below error.. and not able to see the latest offset... am I missing Something here.... I have been using the same JAAS conf for my app.. Not sure why its throwing Caused by: java.lang.IllegalArgumentException: Login module not specified in JAAS config

[info] k.m.a.KafkaManagerActor - Updating internal state...
[info] k.m.a.c.BrokerViewCacheActor - Updating broker view...
[info] k.m.a.c.KafkaStateActor - SASL Mechanism =SASL_MECHANISM_GSSAPI
[info] k.m.a.c.KafkaStateActor - SASL JAAS config=/home/admin-user/km-properties/jaas.conf
[error] k.m.a.c.KafkaStateActor - consumerProperties:{security.protocol=SASL_SSL, value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, sasl.kerberos.service.name=kafka, group.id=kafka-manager-sdataflow-dev, ssl.truststore.location=/security/tls/truststore/truststore.jks, bootstrap.servers=kafka.server.com:6668, ssl.truststore.password=Pass, sasl.jaas.config=/home/admin-user/km-properties/jaas.conf, key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, sasl.mechanism=GSSAPI} WARNING arguments left: 1
[error] k.m.a.c.KafkaStateActor - KafkaTopicOffsetGetter exception
org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
at org.apache.kafka.clients.consumer.KafkaConsumer.(KafkaConsumer.java:793) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.clients.consumer.KafkaConsumer.(KafkaConsumer.java:644) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.clients.consumer.KafkaConsumer.(KafkaConsumer.java:624) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$10$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1490) ~[kafka-manager.kafka-manager-1.3.3.21-sans-externalized.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$10$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1468) ~[kafka-manager.kafka-manager-1.3.3.21-sans-externalized.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:891) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at scala.collection.MapLike$DefaultKeySet.foreach(MapLike.scala:174) ~[org.scala-lang.scala-library-2.11.12.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$10.apply$mcV$sp(KafkaStateActor.scala:1468) ~[kafka-manager.kafka-manager-1.3.3.21-sans-externalized.jar:na]
at scala.util.control.Breaks.breakable(Breaks.scala:38) ~[org.scala-lang.scala-library-2.11.12.jar:na]
Caused by: java.lang.IllegalArgumentException: Login module not specified in JAAS config
at org.apache.kafka.common.security.JaasConfig.(JaasConfig.java:66) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.common.security.JaasContext.load(JaasContext.java:90) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.common.security.JaasContext.loadClientContext(JaasContext.java:84) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:119) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:65) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:88) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.clients.consumer.KafkaConsumer.(KafkaConsumer.java:710) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.clients.consumer.KafkaConsumer.(KafkaConsumer.java:644) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at org.apache.kafka.clients.consumer.KafkaConsumer.(KafkaConsumer.java:624) ~[org.apache.kafka.kafka-clients-1.1.0.jar:na]
at kafka.manager.actor.cluster.KafkaStateActor$KafkaTopicOffsetGetter$$anonfun$run$7$$anonfun$apply$10$$anonfun$apply$mcV$sp$14.apply(KafkaStateActor.scala:1490) ~[kafka-manager.kafka-manager-1.3.3.21-sans-externalized.jar:na]
^C[info] k.m.a.KafkaManagerActor - Shutting down kafka manager

Gavin-An · 2018-08-19T22:20:33Z

@thammuio For our Kafka Cluster, we use sasl.mechanism=PLAIN. And you start the kafka manager, have you specify the "-Djava.security.auth.login.config" which points to your jass.conf file. Cheers. Gavin

thammuio · 2018-09-10T18:53:59Z

@Gavin-An Yes I did have -Djava.security.auth.login.config property while starting the process. Not sure what else is missing here.

sangcheolroh · 2018-09-11T01:57:24Z

@thammuio
i had same issue.
But after updating security configuration of cluster on web-ui like below, it works to me.

thammuio · 2018-09-11T17:18:14Z

@sangcheolroh Great. It is working for me now.. Thanks...

thammuio · 2018-09-11T17:18:38Z

Closing this issue.. as it is resolved for me now...

bthodla · 2018-10-15T20:31:46Z

I am having a hard time configuring Kafka Manager to work with my Kafka Cluster which is encrypted using SASL and authenticated using SASL_PLAIN.

Here is my setup:

kafka_manager_jaas.conf

Client {
org.apache.kafka.common.security.plain.PlainLoginModule required
username="username"
password="password";
};

consumer.properties

security.protocol=SASL_PLAINTEXT
sasl.mechanism=PLAIN
ssl.truststore.location=path2_truststore
ssl.truststore.password=password

When I run the Kafka Manger, everything goes through fine including connection to ZK but I get the following error:

java.util.NoSuchElementException: key not found: PLAINTEXT

Does the "basicAuthentication.enabled=false" in the "application.conf" relate to authentication to access the Kafka Manager web UI?

I would appreciate any help to fix this issue. I am running 1.3.3.21 version of Kafka Manager.

kingmorning pushed a commit to kingmorning/kafka-manager that referenced this issue Jul 16, 2018

fixed issues: yahoo#528, yahoo#513,yahoo#502,yahoo#479,yahoo#477,yaho…

466f059

…o#471. update add/update cluster page, add sasl.machenisam and sasl.jaas.config inputs.

kingmorning mentioned this issue Jul 16, 2018

I added sasl.mechanism, and sasl.jaas.config for each cluster. and fix some bugs [#528, #513,#502,#479,#477,#471] #532

Merged

patelh pushed a commit to kingmorning/kafka-manager that referenced this issue Jul 28, 2018

fixed issues: yahoo#528, yahoo#513,yahoo#502,yahoo#479,yahoo#477,yaho…

7fdd8eb

…o#471. update add/update cluster page, add sasl.machenisam and sasl.jaas.config inputs.

patelh added a commit that referenced this issue Jul 28, 2018

Merge pull request #532 from kingmorning/master

e27328c

I added sasl.mechanism, and sasl.jaas.config for each cluster. and fix some bugs [#528, #513,#502,#479,#477,#471]

thammuio closed this as completed Sep 11, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

java.util.NoSuchElementException: key not found: PLAINTEXT #479

java.util.NoSuchElementException: key not found: PLAINTEXT #479

thammuio commented Mar 7, 2018 •

edited

Loading

thammuio commented Mar 7, 2018

DavidLiuXh commented Mar 12, 2018

thammuio commented Mar 12, 2018

DavidLiuXh commented Mar 12, 2018

thammuio commented Mar 12, 2018

wadhwasam commented Apr 3, 2018

thammuio commented Apr 12, 2018

tyutlt commented Apr 14, 2018

lllewellyn commented May 16, 2018

thammuio commented Jul 17, 2018 •

edited

Loading

kingmorning commented Jul 31, 2018

jia2 commented Aug 8, 2018

Gavin-An commented Aug 16, 2018

jsargiot commented Aug 17, 2018

Gavin-An commented Aug 17, 2018

jsargiot commented Aug 17, 2018

Gavin-An commented Aug 17, 2018

thammuio commented Aug 18, 2018 •

edited

Loading

Gavin-An commented Aug 19, 2018

thammuio commented Sep 10, 2018

sangcheolroh commented Sep 11, 2018

thammuio commented Sep 11, 2018

thammuio commented Sep 11, 2018

bthodla commented Oct 15, 2018 •

edited

Loading

java.util.NoSuchElementException: key not found: PLAINTEXT #479

java.util.NoSuchElementException: key not found: PLAINTEXT #479

Comments

thammuio commented Mar 7, 2018 • edited Loading

thammuio commented Mar 7, 2018

DavidLiuXh commented Mar 12, 2018

thammuio commented Mar 12, 2018

DavidLiuXh commented Mar 12, 2018

thammuio commented Mar 12, 2018

wadhwasam commented Apr 3, 2018

thammuio commented Apr 12, 2018

tyutlt commented Apr 14, 2018

lllewellyn commented May 16, 2018

thammuio commented Jul 17, 2018 • edited Loading

kingmorning commented Jul 31, 2018

jia2 commented Aug 8, 2018

Gavin-An commented Aug 16, 2018

jsargiot commented Aug 17, 2018

Gavin-An commented Aug 17, 2018

jsargiot commented Aug 17, 2018

Gavin-An commented Aug 17, 2018

thammuio commented Aug 18, 2018 • edited Loading

Gavin-An commented Aug 19, 2018

thammuio commented Sep 10, 2018

sangcheolroh commented Sep 11, 2018

thammuio commented Sep 11, 2018

thammuio commented Sep 11, 2018

bthodla commented Oct 15, 2018 • edited Loading

kafka_manager_jaas.conf

consumer.properties

thammuio commented Mar 7, 2018 •

edited

Loading

thammuio commented Jul 17, 2018 •

edited

Loading

thammuio commented Aug 18, 2018 •

edited

Loading

bthodla commented Oct 15, 2018 •

edited

Loading