golang基础-kafka、zookeeper搭建、go终端发送数据给kafka

概述zookeeper搭建 kafka搭建 kafka链接zookeeper 在go终端写入kafka zookeeper搭建 1、安装JAVA-JDK，从oracle下载最新的SDK安装(我用的是1.8的) 2、安装zookeeper3.3.6，下载地址：http://apache.fayea.com/zookeeper/ 3、重命名conf/zoo_sample.cfg 为conf/zoo.cfg zookeeper搭建 kafka搭建 kafka链接zookeeper 在go终端写入kafka zookeeper搭建

1、安装JAVA-JDK，从oracle下载最新的SDK安装(我用的是1.8的)
2、安装zookeeper3.3.6，下载地址：http://apache.fayea.com/zookeeper/
3、重命名conf/zoo_sample.cfg 为conf/zoo.cfg
4、编辑 conf/zoo.cfg，修改dataDir=D:\zookeeper-3.3.6\data\
4、运行bin/zkServer.cmd

启动zookeeper如下

kafka搭建

1、打开链接：http://kafka.apache.org/downloads.html下载kafka2.1.2
2、打开config目录下的server.propertIEs， 修改log.dirs为D:\kafka_logs,

############################# Log Basics ############################## A comma seperated List of directorIEs under which to store log fileslog.dirs=/tmp/kafka-logs#log.dirs=E:\develop\kafka\kafka_logs

3、修改advertised.host.name=服务器ip

# root directory for all kafka znodes.zookeeper.connect=localhost:2181# Timeout in ms for connecting to zookeeperzookeeper.connection.timeout.ms=6000advertised.host.name=192.168.11.28

4、启动kafka ./bin/windows/kafka-server-start.bat ./config/server.prepertIEs

kafka链接zookeeper 在go终端写入kafka

package mainimport (    "fmt"    "github.com/Shopify/Sarama")func main() {    config := Sarama.NewConfig()    config.Producer.requiredAcks = Sarama.WaitForAll    config.Producer.Partitioner = Sarama.NewRandomPartitioner    config.Producer.Return.Successes = true    msg := &Sarama.ProducerMessage{}    msg.topic = "Nginx_log"    msg.Value = Sarama.StringEncoder("this is a good test,my message is good")    clIEnt,err := Sarama.NewSyncProducer([]string{"192.168.11.28:9092"},config)    if err != nil {        fmt.Println("producer close,err:",err)        return    }    defer clIEnt.Close()    pID,offset,err := clIEnt.SendMessage(msg)    if err != nil {        fmt.Println("send message Failed,",err)        return    }    fmt.Printf("pID:%v offset:%v\n",pID,offset)}

终端执行如下：我这里有个问题

PS E:\golang\go_pro\src\safly> go run demo.goproducer close,err: kafka: clIEnt has run out of available brokers to talk to (Is your cluster reachable?)PS E:\golang\go_pro\src\safly>

可能是我在启动kafka时，出现如下的问题：具体还没解决？网友有知道解决方法的话，告知下多谢~~~
InvalID character ‘:’ in value part of property
ogDirectory=E:\tmp\kafka-logs我用的默认的、或者修改成自定义配置都会出这个问题

# A comma seperated List of directorIEs under which to store log fileslog.dirs=/tmp/kafka-logs#log.dirs=E:\develop\kafka\kafka_logs

[2017-11-18 20:13:02,517] WARN Error processing kafka.log:type=LogManager,name=LogDirectoryOffline,logDirectory=E:\tmp\kafka-logs (com.yammer.metrics.reporting.JmxReporter)javax.management.MalformedobjectnameException: InvalID character ':' in value part of property        at javax.management.Objectname.construct(Objectname.java:618)        at javax.management.Objectname.<init>(Objectname.java:1382)        at com.yammer.metrics.reporting.JmxReporter.onMetricAdded(JmxReporter.java:395)        at com.yammer.metrics.core.MetricsRegistry.notifyMetricAdded(MetricsRegistry.java:516)        at com.yammer.metrics.core.MetricsRegistry.getorAdd(MetricsRegistry.java:491)        at com.yammer.metrics.core.MetricsRegistry.newGauge(MetricsRegistry.java:79)        at kafka.metrics.KafkaMetricsGroup.newGauge(KafkaMetricsGroup.scala:74)        at kafka.metrics.KafkaMetricsGroup.newGauge$(KafkaMetricsGroup.scala:73)        at kafka.log.LogManager.newGauge(LogManager.scala:50)        at kafka.log.LogManager.$anonfun$new$1(LogManager.scala:122)        at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:59)        at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:52)        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)        at kafka.log.LogManager.<init>(LogManager.scala:116)        at kafka.log.LogManager$.apply(LogManager.scala:814)        at kafka.server.KafkaServer.startup(KafkaServer.scala:222)        at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)        at kafka.Kafka$.main(Kafka.scala:92)        at kafka.Kafka.main(Kafka.scala)[2017-11-18 20:13:02,522] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)

总结

以上是内存溢出为你收集整理的golang基础-kafka、zookeeper搭建、go终端发送数据给kafka全部内容，希望文章能够帮你解决golang基础-kafka、zookeeper搭建、go终端发送数据给kafka所遇到的程序开发问题。

如果觉得内存溢出网站内容还不错，欢迎将内存溢出网站推荐给程序员好友。