zookeeper与metaq集群

/backall/apache/zookeeper-3.4.6.tar.gz

/backall/apache/metaq-server-1.4.6.2.tar.gz

[[email protected] local]# cat /etc/hosts

10.10.12.203  c11-metaq-n01

10.10.12.204  c11-metaq-n02

10.10.12.205  c11-metaq-n03

mkdir -p /usr/local/metaqCluster

mkdir -p /usr/local/zookeeperCluster

jdk 1.7 64bit : /usr/local/jdk

#############################################################################################################

#############################################################################################################

#############################################################################################################

cd /usr/local/metaqCluster

tar xzvf /backall/apache/zookeeper-3.4.6.tar.gz

[[email protected] local]# vi zookeeperCluster/zookeeper-2181/conf/zoo.cfg

# The number of milliseconds of each tick

tickTime=2000

# The number of ticks that the initial

# synchronization phase can take

initLimit=10

# The number of ticks that can pass between

# sending a request and getting an acknowledgement

syncLimit=5

# the directory where the snapshot is stored.

# do not use /tmp for storage, /tmp here is just

# example sakes.

dataDir=/usr/local/zookeeperCluster/zookeeper-2181/dataDir

# the port at which the clients will connect

clientPort=2181

# the maximum number of client connections.

# increase this if you need to handle more clients

#maxClientCnxns=60

#

# Be sure to read the maintenance section of the

# administrator guide before turning on autopurge.

#

# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance

#

# The number of snapshots to retain in dataDir

#autopurge.snapRetainCount=3

# Purge task interval in hours

# Set to "0" to disable auto purge feature

#autopurge.purgeInterval=1

server.1=c11-metaq-n01:2888:3888

server.2=c11-metaq-n02:2888:3888

server.3=c11-metaq-n03:2888:3888

修改zookeeper服务的myid标签为1

[[email protected] local]# vi /usr/local/zookeeperCluster/zookeeper-2181/dataDir/myid

1

添加JDK配置:

[[email protected] local]# vi zookeeperCluster/zookeeper-2181/bin/zkEnv.sh

JAVA_HOME=/usr/local/jdk

#############################################################################################################

#############################################################################################################

#############################################################################################################

cd /usr/local/zookeeperCluster

tar xzvf /backall/apache/metaq-server-1.4.6.2.tar.gz

配置brokerId、端口、zookeeper和topic信息:

[[email protected] local]# vi ./metaqCluster/taobao-8123/metamorphosis-server-wrapper/conf/server.ini

[system]

brokerId=0

numPartitions=10

serverPort=8123

dataPath=/usr/local/metaqCluster/taobao-8123/data

dashboardHttpPort=8120

unflushThreshold=0

unflushInterval=10000

maxSegmentSize=1073741824

maxTransferSize=1048576

deletePolicy=delete,168

deleteWhen=0 0 3 * * ?

flushTxLogAtCommit=1

stat=true

;; Update consumers offsets to current max offsets when consumers offsets are out of range of current broker‘s messages.

;; It must be false in production.But recommend to be true in development or test.

updateConsumerOffsets=true

[zookeeper]

zk.zkConnect=10.10.12.203:2181,10.10.12.204:2181,10.10.12.205:2181

#zk.zkConnect=10.10.12.203:2181

zk.zkSessionTimeoutMs=30000

zk.zkConnectionTimeoutMs=30000

zk.zkSyncTimeMs=5000

;; Topics section

[topic=test]

[topic=meta-test]

[topic=user-action]

配置JDK环境变量:

[[email protected] local]# vi ./metaqCluster/taobao-8123/metamorphosis-server-wrapper/bin/env.sh

#!/bin/bash

#Config your java home

JAVA_HOME=/usr/local/jdk/

if [ -z "$JAVA_HOME" ]; then

export JAVA=`which java`

else

export JAVA="$JAVA_HOME/bin/java"

fi

#JMX port

meta_home=$BASE_DIR

#Broker JMX port

export JMX_PORT=9123

export CLASSPATH=$CLASSPATH:$BASE_DIR/conf:$(ls $BASE_DIR/lib/*.jar | tr ‘\n‘ :)

echo $CLASSPATH > /tmp/classpath.txt

#Broker jvm args

BROKER_JVM_ARGS="-Xmx512m -Xms512m -server -Dmeta.home=$meta_home -cp $CLASSPATH "

#Tools jvm args,you don‘t have to modify this at all.

TOOLS_JVM_ARGS="-Xmx128m -Xms128m -Dmeta.home=$meta_home -cp $CLASSPATH "

#whether to enable http endpoints

export enableHttp=false

if [ -z "$BROKER_ARGS" ]; then

export BROKER_ARGS="$BROKER_JVM_ARGS -Dlog4j.configuration=file:$BASE_DIR/bin/log4j.properties"

fi

if [ -z "$TOOLS_ARGS" ]; then

export TOOLS_ARGS="$TOOLS_JVM_ARGS -Dlog4j.configuration=file:$BASE_DIR/bin/tools_log4j.properties"

fi

[[email protected] lib]# cp -r /backall/apache/zk&metaq/*.jar /usr/local/metaqCluster/taobao-8123/metamorphosis-server-wrapper/lib/

启动方式:

[[email protected] local]# ./metaqCluster/taobao-8123/metamorphosis-server-wrapper/bin/metaServer.sh start

查看启动状态:

[[email protected] local]# ./metaqCluster/taobao-8123/metamorphosis-server-wrapper/bin/metaServer.sh status

时间: 2024-08-30 05:12:08

zookeeper与metaq集群的相关文章

(转)ZooKeeper伪分布式集群安装及使用

转自:http://blog.fens.me/hadoop-zookeeper-intro/ 前言 ZooKeeper是Hadoop家族的一款高性能的分布式协作的产品.在单机中,系统协作大都是进程级的操作.分布式系统中,服务协作都是跨服务器才能完成的.在ZooKeeper之前,我们对于协作服务大都使用消息中间件,随着分布式系统的普及,用消息中间件完成协作,会有大量的程序开发.ZooKeeper直接面向于分布式系统,可以减少我们自己的开发,帮助我们更好完成分布式系统的数据管理问题. 目录 zook

ZooKeeper伪分布式集群安装

获取ZooKeeper安装包 下载地址:http://apache.dataguru.cn/zookeeper 选择一个稳定版本进行下载,我这里下载的是zookeeper-3.4.6版本. ZooKeeper伪分布式集群安装 伪分布式集群:在一台Server中,启动多个ZooKeeper的实例. 上传并解压安装包 cd /usr rz -by tar xf zookeeper-3.4.6.tar.gz 创建实例配置文件 cd zookeeper-3.4.6/conf cp zoo_sample.

Zookeeper实现分布式集群监控

Zookeeepr实现分布式集群监控 Zookeeper中节点有两种:临时节点和永久节点 从类型上看节点又可以分为四种节点类型:PERSIST,PERSIST_SEQUENTIAL,EPHEMERAL,EPHEMERAL_SEQUENTIAL 临时节点有一个特点:当创建临时节点的程序停掉之后,这个临时节点就会消失. 监视器的特点:可以给zk中的节点注册监视器,见识这个节点的变化情况. 监视器注册一次,只能使用一次,多次使用就要多次注册. 我们利用这个Zookeeper的临时节点特性+监视器(Wa

ZooKeeper伪分布集群安装及使用 RMI+ZooKeeper实现远程调用框架

使用 RMI + ZooKeeper 实现远程调用框架,包括ZooKeeper伪集群安装和代码实现两部分.  一.ZooKeeper伪集群安装: 1>获取ZooKeeper安装包 下载地址:http://apache.dataguru.cn/zookeeper 选择一个稳定版本进行下载,我这里下载的是zookeeper-3.4.6版本. 2>ZooKeeper伪分布式集群安装 伪分布式集群:在一台Server中,启动多个ZooKeeper的实例. 3>上传并解压安装包 4>创建实例

十分钟教你学会zookeeper安装和集群搭建(伪集群 )

1. zookeeper介绍 ZooKeeper是一个为分布式应用所设计的分布的.开源的协调服务,它主要是用来解决分布式应用中经常遇到的一些数据管理问题,简化分布式应用协调及其管理的难度,提供高性能的分布式服务.ZooKeeper本身可以以Standalone模式安装运行,不过它的长处在于通过分布式ZooKeeper集群(一个Leader,多个Follower),基于一定的策略来保证ZooKeeper集群的稳定性和可用性,从而实现分布式应用的可靠性. ZooKeeper是作为分布式协调服务,是不

ZooKeeper伪分布式集群安装及使用

前言 ZooKeeper是Hadoop家族的一款高性能的分布式协作的产品.在单机中,系统协作大都是进程级的操作.分布式系统中,服务协作都是跨服务器才能完成的.在ZooKeeper之前,我们对于协作服务大都使用消息中间件,随着分布式系统的普及,用消息中间件完成协作,会有大量的程序开发.ZooKeeper直接面向于分布式系统,可以减少我们自己的开发,帮助我们更好完成分布式系统的数据管理问题. 目录 zookeeper介绍 zookeeper单节点安装 zookeeper伪分布式集群安装 zookee

zookeeper集群环境搭建(使用kafka的zookeeper搭建zk集群)

---恢复内容开始--- 使用kafka的zookeeper来搞集群的话和单纯用zk的其实差不了多少. 0.说在前头,搭建kafka集群之前请把每个服务器的jdk搞起来. 1.安装kafka wget http://mirrors.hust.edu.cn/apache/kafka/2.0.0/kafka_2.11-2.0.0.tgz 下载kafka然后放到你的目录下 解压 tar zxvf kafka_2.11-2.0.0.tgz 2.配置zk cd kafka_2.11-2.0.0/confi

使用Docker快速搭建Zookeeper和kafka集群

集群搭建 镜像选择 Zookeeper和Kafka集群分别运行在不同的容器中zookeeper官方镜像,版本3.4kafka采用wurstmeister/kafka镜像 集群规划 hostname Ip addr port listener zoo1 172.19.0.11 2184:2181 zoo2 172.19.0.12 2185:2181 zoo3 172.19.0.13 2186:2181 kafka1 172.19.0.14 9092:9092 kafka1 kafka2 172.1

zookeeper 安装 配置集群

https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/ [[email protected] src]# tar -xzvf zookeeper-3.5.2-alpha.tar.gz [[email protected] src]# ls zookeeper-3.5.2-alpha zookeeper-3.5.2-alpha.tar.gz [[email protected] zookeeper-3.5.2-alpha]# ls bin iv