Flume单机安装与配置

下载

apache-flume-1.6.0-bin.tar.gz

解压

tar -zxvf apache-flume-1.6.0-bin.tar.gz 

配置

cp conf/flume-conf.properties.template conf/flume-conf.properties
cp conf/flume-env.sh.template conf/flume-env.sh

flume-env.sh

# Enviroment variables can be set here.
export JAVA_HOME=/csh/link/jdk

# Give Flume more memory and pre-allocate, enable remote monitoring via JMX
# export JAVA_OPTS="-Xms100m -Xmx2000m -Dcom.sun.management.jmxremote"

# Note that the Flume conf directory is always included in the classpath.
FLUME_CLASSPATH=/csh/link/flume/lib

单机配置

在conf目录下创建single-node.conf文件,并将下面内容复制粘贴

# example.conf: A single-node Flume configuration

# Name the components on this agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1

# Describe/configure the source
a1.sources.r1.type = netcat
a1.sources.r1.bind = localhost
a1.sources.r1.port = 44444

# Describe the sink
a1.sinks.k1.type = logger

# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

运行

bin/flume-ng agent --conf conf --conf-file conf/single-node.conf --name a1 -Dflume.root.logger=INFO,console

命令行输出:

Info: Sourcing environment configuration script /csh/link/flume/conf/flume-env.sh
Info: Including Hadoop libraries found via (/csh/link/hadoop/bin/hadoop) for HDFS access
Info: Excluding /csh/software/hadoop-2.7.2/share/hadoop/common/lib/slf4j-api-1.7.10.jar from classpath
Info: Excluding /csh/software/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar from classpath
Info: Including HBASE libraries found via (/csh/link/hbase/bin/hbase) for HBASE access
Info: Excluding /csh/link/hbase/lib/slf4j-api-1.7.7.jar from classpath
Info: Excluding /csh/link/hbase/lib/slf4j-log4j12-1.7.5.jar from classpath
Info: Excluding /csh/software/hadoop-2.7.2/share/hadoop/common/lib/slf4j-api-1.7.10.jar from classpath
Info: Excluding /csh/software/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar from classpath
Info: Including Hive libraries found via (/csh/link/hive) for Hive access
+ exec /csh/link/jdk/bin/java -Xmx20m -Dflume.root.logger=INFO,console -cp ‘/csh/link/flume/conf:/csh/link/flume/lib/*:/csh/link/flume/lib:/csh/software/hadoop-2.7.2/etc/hadoop:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/activation-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/avro-1.7.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-cli-1.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-codec-1.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-collections-3.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-compress-1.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-configuration-1.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-digester-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-httpclient-3.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-lang-2.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-logging-1.1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-math3-3.1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-net-3.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/curator-client-2.7.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/curator-framework-2.7.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/gson-2.2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/guava-11.0.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/hadoop-annotations-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/hadoop-auth-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/hamcrest-core-1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/httpclient-4.2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/httpcore-4.2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jersey-json-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jets3t-0.9.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jettison-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jetty-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jetty-util-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jsch-0.1.42.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jsp-api-2.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jsr305-3.0.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/junit-4.11.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/mockito-all-1.8.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/paranamer-2.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/servlet-api-2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/stax-api-1.0-2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/xmlenc-0.52.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/xz-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/zookeeper-3.4.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/hadoop-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/hadoop-common-2.7.2-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/hadoop-nfs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/jdiff:/csh/software/hadoop-2.7.2/share/hadoop/common/lib:/csh/software/hadoop-2.7.2/share/hadoop/common/sources:/csh/software/hadoop-2.7.2/share/hadoop/common/templates:/csh/software/hadoop-2.7.2/share/hadoop/hdfs:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/guava-11.0.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/hadoop-hdfs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/hadoop-hdfs-2.7.2-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/jdiff:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/sources:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/templates:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/webapps:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/activation-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/aopalliance-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-cli-1.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-codec-1.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-lang-2.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/guava-11.0.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/guice-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/javax.inject-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-client-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-json-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jettison-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jetty-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/servlet-api-2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/xz-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-api-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-client-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-registry-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib:/csh/software/hadoop-2.7.2/share/hadoop/yarn/sources:/csh/software/hadoop-2.7.2/share/hadoop/yarn/test:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/guice-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/javax.inject-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/junit-4.11.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/xz-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.2-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib-examples:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/sources:/csh/link/hadoop/contrib/capacity-scheduler/*.jar:/csh/link/hbase/conf:/csh/link/jdk/lib/tools.jar:/csh/link/hbase:/csh/link/hbase/lib/activation-1.1.jar:/csh/link/hbase/lib/antisamy-1.4.3.jar:/csh/link/hbase/lib/aopalliance-1.0.jar:/csh/link/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/csh/link/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/csh/link/hbase/lib/api-asn1-api-1.0.0-M20.jar:/csh/link/hbase/lib/api-util-1.0.0-M20.jar:/csh/link/hbase/lib/asm-3.1.jar:/csh/link/hbase/lib/avro-1.7.4.jar:/csh/link/hbase/lib/batik-css-1.7.jar:/csh/link/hbase/lib/batik-ext-1.7.jar:/csh/link/hbase/lib/batik-util-1.7.jar:/csh/link/hbase/lib/bsh-core-2.0b4.jar:/csh/link/hbase/lib/commons-beanutils-1.7.0.jar:/csh/link/hbase/lib/commons-beanutils-core-1.7.0.jar:/csh/link/hbase/lib/commons-cli-1.2.jar:/csh/link/hbase/lib/commons-codec-1.9.jar:/csh/link/hbase/lib/commons-collections-3.2.2.jar:/csh/link/hbase/lib/commons-compress-1.4.1.jar:/csh/link/hbase/lib/commons-configuration-1.6.jar:/csh/link/hbase/lib/commons-daemon-1.0.13.jar:/csh/link/hbase/lib/commons-digester-1.8.jar:/csh/link/hbase/lib/commons-el-1.0.jar:/csh/link/hbase/lib/commons-fileupload-1.2.jar:/csh/link/hbase/lib/commons-httpclient-3.1.jar:/csh/link/hbase/lib/commons-io-2.4.jar:/csh/link/hbase/lib/commons-lang-2.6.jar:/csh/link/hbase/lib/commons-logging-1.2.jar:/csh/link/hbase/lib/commons-math-2.2.jar:/csh/link/hbase/lib/commons-math3-3.1.1.jar:/csh/link/hbase/lib/commons-net-3.1.jar:/csh/link/hbase/lib/disruptor-3.3.0.jar:/csh/link/hbase/lib/esapi-2.1.0.jar:/csh/link/hbase/lib/findbugs-annotations-1.3.9-1.jar:/csh/link/hbase/lib/guava-12.0.1.jar:/csh/link/hbase/lib/guice-3.0.jar:/csh/link/hbase/lib/guice-servlet-3.0.jar:/csh/link/hbase/lib/hadoop-annotations-2.5.1.jar:/csh/link/hbase/lib/hadoop-auth-2.5.1.jar:/csh/link/hbase/lib/hadoop-client-2.5.1.jar:/csh/link/hbase/lib/hadoop-common-2.5.1.jar:/csh/link/hbase/lib/hadoop-hdfs-2.5.1.jar:/csh/link/hbase/lib/hadoop-mapreduce-client-app-2.5.1.jar:/csh/link/hbase/lib/hadoop-mapreduce-client-common-2.5.1.jar:/csh/link/hbase/lib/hadoop-mapreduce-client-core-2.5.1.jar:/csh/link/hbase/lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/csh/link/hbase/lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/csh/link/hbase/lib/hadoop-yarn-api-2.5.1.jar:/csh/link/hbase/lib/hadoop-yarn-client-2.5.1.jar:/csh/link/hbase/lib/hadoop-yarn-common-2.5.1.jar:/csh/link/hbase/lib/hadoop-yarn-server-common-2.5.1.jar:/csh/link/hbase/lib/hbase-annotations-1.1.4.jar:/csh/link/hbase/lib/hbase-annotations-1.1.4-tests.jar:/csh/link/hbase/lib/hbase-client-1.1.4.jar:/csh/link/hbase/lib/hbase-common-1.1.4.jar:/csh/link/hbase/lib/hbase-common-1.1.4-tests.jar:/csh/link/hbase/lib/hbase-examples-1.1.4.jar:/csh/link/hbase/lib/hbase-hadoop2-compat-1.1.4.jar:/csh/link/hbase/lib/hbase-hadoop-compat-1.1.4.jar:/csh/link/hbase/lib/hbase-it-1.1.4.jar:/csh/link/hbase/lib/hbase-it-1.1.4-tests.jar:/csh/link/hbase/lib/hbase-prefix-tree-1.1.4.jar:/csh/link/hbase/lib/hbase-procedure-1.1.4.jar:/csh/link/hbase/lib/hbase-protocol-1.1.4.jar:/csh/link/hbase/lib/hbase-resource-bundle-1.1.4.jar:/csh/link/hbase/lib/hbase-rest-1.1.4.jar:/csh/link/hbase/lib/hbase-server-1.1.4.jar:/csh/link/hbase/lib/hbase-server-1.1.4-tests.jar:/csh/link/hbase/lib/hbase-shell-1.1.4.jar:/csh/link/hbase/lib/hbase-thrift-1.1.4.jar:/csh/link/hbase/lib/htrace-core-3.1.0-incubating.jar:/csh/link/hbase/lib/httpclient-4.2.5.jar:/csh/link/hbase/lib/httpcore-4.1.3.jar:/csh/link/hbase/lib/jackson-core-asl-1.9.13.jar:/csh/link/hbase/lib/jackson-jaxrs-1.9.13.jar:/csh/link/hbase/lib/jackson-mapper-asl-1.9.13.jar:/csh/link/hbase/lib/jackson-xc-1.9.13.jar:/csh/link/hbase/lib/jamon-runtime-2.3.1.jar:/csh/link/hbase/lib/jasper-compiler-5.5.23.jar:/csh/link/hbase/lib/jasper-runtime-5.5.23.jar:/csh/link/hbase/lib/javax.inject-1.jar:/csh/link/hbase/lib/java-xmlbuilder-0.4.jar:/csh/link/hbase/lib/jaxb-api-2.2.2.jar:/csh/link/hbase/lib/jaxb-impl-2.2.3-1.jar:/csh/link/hbase/lib/jcodings-1.0.8.jar:/csh/link/hbase/lib/jersey-client-1.9.jar:/csh/link/hbase/lib/jersey-core-1.9.jar:/csh/link/hbase/lib/jersey-guice-1.9.jar:/csh/link/hbase/lib/jersey-json-1.9.jar:/csh/link/hbase/lib/jersey-server-1.9.jar:/csh/link/hbase/lib/jets3t-0.9.0.jar:/csh/link/hbase/lib/jettison-1.3.3.jar:/csh/link/hbase/lib/jetty-6.1.26.jar:/csh/link/hbase/lib/jetty-sslengine-6.1.26.jar:/csh/link/hbase/lib/jetty-util-6.1.26.jar:/csh/link/hbase/lib/joni-2.1.2.jar:/csh/link/hbase/lib/jruby-complete-1.6.8.jar:/csh/link/hbase/lib/jsch-0.1.42.jar:/csh/link/hbase/lib/jsp-2.1-6.1.14.jar:/csh/link/hbase/lib/jsp-api-2.1-6.1.14.jar:/csh/link/hbase/lib/jsr305-1.3.9.jar:/csh/link/hbase/lib/junit-4.12.jar:/csh/link/hbase/lib/leveldbjni-all-1.8.jar:/csh/link/hbase/lib/libthrift-0.9.0.jar:/csh/link/hbase/lib/log4j-1.2.17.jar:/csh/link/hbase/lib/metrics-core-2.2.0.jar:/csh/link/hbase/lib/nekohtml-1.9.12.jar:/csh/link/hbase/lib/netty-3.2.4.Final.jar:/csh/link/hbase/lib/netty-all-4.0.23.Final.jar:/csh/link/hbase/lib/paranamer-2.3.jar:/csh/link/hbase/lib/protobuf-java-2.5.0.jar:/csh/link/hbase/lib/servlet-api-2.5-6.1.14.jar:/csh/link/hbase/lib/servlet-api-2.5.jar:/csh/link/hbase/lib/snappy-java-1.0.4.1.jar:/csh/link/hbase/lib/spymemcached-2.11.6.jar:/csh/link/hbase/lib/xalan-2.7.0.jar:/csh/link/hbase/lib/xml-apis-1.3.03.jar:/csh/link/hbase/lib/xml-apis-ext-1.3.04.jar:/csh/link/hbase/lib/xmlenc-0.52.jar:/csh/link/hbase/lib/xom-1.2.5.jar:/csh/link/hbase/lib/xz-1.0.jar:/csh/link/hbase/lib/zookeeper-3.4.6.jar:/csh/software/hadoop-2.7.2/etc/hadoop:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/activation-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/avro-1.7.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-cli-1.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-codec-1.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-collections-3.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-compress-1.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-configuration-1.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-digester-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-httpclient-3.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-lang-2.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-logging-1.1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-math3-3.1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/commons-net-3.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/curator-client-2.7.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/curator-framework-2.7.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/gson-2.2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/guava-11.0.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/hadoop-annotations-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/hadoop-auth-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/hamcrest-core-1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/httpclient-4.2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/httpcore-4.2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jersey-json-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jets3t-0.9.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jettison-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jetty-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jetty-util-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jsch-0.1.42.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jsp-api-2.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/jsr305-3.0.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/junit-4.11.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/mockito-all-1.8.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/paranamer-2.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/servlet-api-2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/stax-api-1.0-2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/xmlenc-0.52.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/xz-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/lib/zookeeper-3.4.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/hadoop-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/hadoop-common-2.7.2-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/hadoop-nfs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/common/jdiff:/csh/software/hadoop-2.7.2/share/hadoop/common/lib:/csh/software/hadoop-2.7.2/share/hadoop/common/sources:/csh/software/hadoop-2.7.2/share/hadoop/common/templates:/csh/software/hadoop-2.7.2/share/hadoop/hdfs:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/guava-11.0.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/hadoop-hdfs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/hadoop-hdfs-2.7.2-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/jdiff:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/lib:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/sources:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/templates:/csh/software/hadoop-2.7.2/share/hadoop/hdfs/webapps:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/activation-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/aopalliance-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-cli-1.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-codec-1.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-lang-2.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/guava-11.0.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/guice-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/javax.inject-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-client-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-json-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jettison-1.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jetty-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/servlet-api-2.5.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/xz-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-api-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-client-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-registry-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/yarn/lib:/csh/software/hadoop-2.7.2/share/hadoop/yarn/sources:/csh/software/hadoop-2.7.2/share/hadoop/yarn/test:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/asm-3.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/guice-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/javax.inject-1.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/junit-4.11.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib/xz-1.0.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.2-tests.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/lib-examples:/csh/software/hadoop-2.7.2/share/hadoop/mapreduce/sources:/csh/link/hadoop/contrib/capacity-scheduler/*.jar:/csh/link/hbase/conf:/csh/link/hive/lib/*‘ -Djava.library.path=:/csh/software/hadoop-2.7.2/lib/native:/csh/software/hadoop-2.7.2/lib/native org.apache.flume.node.Application --conf-file conf/single-node.conf --name a1
2016-04-19 21:44:11,126 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:61)] Configuration provider starting
2016-04-19 21:44:11,165 (conf-file-poller-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:133)] Reloading configuration file:conf/single-node.conf
2016-04-19 21:44:11,200 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:931)] Added sinks: k1 Agent: a1
2016-04-19 21:44:11,200 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1017)] Processing:k1
2016-04-19 21:44:11,201 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1017)] Processing:k1
2016-04-19 21:44:11,285 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:141)] Post-validation flume configuration contains configuration for agents: [a1]
2016-04-19 21:44:11,285 (conf-file-poller-0) [INFO - org.apache.flume.node.AbstractConfigurationProvider.loadChannels(AbstractConfigurationProvider.java:145)] Creating channels
2016-04-19 21:44:11,341 (conf-file-poller-0) [INFO - org.apache.flume.channel.DefaultChannelFactory.create(DefaultChannelFactory.java:42)] Creating instance of channel c1 type memory
2016-04-19 21:44:11,506 (conf-file-poller-0) [INFO - org.apache.flume.node.AbstractConfigurationProvider.loadChannels(AbstractConfigurationProvider.java:200)] Created channel c1
2016-04-19 21:44:11,507 (conf-file-poller-0) [INFO - org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:41)] Creating instance of source r1, type netcat
2016-04-19 21:44:11,590 (conf-file-poller-0) [INFO - org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:42)] Creating instance of sink: k1, type: logger
2016-04-19 21:44:11,610 (conf-file-poller-0) [INFO - org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:114)] Channel c1 connected to [r1, k1]
2016-04-19 21:44:11,684 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:138)] Starting new configuration:{ sourceRunners:{r1=EventDrivenSourceRunner: { source:org.apache.flume.source.NetcatSource{name:r1,state:IDLE} }} sinkRunners:{k1=SinkRunner: { policy:[email protected]7ceacc49 counterGroup:{ name:null counters:{} } }} channels:{c1=org.apache.flume.channel.MemoryChannel{name: c1}} }
2016-04-19 21:44:11,713 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:145)] Starting Channel c1
2016-04-19 21:44:17,439 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.register(MonitoredCounterGroup.java:120)] Monitored counter group for type: CHANNEL, name: c1: Successfully registered new MBean.
2016-04-19 21:44:17,440 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.start(MonitoredCounterGroup.java:96)] Component type: CHANNEL, name: c1 started
2016-04-19 21:44:17,452 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:173)] Starting Sink k1
2016-04-19 21:44:17,462 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:184)] Starting Source r1
2016-04-19 21:44:17,474 (lifecycleSupervisor-1-1) [INFO - org.apache.flume.source.NetcatSource.start(NetcatSource.java:150)] Source starting
2016-04-19 21:44:18,012 (lifecycleSupervisor-1-1) [INFO - org.apache.flume.source.NetcatSource.start(NetcatSource.java:164)] Created serverSocket:sun.nio.ch.ServerSocketChannelImpl[/127.0.0.1:44444]

测试

在XShell中打开另一个窗口输入:

[[email protected] ~]# telnet 127.0.0.1 44444
Trying 127.0.0.1...
Connected to 127.0.0.1.
Escape character is ‘^]‘.
hello flume!
OK
hello big data
OK

在原来启动flume的命令行中可以看到:

2016-04-19 21:47:35,653 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:94)] Event: { headers:{} body: 68 65 6C 6C 6F 20 66 6C 75 6D 65 21 0D          hello flume!. }
2016-04-19 21:49:10,610 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:94)] Event: { headers:{} body: 68 65 6C 6C 6F 20 62 69 67 20 64 61 74 61 0D    hello big data. }

个人博客原文:

Flume单机安装与配置

时间: 2024-09-28 21:39:28

Flume单机安装与配置的相关文章

redis的单机安装与配置以及生产环境启动方案

简单介绍一下redis的单机安装与配置,方便自己记录安装步骤的同时方便他人获取知识. 首先,从官网下载最新版的(稳定版)的redis安装包.官网地址如下:https://redis.io/download 下载源码包后,redis需要编译安装.需要安装gcc和tcl,gcc用于编译tcl用于测试. 使用命令安装gcc,yum install gcc,一路选择yes,gcc就可以安装成功. 接下来安装tcl,首先获取tcl源码包(见百度云盘)或者使用命令:wget http://downloads

Flume的安装与配置

Flume的安装与配置 一.       资源下载 资源地址:http://flume.apache.org/download.html 程序地址:http://apache.fayea.com/flume/1.6.0/apache-flume-1.6.0-bin.tar.gz 源码地址:http://mirrors.hust.edu.cn/apache/flume/1.6.0/apache-flume-1.6.0-src.tar.gz 二.       安装搭建 (1)编译好的包: 直接在安装

ZooKeeper安装与配置

一. 单机安装.配置: 1. 下载zookeeper二进制安装包下载地址:http://apache.dataguru.cn/zookeeper/zookeeper-3.4.3/zookeeper-3.4.3.tar.gz 上面地址应该已经失效 最新地址是http://mirrors.hust.edu.cn/apache/zookeeper/zookeeper-3.4.9/ 2.解压zookeeper安装包把zookeeper-3.4.3.tar.gz文件存放在/home/hadoop目录下,进

转载:Hadoop安装教程_单机/伪分布式配置_Hadoop2.6.0/Ubuntu14.04

原文 http://www.powerxing.com/install-hadoop/ 当开始着手实践 Hadoop 时,安装 Hadoop 往往会成为新手的一道门槛.尽管安装其实很简单,书上有写到,官方网站也有 Hadoop 安装配置教程,但由于对 Linux 环境不熟悉,书上跟官网上简略的安装步骤新手往往 Hold 不住.加上网上不少教程也甚是坑,导致新手折腾老几天愣是没装好,很是打击学习热情. 本教程适合于原生 Hadoop 2,包括 Hadoop 2.6.0, Hadoop 2.7.1

flume详细介绍,安装,配置

一.什么是Flume? flume 作为 cloudera 开发的实时日志收集系统,受到了业界的认可与广泛应用.Flume 初始的发行版本目前被统称为 Flume OG(original generation),属于 cloudera.但随着 FLume 功能的扩展,Flume OG 代码工程臃肿.核心组件设计不合理.核心配置不标准等缺点暴露出来,尤其是在 Flume OG 的最后一个发行版本 0.94.0 中,日志传输不稳定的现象尤为严重,为了解决这些问题,2011 年 10 月 22 号,c

ZooKeeper的安装、配置、启动和使用(一)——单机模式

ZooKeeper的安装非常简单,它的工作模式分为单机模式.集群模式和伪集群模式,本博客旨在总结ZooKeeper单机模式下如何安装.配置.启动和使用: 一.安装配置ZooKeeper(在Windows操作系统下) a.下载ZooKeeper压缩安装文件,这里下载稳定版--zookeeper-3.4.5.tar.gz b.解压压缩文件,这里将其解压到C盘根目录下,打开解压后的文件夹,得到下图: c.点击上图名为"conf"的文件夹,可以看到下图: d.用记事本打开上图名为"z

zookeeper的安装与配置(单机和集群)

单机模式: 1.首先去官网下载zookeeper的包 zookeeper-3.4.10.tar.gz 2.用FTP文上传到/usr/local下 3.解压文件tar -zxvf zookeeper-3.4.10.tar.gz 4.在conf文件夹下新建zoo.cfg文件,或者使用里面自带的zoo_sample.cfg,重新cp zoo_sample.cfg  zoo.cfg zoo.cfg文件内容: 1 tickTime=2000 2 dataDir=/Users/zookeeper/data

Hadoop安装教程_单机/伪分布式配置_Hadoop2.6.0/Ubuntu14.04

参见:http://www.powerxing.com/install-hadoop/ 完全拷贝至上面网址 环境 本教程使用 Ubuntu 14.04 64位 作为系统环境(Ubuntu 12.04 也行,32位.64位均可),请自行安装系统. 如果用的是 RedHat/CentOS 系统,请查看相应的CentOS安装Hadoop教程_单机伪分布式配置. 本教程基于原生 Hadoop 2,在 Hadoop 2.6.0 (stable) 版本下验证通过,可适合任何 Hadoop 2.x.y 版本,

Hadoop:Hadoop单机伪分布式的安装和配置

http://blog.csdn.net/pipisorry/article/details/51623195 因为lz的linux系统已经安装好了很多开发环境,可能下面的步骤有遗漏. 之前是在docker中配置的hadoop单机伪分布式[Hadoop:Hadoop单机伪分布式的安装和配置 ],并且在docker只有root用户,所有没有权限问题存在. 这里直接在linux下配置,主要是为了能用netbeans ide调试hadoop程序,并且使用的用户就是开机时登录的用户pika. 本教程配置