hadoop2.6.0实践:003 检查hadoop是否可用

start-dfs.sh

start-yarn.sh

1、检查hdfs

hdfs dfs -ls /

http://localhost:50070

2、运行例子程序

hdfs dfs -ls /

hdfs dfs -mkdir -R /example/grep/input

hdfs dfs -mkdir -R /example/grep/output

hdfs dfs -copyFromLocal  /etc/profile  /example/grep/input

hdfs dfs -rm -r /example/grep/output

hadoop jar

3、检查yarn

http://localhost:8088

hdfs dfs -cat /example/grep/output/*

4、stop

stop-dfs.sh

stop-yarn.sh

时间: 2024-11-19 18:06:59

hadoop2.6.0实践:003 检查hadoop是否可用的相关文章

hadoop2.7.0实践- WordCount

环境要求 说明:本文档为wordcount的mapreduce job编写及运行文档. 操作系统:Ubuntu14 x64位 Hadoop:Hadoop 2.7.0 Hadoop官网:http://hadoop.apache.org/releases.html MapReduce参照官网步骤: http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTu

hadoop2.6.0实践:002 检查伪分布式环境搭建

1.检查网络配置[[email protected] ~]# cat /etc/sysconfig/networkNETWORKING=yesHOSTNAME=hadoop-masterGATEWAY=192.168.126.2 [[email protected] ~]# cat /etc/hosts127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4::1 localhost localhos

Hadoop2.6.0实践:000 环境搭建

##################### Centos6.4VM_01_os.rar ################################################准备工作/opt /opt/modules 软件安装目录 /opt/softwares 软件包(tar.bin.zip) /opt/tools(eclipse等) /opt/data(测试数据)/home/hadoop(工具和数据) ##################### Centos6.4VM_01_os.r

hadoop2.6.0实践:引入开发依赖的jar包

hadoop-2.5.0\share\hadoop\common  所有jar,hadoop-2.5.0\share\hadoop\common\lib  所有jar, hadoop-2.5.0\share\hadoop\hdfs  所有jar hadoop-2.5.0\share\hadoop\mapreduce  所有jar hadoop-2.5.0\share\hadoop\yarn  所有jar

hadoop2.6.0实践:hadoop dfs -ls /

[[email protected] data]$ hadoop dfs -ls /DEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it. Found 3 itemsdrwxr-xr-x - hadoop supergroup 0 2017-01-18 15:34 /examplesdrwx------ - hadoop supergroup

hadoop2.6.0实践:A02 问题处理 util.NativeCodeLoader: Unable to load native-hadoop library for your platform

############################################################# hadoop "util.NativeCodeLoader: Unable to load native-hadoop library for your platform" hadoop安装完以后,经常会提示以下警告: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your

hadoop2.7.0实践-环境搭建

文档说明 本文档为hadoop搭建实践文档,相关理论可到hadoop官网查看学习. 操作系统:Ubuntu14 x64位 Hadoop:Hadoop 2.7.0 Ubuntu官网:http://www.ubuntu.com/download/desktop 下载地址: http://211.167.105.77:83/1Q2W3E4R5T6Y7U8I9O0P1Z2X3C4V5B/releases.ubuntu.com/14.04.2/ubuntu-14.04.2-desktop-amd64.is

hadoop2.6.0实践:控制台入口url列表

hadoop web控制台页面的端口整理: 50070:hdfs文件管理 8088:ResourceManager 8042:NodeManager 19888:JobHistory(使用"mr-jobhistory-daemon.sh"来启动JobHistory Server)

Hadoop安装教程_单机/伪分布式配置_CentOS6.4/Hadoop2.6.0

Hadoop安装教程_单机/伪分布式配置_CentOS6.4/Hadoop2.6.0 环境 本教程使用 CentOS 6.4 32位 作为系统环境,请自行安装系统.如果用的是 Ubuntu 系统,请查看相应的 Ubuntu安装Hadoop教程. 本教程基于原生 Hadoop 2,在 Hadoop 2.6.0 (stable) 版本下验证通过,可适合任何 Hadoop 2.x.y 版本,例如 Hadoop 2.7.1, Hadoop 2.4.1等. Hadoop版本 Hadoop 有两个主要版本,