eclipse hadoop ERROR [main] security.UserGroupInformation

2015-07-26 23:49:05,594 ERROR [main] security.UserGroupInformation (UserGroupInformation.java:doAs(1494)) - PriviledgedActionException as:cau (auth:SIMPLE) cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/user/guest/0Data

Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/user/guest/0Data

at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:285)

at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:340)

at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:491)

at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:508)

at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:392)

at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)

at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)

at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)

at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)

at Test.DataSelection.main(DataSelection.java:136)

====================================================================================================================

将路由:

Configuration conf = new Configuration();

conf.set("mapred.job.tracker", "10.2.173.15:9001");

String[] ioArgs = new String[] { "/user/guest/0Data", "/user/guest/0data" };

改写为:

FileInputFormat.addInputPath(job,new Path("hdfs://10.2.173.15:9000/user/guest/0Data"));

FileOutputFormat.setOutputPath(job, new Path("hdfs://10.2.173.15:9000/user/guest/0data"));

版权声明:本文为博主原创文章,未经博主允许不得转载。

时间: 2024-08-06 11:54:13

eclipse hadoop ERROR [main] security.UserGroupInformation的相关文章

ERROR security.UserGroupInformation: PriviledgedActionException + java.net.ConnectException解决办法

HADOOP运行mr程序时报错: 15/05/18 19:25:33 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server 15/05/18 19:25:34 INFO ipc.Client: Retrying connect to server: nwj5/192.168.11.1

ERROR security.UserGroupInformation: PriviledgedActionException

16/02/15 08:56:31 ERROR security.UserGroupInformation: PriviledgedActionException as:hadoop cause:org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.mapred.SafeModeException: JobTracker is in safe mode at org.apache.hadoop.mapred.JobTracker.che

ERROR security.UserGroupInformation

[java] 15/11/14 12:58:19 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. [java] 15/11/14 12:58:19 INFO mapred.JobClient: Cleaning up the staging area hdfs://192.168.190.128:9

Mac下报错'WARN security.UserGroupInformation: PriviledgedActionException as:用户名...No such file or directory'的一种解决方法

Mac下使用IDEA远程连接Hadoop调试MapReduce程序,参考网上博客,总会出现如题报错,下面是我在mac下的一种解决办法,可以参考. 前期准备 如果想远程调试,需要做一些准备工作,简单罗列下. (1)在本地准备一份了hadoop(有博主直接从集群中copy一份),设置环境变量. # hadoop路径为具体路径export HADOOP_HOME=/Users/yangchaolin/hadoop2.6.0/hadoop-2.6.0-cdh5.14.0 (2)IDEA工程下,将本地ha

大数据【二】HDFS部署及文件读写(包含eclipse hadoop配置)

一 原理阐述 1' DFS 分布式文件系统(即DFS,Distributed File System),指文件系统管理的物理存储资源不一定直接连接在本地节点上,而是通过计算机网络与节点相连.该系统架构于网络之上,势必会引入网络编程的复杂性,因此分布式文件系统比普通磁盘文件系统更为复杂. 2' HDFS 借此,关于GFS和HDFS的区别与联系查看 我于博客园找到的前辈的博客>>http://www.cnblogs.com/liango/p/7136448.html HDFS(Hadoop Dis

ERROR [main] zookeeper.RecoverableZooKeeper: ZooKeeper create failed after 4 attempts

ERROR [main] zookeeper.RecoverableZooKeeper: ZooKeeper create failed after 4 attempts ERROR [main] master.HMasterCommandLine: Master exiting java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster more…

adt eclipse 配置问题 error:could not open ...jvm.cfg

在安装adt eclipse后,打开eclipse提示error:could not open eclipse\jre\lib\amd64\jvm.cfg 据网上显示原因应该是以前安装过java,然后错误什么的..甲骨文也太那啥了,好像身边装java的人都遇到过大大小小的各种配置问题. 我的情况是,以前安装过eclipse,然后现在为android开发,要安装adt,在官网直接下载了个已经装好的eclipse版本,打开后显示error:could not open ...jvm.cfg. 解决办

微信证书 javax.net.ssl.SSLException: java.lang.RuntimeException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty

这几天在做微信退款接口,按照api写完之后,在本地测试了下没有问题,于是交给测试让他们在测试环境开测.他们说退款没有成功,感觉去查日志,发现后台报了 javax.net.ssl.SSLException: java.lang.RuntimeException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty .退款证书没

求助 Eclipse + NDK error: stray '\24' in program

[size=16px][b][color=#FF0000]求助 Eclipse + NDK  error: stray '\24' in program[/color][b][/b][/b][/size] 最近在研究JNI采用Eclipse+NDKR7B搭建环境 按照网上教的步骤build 什么都配好了写了个最简单的例子,clean以后就出现该异常很是头疼:异常信息: "Compile thumb : TestNdk <= com_example_testndk_JniClient.c j