hadoop程序问题：java.lang.IllegalArgumentException: Wrong FS: hdfs:/ expected file:///

Java代码如下：

FileSystem fs = FileSystem.get(conf);
in = fs.open(new Path("hdfs://192.168.130.54:19000/user/hmail/output/part-00000"));

抛出异常如下：

Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://192.168.130.54:19000/user/hmail/output/part-00000, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:310)
at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:47)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:357)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:356)
at com.netease.hadoop.HDFSCatWithAPI.main(HDFSCatWithAPI.java:23)

解决方案：

hadoop需要把集群上的core-site.xml和hdfs-site.xml放到当前工程下。eclipse工作目录的bin文件夹下面

因为是访问远程的HDFS 需要通过URＩ来获得FileSystem.

时间： 2024-10-05 04:27:58

hadoop程序问题：java.lang.IllegalArgumentException: Wrong FS: hdfs:/ expected file:///的相关文章

Wrong FS: hdfs://......, expected: file:///

单机版使用的是FileSystem类的静态函数: FileSystem hdfs = FileSystem.get(conf) 伪分布式下需要使用Path来获得 Path path = new Path("hdfs://mlj:9000/dir"); FileSystem hdfs = path.getFileSystem(jobConf);

启动hive错误：Exception in thread "main" java.lang.IllegalArgumentException

启动hive错误:Exception in thread "main" java.lang.IllegalArgumentException 2018-03-20 15:19:07 Gethin_H 阅读数 1357更多分类专栏: Hive 版权声明:本文为博主原创文章,遵循CC 4.0 BY-SA版权协议,转载请附上原文出处链接和本声明. 本文链接:https://blog.csdn.net/Gethin_H/article/details/79626223 启动hive时报错了

java.lang.IllegalArgumentException: XXX is ambiguous in Mapped Statements collection

问题的出现: 在后台添加一个新栏目的时候,照着程序已有原来的代码添加新的功能时,文件没有错误.点击新的栏目的时候报了java.lang.IllegalArgumentException: selectPageByExample is ambiguous in Mapped Statements collection (try using the full name including the namespace, or rename one of the entries). 解决: 在网上查找了

mllib:java.lang.IllegalArgumentException: GiniAggregator given label 2.0 but requires label < numCla

报错信息 : java.lang.IllegalArgumentException: GiniAggregator given label 2.0 but requires label < numClasses (= 2) 在用mllib做分类,当用到一些分类算法时,常常需要加入基尼系数. 程序代码: RandomForest.trainClassifier(validData,2,Map[Int,Int](),10,"auto","gini",8,32) 当

java.lang.IllegalArgumentException: Wrong state classs

java.lang.IllegalArgumentException: Wrong state class, expecting View State but received class cn.etouch.ecalendar.waterfallview.StaggeredGridView$GridListSavedState instead. This usually happens when two views of different type have the same id in t

解决kylin报错：Failed to create dictionary on <db>.<table>, Caused by: java.lang.IllegalArgumentException: Too high cardinality is not suitable for dictionary

报错信息: 2017-05-13 15:14:30,035 DEBUG [pool-9-thread-10] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.TrieDictionary 2017-05-13 15:14:30,036 ERROR [pool-9-thread-10] common.HadoopShellExecutable:65 : error execute HadoopShellEx

android——fragment长时间home或者锁屏java.lang.IllegalArgumentException：No view found for id for....

在项目中遇到了这个问题.头痛了很久,总是无法重现,也不能很好的解决.总是在息屏后一段时间,就会报java.lang.IllegalArgumentException:No view found for id for....的问题,然后程序就崩溃了.相信很多朋友也有和我一样遇到这个问题的.那么这个问题怎么去解决呢? 在仔细研究fragment的manager后,下面是我发现的东西什么鬼?怎么会有两个fragmentManager.这两个东西有什么关系呢? API上面说了一大堆,我这里简单总结一下

java.lang.IllegalArgumentException: Receiver not registered

错误提示:java.lang.IllegalArgumentException: Receiver not registered. 顾名思义就是Receiver没有被注册,这是由于取消了没有注册的Receiver导致的错误. 我们使用Receiver时必须保证注册(register)和反注册(unregister)成对出现. 遇到这种问题时,你需要检查下自己代码中注册和反注册的代码,看下是否存在多次调用unregister的时候. 很多时候都是想当然认为会那样,但是程序中可能有我们未预料的出口,

解决nested exception is java.lang.IllegalArgumentException: No converter found for return value of type: class java.util.ArrayList问题

一.背景最近闲来无事,想自己搭建一套Spring+SpringMVC+Mybatis+Mysql的环境(搭建步骤会在以后博客中给出),结果运行程序时,适用@ResponseBody注解进行返回List<对象>的json数据时出现了:nested exception is java.lang.IllegalArgumentException: No converter found for return value of type: class java.util.ArrayList错误,就细细