about hadoop-eclipse-plugin used by IDE

Apache Hadoop Development Tools (HDT) is still in development phase. So, no official distribution of Hadoop 2.2.0 Eclipse Plugin is available now. But we can build the same using winghc/hadoop2x-eclipse-plugin. In this post, we‘ll build, install and configure the plugin with the Eclipse or any Eclipse based IDE (say, Spring Tool Suite) to ease the development activities using Hadoop framework.

The Hadoop Development Tools (HDT) is a set of plugins for the Eclipse IDE for developing against the Hadoop platform.

Currently we are in the process of porting the existing MapReduce tools from the Apache Hadoop project to allow working with multiple versions of Hadoop from within one IDE.

Come get involved as we move towards our first release!

This project is currently a member of the Apache Incubator, so check back for updates, or come join us [email protected].

[[email protected] eclipse-plugin]# ant jar -Dversion=2.5.1 -Declipse.home=$ECLIPSE_HOME -Dhadoop.home=/usr/local/CDH

BUILD FAILED
/home/developer/developPlatform/hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin/build.xml:117:
 Warning: Could not find file /usr/local/CDH/share/hadoop/common/lib/commons-lang-2.5.jar to copy.

BUILD FAILED
/home/developer/developPlatform/hadoop2x-eclipse-plugin-master/src/contrib/eclipse-plugin/build.xml:123:
 Warning: Could not find file /usr/local/CDH/share/hadoop/common/lib/hadoop-auth-2.2.0.jar to copy.
 
<copy file="${hadoop.home}/share/hadoop/common/lib/commons-lang-2.6.jar"  todir="${build.dir}/lib" verbose="true"/>
 
<copy file="${hadoop.home}/share/hadoop/common/lib/hadoop-auth-2.5.0-cdh5.2.0.jar"  todir="${build.dir}/lib" verbose="true"/>

时间: 2024-10-17 16:07:24

about hadoop-eclipse-plugin used by IDE的相关文章

2.1 Hadoop Eclipse Plugin 配置及安装

Hadoop Eclipse 开发工具 主要分为 1.根据Hadoop版本生成插件 2.安装Hadoop Eclipse插件 3.配置Hadoop目录 4.配置Hadoop连接 5.新一个MapReduce工程 WordCount.java MapReduce--WordCount问题总结 参考:http://blog.sina.com.cn/s/blog_7fcb1aef0100zpux.html 正成功输入出后信息: 14/05/21 23:06:47 INFO input.FileInpu

使用hadoop eclipse plugin提交Job并添加多个第三方jar

来自:http://heipark.iteye.com/blog/1171923 通过 "conf.set("tmpjars", jars);" 可以设置第三方jar,之前一直只是添加一个jar,运行OK,今天打算添加多个jar的时候发现mapreduce在运行时找不到 class(ClassNotFoundException),跟踪代码发现jar文件的确上传到了HDFS中,所以甚是无解,后来上传jar到 hdfs,然后使用DistributedCache.addF

Hadoop eclipse plugin

我的eclipse是在win7上,hadoop在win7里的虚拟机里的ubuntu上,为了方便起见,想在eclipse上安装hadoop的插件,主要参考 https://my.oschina.net/muou/blog/408543,上面写得蛮详细的,配置完后,出现在上面所写的问题一,按照他所说的创建目录后,eclipse里的 DFS Locations 里面依旧显示Connection Refused.找到了官方文档: https://wiki.apache.org/hadoop/Connec

windows Hadoop环境搭建之三---Hadoop eclipse Plugin

准备环境 先下载htrace-core-3.0.4.jar文件 官网链接: http://mvnrepository.com/artifact/org.htrace/htrace-core/3.0.4 copy到Hadoop的share/hadoop/common/lib目录下 避免出现错误找不到文件的错误. 下载hadoop2x-eclipse-plugin 官网地址: https://github.com/winghc/hadoop2x-eclipse-plugin 解压后,上传到 Hado

Plug-in com.android.ide.eclipse.adt was unable to lead class Error

Today while i started my Android ADT Eclipse Workspace i got the following error message, Problem Opening Wizard The selected wizard could not be started. Reason : Plug-in com.android.ide.eclipse.adt was unable to load classcom.android.ide.eclipse.ad

hadoop eclipse插件生成

hadoop eclipse插件生成 做了一年的hadoop开发.还没有自动生成过eclipse插件,一直都是在网上下载别人的用,今天有时间,就把这段遗憾补回来,自己生成一下,废话不说,開始了. 本文着重介绍Eclipse插件的生成.配置过程.常见错误的解放方法以及使用Eclipse插件測试执行wordcount演示样例. 一.环境说明 本列中的hadoop eclipse插件通过eclipse生成(未使用命令生成是由于用命令生成插件过程中发生的一些问题.不easy查看和改动,用eclipse非

(转)Hadoop Eclipse开发环境搭建

来源:http://www.cnblogs.com/justinzhang/p/4261851.html This document is from my evernote, when I was still at baidu, I have a complete hadoop development/Debug environment. But at that time, I was tired of writing blogs. It costs me two day’s spare tim

Hadoop Eclipse开发环境搭建

    This document is from my evernote, when I was still at baidu, I have a complete hadoop development/Debug environment. But at that time, I was tired of writing blogs. It costs me two day's spare time to recovery from where I was stoped. Hope the b

Installing the Eclipse Plugin

Installing the Eclipse Plugin Android offers a custom plugin for the Eclipse IDE, called Android Development Tools (ADT). This plugin provides a powerful, integrated environment in which to develop Android apps. It extends the capabilities of Eclipse

关于自编译hadoop eclipse 插件

由于在eclipse下开发hadoop 程序需要插件支持,而且hadoop报下已经没有插件了,所以需要我们自己编译,操作步骤如下 1.进入D:\hadoop-1.2.1\src\contrib目录,找到build-contrib.xml文件 ,将hadoop.root改为hadoop解压目录. <property name="hadoop.root" location="D:\hadoop-1.2.1"/> 在下面添加如下两行:Eclipse安装根目录,