hadoop 2.7.3 - 소스 개발환경 (windows, eclipse)

참조 : https://wiki.apache.org/hadoop/EclipseEnvironment

** 이전 이야기

F:\projects\big\src\hadoop-2.7.3-src 에 하둡 소스를 풀고 컴파일 성공 (windows 10, visual studio 2017)

(http://yamoe.tistory.com/434)

** maven eclipse 프로젝트 생성

> cd F:\projects\big\src\hadoop-2.7.3-src

> mvn eclipse:eclipse -DdownloadSources=true -DdownloadJavadocs=true

** eclipse import project

모든 프로젝트 import 함.

eclipse MARS 사용 (JDK 1.7)

* comman project

  - file -> import -> Existing Projects into Workspace

    Select root directory :

      F:\projects\big\src\hadoop-2.7.3-src\hadoop-common-project

    Projects : 

      hadoop-annotations, hadoop-auth, hadoop-auth-examples, hadoop-nfs, hadoop-common projects

      hadoop-kms, hadoop-minikdc, hadoop-nfs

    

  - file -> import -> Existing Projects into Workspace

    Select root directory :

      F:\projects\big\src\hadoop-2.7.3-src\hadoop-assemblies

    Projects : 

      hadoop-assemblies

    

  - import 후  Access restriction 에러가 있는 경우 Java Build Path의 JRE System Library를 시스템에 맞게 변경

    (나의 경우 hadoop-common, hadoop-hdfs, hadoop-yarn-registry 프로젝트에서 발생하여 Workspace Default JRE 로 변경 함)

  - hadoop-common 프로젝트에 New -> Source Folder 로 "target/generated-test-sources/java" 폴더 추가

* HDFS project

  

  - file -> import -> Existing Projects into Workspace

    Select root directory :

      F:\projects\big\src\hadoop-2.7.3-src\hadoop-hdfs-project

    Projects : 

      hadoop-hdfs

      hadoop-hdfs-httpfs, hadoop-hdfs-nfs

    

  

* MapReduce project

  - file -> import -> Existing Projects into Workspace

    Select root directory :

      F:\projects\big\src\hadoop-2.7.3-src\hadoop-mapreduce-project

    Projects : 

      hadoop-mapreduce-client-app, hadoop-mapreduce-client-common, hadoop-mapreduce-client-core, hadoop-mapreduce-client-hs, hadoop-mapreduce-client-hs-plugins, hadoop-mapreduce-client-jobclient, hadoop-mapreduce-client-shuffle, hadoop-mapreduce-examples

* YARN project

  - file -> import -> Existing Projects into Workspace

    Select root directory :

      F:\projects\big\src\hadoop-2.7.3-src\hadoop-yarn-project

    Projects : 

      hadoop-yarn-api, hadoop-yarn-application-distributedshell, hadoop-yarn-application-unmanaged-am-launcher, hadoop-yarn-client, hadoop-yarn-common, hadoop-yarn-registry, hadoop-yarn-server-applicationhistoryservice, hadoop-yarn-server-common, hadoop-yarn-server-nodemanater, hadoop-yarn-server-sharedcachemanager, hadoop-yarn-server-tests, hadoop-yarn-server-web-proxy

** 완료