How do I include all the Hadoop dependencies using Maven

Question

• I have installed Hadoop on my CentOS VM
• I am using eclipse IDE and my hadoop project has listed hadoop*.jar as dependency
• My mvn install command fails:

(master) $ mvn clean install

[INFO] Scanning for projects...

[ERROR] The build could not read 1 project -> [Help 1]

[ERROR]  

[ERROR]   The project groupId:hadoop:master-SNAPSHOT (/home/edureka/hadoop-programs/test/pom.xml)

I changed my pom.xml to following

POM.XML

<?xml version="1.0" encoding="UTF-8"?>

<project xmlns="http://maven.apache.org/POM/4.0.0"

         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"

         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">

    <modelVersion>4.0.0</modelVersion>


    <groupId>groupId</groupId>

    <artifactId>hadoop</artifactId>

    <version>master-SNAPSHOT</version>

    <packaging>jar</packaging>


    <dependencies>

        <dependency>

            <groupId>org.apache.hadoop</groupId>

            <artifactId>hadoop-core</artifactId>

            <version>1.0.3</version>

            <type>jar</type>

            <systemPath>/usr/lib/hadoop/1.0.3/libexec/hadoop-core-1.0.3.jar</systemPath>

        </dependency>

    </dependencies>

</project>

Still getting the same error.

Answer 1

This is a dependency mismatch error. I would recommend you to use the following hadoop-core dependency.

<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-core</artifactId>
    <version>0.20.2</version>
</dependency>