Trending questions in Big Data Hadoop

–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,662 views
–1 vote
1 answer

Create Hive table with bucketing and ORC file format

create table hive_dml (emp_id int, first_name string, last_name ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,961 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
6,209 views
0 votes
2 answers

Which one among the both MapRed and MapReduce is considered better to create a Hadoop job?

The new API is cleaner and faster. ...READ MORE

Mar 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,086 views
0 votes
1 answer

How to import PIG data into HBase?

Follow the below steps to do it: # ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,107 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
6,077 views
0 votes
1 answer

Hive installation on Linux

Download hive from: http://www.apache.org/dyn/closer.cgi/hive/ Extract the files using ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Mahesh
1,520 views
0 votes
1 answer

Doubt regarding --last-value in sqoop while importing.

I think you are a little confused. ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,867 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,347 views
0 votes
1 answer

Hadoop Mapper is failed because of the following error - “Container killed by the ApplicationMaster”

I suggest you include below property files ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,276 views
0 votes
1 answer

What does hadoop mean?

I see that you are confused about ...READ MORE

Mar 6, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,127 views
0 votes
1 answer

How does Avro schema evolution work?

If you have one avro file and ...READ MORE

Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
8,386 views
0 votes
1 answer

Sqoop installation on Linux

Before installing Sqoop, make sure Hadoop is ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Kriti
1,429 views
0 votes
1 answer

Point data from Hive to Hbase

Refer to the below steps to transfer ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,913 views
0 votes
1 answer

Location of Sqoop job

It depends on how you are running ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,683 views
0 votes
1 answer

Unable to run import script using sqoop

You are writing incorrect command. Please write ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Raj
930 views
0 votes
1 answer

What do you understand by an inner bag and outer bag in Pig?

Outer bag or relation is nothing but ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Frankie
• 9,830 points
1,561 views
0 votes
1 answer

Pig mapreduce mode vs local mode?

Both MapReduce mode and local mode seem ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,612 views
0 votes
1 answer

Bucketing in Hive

By default, only 1 bucket will be ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,962 views
0 votes
1 answer

How to install scala on Ubuntu?

You can install Scala using apt-get using the ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,606 views
0 votes
1 answer

Validation in Spark

This can be prevented if you use ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,596 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,726 views
0 votes
1 answer

Sqoop overwrite a directory

You can use the --hive-overwrite: $ sqoop import --connect ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,892 views
0 votes
1 answer

How to get absolute path of files in a directory in Hadoop?

You can use HDFS API like the ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,859 views
0 votes
1 answer

Installing Pig on Linux System

It was a good thing that you ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Yuri
1,167 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
5,814 views
0 votes
1 answer

Update new sql data in sqoop

You can use incremental for this. When ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,820 views
0 votes
1 answer

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

Sqoop is not able to communicate with ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,422 views
0 votes
1 answer

Difference between Application Master and Application Manager?

The Application Master is responsible for the ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
15,084 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,662 views
0 votes
1 answer

Error while hitting the hadoop jar command to execute my map reduce

Since your jar file was inside the ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,798 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,276 views
0 votes
1 answer

Hadoop: localhost: Error: JAVA_HOME is not set.

Seems like PATH problem in hadoop-env.sh file. Try ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,956 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Roshan
5,497 views
0 votes
1 answer

How to count meta data?

In Hadoop, Namenode consumes about 150 bytes ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,901 views
0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,919 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
• 9,830 points
3,380 views
0 votes
1 answer

Speculative Execution in Hadoop

In Hadoop, Speculative Execution is a process ...READ MORE

Aug 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
8,956 views
0 votes
1 answer

Not able to run hdfs commands

Because you said it ran yesterday and ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,364 views
0 votes
1 answer

Hadoop HDFS: Exception in createBlockOutputStream

It's a connection error. Have you turned ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,243 views
0 votes
1 answer

To whom is the Hadoop job submitted?

When a hadoop job is submitted, it ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Loki
1,347 views
0 votes
1 answer

Hadoop Hive: Correlating expression cannot contain unqualified column references

Try the following command and see if ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,619 views
0 votes
1 answer

How to perform a word count on a dataframe column?

You can use the below code to ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,468 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,702 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,185 views
0 votes
1 answer

hadoop: command not found

The reason you are getting hadoop as ...READ MORE

Mar 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
15,386 views
0 votes
1 answer

Pig: mismatched input "T1" expecting RIGHT_CURLY

In Pig, the bag and tuple format ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Yuri
1,431 views
0 votes
1 answer

Not able to delete file using pig

rmf is a hadoop file system command and you ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,854 views
–1 vote
1 answer

Error while creating Hive Database table

In your error, it says that the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,220 points
3,020 views
0 votes
1 answer

Hadoop: How to get the column name along with the output in Hive?

You can get the column names by ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,070 views