Trending questions in Big Data Hadoop

0 votes
1 answer

Differentiate: hadoop fs -text vs hadoop fs -cat vs hadoop fs -get

The main difference between -cat and -text ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,434 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,943 views
0 votes
1 answer

Error while accessing the file outformat method SetOutputpath

You have imported org.apache.hadoop.mapred.FileOutputFormat, ​​you need to import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat So, make ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,019 views
0 votes
2 answers

Not able to use npm after installing yarn

 "The easiest way to get started is ...READ MORE

Feb 5, 2019 in Big Data Hadoop by rajesh
 • 1,270 points • 1,664 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,282 views
0 votes
1 answer

Sqoop getting error while connecting to MySQL

Have you set a password for MySQL? ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,540 views
0 votes
1 answer

How to retrieve the list of sql (Hive QL) commands that has been executed in a hadoop cluster?

Well, what you can do is use ...READ MORE

Apr 4, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 14,887 views
0 votes
1 answer

Hbase to pig integration

First enter into grunt shell: $ ./pig –x ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 999 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,754 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,087 views
0 votes
1 answer

Error connecting hive using python pyhs2

Seems like the host IP is not ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,639 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,834 views
0 votes
1 answer

Apache storm installation

The “conf/storm.yaml” file contains configurations of Storm. And ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,123 views
0 votes
1 answer

Permission denied while uploading files to hdfs

It is not the problem about permission ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,011 views
0 votes
1 answer

How to send curl downloaded data in hdfs?

Try using put command with stdin as ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,992 views
0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,160 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,808 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
 • 4,164 views
0 votes
1 answer

What is the difference between Apache ZooKeeper and Apache Oozie?

The main difference between these two is ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Anoop
 • 4,777 views
–1 vote
1 answer

WARN util.NativeCodeLoader: Unable to load native-hadoop library

To remove this warning, you can use:  hdfs ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,139 views
0 votes
1 answer

Unable to instantiate org.apache.hadoop.hive

You might not have set the connector. ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,953 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,067 views
0 votes
1 answer

Hadoop Distribution Differences

The Yahoo distribution is a version of ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 894 views
0 votes
1 answer

MapReduce: Map Value Mismatch error

Seems like you have not specified few ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Haman
 • 1,062 views
0 votes
1 answer

Why should we use "extends Mapper" for Mapreduce code?

The Mapper class belongs to package org.apache.hadoop.mapreduce ...READ MORE

Feb 8, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,277 views
0 votes
1 answer

Failing to execute the script pig file on HDFS

By convention, the pig script that you ...READ MORE

Feb 15, 2019 in Big Data Hadoop by John
 • 997 views
0 votes
1 answer

BigData in MPI

MPI is a communication protocol for programming ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Disha
 • 1,032 views
0 votes
1 answer

Not able to see racks in reports

Seems like rack awareness is not configure.  Try ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Lucky
 • 602 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,449 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,317 views
0 votes
1 answer

Can DataNode and NameNode be commodity hardware?

DataNodes are the commodity hardware only as ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 3,403 views
0 votes
1 answer

How to check Cloudera Manager Service status?

There surely is a command to check ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,445 views
0 votes
1 answer

Mapreduce problem with output part file

As the error suggests and you have ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,198 views
0 votes
1 answer

Doubt in word count query

The COUNT function returns the number of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 702 views
0 votes
1 answer

Spark - load CSV file as DataFrame?

spark-csv is part of core Spark functionality ...READ MORE

Sep 25, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 6,991 views
0 votes
1 answer

Hadoop Job Tracker problem. I cannot connect to http://localhost:50030/

I think you are using new version ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,156 views
0 votes
1 answer

What is Metastore in Hive?

It stores metadata for Hive tables (like their schema ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,253 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,489 views
0 votes
1 answer

Browse HDFS & Job Logs

You can browse the hdfs and see the ...READ MORE

Jan 26, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,657 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,282 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,561 views
–1 vote
1 answer

Does Hadoop merge the output files after reduce phase?

No, the files after the reduce phase are ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,760 views
0 votes
1 answer

expected org.apache.hadoop.io.IntWritable, received org.apache.hadoop.io.LongWritable

Hey George!  This error comes whenever you use ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,586 views
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,347 views
0 votes
1 answer

What is the Path of hdfs.site.xml?

Here's where you can find the file: /etc/hadoop/[service ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,487 views
0 votes
1 answer

How will you submit job as particular user?

You need to create a new user ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,335 views
0 votes
1 answer

How to create files in hdfs?

You can create a file directly in ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,582 views
0 votes
1 answer

[edureka_159609@ip-20-0-41-190 bin]$ hdfs dfs -mkdir ://localhost:9000/Pig_Data -mkdir: java.net.URISyntaxException: Expected scheme name at index 0: ://localhost:9000/Pig_Data

Hey @Mohan! Could you try the following ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,634 views
0 votes
1 answer

Not able to list tables in sqoop

The default port number for MySQL is ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,400 views
0 votes
1 answer

Not able to insert in hive partition table

You have to add the partition before ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,340 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.