I want to run some MapReduce jobs with Hbase locally in TOS for Big Data 7.0 in my Windows 10 x64 with cloudera 5.13.0. I don’t have hadoop installed on my PC.

I have created a Maven project with hadoop 2.6.0 in other machin, and I added it to My job as a dependency on a user routine. I can successfully connect to Hbase and add new tables but when I want submit the job MapReduce I receive the following error: Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.createDirectoryWithMode0(Ljava/lang/String;I)V at org.apache.hadoop.io.nativeio.NativeIO$Windows.createDirectoryWithMode0(Native Method) at org.apache.hadoop.io.nativeio.NativeIO$Windows.createDirectoryWithMode(NativeIO.java:524) at org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:478) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:532) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:509) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:312) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:133) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:144) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Unknown Source) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)

I have found some solutions in the web.

I have put hadoop.dll and winutils.exe and other files from this link in C:\winutils\bin folder and I added this folder to PATH and HADOOP_HOME as it shown in the figure, I also put hadoop.dll into the C:\Windows\System32 folder. But always I have the same problem . founded solutions

0 Answers