Hive join fails with MapredLocalTask error (other people mentioned already that the workaround is to use


Works for me, but wondering, if this is a fundamental problem, since I am running on Windows 10). Would be great to get some views here.

As said, I can get by with using


But really would like to use the auto convert feature. From looking around people state that it may be an issue with creating a process in Win32 ... I am running hive 2.3.4 against hadoop 3.2.0 (may be not the perfect combination, but works find otherwise).

Query is:

set hive.mapred.mode=nonstrict;

>select * from film fi inner join film_actor fa on (fi.film_id = 
fa.film_id) where fi.film_id = 1;

Now running this I get:

2019-04-05 15:41:33,700 INFO mr.MapredLocalTask: Executing: C:\hadoop-3.2.0\bin\hadoop jar /C:/apache-hive-2.3.4-bin/lib/hive-exec-2.3.4.jar -localtask -plan file:/tmp/fdai0145/11acb838-07fc-4566-8fbf-79c2718db072/hive_2019-04-05_15-41-33_019_1135603159764858363-1/-local-10006/plan.xml   -jobconffile file:/tmp/fdai0145/11acb838-07fc-4566-8fbf-79c2718db072/hive_2019-04-05_15-41-33_019_1135603159764858363-1/-local-10007/jobconf.xml
2019-04-05 15:41:33,702 ERROR mr.MapredLocalTask: Exception: Cannot run program "C:\hadoop-3.2.0\bin\hadoop" (in directory "C:\Windows\System32"): CreateProcess error=193, %1 ist keine zul├Ássige Win32-Anwendung
        at java.lang.ProcessBuilder.start(
        at java.lang.Runtime.exec(
        at java.lang.Runtime.exec(
        at org.apache.hadoop.hive.ql.exec.Task.executeTask(
        at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(
        at org.apache.hadoop.hive.ql.Driver.launchTask(
        at org.apache.hadoop.hive.ql.Driver.execute(
        at org.apache.hadoop.hive.ql.Driver.runInternal(
        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(
        at org.apache.hadoop.hive.cli.CliDriver.processLine(
        at org.apache.hadoop.hive.cli.CliDriver.executeDriver(
        at org.apache.hadoop.hive.cli.CliDriver.main(
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(
        at java.lang.reflect.Method.invoke(
        at org.apache.hadoop.util.RunJar.main(
Caused by: CreateProcess error=193, %1 ist keine zul├Ássige Win32-Anwendung
        at java.lang.ProcessImpl.create(Native Method)
        at java.lang.ProcessImpl.<init>(
        at java.lang.ProcessImpl.start(
        at java.lang.ProcessBuilder.start(
        ... 23 more
FAILED: Execution Error, return code 1 from
2019-04-05 15:41:33,703 ERROR ql.Driver: FAILED: Execution Error, return code 1 from
2019-04-05 15:41:33,706 INFO ql.Driver: Completed executing command(queryId=fdai0145_20190405154133_8294339b-cccf-4543-b151-412c31dc7aa3); Time taken: 0.133 seconds
2019-04-05 15:41:33,706 INFO exec.ListSinkOperator: Closing operator LIST_SINK[16]
2019-04-05 15:41:33,717 INFO conf.HiveConf: Using the default value passed in for log id: 11acb838-07fc-4566-8fbf-79c2718db072
2019-04-05 15:41:33,717 INFO session.SessionState: Resetting thread name to  main

0 Answers