Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

INSERT with no result when using Tez #2

Open
roderickyao opened this issue Sep 16, 2019 · 4 comments
Open

INSERT with no result when using Tez #2

roderickyao opened this issue Sep 16, 2019 · 4 comments

Comments

@roderickyao
Copy link
Contributor

When using Tez as Hive execution engine, INSERT statement will return successful but no rows are inserted. This works under MapReduce engine.

Tez somehow does not seem to call OutputCommitter at all.

@alfonsonishikawa
Copy link

alfonsonishikawa commented Aug 21, 2020

Happens the same to me. Any fix/workaround?
When I execute it from Hive View (HDP) works, but from Oozie does not work. With execution engine mr it works.
The execution is not shown in Tez View neither when launching with Oozie.

@vishal2535
Copy link

I am facing same issue with execution engine MR. It's returning success but no rows are inserted. Any idea?
Insert into bq_test values ('Vishal', 33);
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = hduser_20220214125524_7b6db0f8-9792-4acb-b4f6-6e4de208f2fa
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Job running in-process (local Hadoop)
2022-02-14 12:55:27,341 Stage-3 map = 100%, reduce = 0%
Ended Job = job_local758927901_0001
MapReduce Jobs Launched:
Stage-Stage-3: HDFS Read: 7 HDFS Write: 7 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
OK
Time taken: 3.203 seconds

@michTalebzadeh
Copy link

I believe with mr as engine, there is the issue of OutputCommitter not being called somehow, something probably to do with jar.

@vishal2535
Copy link

@michTalebzadeh Yes, I noticed the same behavior. Let me know if you find any solution for this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants