-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parenthesis removal in VDS creation #167
Comments
Hi Alain, that is very strange behaviour. We will look into this as soon as we can. Thanks for raising this issue! |
Could you please:
Also, could you clarify what you mean by "we noticed some behaviour change in the query that are executed by our users"? Do you mean that this was not happening before and it is now happening? |
|
Any update on this ? |
@Alain-Barrette we just finished getting dbt-dremio 1.4.5 out the door. Can you please see if you can reproduce this after upgrading? However, dbt-dremio 1.4.5 won't automatically upgrade dbt-core. So please run We believe that this regression is in dbt-core itself, but still looking into it. |
reproduced after upgrade to 1.4.5 |
@Alain-Barrette I made a small change in my test branch, which removes parentheses from views. Do you mind testing if this resolves your problem by cloning this repo, switching to test-branch and then installing your local repo (similar to how your team did for #134)? |
Fix from test branch is working. We are deploying to our dev team member until the fix made it to an official release. |
### Summary Remove parentheses from view materialization to optimize VDSs in Dremio. ### Description Before: ``` ( select * from table ) ``` After: ``` select * from table ``` ### Test Results All functional tests pass. ### Changelog - [ ] Added a summary of what this PR accomplishes to CHANGELOG.md ### Related Issue #167
Describe the enhancement requested
We put dbt in place for about 1,100 objects over the last month. We noticed some behavior change in the query that are executed by our users.
We traced that to the presence of encapsulating parenthesis in the object deployed thru dbt.
Going from select column from table to ( select column from table ) is causing issue when the top vds are querying.
The top vds used to do
select column from tableA, tableB join on PK are now doing
select column from tableA, ( select column from tableB ) where PK join
This cause massive performance issue.
Is there any way we can remove theses parenthesis ?
Justification for this enhancement
Query performance improvement
The text was updated successfully, but these errors were encountered: