Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

code cleanup around get_source_ibis_table and get_target_ibis_table in config_manager.py #1294

Open
sundar-mudupalli-work opened this issue Oct 9, 2024 · 0 comments
Labels
priority: p2 Medium priority. Fix may not be included in next release (e.g. minor documentation, cleanup) type: cleanup An internal cleanup or hygiene concern.

Comments

@sundar-mudupalli-work
Copy link
Collaborator

Hi,

There is some confusing logic and pre-conditions around these functions. It would be good to have a thorough review and cleanup this code. Specifically this line says:

        if self.validation_type == consts.CUSTOM_QUERY:
            self._target_ibis_table = clients.get_ibis_table(
                self.target_client, self.target_schema, self.target_table
            )

When you have a custom query - you don't have a target schema and a target table. So this code will most likely fail. It appears that this code is never executed. To make things more interesting _target_ibis_table does not appear to be set anywhere or in other places - so not sure how this would work. Same or similar comments on _source_ibis_table.

Things may have evolved since this code was written and this code is no longer needed and could use cleanup. Needs someone with a fresh perspective to review this and cleanup.

Sundar Mudupalli

@helensilva14 helensilva14 added type: cleanup An internal cleanup or hygiene concern. priority: p2 Medium priority. Fix may not be included in next release (e.g. minor documentation, cleanup) labels Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority: p2 Medium priority. Fix may not be included in next release (e.g. minor documentation, cleanup) type: cleanup An internal cleanup or hygiene concern.
Projects
None yet
Development

No branches or pull requests

2 participants