Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: add support for Spark Connect #63

Merged
merged 84 commits into from
Oct 29, 2024
Merged

feature: add support for Spark Connect #63

merged 84 commits into from
Oct 29, 2024

Conversation

mikita-sakalouski
Copy link
Contributor

@mikita-sakalouski mikita-sakalouski commented Sep 10, 2024 •
edited by dannymeijer
Loading

Description

Related Issue

Motivation and Context

How Has This Been Tested?

Screenshots (if appropriate):

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

@mikita-sakalouski mikita-sakalouski linked an issue Sep 10, 2024 that may be closed by this pull request
[FEATURE] Ensure that we can support DBR 14.3LTS #33
Open
3 tasks
@dannymeijer dannymeijer added this to the 0.9.0 milestone Oct 2, 2024
mikita-sakalouski and others added 24 commits October 8, 2024 23:25
@mikita-sakalouski
chore: update dependencies and improve SQL step handling
f3e6014
@dannymeijer
Added show_string utility
f24ed3e
@mikita-sakalouski
refactor: replace spark_minor_version with SPARK_MINOR_VERSION consta…
ecbdc9a 
…nt for consistency
@dannymeijer
few more fixes
18ff011
@dannymeijer
Merge remote-tracking branch 'origin/33-feature-ensure-that-we-can-su…
8a84038 
…pport-dbr-143lts' into 33-feature-ensure-that-we-can-support-dbr-143lts
@dannymeijer
few more fixes
6a291b2
@mikita-sakalouski
refactor: update utility functions and improve test assertions for cl…
3bfe84a 
…arity
@dannymeijer
few more fixes
a3a5ad6
@dannymeijer
Down to the last 36 tests to fix
31bb7d7
@dannymeijer
fix typo
c837cd4
@mikita-sakalouski
refactor: streamline imports in row_number_dedup.py for clarity
3b09e5e
@mikita-sakalouski
refactor: enhance BoxCsvFileReader to use pandas for CSV parsing
ac9eee5
@dannymeijer
last 24
b360d8e
@dannymeijer
fix formatting
cfab89f
@dannymeijer
one more test
891c7f5
@dannymeijer
17 more remaining
349770c
@dannymeijer
Last 21
1b47c75
@dannymeijer
Last 21
4c93701
@dannymeijer
Last 20
1a77512
@dannymeijer
EOD
224c0cc
@mikita-sakalouski
fix: refactor connect types
42b7d86
@mikita-sakalouski
fix: improve session handling and type annotations in connect_utils a…
0c3b4f1 
…nd delta readers
@mikita-sakalouski
fix: improve tests
586d76a
@dannymeijer
snowflake refactoring (95% done)
46a18ca
@dannymeijer dannymeijer force-pushed the 33-feature-ensure-that-we-can-support-dbr-143lts branch from c9588ae to cc29864 Compare October 29, 2024 18:34
@dannymeijer dannymeijer changed the base branch from main to release/0.9 October 29, 2024 18:42
@mikita-sakalouski mikita-sakalouski changed the base branch from release/0.9 to main October 29, 2024 19:25
@mikita-sakalouski mikita-sakalouski changed the base branch from main to release/0.9 October 29, 2024 19:26
@mikita-sakalouski mikita-sakalouski marked this pull request as ready for review October 29, 2024 20:53
@mikita-sakalouski mikita-sakalouski requested a review from a team as a code owner October 29, 2024 20:53
@mikita-sakalouski mikita-sakalouski merged commit 3deae1a into release/0.9 Oct 29, 2024
12 checks passed
@mikita-sakalouski mikita-sakalouski deleted the 33-feature-ensure-that-we-can-support-dbr-143lts branch October 29, 2024 21:14
@mikita-sakalouski mikita-sakalouski mentioned this pull request Oct 29, 2024
Closed
@dannymeijer dannymeijer mentioned this pull request Oct 30, 2024
Closed
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dannymeijer dannymeijer dannymeijer approved these changes

@maxim-mityutko maxim-mityutko Awaiting requested review from maxim-mityutko

@pariksheet pariksheet Awaiting requested review from pariksheet

Assignees

@mikita-sakalouski mikita-sakalouski

Labels
None yet
Projects
Koheesio
Status: Done
Milestone
0.9.0
Development

Successfully merging this pull request may close these issues.

[FEATURE] Ensure that we can support DBR 14.3LTS
3 participants
@mikita-sakalouski @pariksheet @dannymeijer