fix(source-jira): upgrade to CDK v6 to use concurrency for incremental streams

[tolik0]

What

This PR upgrades the CDK to version 6 and leverages its concurrency capabilities to enhance the handling of incremental streams. Additionally, it introduces substream state migration to ensure reliable data synchronization.

How

CDK Upgrade & Concurrency Enhancements:

• Upgraded CDK from version 5 to version 6 to support concurrent processing of multiple incremental streams, enhancing performance and efficiency.
• Updated configuration files and dependencies to accommodate changes introduced in CDK v6.

Substream State Migration:

• Implemented state migration logic within the PerPartitionWithFallback class to handle incremental dependencies.
• Modified the set_initial_state method to ensure that parent streams correctly inherit state from child streams during the initial sync.

Review guide

User Impact

Fix error with substreams failing with retry error after the previous update because of rereading parent stream.

Can this PR be safely reverted and rolled back?

• YES 💚
• NO ❌

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
airbyte-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 8, 2024 5:13pm

[tolik0]

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (db38ecc)