Skip to content
This repository has been archived by the owner on Jan 3, 2023. It is now read-only.

SQL Data Source Cache Plasma Backend can not compatible with spark-sql_2.12-3.1.1-amzn-0.jar on AWS EMR-6.3.0 #150

Open
haojinIntel opened this issue Jun 16, 2021 · 1 comment
Open

SQL Data Source Cache Plasma Backend can not compatible with spark-sql_2.12-3.1.1-amzn-0.jar on AWS EMR-6.3.0 #150

haojinIntel opened this issue Jun 16, 2021 · 1 comment

Comments

@haojinIntel
Copy link
Contributor

For OAP-1.2, we target to support all features on cloud. We choose emr-6.3.0 and the versions of software are showed below:
image
We try to run TPC-DS power test with 1GB data scale and meet the issue like:
image

If we use spark-sql_2.12-3.1.1.jar instead of spark-sql_2.12-3.1.1-amzn-0.jar all work well.
@haojinIntel
Copy link
Contributor Author

@winningsix @zhixingheyi-tian Please help to track the issue. Thanks!

@HongW2019 HongW2019 mentioned this issue Jun 30, 2021
Closed
@zhixingheyi-tian zhixingheyi-tian changed the title Support to use plasma-sql-ds-cache on AWS EMR-6.3.0 SQL Data Source Cache Plasma Backend can not compatible with spark-sql_2.12-3.1.1-amzn-0.jar on AWS EMR-6.3.0 Jun 30, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@haojinIntel