Skip to content

Commit

Permalink
[SPARK-44614][PYTHON][CONNECT] Add missing packages in setup.py
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?

Adds missing packages in `setup.py`.

### Why are the changes needed?

The following packages are not listed in `setup.py`.

- `pyspark.sql.connect.avro`
- `pyspark.sql.connect.client`
- `pyspark.sql.connect.streaming`
- `pyspark.ml.connect`

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

The existing tests.

Closes #42248 from ueshin/issues/SPARK-44614/packages.

Authored-by: Takuya UESHIN <[email protected]>
Signed-off-by: Takuya UESHIN <[email protected]>
  • Loading branch information
ueshin committed Aug 1, 2023
1 parent 3f81595 commit a011d16
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion python/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -238,20 +238,24 @@ def run(self):
"pyspark.mllib.linalg",
"pyspark.mllib.stat",
"pyspark.ml",
"pyspark.ml.connect",
"pyspark.ml.linalg",
"pyspark.ml.param",
"pyspark.ml.torch",
"pyspark.ml.deepspeed",
"pyspark.sql",
"pyspark.sql.avro",
"pyspark.sql.connect",
"pyspark.sql.connect.avro",
"pyspark.sql.connect.client",
"pyspark.sql.connect.proto",
"pyspark.sql.connect.streaming",
"pyspark.sql.connect.streaming.worker",
"pyspark.sql.pandas",
"pyspark.sql.protobuf",
"pyspark.sql.streaming",
"pyspark.sql.worker",
"pyspark.streaming",
"pyspark.sql.connect.streaming.worker",
"pyspark.bin",
"pyspark.sbin",
"pyspark.jars",
Expand Down

0 comments on commit a011d16

Please sign in to comment.