Skip to content

Commit

Permalink
Update Federation.md
Browse files Browse the repository at this point in the history
  • Loading branch information
wangxiaoying authored Oct 8, 2024
1 parent 8c53c58 commit 1c0afb1
Showing 1 changed file with 8 additions and 0 deletions.
8 changes: 8 additions & 0 deletions Federation.md
Original file line number Diff line number Diff line change
@@ -1,2 +1,10 @@
# Enabling Query Federation

We use [accio](https://github.com/sfu-db/accio) to rewrite a federated query into multiple single-source ones, and combine the result locally with [datafusion](https://github.com/apache/datafusion).

To enable query federation for connectorx:
1. Clone accio: `[email protected]:sfu-db/accio.git`.
2. Build accio: `cd accio/rewriter && mvn package -Dmaven.test.skip=true`.
3. Move the jar file to location `${YOUR_LOCAL_PYTHON_PATH}/site-packages/connectorx/dependencies/federated-rewriter.jar`
4. Configure accio and set the configuration path as `FED_CONFIG_PATH`. Example configurations can be found [here](https://github.com/sfu-db/accio/tree/main/benchmark/config/tpch10_datafusion/10gbit).
5. Run federated query using connectorx!

0 comments on commit 1c0afb1

Please sign in to comment.