Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Idea: Add services support HBase/OBKV #3919

Open
WenyXu opened this issue Jan 5, 2024 · 8 comments
Open

Idea: Add services support HBase/OBKV #3919

WenyXu opened this issue Jan 5, 2024 · 8 comments

Comments

@WenyXu
Copy link
Member

WenyXu commented Jan 5, 2024

We are considering using OpenDAL to access OBKV(OceanBase storage layer; it could be considered HBase-compatible)

There is a rust obkv-table-client-rs, which we can rely on, but it uses a nightly rust version(maybe we can change it to a stable version)

@WenyXu
Copy link
Member Author

WenyXu commented Jan 5, 2024

For the obkv-table-client-rs, my colleague may have more details. cc @fengjiachun

@Xuanwo
Copy link
Member

Xuanwo commented Jan 5, 2024

Interestingly, I created the OpenDAL KV adapter just for fun, but now it's actually being used!

@Xuanwo
Copy link
Member

Xuanwo commented Jan 5, 2024

I'm fine to add both obkv/hbase services, as long as:

  • The newly added dep is well-maintained
  • CI passed (with stable rust)
  • Test passed

@Xuanwo
Copy link
Member

Xuanwo commented Jan 5, 2024

  • CI passed (with stable rust)

For this, I submitted oceanbase/obkv-table-client-rs#87

@tisonkun
Copy link
Member

This is a related PR oceanbase/obkv-table-client-rs#82

I ever thought about this and blocked because I cannot prepare a CI env for debugging and regression testing.

@Xuanwo
Copy link
Member

Xuanwo commented Jan 11, 2024

I cannot prepare a CI env for debugging and regression testing.

Oh, this might be an issue.

@IHEII
Copy link

IHEII commented Jan 12, 2024

This is a related PR oceanbase/obkv-table-client-rs#82

I ever thought about this and blocked because I cannot prepare a CI env for debugging and regression testing.

Maybe we could implement CI for debugging and regression now. The Rust client server now supports 4.x server and we have a light observer in docker now (oceanbase/oceanbase-ce imageTag = "4.2.1_bp2"). See here for details.

@jiacai2050
Copy link

https://github.com/apache/incubator-horaedb/blob/main/src/components/object_store/src/obkv/mod.rs

HoraeDB already have an object store implementation based on OBKV, this maybe useful for this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants