Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

init s3 storage #29

Merged
merged 44 commits into from
Oct 26, 2023
Merged

init s3 storage #29

Show file tree
Hide file tree
Changes from 32 commits
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
c8d902b
WIP: rewrite fl scehma
muhamadazmy Sep 15, 2023
3f39b68
update routes
muhamadazmy Sep 15, 2023
bb44194
WIP: refactor for separate stores
muhamadazmy Sep 18, 2023
1ce3cad
Separation of cache and store
muhamadazmy Sep 19, 2023
4281572
WIP: pack function
muhamadazmy Sep 19, 2023
46d5880
complete the pack/unpack cycle
muhamadazmy Sep 20, 2023
0d959b9
Store needs to return their url and range
muhamadazmy Sep 20, 2023
917f2d8
fix bug in router and improve tests for pack/unpack
muhamadazmy Sep 20, 2023
00b2e3b
Apply clippy
muhamadazmy Sep 20, 2023
86ed118
Assert routes creation
muhamadazmy Sep 20, 2023
7b973e2
improve tests
muhamadazmy Sep 21, 2023
8617e5e
dynamic creation of stores based on url
muhamadazmy Sep 21, 2023
833e781
start fs mount based on stores from the fl
muhamadazmy Sep 21, 2023
f08ac50
first working version
muhamadazmy Sep 21, 2023
5bdc98d
implement create
muhamadazmy Sep 21, 2023
4d909b0
use different impl pack
muhamadazmy Sep 21, 2023
fb6462a
use blake2
muhamadazmy Sep 21, 2023
75db699
use blake2_simd implementation
muhamadazmy Sep 22, 2023
cb5becc
fix bug in parent ino
muhamadazmy Sep 22, 2023
f0390fe
implement unpack with no recurssion
muhamadazmy Sep 22, 2023
0a706db
add support to use multiple stores from cmdlin
muhamadazmy Sep 22, 2023
8df4b97
clean up dependencies
muhamadazmy Sep 22, 2023
5cdd2b0
updating docs
muhamadazmy Sep 22, 2023
94d38fb
fix typos
muhamadazmy Sep 22, 2023
f27801f
implement preserver-ownership flag
muhamadazmy Sep 22, 2023
cb795e6
make sure on get stores are tried in random order
muhamadazmy Sep 25, 2023
14b12e4
fix ci
muhamadazmy Sep 25, 2023
a8ed37b
Parallel upload
muhamadazmy Sep 27, 2023
47d3ac1
init s3 storage
Omarabdul3ziz Sep 25, 2023
5bb0268
better error handling and runnable code
Omarabdul3ziz Sep 27, 2023
b74ebd8
move to store directory and update cargo files
Omarabdul3ziz Sep 27, 2023
acdadc9
wip: refactor s3store to implement store and register it
Omarabdul3ziz Sep 27, 2023
991d4f9
wip: use `s3` crate and parse config from url
Omarabdul3ziz Oct 2, 2023
0e9865b
Merge branch 'master' of https://github.com/threefoldtech/rfs into ma…
Omarabdul3ziz Oct 3, 2023
80851b9
update lock file
Omarabdul3ziz Oct 3, 2023
2f45892
add test_get_config
Omarabdul3ziz Oct 3, 2023
cabe4a0
add region_name to the url as a param and better error propagation
Omarabdul3ziz Oct 4, 2023
fd0af8a
handle requests without tls and add test for setting and getting func…
Omarabdul3ziz Oct 4, 2023
4f63125
resolve comments:
Omarabdul3ziz Oct 4, 2023
c6b78d5
- clearer errors
Omarabdul3ziz Oct 5, 2023
fbd1533
use regex to capture range and url
Omarabdul3ziz Oct 8, 2023
119f56d
add regex crate
Omarabdul3ziz Oct 8, 2023
80064a5
update docs, and make region optional
Omarabdul3ziz Oct 26, 2023
047c4cd
change to `unwrap_or_default`
Omarabdul3ziz Oct 26, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 0 additions & 4 deletions .github/workflows/tests.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,3 @@ jobs:
- uses: Swatinem/rust-cache@v1
- name: Unit Testing
run: cargo test --bins --features build-binary
- name: Config FUSE to run without sudo
run: echo user_allow_other | sudo tee /etc/fuse.conf
- name: Integration Testing
run: cargo test --features build-binary --release --test '*' -- --test-threads=1
Loading
Loading