Add user storage guide #138
Conversation
rabernat
commented
Apr 12, 2022
rabernat
commented
- Closes Document object storage and scratch bucket #135
- Starts to address Documentation for end-users of 2i2c hubs #129 by adding a new section to the docs called "Hub User Guide", for which the storage page is currently the only entry.
user/storage.md
Outdated
|
|
||
| Writing data (and reading private data) requires credentials for authentication. | ||
| 2i2c does not provide credentials to individual users. | ||
| Instead you 2i2c customers should manage their own cloud storage directly. |
There was a problem hiding this comment.
Can we think of some more concrete suggestions to put here?
There was a problem hiding this comment.
I really like this - I'm always impressed at the clarity and usefulness of the Pangeo docs. Thanks so much @rabernat for porting this over.
I made several comments and suggestions throughout to improve the clarity and readability. There are also a few places where I think we might need to update the names of things (in particular the PANGEO_SCRATCH variable name...but correct me if I'm wrong). I also added a big "warning" to the instructions about GitHub credentials storage, so that we can merge this PR without blocking on the longer-term fix that @yuvipanda mentions.
IMO once the comments are resolved, we can merge this one in.
|
@rabernat, Chris left a bunch of comments, can I ask for a follow-up from you since you were the original author of this PR? |
|
Thanks for the feedback everyone! I have a busy M-W but will try to find time to revise this on Thursday. |
|
I'll try to get in my gh-scoped-creds documentation PR to this PR before thursday then :) |
Also adds docs on how to do this! pangeo-data/pangeo-docker-images#305 adds the required package to the pangeo docker image. See 2i2c-org/docs#138 (comment) for more discussion
Much secure, such power
|
rabernat#1 is my PR to this PR :) |
Replace ssh-keygen with gh-scoped-creds
Co-authored-by: Chris Holdgraf <[email protected]>
user/storage.md
Outdated
|
|
||
| - **[s3fs](https://s3fs.readthedocs.io/en/latest/)** - for working with AWS S3 | ||
| (Simple Storage Service) and compatible APIs. Most third-party object storage | ||
| services (e.g. [Wasabi](https://wasabi.com/) and [Open Storage Newtork](https://www.openstoragenetwork.org/)) |
There was a problem hiding this comment.
The link checker is erroneously flagging this as a broken link
( user/storage: line 109) broken https://www.openstoragenetwork.org/ - HTTPSConnectionPool(host='www.openstoragenetwork.org', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1131)')))
There was a problem hiding this comment.
I added an exception to openstoragenetwork, not sure why it wasn't working
|
Thanks, @rabernat and @choldgraf! |
