Fsspec remfile with cache

[sinha-r]

Implementation for fsspec with cache and remfile with cache.

• A tmpdir was added for both cases to facilitate cleanup.

Fix #45

[oruebel]

It looks like there are a few issues with indentation, but otherwise this looks good to me.

[CodyCBakerPhD]

Looks good to me minus the syntax issues - @sinha-r can you ensure that you can successfully run the new benchmarks before we merge?

[CodyCBakerPhD]

One more thing I just now realized - apparently doing del tmpdir doesn't remove the directory on my system - can you add a teardown method (this will be called automatically at end of each check, very similar to unittest.TestCase.TearDown) to each benchmark using a temporary cache?

[oruebel]

One more thing I just now realized - apparently doing del tmpdir doesn't remove the directory on my system - can you add a teardown method

Strange, the main point of TemporaryDirectory is that it is supposed to clean up automatically, at the very latest once the Python garbage collector cleans up the object. Maybe an error in the tests caused the clean-up to fail. I've set the ignore_cleanup_errors=True parameter to make sure it tries to also clean up when it encounters issues and I've added teardown functions to the corresponding tests to also explicitly call the cleanup method of the TemporaryDirectory, rather than relying on the garbage collector. Hopefully that fixes that issue you were seeing.

[oruebel]

I've fixed the errors I found and am running the benchmarks now to make sure they work. Otherwise this seems good to merge now.

[oruebel]

It looks like all the tests ran on my machine at work. Good to merge.