Add integration test for full deal flow, fix retrieval bugs

[hannahhoward]

Goals

Write an integration test that verifies data is actually sent into singularity and deals are proposed to boost. Test retrieval including:

• Test the retrieval process from both the datasource and Filecoin.
• Verify the correct functioning of the read seeker.
• Test the HTTP endpoint for file retrieval.
• Verify Lassie integration and CAR file retrieval.

fixes #103

Implementation

• Various bug fixes already shipped and merged to singularity discovered in testing
• Move most execution of devnet integration test out of github action into a Makefile. See integration/test/README.md for more information. This enables running tests and devnets locally with ease
• Switch from SINGULARITY_TAG to SINGULARITY_REF, removing the automatically inserted colon. This allows us to run from direct SHA tags as needed. It also means the code will run is no ref is specified, as opposed to before where it would fail if no SINGULARITY_TAG was present
• Fix bug with go-routine execution of singularity preparation introduced in cleanup data PR
• Fix bug with blob descriptors when local file is deleted
• Fix bug where local data was deleted before the deal status was published or active
• Add several hook scripts to enable acceptance of boost deals (such as pricing deals to zero)
• Various configuration fixes to make dealmaking in test run smoothly
• Integration test that now does a MUCH more full cycle -- pushes, retrieves, waits for full storage on filecoin, then retrieves with Lassie

For discussion

• I had to add a custom entrypoint boost in order to properly configure boost to advertise booster-http. We should probably upstream this.

• There is a bug fix for singularity that should get in before we merge this.

[elijaharita]

amazing! so glad we are getting this

looks good to me, i don't see anything to suggest except for a log typo, haha