Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes while I wrote an indexer #10

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

xrl
Copy link

@xrl xrl commented Dec 19, 2020

I was experimenting with this library to build an indexer.

  • Async support
  • Buffered IO
  • TLS support
  • Trying to work out how to pipeline requests
  • Github actions for tests
  • Indexer example which works against an Elasticsearch cluster (see the docker-compose)

I've just been merging in to my master branch so it's a big ball of changes. But I wanted to float this past you so you could see how all this is coming together.

I couldn't figure out how to recombobulate binary groups to make sense of articles so this work just kind of came to a pause

xrl added 2 commits March 1, 2020 16:16
* Some TLC for the crate:

 * Convert writes to byte slices
 * Replace pervasive matches with ?
 * Use Result::map operator for conversions
 * Reformat with "cargo +stable fmt"

* Read from bufstream, use lines helper where appropriate

* Binaries (#3)

* Messy work, but we can auth with TLS and passwords

* Pipeline article reading works

* GZIP (#2)

* Let's see what happens

* tackled all the warnings, converted to a custom error type

* Looking much better for parsing headers

* More goodies

* snagging headers

* GitHub actions (#1)

* does it build

* let's use nightly

* BufStream helper

* whack-a-mole with errors I left hanging around

* Not sure what's going on with this old code

* I think it's happy again

* Clippy run, go clippy go

* cargo test warnings go away
* Some TLC for the crate:

 * Convert writes to byte slices
 * Replace pervasive matches with ?
 * Use Result::map operator for conversions
 * Reformat with "cargo +stable fmt"

* Read from bufstream, use lines helper where appropriate

* Binaries (#3)

* Messy work, but we can auth with TLS and passwords

* Pipeline article reading works

* GZIP (#2)

* Let's see what happens

* tackled all the warnings, converted to a custom error type

* Looking much better for parsing headers

* More goodies

* snagging headers

* GitHub actions (#1)

* does it build

* let's use nightly

* BufStream helper

* whack-a-mole with errors I left hanging around

* Not sure what's going on with this old code

* I think it's happy again

* Clippy run, go clippy go

* cargo test warnings go away
@xrl xrl mentioned this pull request Dec 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant