Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added scrape-meta for lake_county_sheriff #132 #157

Open
wants to merge 4 commits into
base: dev
Choose a base branch
from

Conversation

naumansharifwork
Copy link
Contributor

Closes #132

@newsroomdev newsroomdev added the bug Something isn't working label Oct 24, 2024
@newsroomdev
Copy link
Member

@naumansharifwork this scraper is producing 401 errors. could you take a look when you have a moment, please?

❯ pipenv run python -m clean.cli scrape-meta ca_lake_county_sheriff -l DEBUG
2024-10-24 09:47:52,146 - clean.runner - Scraping ca_lake_county_sheriff
2024-10-24 09:47:52,146 - clean.utils - Requesting https://api.zenrows.com/v1/
2024-10-24 09:47:52,527 - clean.utils - Response code: 401
2024-10-24 09:47:52,527 - retry.api - , retrying in 15 seconds...
2024-10-24 09:48:07,534 - clean.utils - Requesting https://api.zenrows.com/v1/
2024-10-24 09:48:07,876 - clean.utils - Response code: 401
2024-10-24 09:48:07,876 - retry.api - , retrying in 30 seconds...

@naumansharifwork
Copy link
Contributor Author

Hey @newsroomdev have you tried adding the zenrows api key to the env file?

@tarakc02
Copy link
Collaborator

This all looks good! I followed the instructions and added the zenrows api key and successfully ran on scott. @newsroomdev this is ready to merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Lake County Sheriff
3 participants