-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
added scrape-meta and scrape for riverside pd #57
Conversation
@zstumgoren @newsroomdev please review this PR as well i have formatted the json as it was mentioned in the discussion |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@naumansharifwork, sorry i misesed this earlier, but filename/slug should be "riverside_pd" rather than "river_side_pd". otherwise i don't have any other changes, it looks good to me.
clean/ca/riverside_pd.py
Outdated
return dl_assets | ||
|
||
def _make_download_path(self, asset): | ||
folder_name = asset["case_number"] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should be folder_name = asset["case_num"]
, due to previous standardizing of metadata per #58 .
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@tarakc02 fixed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks good to me!
Hey @zstumgoren please review this as well, Thanks |
This is looking very close to being done! Nice work. Two changes and this should be good to merge. Let me know when you'd like me to take another look, and thank you for your diligence as this codebase adds downstream dependencies |
Hey @newsroomdev Thanks for the review, the requested changes are done please check Thanks. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is looking good! Feel free to merge it in when you're ready
* added scrape-meta and scrape for riverside pd * changes for meta-data file formating * changed file name * tiny fix * removed scrape and changed case_num to case_id
Hey fellows,
Created scraper for City of Riverside,
Below is the tree screenshot and meta json
i have made folder name as case numbers.
ca_river_side_pd.json