Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create South Korea crawl list #50

Closed
SebastianZimmeck opened this issue Jul 4, 2024 · 3 comments
Closed

Create South Korea crawl list #50

SebastianZimmeck opened this issue Jul 4, 2024 · 3 comments
Assignees
Labels
crawl An issue related to the crawl

Comments

@SebastianZimmeck
Copy link
Member

As we will be testing (issue #9) on South Korea since @atlasharry will be there and there is a South Korea Google VM, it makes sense to also include South Korean sites in the crawl.

@atlasharry will create such list with 525 sites similar to the other crawl lists according to @dadak-dom's protocol. @dadak-dom will provide input on how to create this list.

@SebastianZimmeck SebastianZimmeck added the crawl An issue related to the crawl label Jul 4, 2024
atlasharry added a commit that referenced this issue Jul 9, 2024
@atlasharry
Copy link
Member

South Korea's top 525 list is now uploaded to branch 50, along with some scripts to build this list. I will merge this branch into branch 51-prepare-crawler-test-list to make the final test

@SebastianZimmeck
Copy link
Member Author

Sounds good, @atlasharry! Feel free to close this issue if there is nothing more to do.

@atlasharry
Copy link
Member

The list is created and now merged into the main branch. I will close this issue now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
crawl An issue related to the crawl
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

2 participants