Update license, add tests, split files

russellsteadman · Jan 29, 2022 · aac0d17 · aac0d17
1 parent 8d89d68
commit aac0d17
Show file tree

Hide file tree

Showing 19 changed files with 839 additions and 2,740 deletions.
diff --git a/LICENSE b/LICENSE
@@ -0,0 +1 @@
+See the LICENSE files in the individual packages.
diff --git a/README.md b/README.md
@@ -1 +1,18 @@
-# NetScrape
+# NetScrape Mono-Repo
+
+Efficient, simple, and compliant web scraping.
+
+## Packages
+
+- [`netscrape`](https://github.com/russellsteadman/netscrape/tree/main/packages/bot#readme)
+  — A simple web scraping client
+- [`exclusion`](https://github.com/russellsteadman/netscrape/tree/main/packages/exclusion#readme)
+  — A simple and compliant robots.txt parser
+
+## Get Started
+
+Visit the `netscrape` package [on npm](https://www.npmjs.com/packages/netscrape) to get started.
+
+## Licenses
+
+See the individual packages for licenses.
diff --git a/netscrape.code-workspace b/netscrape.code-workspace
@@ -0,0 +1,11 @@
+{
+	"folders": [
+		{
+			"path": "packages/exclusion"
+		},
+		{
+			"path": "packages/bot"
+		}
+	],
+	"settings": {}
+}
diff --git a/packages/bot/README.md b/packages/bot/README.md
@@ -1 +1,8 @@
-Just getting started!
+# NetScrape
+
+Web scraping made efficient, simple, and compliant.
+
+## License
+
+MIT (C) 2022 [Russell Steadman](https://github.com/russellsteadman). See LICENSE file. Visit [Google
+deps.dev](https://deps.dev/npm/netscrape) for dependency information.