-
Notifications
You must be signed in to change notification settings - Fork 2
Why Firefox
wget is an excellent & lightweight tool that does exactly what we need - collecting text from a page, but it doesn't follow hidden redirects embedded in Javascript.
We need a sneak attack that will let us scrape the page and can parse these "enhancements" in order to snag the text needed, without ending up with blank postings.
As of version 1.1.0 of Resgen, we're sending a headless browser after the posting, to simulate a user viewing the page.
Versions of Firefox ESR prior to v60 are not compatible with Resgen, as it lacks the headless capability utilized by the automation technique; you'll want to install a newer version of Firefox (or upgrade, ideally) in order to have the best possible automation experience.
You don't actually have to use it for anything, other than letting Resgen use it as a dependency.