Automate WPT results periodically

[housseindjirdeh]

This issue can track how we can eventually set up automated runs of WPT and extract results periodically. There's a Node wrapper for the API that looks handy.

Will love to hear everyone's thoughts on how we can do this 💃

[addyosmani]

I've been chatting about this with @ebidel who has been working on a CI story for Lighthouse with WebPageTest over in https://github.com/ebidel/lighthouse-ci/blob/master/frontend/lighthouse-ci.js#L75.

This might be something we can piggy back off :) He's working on some docs for a bit but maybe something we can look at in a week.

[ebidel]

Lighthouse CI docs are up!

Check out https://github.com/ebidel/lighthouse-ci#auditing-github-pull-requests and LMK if you run into issues. To run on WPT, you'll want to use --runner=wpt. Example output (the GH comment and pass/failing a PR): ebidel/chromium-dashboard#6 (comment)

FWIW, the CI only works on PRs events from Travis atm. But I'd love to know more about how you guys want to automate testing. For example, we could figure out ways to make the runlighthouse.js module work for than Travis setups. It's already fairly flexible.