Scour

Scour is our retriever gem. Based on MetaInspector, the Scour Gem updates MetaInspector to handle a couple of unique cases.

  1. It handles wrapping it in a Splash Proxy system.. so we can run JS in the retrieve and have the proxy return the HTML with JS already formatted.

  2. It handles non HTML responses so you can use it to retrieve JS results.

  3. It has a scripting language that can be used to script the proxy and the JS engine, running commands, clicking on stuff, before returning a result.

PreviousAudienti-RetrieverNextHaystack

Last updated