I'm working on a drupal project where I need to sync content (HTML and JSON) with a remote website. I need to manipulate the data and have it accessable as either blocks, nodes, or both. Essentially what I needed was a scraper with a cron hook and call back functionality. To my suprise I couldn't find a Drupal Module that did exactly that.

Luckily the project is large enough to justify custom module development. Attached is a "beta" of my module. My hope is that others will have a need for it and can motivate me to improve it! I give you "cronget".

From the readme:

This module retrieves remote data via drupal_http_request and saves it. It is
executed via the cron hook. The data is saved in a local table and can also
be saved as a node or a block. There is also callback functionality
so the remote data can be manipulated after retrieval.