There's a dynamically updating website from which we wish to scrape data.
This data sometimes needs to be synced to another dynamically updating website. The second site is on yahoo.com
We need a db to be created from this data - searchable back to 2007.
The finished project will allow us to do the kind of inquiries we are currently interested in and may be in the future.
NOTE: We will mainly be doing HISTORICAL searches, so the db wouldn't need to necessarily be updated but every week or two.