Scrape All Trustee Sites (25 site)
All trustee sites need to be scrapped:
• Once a day
• When the sale gets to be within three days it needs to scrape every four hours.
• When it gets to two days before the sale it needs to scrape every hour
• When it gets to one day before the sale and the day of the sale it needs to scrap every 3 seconds.
All scrappers need to scrape:
• Opening bids
• Sites for notes
• Every three seconds
If any of the existing scrappers are not doing this, they will need to be fixed to do this.
You need scrape the data and have it populate into our MYSQL database and from there the foreclosure tracking site.
You may also need to create fields on the foreclosure tracking site so the data will have a place to go. You may also need to add a search feature to be able to search the data on the foreclosure tracking site.
You will need to scrape all prior data that is on the site and all future data on the site. Once all data is pulled from the site then the scrappers will scrape as mentioned above.
We will add a few more sites and videos that will be similar to these sites.