Build a scraper to download data from a specific website and convert it to a csv file. To be done using the python web crawling framework Scrapy. Scrapy is Python based.
The spider must:
1) Authenticate with the server using cookies
2) Extract times from HTML and convert them to Unix time.
3) Extract program durations and convert them to seconds.
4) Extract titles
5) Extract Event Descriptions
6) Export the above to .csv along with other specific (predetermined) values.
The data is available in a format by channel and by day. The scraper would download the next 7 days data for each channel.
*Background on Scrapy*
Scrapy ([url removed, login to view])
Examples of Scrapy spiders: [url removed, login to view])
Items in Scrapy : [url removed, login to view]