Web-scraping a big dataset
This project received 22 bids from talented freelancers with an average bid price of €167 EUR.Get free quotes for a project like this
Project Budget€30 - €250 EUR
Currently you can get 24H data for all stations. Using a script create requests for all days one by one (without overwhelming the server). Requests are processed and then the resulting data is dumped on an ftp server  with the respective request number. 24H data for all stations should be about 1.5 GB of data. Download them and put them on a server where we can access them in bulk.
Download procedure to be automated:
1) Enter an e-mail address
2) Select data format: Mini-Seed
3) Select time interval: Loop over A single day from 1/1/2009 to 16/10/2016
4)Select stations: Select all stations and all channels
5) Submit request
6) Wait and collect the completed request from 
 [url removed, login to view]
 ftp://[url removed, login to view]
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online