Create an Excel macro to extract data from tables on websites. There are between 2 and X possible datapoints to be extracted from each URL which are presented in tables depending on number of grades in a school and number of proficiency/test scores. These are (data point in parentheses): percent proficient on state standardized reading (1), writing (2) and math (3) exams; (1), (2) and (3) broken out by regular (5-7), special education (8-10) and perhaps ESL/LEP (11 and 13) student categories; for those schools which only have standardized test scores (depending on state and year), (1) thru (13) might be replaced by National standardized exams (SAT, ACT or Stanford-9 – depending on the year,) for reading, writing and math scores. I need percent proficient on state exams when available, but not both proficiency scores and standardized test scores if both are available. Note: If each of these scores are supplied by grade, this may multiply the datapoints by as much as a factor of 4 per year (but it is unlikely that a state would have subscores for types of students (5-13) and grade levels, so I estimate the highest number of datapoints to be extracted on any one URL to be 12). This needs to be done for each year there is data available. Because there are multiple years per school, the dataset will be duplicated as such:
Schid 1, year x, score1, score2, etc.
Schid 1, year y, score1, score2, etc.
Schid 2, year y, score1, score2, etc.
Schid 2, year z, score1, score2, etc.
I will specify by state and school level the datapoints to be collected. Macro should read from an existing Excel Spreadsheet.
After a total bid is accepted, I would like a scope of work (a brief description of the technical methodology, how you will avoid being locked out of the website due to the amount of traffic this will produce, and the estimated time. I will escrow the total bid upfront after I receive and approve the scope of work.