I am URGENTLY looking for some new software to be written to be able to extract information from a specific website ([login to view URL]) using the search facility - [login to view URL] where q= a number which increments by 1 each time. I want to set the start and end numbers for each search. We have a very good piece of software already but it needs to be updated. It searches using multi-threading and brings back 10, 50 or 100 records at a time (depending on which we choose) and then writes them to SQL.
A dropdown box is needed for England & Wales where the Company numbers are an 8 digit number from 00000001 upwards, Scotland where the Company numbers begin SC and then have 6 digits from SC600000 upwards e.g. SC600600 and Northern Ireland where the Company numbers begin NI and then have 6 digits from NI600000 upwards.
The extracted data needs to be written directly to our SQL database in the correct fields. Screen shot of what the existing software looks like attached and SQL schema also attached (although not all fields are written to by the program).
We can also provide all of the software files from the current version. As the process in in motion, the current software version writes a log to the screen which shows the Company number and OK as it writes to the SQL database.
The current program also creates a .txt log file for each search with the same data that's been added to SQL (see example copy attached)
First Directors Name
31 freelancers are bidding on average £463 for this job
Hello, I have python scraping, multithreading and MySQL experience which will be useful for this software. The part I did not understood is, you already have the software, what will change in the new version?