Project Description:
Need help to scrap data from a website. The program is preferably to be written in PHP or Python. Linux shell script with curl or wget are acceptable. Java and Perl are also acceptable but not desired.
The website displays information after receiving form data. The form data is submitted using HTTP POST. Then a new webpage with multiple frames will appear. Buttons will appear in frame 1. Clicking those buttons (javascripts are executed to call a url) will change contents in frame 2. Frame 2 is composed of text and images.
Need a program to automatically submit the form data, mimic the button clicking and then store the text and images in frame 2.
Seems the website also uses cookies to keep track of a session.
Those who are interested, please send me a message. I will reply with screen dumps to help you to better estimate the development cost.
