I'm in the need for a quick script/program to perform a bunch of http requests. Using Charles web proxy and a browser that emulates the iphone, I can perform the task I want on the website and capture every request in Charles. However, something (which I expect to be some basic error) is not working because by replicating the exact same requests programatically does not provide the same responses from the server. Only html, no flash envolved.
I can provide you with my current solution, using a combo of ruby + net/http + zlib
The HTTP requests are made over SSL.
I'll provide a dump of a successful http exchange (xml, CVS, whatever you prefer), all the requests were made using mobile safari ( the site behaves differently according with user agent and so on...)
We're talking about a maximum of 20 http requests.
I can provide the code I wrote, you can deliver your solution in the language you prefer - as long as you explain how to compile it alongside the required libraries.
This should be a very simple task and I expect it to be accomplished in one or two days.
Contact me directy for more info.