You have chosen to sponsor your bid up to a maximum amount of .
Looking for an experienced PHP programmer to write a web crawler script.
the script should take the web url as input and generate output in csv format.
should crawl the current page and the pages in the pager until it gets the count specified in the url which is 25 in above example.
the crawler should extract whatever important information it can get like in the example above it should get title, thumbnail image url and the crawler should crawl the respective inner detail page like http://ap7am.com/lv-64028-special-focus-on-adolf-hitler.html and get embed code and Tags
multiple values in a column should be seperated by a separator like [*#seperator@#]
note that there are 3 parts in the above example. the crawler should get embed code from all the three and separate them with [*#separator@#]
similarly it should work(or another script with slight modifications) for http://example.com/crawler-script.php?url=http://videomasti.net/page/3/&count=35
for inner detail page like http://videomasti.net/2012/04/20/ullasam-telugu-movie/
it should pick first link(because that was recently added). and because first link has 2 parts, multiple embed codes should be separated with [*#seperator@#]
and also work for http://example.com/crawler-script.php?url=http://videomasti.net/telugu-movie-index-a/&count=35
Use standard crawler engines(free, opensource) like
If you have worked on similar task and can show me a sample it will be great.