Closed

spider/crawler/scraper needed to compile a survey

We need a script/application that we can leave running on a PC that will crawl the web, preferably with editable limits (e.g. just .com domains, or just pages within a specific domain) and compile data.

It needs to log the page name, URL, and results for about 3 criteria....

1) Does the site use frames (y/n)

2) Does the page have a Doctype declaration (y/n)

3) Does the page code validate (might be too difficult, let me know your thoughts)

Please state how you will achieve this, how the logged data can be accessed (ideally a spreadsheet), and post examples if you have done similar things.

Skills: .NET, ASP, Windows Desktop

See more: asp spider, metaphase, log post, data crawler, crawl, web data crawler, net crawl, application crawl, survey application asp, net spreadsheet, crawl net, survey data spreadsheet, url crawl, let log, crawl web application, compile code, web crawl spreadsheet, need web crawler data, web data crawler net, script crawl data, url spider, page needed, spider spreadsheet, site specific crawler, script crawler spider

About the Employer:
( 39 reviews ) Surrey, United Kingdom

Project ID: #22089

10 freelancers are bidding on average $84 for this job

Spin

We will doing all that you want (and more... :-))). Quickly, Professional, Quality - our answer you and your organization. We work more than 10 years.There are questions?

$100 USD in 7 days
(2 Reviews)
5.9
Properbouncetech

Hello, thanks for your bid invitation and think our price and time span are the best one as per your budget and project. Pls. See PMB. Regards.... Microsectec.

$88 USD in 8 days
(7 Reviews)
4.9
viaden

Dear Friend, The project is within our skills and abilities. We are a company with more than 10 years of experience in the IT-sphere. We offer flexible pricing and fast turnaround. If you are interested, please, contac More

$100 USD in 7 days
(1 Review)
3.8
ebusiness2

Our bid is for really very high quality work for your spider/crawler/scraper needed to compile a survey that will be made to be upgradable in case you need some upgrades in future. We will always be available for upgra More

$100 USD in 6 days
(3 Reviews)
3.3
tanuj99

pl see pmb for details

$89 USD in 10 days
(2 Reviews)
3.2
ruslimeddy

my bid thx

$100 USD in 7 days
(0 Reviews)
0.0
dragoscumt

Hi! I'm a C#.Net developer comitted to deliver high quality solutions in short time. Please, see my PM. Best regards!

$40 USD in 6 days
(0 Reviews)
0.0
coderjoeyc

To scan for frames or doc type is a sinch , however if you want to validate the code it would be difficult without a syntax checker. If you want to attach a syntax checker that is already a program that you own or a More

$100 USD in 2 days
(0 Reviews)
0.0
wearydreamer

i have fairly much experience of making crawler

$50 USD in 2 days
(0 Reviews)
0.0
CodesWork

Respected Sir . I have already done many Web Spidering projects. So I can assure you that it would be of good quality. Could you please check the Private Mesage board for my privately posted message and contact me fo More

$75 USD in 3 days
(0 Reviews)
0.0