Web Crawling Spider Creation for Property Maintenance C0

  • Status Closed
  • Budget $8 - $15 USD / hour
  • Total Bids 5

Project Description

I am looking for someone to write the script I guess for Control Web Crawler This is all I can tell you Its off the Godaddy site.

Use this page to specify what you do and don't want spiders to see on your site.

Determine what pages of your site can be crawled and by whom. Then, create the appropriate [url removed, login to view] file and upload it to the root of your hosted site. If you do not have FTP access to your hosting account, specify your crawling preferences, create the corresponding Meta Tag, and paste it in the section of your site's HTML.

So I am looking for the txt file and or Meta Tag designed for my website

Get free quotes for a project like this

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online