Mod-QOS Expert: Help To Write Rules To Slow Down Specific Bots / Crawlers


I am looking for a Mos_QOS expert who can help to write rules that will effectively prevent some bots to crawl pages

1 => research all scrapers, bots that are commonly used to scrape e.g. [url removed, login to view] etc and write them down in an Excel file

2 => block scrapers using mod_qos

3 => allow slurp, googlebot, etc

This needs to be sophisticated so you need to write rules to whitelist googlebot, bing, yahoo and others and make sure to throttle scrapers or ban them

Skills: Apache, System Admin

See more: write for others needs, who can expert in excel, need expert excel help, need a help to write a will, looking for an excel expert, help to write, expert in excel help, so slow, excel expert 2013, rules, qos, apache crawler, excel 2013 expert, write file excel, system admin expert, excel slow, sure can write, file system crawler, ban system, crawl pages, crawl scrape excel, help write, scrape crawler, scrape write file, scrape bing

About the Employer:
( 183 reviews ) Asbach, Germany

Project ID: #4703204

3 freelancers are bidding on average $205 for this job


Hi there, i am very interested to complete this project. please see my past reviews related to system administration lets complete this project

$226 USD in 3 days
(80 Reviews)

i can help you. please check pmb.

$166 USD in 3 days
(5 Reviews)

Note that this is not something you can expect to be bulletproof, for variety of reasons (otherwise everyone would implement it a long time ago). What we can do is make your web more responsive by applying some qos rul More

$222 USD in 3 days
(0 Reviews)