Need linux expert: How to limit access to web site to prevent harvesting
Project ID:
430428Project Type:
FixedBudget:
$30-$250 USD
Project Description:
We need the help of a Linux expert. We have a very large web site, with millions of pages, and we need to be able to limit access to the public by restricting access to 50 pages within 24 hours per IP address. In other words if you surf the web and go to our web site, we will let you surf through 50 html pages before we block you. We need this to prevent data harvesting by end users and also by our competition. We are running the latest version of Linux Slackware. We know it can be done, but we can not find how. We need someone to explain to us how to set this up by sending us the instructions.Additional Project Description:
05/06/2009 at 14:50 EDT:We need to limit access to a specific domain abc.com for example. So regardless of the html files, images etc, anything that is under abc.com must be limited. So let's say that we want to limit access to 500 "items" per IP per day. This means that the total transfer of material from the domain abc.com, be it, html files, images, etc. would max to 500. If the user hits the 500 maximum, the system should display an error html page which will be under another domain like abc-error.com. The setup must be simple and you must provide the step by step documentation on how to do this.
Skills required:
Linux, System Admin
Public Clarification Board
1 messages
-
andrew4gaf
We need to limit access to a specific domain abc.com for example. So regardless of the html files, images etc, anything that is under abc.com must be limited. So let's say that we want to limit access to 500 "items" per IP per day. This means that the total transfer of material from the domain abc.com, be it, html files, images, etc. would max to 500. If the user hits the 500 maximum, the system should display an error html page which will be under another domain like abc-error.com. The setup must be simple and you must provide the step by step documentation on how to do this.
over 2 years ago
Awarded Bids
All Bids ()
nknk
|
nknk
From United States
Gold Member
Offline
|
US English Level 2 (88%, 41st percentile)
Unix Level 1 (100%, 100th percentile)
Foundation EUFreelance.com Member
$120
in 3 days
over 2 years ago
Hi. That's my specialty. Please check PM.
I have profound linux systems engineering and network protocol skills which I'd be glad to use for helping you. Please check your PMB for further discussion.
Please check the PM, thanks
diegows
|
diegows
From Argentina
Offline
|
Unix Level 1 (93%, 77th percentile)
$120
in 1 day
over 2 years ago
I work with Linux since 2000. I could finish you project quickly despite the web server you are using.
Sir
I'm an experienced linux system administrator. Please check my other profile here :
http://www.rentacoder.com/RentACoder/DotNet/SoftwareCoders/ShowBioInfo.aspx?lngAuthorId=1441610
I'm ready to help You wit... more
Sir
I'm an experienced linux system administrator. Please check my other profile here :
http://www.rentacoder.com/RentACoder/DotNet/SoftwareCoders/ShowBioInfo.aspx?lngAuthorId=1441610
I'm ready to help You with solving ip access blocking issue. less
Please see PMB.
neelu7779
|
neelu7779
From India
Offline
|
Foundation Freelancer.co.uk Member
$150
in 2 days
over 2 years ago
Hi,
Please check the pmb.
asdsolutions
|
asdsolutions
From United States
Offline
|
Foundation EUFreelance.com Member
$200
in 2 days
over 2 years ago
Hello, we are unix experts company. We can do it.
I may give you the configuration which can even limit bandwith for each client at the moment based on the total number of connections. So one who has a fast connection wont be able to suck all your bandwith.
If you have on port 80 only abc.com, then iptables (mod ipt_recent)
iptables -t nat -I PREROUTING -i eth0 -p tcp -m state --state NEW --dport 80 -m recent --set --name HTTP_ATTACKER --rsource
iptables -I INPUT -i eth... more
If you have on port 80 only abc.com, then iptables (mod ipt_recent)
iptables -t nat -I PREROUTING -i eth0 -p tcp -m state --state NEW --dport 80 -m recent --set --name HTTP_ATTACKER --rsource
iptables -I INPUT -i eth0 -p tcp -m state --state NEW --dport 80 -m recent --update --seconds 86400(day) --hitcount 500 --name HTTP_ATTACKER --rsource -j DROP(or redirect) less
If you are using Apache as HTTP server I can do this, please check your PM
frankdrake
|
|
frankdrake
From United Kingdom
Offline
|
Foundation Freelancer.co.uk Member
Foundation LimeExchange Member
$150
in 1 day
over 2 years ago
This can be done quite simply and should require little maintenance after install and config.
I would accomplish this by writing a perl script which would scan the web server access log for GETs by IP address and accumulate the totals. If any IP address went over the limit within 24 hours they would then be bl... more
I would accomplish this by writing a perl script which would scan the web server access log for GETs by IP address and accumulate the totals. If any IP address went over the limit within 24 hours they would then be blocked. Timestamps would be used so the blocked IP address would be unblocked after 24 hours.
I could write this for a generic access file and allow it to be configured for any specific log file desired. That way if you had multiple web servers you could scan any specific access logs needed. You might also find that some IPs would need to be excluded, ie, never banned, so you might want such a feature implemented. less