Simple Ebay Scraper / Crawler

Closed Posted Oct 13, 2006 Paid on delivery
Closed Paid on delivery

Please download attached .zip file for visual reference (if necessary)

I'm looking for someone to build a pretty simple php web crawler that sifts out various ebay information, cross matches it to an existing mysql database and adds to it if necessary.

Initially it will start at the eBay advanced search page ([url removed, login to view])

It will reference a specific pre-existing table in the mysql database to determine what search terms to place under keywords and excluded words. It will check the completed listings only box, and it will alter the pull down menu at the bottom to show 200 listings per page (to cut down on page turning).

Then it will click search and proceed to ([url removed, login to view])

Here it will just need to reference the mysql database for the username and password to login

Then it will sign in and proceed to ([url removed, login to view])

From here it will sift out all of the item numbers on the page out of the URLs linking to each item. It will cross reference those item numbers to see if any of them already exist in the database. If the item DOESN’T exist, it will create a new entry for the item number and it will also record whether it sold, or didn’t sell (depending on the color of the price(red/green). Since ebay will only display a max # of 200 items per page, it will need to proceed through each page until it’s checked for all new listings.

For each new item recorded, it will need to proceed to ([url removed, login to view]) to record additional information. Step_4 is the detailed item page, here it will record the winning bid amount, the end date and time, the shipping costs, the buyer, number of bids and the sellers username.

There will be a new table for each month, so on Step_3 it will make a new table for items beginning on a new month.

It needs to be on a timer to do this every morning.

Thanks, looking forward to hearing from you.

Mike

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):

a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

Don't care

Amazon Web Services Data Entry Engineering MySQL PHP Software Architecture Software Testing Web Hosting Website Management Website Testing

Project ID: #3859274

About the project

5 proposals Remote project Active Dec 3, 2006

5 freelancers are bidding on average $53 for this job

sting01

See private message.

$38.25 USD in 5 days
(35 Reviews)
4.4
flestervw

See private message.

$51 USD in 5 days
(3 Reviews)
1.6
sunglowsystems

See private message.

$84.15 USD in 5 days
(0 Reviews)
0.0
sarsijsoftw

See private message.

$41.65 USD in 5 days
(3 Reviews)
0.0
kapilzen

See private message.

$51 USD in 5 days
(1 Review)
0.0