Closed

Write some Software

I would like to have a web-crawling script that crawls a website (which is an online retailer). The script should be done in PHP (Curl) with the help of Javascript (if needed). If it can be done in JS only, it's ok as long as it works.

The script should comply to the following:

- Start reading from the URL I will provide (which will be a product category product listing page). From that page it should open in a sub-process each of the products in the listing of the current page and on each of those pages extract certain parameters I'll provide. When it has finished extracting all of the products on the current page, it should move forward to the NEXT PAGE of the products category listing and start doing the same (open each product in a sub-process and extract certain pieces of information on each of those product).

- This should continue until ALL PAGES of the product category listing has finished OR until the price of the product is a certain VALUE.

- The pieces of information (eg: name of the product, colors available, sizes available, etc) should be saved to an excel sheet or to DB tables.

- The script should work with cookies and there must be a place to configure the browser header (it can be a define inside the code).

- Requests should replicate a real web-browser as much as possible.

- This project should be done in a timely manner.

- You should mention the word Croucos in the bidding so I know you have read all the spec.

Regards, TheGuy

Skills: Javascript, PHP, Software Architecture, Web Scraping

See more: write javascript code online, write script excel sheet data, write script rename sheet excel file, write excel sheet excel php, uk software companies list excel sheet, software write mq4, software write chip epson, useful software write book, software write web specs, free software write user guide, software write edid, free software write company profile, software write websites idea, software write book images, software write books, write data excel sheet aspnet, software write protection, free software write book, software write book, format salary sheet excel

About the Employer:
( 4 reviews ) San Isidro, Argentina

Project ID: #10961944

19 freelancers are bidding on average $12/hour for this job

nuked24

Hi, We are expert in designing as well in development. We will provide you quality of work. We will provide you our [login to view URL] want long term relationship with you. Please choose us and provide a chance to work wi More

$15 USD / hour
(141 Reviews)
8.4
qitsol

We have completed over 500 jobs on freelancer + upwork. We did similar projects. Please check our 241 reviews on freelancer.com [login to view URL] See our 100+ reviews on upwork / [login to view URL] http:/ More

$22 USD / hour
(95 Reviews)
7.5
sphinxsolution

Hi, This is Gaurav, Writing on behalf of Team Sphinx. We are one of the rapidly growing Mobile App Development Company based out of New Jersey,USA & Pune,India. We have developed more than 300+ iPhone and And More

$15 USD / hour
(19 Reviews)
6.9
phamtech211

Dear Sir/ Madam, I understand that you are looking for a highly efficient IT Outsourcing team that can offer high quality work along with affordable price rate for your project, and can also provide long term suppor More

$11 USD / hour
(18 Reviews)
6.7
pytho

Hi, Please tell me what is your deadline for this project? I am managing a Web Design Agency located in Romania and I am really interested to help you complete your PHP website. Based on your response I will be able t More

$20 USD / hour
(42 Reviews)
7.0
rkumarvw

Hi, We have studied & discussed your project with our Technical team and based on our assessment. We have an expertise in PHP around above 5 years experienced developers in our team who manages to resolve the issues o More

$12 USD / hour
(102 Reviews)
6.5
mananraja

Hi there, I have read the project & would like to discuss.. I can scrape data from websites using Python scripts.. I have good web scraping reviews for my past projects.. Hope to hear from you..

$8 USD / hour
(77 Reviews)
5.7
websolutions008

Hi, This is Sherly We could build a website. Payment could be released after you are completely satisfied with our output. our recent online store wordpress site in woocommerce. [login to view URL] https:// More

$15 USD / hour
(55 Reviews)
6.0
naren901

Hi sir, I can deliver the required tool which can fetch the necessary content from the retail website. I have previously worked on other retail websites like [login to view URL], [login to view URL], https://www.e More

$11 USD / hour
(74 Reviews)
6.1
elbruninh

Croucos Hola, estoy interesado en tu proyecto, podrias darme mas detalles por favor? Cual es el site? saludos [login to view URL]

$10 USD / hour
(31 Reviews)
5.7
abupabuya

hi sir my name is adlrin, im an expert in web [login to view URL] research,. pls tell me the url need to scrape sir? i had six years of experienced...im very confident im the perfect guy for the project. pls check m More

$10 USD / hour
(65 Reviews)
5.8
suniljoshi151

Hi, I can start work on your project immediately once you confirm me and i am also open for further discussion if you want. I have 7+ years in web designing & development with good experience in following skills More

$12 USD / hour
(47 Reviews)
5.7
alenoblak

Croucos Dear sir or madam, I have done many web scraping in the last year, I have a lot of experience in this field. I've done projects which require login, forms submitting, I've done projects with multithre More

$16 USD / hour
(16 Reviews)
4.4
supersuntech

Hi Employer Greetings I have 5+ years of experience in web designing with wordpress,PHP,joomla. I am showing you some of my recent work of web designing, have a look at it. So that you can be sure of our quality More

$10 USD / hour
(10 Reviews)
4.5
DazzlerFreelance

Hi I read the project details and could do this work really very fast. I have 6+ years of experience with java, jsp,php, mysql, wordpress and javascript.. Just message me and we can talk :)

$15 USD / hour
(18 Reviews)
4.4
$12 USD / hour
(12 Reviews)
3.2
vw8092236vw

I am expert in making web crappers . Feel free to contact me . .........................................

$8 USD / hour
(4 Reviews)
1.7
ahmedemam800

Hi there, This is Ahmed. I have +4 years of experience with web development. Does the url have ssl certificate ? can I see an example ?

$8 USD / hour
(0 Reviews)
0.0
DevScript2016

I have JavaScript code that will do this for you, ready and waiting -- you just need to provide the url and the fields. The script runs in TamperMonkey (a chrome plug-in, no need for PHP) and also provides scripts to r More

$11 USD / hour
(0 Reviews)
0.0
nanthini2812

We are a outsourcing company. We a professional IT & ITES service provider helping clients globally in this sector. We provide Web designing , IT services and REMOTE MANAGEMENT SERVICES at a affordable price, More

$8 USD / hour
(0 Reviews)
0.0