Closed

Web crawling, data scrapping project

Looking for expert web scrapping, crawling to scrap e-commerce price comparison websites, plus some other travel website, total of 10 websites.

The tasks follow:

1. Develop the scraping platform.

2. Setup cron job to update some fields.

3. Setup and Pipe line the data to nosql, Poatgre or mangodb.

4. Relink the affiliate with our affiliate tag.

5. Setup proxy

Skills: Data Mining, Web Scraping

See more: scrapy example, python web crawler github, scrapy python 3, python web crawler beautifulsoup, python web crawler source code, web crawler python, python web crawler tutorial, python scrapy tutorial, data scrapping project, web crawling project, web data mining project, web crawling extracting data, web crawling data grabbing, web extraction data project, web automation data scrapping

About the Employer:
( 1 review ) Manama, Bahrain

Project ID: #14812163

36 freelancers are bidding on average $186 for this job

mantislin

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr More

$170 USD in 5 days
(166 Reviews)
7.0
phpXpertbd

Dear Sir, I specialize in web development, web scraping and data mining projects. Please open chat with and lets discuss in more details about the project. Many thanks!!! Relevant Skills and Experience PHP-cURL, Pha More

$30 USD in 30 days
(52 Reviews)
6.8
DeepSyaal

Lets start. Having a team of Professionals. We provide high quality work with accuracy. Would you like to discuss more about your current requirements? Relevant Skills and Experience Expert in Web scraping Proposed M More

$150 USD in 2 days
(181 Reviews)
6.4
Verz1Lka

I'm web-scraping expert with 5 years of experience and i have 500+ finished projects (ecommerce, directory listing, etc...) I can export data into any format (csv, json) or database (mysql, mongo). Relevant Skills and More

$133 USD in 2 days
(97 Reviews)
6.4
mirniyazuddin92

Dear Sir/Ma'am, I am a Web research, Data Entry & Web Scrapping expert. I checked and understood your requirements. Relevant Skills and Experience Data Mining, Web Scraping Proposed Milestones $150 USD - 1 If yo More

$150 USD in 3 days
(96 Reviews)
6.5
diamond247

I have gone through the project details, and understand what you are trying to achieve. We have completed a number of similar projects to yours. And we are experienced critical data research. Relevant Skills and Exper More

$200 USD in 3 days
(119 Reviews)
6.5
shahiddar

Proposed Milestones $30 USD - Initial Milestone

$30 USD in 2 days
(13 Reviews)
5.3
RSUKANTA2014

I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. Relevant Skills and Experience web scrapping, d More

$60 USD in 3 days
(17 Reviews)
5.0
schoudhary1553

Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. i can do this Task as per your requirement. Relevant Skills and Experience I have the 5 years of e More

$250 USD in 3 days
(8 Reviews)
4.6
bestit4u

Hello sir. I 've read your post and so very interested in your job. I 'm sure I can satisfy you with my ability. I 'm working in part of coding and software developing for over 6 years. Relevant Skills and Experience More

$222 USD in 3 days
(9 Reviews)
4.7
OvaisNazir

Hello, I've reviewed your complete job description, and I fulfill all the qualifications required for this project.i can perfectly scrap e-commerce price comparison websites along with travel websites Relevant Skills More

$30 USD in 3 days
(6 Reviews)
4.5
jaunty77

Hi there, I can do the job in 5 days. Solution: php-curl and simple_html_dom based to scrap html. Using proxies via curl if you think proxies are required. Might be in case some sites block robots. Relevant Skills and More

$400 USD in 5 days
(8 Reviews)
4.2
$250 USD in 3 days
(8 Reviews)
4.2
adilsyed123

Expert here to do and complete this project professionally and quickly, I have done similar projects, I can do trial work before hire me sir , will wait for your reply, Thanks, Syed Relevant Skills and Experience Dat More

$70 USD in 3 days
(13 Reviews)
3.7
MisterWatson

Bid is per site added to the platform. Cron scheduling/mongodb (my website current runs this for Steam user profiles)/proxies are all areas I'm familiar with. As for the individual scraper, I'll be writing a script th More

$250 USD in 3 days
(5 Reviews)
3.3
Gates777

Hello? I am very interesting in your project I have read your description carefully and i can do this in a short time with high quality Please contact me Let discuss more details together on chat Relevant Skills and E More

$111 USD in 3 days
(2 Reviews)
2.1
furqanahmed55

Hello, I graduated from Boston University USA. I have lot of experience with data collection -- collecting complete details in a profile. Relevant Skills and Experience My personal qualities are: - Detail Oriented, More

$150 USD in 1 day
(1 Review)
1.9
goldenstar0406

Hi,dear. I am a senior software developer. I have just checked your project report, I am able to complete this requirement. I am looking forward to your proposal. Relevant Skills and Experience web scraping Proposed More

$155 USD in 3 days
(1 Review)
0.8
Xeeshanah

Hello there, Read your project description and i can provide you the desired software application with functionalities you mentioned. I have previous experience with these sort of application. Relevant Skills and Expe More

$200 USD in 3 days
(0 Reviews)
0.0
radhikatandon

I am putting up an initial estimate of around 10 USD per website. Relevant Skills and Experience web scraping (please check my portfolio) Proposed Milestones $5 USD - Small Sample $106 USD - Upon completion (Negotiab More

$111 USD in 10 days
(0 Reviews)
0.0