Scrapy Crawler/Scraper (Scrapy Experience Required, Ongoing Work)

Closed Posted 2 years ago Paid on delivery
Closed

I am looking for an experienced python developer who has hands-on knowledge of Scrapy and the Scrapy ecosystem (Scrapyd, Splash, Crawlera, etc...) to build out a large scraping platform (multiple data sources, some used to establish reference data, others used to fetch timely information).

Details of this first phase of the project is contained in the following document:

[login to view URL]

Fetching pages like these:

[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

And extracting basic data, mostly from the page's meta tags.

Looking to get started asap. Please do not respond if you do not have experience with Scrapy.

THIS IS GOING TO BE ONGOING WORK - WHICH IS WHY I POSTED AN HOURLY PROJECT. LOOKING TO SPEND MAX $35/HR. PLEASE INCLUDE IN YOUR RESPONSE YOUR HOUR ESTIMATE FOR THIS FIRST PHASE OF THE PROJECT.

Python Scrapy

Project ID: #32083426

About the project

31 proposals Remote project Active 2 years ago

31 freelancers are bidding on average $30/hour for this job

saubhagyamweb

+++++++++++++++++++++++++++++++++++ Hello There, Hope you are doing well I have checked about your requirements and my skills are a match. I have relevant 5+ years of expertise in Python, Data Analysis, object dete More

$35 USD / hour
(25 Reviews)
6.4
vasilatos80

Hello As you can see my profile and reviews, I have rich experience in development of web crawling automation. Especially have strong skills in bs4, scrapy and selenium for web crawling and automation development. Als More

$35 USD / hour
(15 Reviews)
6.1
tangramua

Hello Thomas G.,   We have 20 years of strong experience in Python, Scrapy, as a result, we can successfully complete this project.   Please, review our profile here: https://www.freelancer.com/u/tangramua Here detaile More

$25 USD / hour
(23 Reviews)
6.1
claudiusanta77

Hello, I have read your job description very carefully and got interested in this project because it fits on my skill stack. As a senior full stack developer, I have rich experience in Python Web Scraping and Crawlera, More

$30 USD / hour
(7 Reviews)
5.3
Sendo77

Hi there, I have 8+ years of professional career as full stack developer in different industries and I am very interested in this position I am very proficient in web scraping and have rich experience with Python, Se More

$30 USD / hour
(3 Reviews)
4.5
mannanmaan1425

Note: I am available to start right now! Dear Hiring Manager, I have read out your job description and the requirements for the job. I am a professional web scraper and having great research sk More

$25 USD / hour
(11 Reviews)
4.1
aliakseidev2

Hello, I read your description in detail. I have experiences at web security and can help you. I am very excited on your project, and I am ready to start work immediately. I have skills: python and Django framework More

$38 USD / hour
(11 Reviews)
4.0
DuskoDjurin

Hello Python Scraping is my main skill. I can deliver a great result to you in a short time. Let's discuss the project in detail. Thanks Dusko

$30 USD / hour
(1 Review)
3.8
victorciobanu999

Hi, I am very interested in your project. I have 10+ years of experience in Python development and I am familiar with python frameworks and libraries like Django, Flask, Panda, etc. And I worked on many scrape projects More

$40 USD / hour
(2 Reviews)
2.4
petko166

I have checked your requirement and that is no problem for me Web Scrapin with python is my main skill. Please look at my profile I will satisfy you by using python. Please send me a message.

$30 USD / hour
(1 Review)
1.9
jframirezr22

$30/40 hours Scraping expert Hello, hope you are doing well. I'm an Data & DevOps engineer with 4 years of experiences. - Building scraping automation system ( 300 sites daily update) - Building trading platform (stro More

$30 USD / hour
(3 Reviews)
2.5
nishitpatelsoft

***Scrapy*** Hello there, Hope you are doing well! I have 5+ years of strong experience as Python Developer. I have expertise with Django, Flask, Python, AI, ML, NLP and Data Science. I am having experience with web More

$25 USD / hour
(0 Reviews)
0.0
makarmatsexa130

Dear, Nice to meet you. I've read your project description and I'm so much interested in your project. I am a senior developer with experience of Scraping in python and node.js I have rich experience of python languag More

$25 USD / hour
(0 Reviews)
0.0
valeriaomeldev

Hello Thomas, I have rich hands on experience in scrapy, until now I have scrapped lots of web sites using python selenium, pandas, bs4...et. I am sure I can do your first Market watch scrape within 15 ~20 hours perfe More

$35 USD / hour
(0 Reviews)
0.0
PandADevelopment

Hello, How are you? I'm a senior software engineer who has over 10 years of experiece. I'm very proficient in Python and very familiar with Scrapping. I'm very familiar with BeautifulSoup, Scrappy to scrap data from we More

$35 USD / hour
(0 Reviews)
0.0
ha9kou

Hello, are you looking for the perfect candidate for your job proposal ? I am a Security Researcher endowed with a great web app pentesting skills and good understanding of the clients' needs. As I consider myself a More

$38 USD / hour
(0 Reviews)
0.0