We're looking for a scraping/crawling engineer to join full time our 3-people Crawling team for a 3-month period.
This team is responsible for extracting information from thousands of websites every day. Due to constant changes in some of these websites, a number of our extractors break every day, so we need to continuously adapt them. We also need to continuously create new extractors for new sources.
Our tech stack: scrapy + Selenium. We use JIRA for the management of tasks.
- fluency in English, both written and spoken
- scraping/crawling experience (3+ years) using scrapy + Selenium
- python programming experience
- experience with online services, such as AWS and Cloudera
Please apply only in case you're an individual (i.e. no agencies) interested in joining the team full time for the next 3 months. Links to GitHub projects that you've developed in the past and any other references will be much appreciated.
A technical interview will be conducted before awarding the job.
33 freelancers are bidding on average €17/hour for this job
Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I hope to work with you!