In Progress

Develop a Automatic data scraping solution (via an API) and a browser extension

SUMMARY

************

1. Automated solution for scraping data from 25 websites

2. Creating an browser extension using the data

3. Providing data insight with use of basic business intelligence tool

DETAIL

******

Help develop a proof of concept for a technology solution:

• Scraping a large amount of data multiple times (minimum 6) every 24hrs from 25 websites

• Comparing the scraped data for changes and showing it in a meaningful way via a browser extension by updating the website in question (think propertylog extensions on chrome)

• Linking information to browser extension (over Chrome, Firefox, android browser [Yandex and Kiwi] and IOS Browser Safari)

The data will need to be linked to a website and be made available. This is PART 2 of the project and will be posted as a separate project.

A good reference example could be these two extensions combined and how they track data, update websites in questions. I recommended that you check them out:

[login to view URL]

[login to view URL]

We will both agree and set deliverable milestones against the full requirements and release payments as we go along. We do not envisage treating this as a ‘Big bang’ delivery and more of a phased approach so this project will require ongoing communication as we develop further solutions based on what you produce.

You MUST be willing to do this as later you will be required to upscale this solution to 100+ websites for data scraping (as part of a new project which will upscaling this work)

*****What do we want****

Someone experienced with:

• Complex Data scraping across multiple website with complex structures and create an internal API based on this data (given similar data being pulled from 25 websites)

* Knowledge of using proxies to avoid being blocked when scraping data

• Development of Browser Extensions changing websites to display additional information

• Someone experienced with developing extensions across multiple platforms (Windows, Mac, Android browsers)

* A basic level experience of Business Intelligence tools

* Ability to work with large amount of data in the business intelligence tool and suggest sensible

dashboards

***Please can you provide examples of the above requirements from your experience ****

Please insert ‘READ IT ALL’ at the top of your bid so we know you have read everything

Further specification will require a signed NDA

Skills: Software Development, Software Documentation, Web Scraping, Business Intelligence, Web API

See more: firefox browser extension, data scraping linux, perl data scraping, parsehub, web scraping python, octoparse, visual scraper, web scraper, web scraper chrome tutorial, web scraping api, web scraping tools open source, data scraping software pfpc, data scraping website using, data scraping vbulletin, data scraping php tool url, php data scraping tool, data scraping php, browser extension java, data scraping etfconnect, data scraping process

About the Employer:
( 8 reviews ) Milton Keynes, United Kingdom

Project ID: #26398318

Awarded to:

anisf919

Respected Sir/Mam! Hope you are fine. It's me Zain here. I am working as a full-stack developer. I m an expert in my profession. I apprehended your mentioned description. I assure you that I will sort out your problem More

$800 USD in 7 days
(1 Review)
0.6

17 freelancers are bidding on average $547 for this job

schoudhary1553

READ IT ALL Hello, I can help you with Develop a Automatic data scraping solution (via an API) and a browser extension I have gone through your job posting and become very much interested to work with you. I am an e More

$500 USD in 7 days
(33 Reviews)
6.3
kirilnberezebko

Hi Fahad. I am a senior web and data scraping script developer with 6+ years of experience. I have worked on several similar projects scraping email address and phone number and specific datas from websites with python More

$500 USD in 3 days
(21 Reviews)
6.0
AHMEDAMER232

Dear Hiring Manager! I'm very confident of your project. I can complete your project in 1 day. 1. My scraping works and experience I have 9 years of experience in web scraping and scraped so many many websites(around More

$350 USD in 2 days
(56 Reviews)
5.3
Guptapuru304

READ IT ALL Hello, my name is Puru. I have 6+ years experience in providing integrated development solutions including web automation and web scraping with industry-grade expertise in python, bs4, scrapy, selenium. I h More

$1500 USD in 7 days
(10 Reviews)
4.9
(7 Reviews)
4.9
Palakash21

I am a full-time Full Stack Freelance having 7+ years of experience and have team working on Web App Developer-Designer (Specialising in CRM, ERP, Ecommerce, Website Developing & Designing, Android Apps, Ios Apps, web- More

$500 USD in 7 days
(4 Reviews)
4.0
arassolenko

Hello Potential Client. I am professional software developer with 7 years experiences of Pandas, WebScraping, Data Mining and Python. I have developed many project including scraping amazon, youtube and twiter. I can s More

$300 USD in 4 days
(8 Reviews)
4.2
mehamednews

I’ll develop an automated web scraping tool to extract all the needed data & provide a dashboard to control and follow up with the process as well as download the data in any format you may need it in (JSON, CSV, EXCEL More

$550 USD in 7 days
(10 Reviews)
4.3
nikhil929

Greeting, We are skilled in Web Scraping, developing chrome extensions and using Business Intelligence tools. We will use Python and Scrapy, and selenium if needed for Web scraping, crawlera for proxy ro More

$500 USD in 7 days
(10 Reviews)
4.3
(1 Review)
3.6
topfreeworker123

READ IT ALL Hi there! I saw your description carefully and I am confident I can full fill your requirement. So I provide my skills in hopes of working with you. I am full-stack developer and I have 5+ years of ample ex More

$300 USD in 7 days
(2 Reviews)
3.2
Venooxpersonal

READ IT ALL Hi, I have experience in dealing with web scraping, APIs and databases. My past projects include a eCommerce website with React as frontend, Node API as backend and MongoDB as database. For API I primarily More

$750 USD in 14 days
(3 Reviews)
3.3
sheikhmateen

Read it all. I am a data scientist but also have extensive experience of scrapping and analysis I am sure i can help you in this task. i have experience in chrome extension development. I have developed many extensi More

$250 USD in 30 days
(1 Review)
1.4
igorchrepanovdev

READ IT ALL Nice to meet you. Thanks a lot for taking your valuable time to read my message. After readout your job description, I am very interested in your project and I believe I’m qualified for this task. I have + More

$500 USD in 10 days
(0 Reviews)
0.0
DataCrops2205

I am pleased to inform you that our offering of Crawling Solutions will be the right solution to comply to your requirement. The functionalities of Scraping / Crawling Solutions is as mentioned below, - Fetch the More

$450 USD in 7 days
(0 Reviews)
0.0
octacer

Hi Sir, Its Hisham. I am a Software Engg. with more than 4 years of market experience. I have developed many web and cloud-based solutions for my clients. I have expertise in many backend and frontend languages which i More

$500 USD in 7 days
(0 Reviews)
0.0