Completed

Database Management System and Python Website Scraper

I need a web based application to perform the following:

Database Management

- View database records and related photos on a multi-million record database

- Store and manage photos associated with database records

- Search database records based on various database fields/taxonomies

- Interface with Python website scraping script (to be built by you - details below)

- Allow database record update via scraping individual website pages/records

- Capable of running on shared host/VPS/Bare metal server

- Database management capable of creating new tables/records based on existing database records.

- Has full CRUD capabilities

- Database needs an secure API for entering CRUD operations

Admins: Can edit database records

Users: Can search database records and mark them as requiring update

Webscraping Script

- Coded in Python

- Multi-threaded

- Scrape individual website pages and multiple pages

- Scrape associated photos on individual pages, label with custom name

- Store results in database

- Have basic error handling capabilities

- Data logging errors during scraping

- Proxy management

Will need to have a discussion regarding what database to use.

Skills: PHP, Python, Web Scraping, MySQL

About the Client:
( 16 reviews ) Portsmouth, United States

Project ID: #34321220

Awarded to:

sapnathakur14

Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP, Python are my major, so you More

$1300 USD in 7 days
(134 Reviews)
8.0

93 freelancers are bidding on average $1219 for this job

r4rony

Hi Have a Blessed Day! I just read your job posting brief that you are a searching for an expert to assist you with making appealing and interactive website. So as we don’t have exact requirement of your project. So More

$1125 USD in 35 days
(216 Reviews)
9.1
(431 Reviews)
8.5
(197 Reviews)
8.1
AzzkaNoor

Hello. Experienced Python Web Scrapper here with 9+ years of hands-on experience in python web scraping and Database Management System. I am happy to mention that I rank in the top 2% among 58+ million freelancers. I a More

$1500 USD in 30 days
(71 Reviews)
8.3
chirgeo

Hi. Can you let me know the website you need to get data from? What I suggest is that we can setup a directus CMS fort you where you will see data and be able todo the managemnet, is that OK?

$1500 USD in 7 days
(150 Reviews)
7.8
(148 Reviews)
7.9
AwaisChaudhry

Hi there! I have read what you exactly need and I have great experience with MySQL, PHP, Web Scraping and Python. However I would like to ask you a few questions. I do work smart and do not rest until I get the job don More

$1500 USD in 13 days
(52 Reviews)
7.5
(71 Reviews)
7.4
(334 Reviews)
7.9
(385 Reviews)
7.3
(146 Reviews)
7.2
(187 Reviews)
7.3
(37 Reviews)
7.0
(103 Reviews)
7.1
mmadi

Dear Daniel M., As you can see my review, I'm expert in MySQL, PHP, Python, Web Scraping So no worry about completing task Let's discuss in detail and start right now I can do this within your budget too $750 - $ More

$1200 USD in 24 days
(50 Reviews)
7.1
(58 Reviews)
7.1
(148 Reviews)
6.7
(32 Reviews)
6.8
saubhagyamweb

Hello Mate, I am pretty sure I can produce high-quality and perfect results for your project. I do have the necessary skill set & resources to complete this project. I’m a Professional and Expert Software Developer ha More

$1125 USD in 7 days
(55 Reviews)
7.1
(221 Reviews)
7.1