Data acquisition & API development

The scope of this project is to build a data services system that will gather data from a website, and then make that data available to third-party clients through an API. Gathered data will also need to be archived in a data warehouse for future use. Finally, an automated process will need to be developed that automatically navigates through an online reservation system at regular intervals to determine if reservations are being accepted (this is only revealed online at the end of the reservation process workflow).

There are 4 primary deliverables in this project:

1. Web scraper to acquire data from a marine transport website

2. Custom-built API to deliver acquired data to third-party clients

3. Data warehouse to archive all data acquired by the web scraper

4. Automated process to determine reservation availability and make that availability known to third party clients through the API

There is a spec available with complete details, and I will be fully available to help with requirements understanding.

Technology choices are flexible and I will accept recommendations with rationales.

Skills: MySQL, PHP, Python, Software Architecture, Web Scraping

See more: web development the netherlands, freelancer consultants fortcp ip data acquisition on web server in delhi, development the world wide web, data acquisition meaning, data acquisition hardware, data acquisition system basics, data acquisition system ppt, data acquisition software open source, types of data acquisition system, data acquisition system block diagram, data acquisition system applications, php, mysql, software architecture, python, web scraping, programming, asp net web api development, find and write the food words 1 a glass of water 2 a bowl of 3 a bag of 4 a can of 5 a plate of, php data via api web

About the Employer:
( 1 review ) Victoria, Canada

Project ID: #15661018

60 freelancers are bidding on average $2721 for this job


Hi i am good API and Data analysis development....i just need to understand the logic or any algorithm for this to design accurate API and database structure...let me know if you want discuss more Relevant Skills and More

$2938 USD in 45 days
(164 Reviews)

Greetings !!! We are interested to complete 4 primary deliverable in this project. We have10 years old expert PHP developer who can complete your requirement well. He is excellent expertise in architecture building, More

$2500 USD in 30 days
(287 Reviews)

Hi, At 1st the data will be fetched from another sites and then they will be stored in database. After that we need to develop API which could used by 3rd party users in order to have data from our site. NOTE: In More

$3609 USD in 54 days
(502 Reviews)

Hi, thanks for posting the job and we're very confident to do this project for you. We'd like to have detailed discussion on this before move forward. We provide lifetime free support for our work. Relevant Skills and More

$6030 USD in 60 days
(410 Reviews)

I have reviewed project details, we can build your reservation system successfully. We have great expertise in web scrapping, apis integrations, developing and customizing custom APIs, cron jobs, etc. Relevant Skills More

$3000 USD in 30 days
(184 Reviews)

Greetings!!   800+ satisfied clients in different business verticals.   We at AIS Technolabs are 100% recommended with 5.0 rating due to our excellent client support and delivery perfection. With over 5 years' expe More

$4381 USD in 30 days
(81 Reviews)

Dear,I am Gang Lee in China. I’m interested in the project you recently posted. I'm a certificated freelancer with over 850 good reviews from clients. I have experienced knowledge in every part of Web development. More

$2577 USD in 30 days
(672 Reviews)

Hi Good Day, I am an Web and API envelopment expert I have developed many medium and large scale applications successfully. I have worked Rest , SOAP API development. Relevant Skills and Experience I have used Basic More

$1736 USD in 21 days
(1031 Reviews)

Hi, I have checked your requirement where we need to scrape data from website and make data to third-party clients through an API. **PLEASE SHARE FULL SPEC FOR THE PROJECT SO WE CAN MORE CLEAR AND LINK WEBSI More

$2000 USD in 30 days
(174 Reviews)

Hi, I have read your post and understood your requirement. Looking for the freelancer to work on your next project? Or just need some issues/bugs/fixes ASAP? I have 8+ years of experience and I'm here for you! My More

$2555 USD in 30 days
(109 Reviews)

Hi, To gather data from other websites we have to scrap the data and then we will develop the api to give the service to access to the data. Upon which framework you want to build it ? Relevant Skills and Experienc More

$1666 USD in 30 days
(386 Reviews)

Hi There, Hope you are doing good. We will develop your system. Let's discuss once all about this system. Relevant Skills and Experience Software Development Proposed Milestones $2000 USD - step by step

$2000 USD in 30 days
(29 Reviews)

we have read your detail requirements about to create API and we are ready to start it. Relevant Skills and Experience General Ecommerce [login to view URL] [login to view URL] PrestaShop [login to view URL] http://inkp More

$1915 USD in 30 days
(73 Reviews)

need to know the site , and data you need to acquire and transmit. Relevant Skills and Experience well experienced in web scraper and api programming Proposed Milestones $1500 USD - to be discussed

$1500 USD in 30 days
(153 Reviews)

Hi Mark here, this sounds like a​n​ interesting project​ and​ I hope we can make some time to discuss this​. Relevant Skills and Experience We have long experience in this type of projects and we currently work for th More

$5944 USD in 60 days
(26 Reviews)

Hi, An upscale infrastructure of 8000 Square feet accommodating a team of 150+ in Pune, India. Our flexible onsite and offshore model helped us in scaling our reach & serving global clientele. Relevant Skills and Exp More

$2500 USD in 30 days
(23 Reviews)

Dear Sir/Mam, I would like to work on your project as I've proven experience of working on the APIs in PHP as well as in nodejs. Please let me know which platform would you prefer to write and API on Relevant Skills More

$2777 USD in 50 days
(47 Reviews)

Dear, Client. How are you? As a professional web developer, I have deep knowledge in PHP, MySQL and javascript for Web development. Preferred frameworks and libraries are Laravel, CodeIgniter, Bootstrap, jQuery and Ang More

$2500 USD in 30 days
(32 Reviews)
$2500 USD in 30 days
(14 Reviews)

Hello, I have very big experience in this area and ready to develop this system. Idea looks clear. Relevant Skills and Experience php, mysql, data scraping, api Proposed Milestones $833 USD - begin work $2500 USD - e More

$3333 USD in 30 days
(412 Reviews)