Closed

Build me an automatic data gathering machine

I need an automatic gathering machine, the project is about getting stock data from Yahoo, the machine should be in python language and work with AWS (Amazon web server) as the process should be automatic.

the process is easy I should give the program a CSV file with the columns date, symbol, Open, High, Low, Close, Adjsuted close, Volume, amc/bmc (which I will refer later).

1. the program will access the CSV file and pull the stock symbol and enter it in this URL: [login to view URL]"Stock name goes here!!"/history?period1=1178139600&period2=1555102800&interval=1d&filter=history&frequency=1d

(inside the page where it says "Time Period:" should be on MAX.)

[login to view URL] go back to the CSV pull the date and search for it on the web page. then when found scrape the "open, high, low, close, adj close, Volume" and implement it back on to the CSV. (if needed create a new CSV file with the same columns).

3. if the stock got amc at the "amc"/"bmo" column then search for the day after the date that was given and repeat step 2. if the stock got bmo then search for the day before the date that was given and repeat step 2.

**possible errors on the Yahoo page there sometimes a duplicate of the date anted as one date have no info for it only says "Dividend". in that case search for the correct date/

Skills: Amazon Web Services, PHP, Python, Software Architecture, Web Scraping

See more: mturk jobs, how to build a data pipeline, amazon mechanical turk login, data pipeline tutorial, how to get started on amazon mechanical turk, amazon mturk worker, amazon mechanical turk job, amazon mechanical turk pay, research data gathering, automatic data entry table using javascript, data weight machine using vbnet, site data gathering, data gathering web site design, products data gathering, data gathering lists outsourcing, automatic data harvesting, data gathering skill, data gathering skills, online data gathering, build telephone data base

About the Employer:
( 0 reviews ) Herzlyia, Israel

Project ID: #19228923

15 freelancers are bidding on average $14/hour for this job

bianyunzhi95

I hope to see you in chat. I am an experienced python scrapy developer with full-stack knowledge and career. I'm sure I can do this perfectly. Thanks for your kind attention.

$25 USD / hour
(88 Reviews)
7.1
YuKai7777

Hello Sir, I’m Professional Web Developer & Programmer. I've skills and proven record in PHP (Laravel, Yii, Codeignitter), JS (React, Angular, Node) , Plugin development & API integration. I read through the job de More

$20 USD / hour
(36 Reviews)
6.5
schoudhary1553

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. More

$15 USD / hour
(84 Reviews)
6.7
Bluesky122

Dear employ. I am Guicai Y. I have saw your description and bid your post now. As you can see my profile I am web scraping expert and I have more experience about web scraping. Before this post I have made more pro More

$12 USD / hour
(39 Reviews)
6.0
hassanalvi95

Hi sir, I am expert in scrapping data and made scrappers for Amazon, eBay, Adidas, and Nike. I made successful scrappers which are running 24/7 and downloading data for my clients. I need some more information from yo More

$12 USD / hour
(37 Reviews)
5.6
limillion819

Hi there. I am very interested in your proposal. I can instantly help you with your starting project with successful completion. As a professional software developer, I ensure for a perfect ongoing project. You wil More

$16 USD / hour
(18 Reviews)
5.6
kkc264043kkc

have already scraped Yahoo finance. can do your job. can build python tool and can scrape data . can deploy it over aws These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantom More

$14 USD / hour
(34 Reviews)
5.1
smsaurabhv

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO More

$8 USD / hour
(46 Reviews)
4.9
ChineseJin

Hello Dear! I read your project proposal carefully and understood clearly what you want. I am high skilled and rich experienced for your project.. If you want I can show you my skill and my past works to confirm my More

$12 USD / hour
(14 Reviews)
4.4
vorasiddh4it

We have 11+ years of experience in software development. We have developed 400+ projects and the research paper in the field of Machine Learning, Artificial Intelligence and Image processing (GIS), Network, SEO based W More

$15 USD / hour
(12 Reviews)
4.6
tanishasharma

Hi How are you? As a 10+yrs exp developer, I understand your project best and can deliver solution according to need. Our recent, project- E-commerce platform,with custom CMS [login to view URL] A p More

$12 USD / hour
(6 Reviews)
3.1
BoyVit85

How are you. I am expert web scraping. I can do your job with BS4 and Seleinum framework of python. Credit is my motto. I can complete your project on time and within your budget. I have worked on similar project More

$12 USD / hour
(7 Reviews)
3.0
cliffstats

Hello? I am a Data scientist with over 5 years experience in using python for web scrapping, data analysis, visualization and modeling. I can provide intuitive python code for machine learning and deep learning problem More

$12 USD / hour
(5 Reviews)
3.1
Lindawebdev

Hello client. I have read your project description and very interested it. I am an experienced and dedicated web scrapping developer who guarantees hard work, quality and perfection. As a professional freelancer, I More

$12 USD / hour
(1 Review)
0.6
kaptanmajere

I have already made a webscraping project for stocks and I am experienced with it.I can make this happen quickly.

$11 USD / hour
(0 Reviews)
0.0