In Progress

Web Scraping Project – PHP/MySQL

We require individual trader transaction data to be scraped from social trading sites Zulu Trade ([url removed, login to view]) and Ayondo ([url removed, login to view]), and placed into a MySQL database.

Credentials of the MySQL database will be provided once project has been accepted.

There should be one table for data from Zulu Trade and one table for data from Ayondo.

Transaction data on Zulu Trade can be found by going to [url removed, login to view], clicking on the profile of an individual trader, then scrolling down to the bottom of the page. When first scraping the data, we need the complete list of trading data (only last 20 pages are shown on first page of the site). When scraping new data in future, we only wish to add trades that have not already been recorded in the database.

Transaction data on Ayondo can be found by going to [url removed, login to view] and clicking on the profile of a trader, then clicking on transaction history. Again, we need a complete list of data the first time it is scraped, in future we only wish to add new data.

For both platforms, in addition to the columns in the transaction history we will need to add to columns to the left of the data – Trader Name and Trader ID.

For both Zulu Trade and Ayondo, we would like to be able to scrape complete trading history from all traders, however this is likely to require a high number of calls to the sites and so will not be possible in one go. As a result, we will need a logical system to divide traders up to ensure there is no repetition of trades.

Data needs to be further processable in MySQL, so we need everything as strings/numbers rather than images.

- For Ayondo, in the L/S column instead of the up arrows please record ‘Buy’. Instead of the down arrows please record ‘Sell’.

- For Zulu Trade, we require the open/close column to be separated into two columns – an open column, with the top number, and a close column, with the bottom number

- We also require the ‘profit’ and ‘total’ columns to be separated into two. Profit Pips and Total Pips should show the top line (as a number, with the ‘pips’ removed) and Profit $ and Total $ should show the bottom line, also as a number

Examples of how we would like the data presented for each platform can be seen in the attached excel file.

We will want to test whatever you produce thoroughly for accuracy and reliability before releasing payment, so please be aware it may take a few days before we release funds.

Skills: MySQL, PHP, Software Architecture, Web Scraping

See more: web platforms scraping, scrolling table, scraping the web, scraping data from web database, new line in php, mysql database buy, is php web scraping, com profile php id, mysql top 10, web scraping excel, transaction history, profile trading, excel file mysql, php add record mysql table, mysql add record, excel add strings, database project php, web scraping table data, scraping web data excel, web performance profile, add clicking project, trading result, scrape data mysql, trader will trade, funds trading

About the Employer:
( 30 reviews ) Croydon, United Kingdom

Project ID: #5215866

Awarded to:

iceman8080

Hello again, they sent me an email, I suppose because I did a job for you before . Sure I believe this is possible - I can see that there is a web service that will give the hidden information on those sites. But it More

$166 USD in 3 days
(8 Reviews)
3.5

21 freelancers are bidding on average $223 for this job

buraqtech

1. Crowd Funding Site In these days we are already near to finish a full CMS based crowd funding site which is a clone of kickstarter but we implemented many unique features in this project to distinguish it from kic More

$242 USD in 7 days
(98 Reviews)
8.0
srinichal

I am an expert in scraping and crawling, willing to discuss further about the project specifications and needs

$252 USD in 6 days
(183 Reviews)
7.7
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$230 USD in 5 days
(297 Reviews)
7.4
virtual7

Hello I will do it properly and will not require any payment until it is 100% done. Upon the first start a script will scrape all trades of all traders from those sites. In the future it will scrape only new da More

$395 USD in 5 days
(115 Reviews)
6.6
ranjitsingh90

Hi, Allow me to work for you, I have considerable amount of experience in web scraping. I will deploy a web program which will automatically scrape data for you. Kindly message me to discuss things further. Thank More

$200 USD in 3 days
(80 Reviews)
6.5
sstechwebindia

Hello There, We have 7 Year experience in this field... We have more than 50 excellent experience team in my company... offering you very cheep rate with sure result... so please give us a chance to start our b More

$257 USD in 10 days
(76 Reviews)
6.0
gahlotkrishan

Hello Sir, I'm expert in automated bot development using microsoft c#. I'm having 5+years experience, 5 star ratings & 100% completion rate here. I can even develop a demo version and show you if you want. Plz let More

$222 USD in 6 days
(35 Reviews)
5.7
developerphp2007

Hi......I can complete your project 100% perfectly, please check my past completed projects I worked only on scraping, so your project very easy for me, I will give you 100% perfectly what you want, please send me a me More

$300 USD in 15 days
(42 Reviews)
5.7
Perfexus

Hello, Greetings! We went through your project description and came to the conclusion that this project has four parts. First, database creation, second, web scraping and data entry from Zulu and Ayondo , third, back More

$277 USD in 5 days
(1 Review)
4.7
mohidkhan

Hi, I am professional Programmer & designer of Front end & Back end, I am working with challenge and hope to improve future plan with good network every client. If you want to get more faster job services with save ti More

$144 USD in 3 days
(7 Reviews)
4.6
malakoder

A proposal has not yet been provided

$360 USD in 3 days
(10 Reviews)
4.8
sunsriinfosys

Hi, I have over 13 years of Experience in software design, development and implementation of various commercial applications in Client/Server environment, Web and ERP applications using C# 1.1/2.0/3.5, ASP.Net, VB.N More

$222 USD in 10 days
(20 Reviews)
4.4
LuisMa

The type of work described by you is within my skills. I am very interested to assist you in your programming needs.

$250 USD in 10 days
(4 Reviews)
4.3
sweetoasis

A proposal has not yet been provided

$247 USD in 7 days
(3 Reviews)
3.6
Superteam786

hi, i can do this job, Expert in web scraping, data mining, have quality softwares, i have many samples i can show [url removed, login to view] in your project..please reply.

$55 USD in 3 days
(33 Reviews)
3.7
gopalv84

I have 5.5 years of experience in scraping information websites using PERL script and loaded directly to database or EXCEL or as CSV file. I can do this job for you. I can provide you sample data if you need. More

$155 USD in 3 days
(7 Reviews)
2.9
mkhalelulah

A proposal has not yet been provided

$50 USD in 3 days
(7 Reviews)
2.5
ed1108

A proposal has not yet been provided

$330 USD in 14 days
(0 Reviews)
0.0
koketsoalb

A proposal has not yet been provided

$155 USD in 3 days
(0 Reviews)
0.0
sapchaadam

Hi, I can do it using CURL and a php script that will store results into your database. I already did the similar work. Contact me for more informations Regards

$177 USD in 3 days
(0 Reviews)
0.0