We require individual trader transaction data to be scraped from social trading sites Zulu Trade ([url removed, login to view]) and Ayondo ([url removed, login to view]), and placed into a MySQL database.
Credentials of the MySQL database will be provided once project has been accepted.
There should be one table for data from Zulu Trade and one table for data from Ayondo.
Transaction data on Zulu Trade can be found by going to [url removed, login to view], clicking on the profile of an individual trader, then scrolling down to the bottom of the page. When first scraping the data, we need the complete list of trading data (only last 20 pages are shown on first page of the site). When scraping new data in future, we only wish to add trades that have not already been recorded in the database.
Transaction data on Ayondo can be found by going to [url removed, login to view] and clicking on the profile of a trader, then clicking on transaction history. Again, we need a complete list of data the first time it is scraped, in future we only wish to add new data.
For both platforms, in addition to the columns in the transaction history we will need to add to columns to the left of the data – Trader Name and Trader ID.
For both Zulu Trade and Ayondo, we would like to be able to scrape complete trading history from all traders, however this is likely to require a high number of calls to the sites and so will not be possible in one go. As a result, we will need a logical system to divide traders up to ensure there is no repetition of trades.
Data needs to be further processable in MySQL, so we need everything as strings/numbers rather than images.
- For Ayondo, in the L/S column instead of the up arrows please record ‘Buy’. Instead of the down arrows please record ‘Sell’.
- For Zulu Trade, we require the open/close column to be separated into two columns – an open column, with the top number, and a close column, with the bottom number
- We also require the ‘profit’ and ‘total’ columns to be separated into two. Profit Pips and Total Pips should show the top line (as a number, with the ‘pips’ removed) and Profit $ and Total $ should show the bottom line, also as a number
Examples of how we would like the data presented for each platform can be seen in the attached excel file.
We will want to test whatever you produce thoroughly for accuracy and reliability before releasing payment, so please be aware it may take a few days before we release funds.
21 freelancers are bidding on average $223 for this job
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
hi, i can do this job, Expert in web scraping, data mining, have quality softwares, i have many samples i can show [url removed, login to view] in your project..please reply.
Hi, I can do it using CURL and a php script that will store results into your database. I already did the similar work. Contact me for more informations Regards