Web Scraping Project – PHP/MySQL

This project was successfully completed by iceman8080 for $166 USD in 3 days.

Get free quotes for a project like this
Project Budget
$30 - $250 USD
Completed In
3 days
Total Bids
Project Description

We require individual trader transaction data to be scraped from social trading sites Zulu Trade ([url removed, login to view]) and Ayondo ([url removed, login to view]), and placed into a MySQL database.

Credentials of the MySQL database will be provided once project has been accepted.

There should be one table for data from Zulu Trade and one table for data from Ayondo.

Transaction data on Zulu Trade can be found by going to [url removed, login to view], clicking on the profile of an individual trader, then scrolling down to the bottom of the page. When first scraping the data, we need the complete list of trading data (only last 20 pages are shown on first page of the site). When scraping new data in future, we only wish to add trades that have not already been recorded in the database.

Transaction data on Ayondo can be found by going to [url removed, login to view] and clicking on the profile of a trader, then clicking on transaction history. Again, we need a complete list of data the first time it is scraped, in future we only wish to add new data.

For both platforms, in addition to the columns in the transaction history we will need to add to columns to the left of the data – Trader Name and Trader ID.

For both Zulu Trade and Ayondo, we would like to be able to scrape complete trading history from all traders, however this is likely to require a high number of calls to the sites and so will not be possible in one go. As a result, we will need a logical system to divide traders up to ensure there is no repetition of trades.

Data needs to be further processable in MySQL, so we need everything as strings/numbers rather than images.

- For Ayondo, in the L/S column instead of the up arrows please record ‘Buy’. Instead of the down arrows please record ‘Sell’.

- For Zulu Trade, we require the open/close column to be separated into two columns – an open column, with the top number, and a close column, with the bottom number

- We also require the ‘profit’ and ‘total’ columns to be separated into two. Profit Pips and Total Pips should show the top line (as a number, with the ‘pips’ removed) and Profit $ and Total $ should show the bottom line, also as a number

Examples of how we would like the data presented for each platform can be seen in the attached excel file.

We will want to test whatever you produce thoroughly for accuracy and reliability before releasing payment, so please be aware it may take a few days before we release funds.

Completed by:

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online