SOLR large data indexing help

This project received 8 bids from talented freelancers with an average bid price of $1434 USD.

Get free quotes for a project like this
Project Budget
$250 - $750 USD
Total Bids
Project Description


We deal with huge solr data (huge rows - 10 billion, but only small size - 200GB) We are trying to index it to solr in fastest way from mysql DB.

The solr importer is custom and works very well, and mysql works very well and is not the bottleneck. The issue is is solr does not commit the documents fast enough. it hangs and then stops after 100 million rows.

We can easily get 100,000 rows per second from all parts, apart from the actual submit / index to solr. More information can be found here:

[url removed, login to view]:changehistory-tabpanel

We need urgent help and advice from an expert who has used solr to index these sort of speeds / data before.


Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online