SOLR large data indexing help
This project received 8 bids from talented freelancers with an average bid price of $1434 USD.Get free quotes for a project like this
Project Budget$250 - $750 USD
We deal with huge solr data (huge rows - 10 billion, but only small size - 200GB) We are trying to index it to solr in fastest way from mysql DB.
The solr importer is custom and works very well, and mysql works very well and is not the bottleneck. The issue is is solr does not commit the documents fast enough. it hangs and then stops after 100 million rows.
We can easily get 100,000 rows per second from all parts, apart from the actual submit / index to solr. More information can be found here:
[url removed, login to view]:changehistory-tabpanel
We need urgent help and advice from an expert who has used solr to index these sort of speeds / data before.
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online