Closed

solr expert needed for some advice java

i need a SOLR expert to give me 1 hours advice / help solving a problem:

We have an issue with indexing speeds:

we are dealing with huge data (some tables are 3 billion rows) each DB is 1TB all of our tables are in mysql format (MyISAM), we were receiving indexing speeds of 80,000 rows per second from mysql to solr, which was not fast enough. we tested with innodb type and we got 300,000 per second which was great, unfortunately we cannot use innodb. We can use myisam and possible export to another format if the export can happen very fast ? or export to csv for example

we are only dealing with 1 production server and can only use 1 server (2x hexa core, 192gb ram and ssd drives) and we are currently using 3 solr cores.

Need urgent advice,

Thanks

Skills: Apache Solr, Database Administration, Java, MySQL

See more: java indexing, expert advice, solr java, urgent java, urgent - java, java core, Hexa, format java using, mysql tables rows, indexing solr, java server 300, mysql production, csv mysql java, solr urgent, java data mysql, csv data expert, core data mysql, need java expert help, mysql indexing using solr, 300 expert, core java expert, java fast, mysql export csv, export csv java, domainmanuk

About the Employer:
( 41 reviews ) dalts, United Kingdom

Project ID: #4609499

6 freelancers are bidding on average $325 for this job

dennisivw

Hi! Your problem seems to come from MySQL side mostly. Need to setup MyISAM buffers and pre-fetching, it should help. Best Denis

$222 USD in 3 days
(93 Reviews)
6.9
IMSeriousBidder

Hello, I have experience on Solr/Lucene , Let's chat Thanks Bing

$257 USD in 1 day
(74 Reviews)
6.9
aczireonline

BigData Solr, Lucene Expert here. Please let me know the details.

$833 USD in 5 days
(35 Reviews)
4.9
garhwalsatyapal

ready to work with you

$277 USD in 2 days
(5 Reviews)
3.6
vw7317507vw

im expert software develop and system administrator.

$250 USD in 6 days
(0 Reviews)
0.0
mihaiisa

Seems like a a mySQL optimisation problem

$111 USD in 1 day
(0 Reviews)
0.0