i need a SOLR expert to give me 1 hours advice / help solving a problem:
We have an issue with indexing speeds:
we are dealing with huge data (some tables are 3 billion rows) each DB is 1TB all of our tables are in mysql format (MyISAM), we were receiving indexing speeds of 80,000 rows per second from mysql to solr, which was not fast enough. we tested with innodb type and we got 300,000 per second which was great, unfortunately we cannot use innodb. We can use myisam and possible export to another format if the export can happen very fast ? or export to csv for example
we are only dealing with 1 production server and can only use 1 server (2x hexa core, 192gb ram and ssd drives) and we are currently using 3 solr cores.
Need urgent advice,