i need a SOLR expert to give me 1 hours advice / help solving a problem:
We have an issue with indexing speeds:
we are dealing with huge data (some tables are 3 billion rows) each DB is 1TB all of our tables are in mysql format (MyISAM), we were receiving indexing speeds of 80,000 rows per second from mysql to solr, which was not fast enough. we tested with innodb type and we got 300,000 per second which was great, unfortunately we cannot use innodb. We can use myisam and possible export to another format if the export can happen very fast ? or export to csv for example
we are only dealing with 1 production server and can only use 1 server (2x hexa core, 192gb ram and ssd drives) and we are currently using 3 solr cores.
Need urgent advice,
Looking to make some money?
- Set your budget and the time frame
- Outline your proposal
- Get paid for your work
Bids on this Project
High-quality, cost-effective IT outsourcing services.Expert in Linux,mysql,java,apache,tomcat,ngnix and web server as well as application server
I am a professional developer for Java/J2EE, Android projects.I have 11 years experience on Java/J2EE programming,5 years experience on Android programming. I have a Master degree in CS (in 2006)from a Top5 China university.I have 6 years working experience as a senior Java developer/architect in a Fortune 500 company. I have implemented 80+ projects , including eCommerce websites,CMS,Automation tools,Web scrapers,Android book reader,GPS based apps etc. I am proficient in following technologies: 1.Mysql,Oracle. 2.Tomcat,Apache,JBoss,Glassfish,Websphere 3.Jsp/Servlet,JDBC JMS,Spring,Hibernate,Struts,JFace etc. 4. Android SDK,GPS,Google Map etc 5.Linux/Windows platform your demands, our supplies; your satisfaction, our destination!
Professional Developer for the past 8 years. Hand-on experience in Windows programming, using VC++, C#, VB.net Expert in JS, PHP, Oracle, MySQL, SQL Server and Stored procedures. Experienced in Linux/*nix System Programming and Networking Solutions, Backup and Restore Custom Solutions. Security Systems/Programming. Well versed in Distributed Systems/Programming using Hadoop, HBase, MapReduce, Hive, Pig, Hue, Oozie, Quartz, Cassandra. Expert in Network & System Security, SQLInjection, XSS, LFI, RFI, Malware, Rootkit, SDLC, Exploit Development, Metasploits...