This project is to build a price comparison website using web crawlers. You need to have good skills in web crawling and a strong knowledge of Java and data objects. The work involves only crawling and data loading.
Essential skills - Java knowledge, Eclipse, JSoup, including OO concepts, reflections, classes, instances.
You also need skills in SQL and Mongo DB which are used to store the data.
You need strong skills in Ubuntu too. An understanding of e-commerce would be useful.
There are several hundred websites to crawl and therefore you should be able to work on a number of websites and work quickly. The sites are all e-commerce based.
All the work is currently in batch so no online queries are needed in the systems.
Please reply if you have all the above skills.
6 freelancers are bidding on average $12/hour for this job
hi i have strong knowledge about following core-java jsp , servlet , struts , hibernate JBOSS , eclipse SQL server , MySQL so if u will consider me as candidate