Large-scale web-crawler shopping website

We invite bids/ proposals from high-caliber firms/ individuals to build a top-notch shopping crawler website which will extract data from a large number of websites across different geographical locations. The distributed web crawler should be robust, able to crawl dynamic websites, perform very deep crawl and have features such as politeness, scalable in design, optimal freshness etc.

The extracted data will be parsed, indexed and stored in a scalable database for a user to query via website. We are not decided on technical design and architecture so would welcome suggestions/ proposals.

If you have previous experience in building a large scale crawler along with aesthetically pleasing aggregator website with high-volume of products then that’s a huge [url removed, login to view] need to be designed in such way as to maximize affiliate revenue. The design and code should be top class.

Typical skills required will be - strong coding skills (PHP, PERL, Python etc) , database design and architecture (MYSQL etc), Distributed computing, SEO etc

We will work with you and provide specific details in our subsequent contacts.

Skills: Big Data, Cloud Computing, SEO, Web Scraping, Website Design

See more: shopping web crawler, web crawler shopping, scalable website, shopping crawler, website building affiliate code, web design proposals, web design class, web crawler features, web crawler architecture, web-crawler, typical website, top seo firms, top design firms, top coding websites, shopping websites design, seo firms, python web design, optimal design, high volume database, firms website, features of a web crawler, dynamic website with php and mysql, design build firms, deep web websites, database design web

About the Employer:
( 0 reviews ) United Kingdom

Project ID: #4220899

27 freelancers are bidding on average $5129 for this job


Your Shopping Crawler website Project can be easily developed by our 2 very experienced dedicated programmers. Kindly open PMB to discuss your project further and move ahead. Thanks, Sushil

$5000 USD in 60 days
(112 Reviews)

We are focused on large projects, definitely we can have a solution for you, ONLY if you have a fair budget for what you want and you are not looking for a rushed job. Happy to discuss the details with you on skype or More

$25000 USD in 90 days
(100 Reviews)

Freshwebsites is a design and web development company, technology services and branding company. Combining unparalleled experience, comprehensive capabilities across the design and development industry and business fun More

$4500 USD in 50 days
(26 Reviews)

Hello, please check PMB. Thanks!

$5000 USD in 60 days
(14 Reviews)

Hi We are interested in your project and read your requirements.We have completed 150+ big projects in last 5 years. Please check private message board for details.

$3000 USD in 25 days
(36 Reviews)

We have all the required designer and developer you are looking for and can allocate dedicated resources for your project. You will be very happy and satisfied of our services.

$4000 USD in 60 days
(37 Reviews)

Our goal is to exceed the expectations of every client by offering outstanding designs, increased flexibility, greater value in development, thus optimizing system functionality and improving operation efficiency. Our More

$5000 USD in 60 days
(18 Reviews)

I can help in your project, please check PMB and our ratings/reviews to get idea of our experience. Please let me know if you have any queries.

$3000 USD in 30 days
(63 Reviews)

Experienced and serious team specializing in open sources like Drupal, wordpress, joomla, Open Cart, PHP Frameworks like Yii, Zend, CakePHP, CodeIgniter, Seagull, Symfony and more with latest web trends and standards. More

$4800 USD in 75 days
(60 Reviews)

Hello, before I describe why you should hire us and what we can do for you, let me give you a preview of what it's like to work with WB. Our success depends on how successful we make our clients! Right now, we have a 4 More

$8000 USD in 55 days
(5 Reviews)

Hello, Kindly review the PMB wherein we have posted the information about your project. Regards, Sam

$3300 USD in 36 days
(4 Reviews)

Seasoned web scraper. I worked on many similar projects, I have big experience in data mining projects. I can finish this task in short time, with the best quality.

$5000 USD in 30 days
(18 Reviews)

Please see inbox for detail

$5000 USD in 90 days
(7 Reviews)

I have excellent team of programmers and designers to work on your project efficiently and complete job in time. Please let me know when you are available to talk further on this so we can start the work asap.

$4875 USD in 65 days
(28 Reviews)

Hello, Please check PMB, we are team of experienced developer and designer. we can start immediately and deliver fast... regards jas

$3000 USD in 30 days
(9 Reviews)

Hello, I can do this work for you and I'm ready to start. Please see pmb for more details. Regards Raul

$3000 USD in 40 days
(12 Reviews)

Hello, bot expert ready, please check pm

$3000 USD in 15 days
(12 Reviews)

Scraping Experts Here. Check the message and contact us. Scraping samples are also attached.

$4999 USD in 31 days
(6 Reviews)

Hello Sir, I am ready to start. No FAKE promises.We are expert. >>>>>Genuine and Reliable<<<<<< Let us do this for you.We are up for a demo also.Will follow all the instructions. Thanks and Regards :-Karan

$4000 USD in 15 days
(3 Reviews)

Hello, it's a pleasure to meet you. For us is honor to have the chance to introduce our company and the quality we offer to you.

$5000 USD in 50 days
(1 Review)