Project Description:
I am posting down the essential project requirements down under. Will be discussing things in detail with right person.
- Need a web crawler to gather data on an continous basis from different file hosting services and filter it.
- Data will be used to provide a files search engine to users. A similar example I can think of can be www.filestube.com. Don't want a clone of this website but infact something better than this one.
- Process of data gathering will be a continous process and will be running on the servers 24x7.
- Data should be properly filtered to erase duplicate enteries and new enteries of the same data should merge.
- Both frontend and backend applications are required along with design.
- Website should be fully responsive. Should work properly on all screens and devices.
- More details or basically in-depth project details will be given to the right person.
I can think of LAMP as the best environment for this application but your suggestions are welcome. I will only entertain people who don't send generic bids and would prefer to work with a person / company with a strong portfolio.