I'm in need of a multi threaded web crawler to crawl the net indexing mp3 files.
It can be done in either Python or C#, whichever you find would be best for the job.
It needs to be highly efficient, and you need to structure the database to hold large amounts of information (hundreds of thousands of songs, potentially millions) efficiently without killing the server. You'll have to figure this out.
The crawler will also have to run the songs through getid3 (to get the name, artist etc) and / or analyze the page from which it gets the song to potentially the song information.
I DONT want people messaging me saying they have an mp3 search engine script that just uses sources, thats NOT what I'm looking for. I need an advanced python or c# programmer to code a crawler for me.
Message me for further details and or if you have any questions.
29 freelancers are bidding on average $1075 for this job
I have a lot of experience with web crawlers. Please see PMB for examples of my previous web crawlers project. Will use Python. Please contact in PMB to discuss details.