.onion websites crawler

$250-750 SGD

In Progress

Posted

almost 5 years ago

$250-750 SGD

Paid on delivery

There are 4 main component for this project Crawler 1- Crawls http and look for new Tor sites link 2- Crawls Tor sites and look for new Tor link 3- Import tor url from txt file 4- Save url in to the database Scraper & Indexing 1- scraping the Tor website which identified during crawler and index the keywords 2- Save Index data in to the database 3- Index any keywords Presentation and Visualization 1- Data must be Integrated Elasticsearch & Kibana 2- Multiplier user login on Kibana - Using keycloak 3- Search Box , in order user to search for index data 4- Present search result Other details 1- Finds email addresses across hidden services 2- Finds bitcoin addresses across hidden services 3- Shows incoming / outgoing links to onion domains 4- Up-to-date alive/dead hidden service status 5- Automatic language detection Prefer tools to be use 1- Linux 2- Scrapy 3- Elasticsearch and Kibana 4- MySQL

Project ID: 20488897

About the project

13 proposals

Remote project

Active 5 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

13 freelancers are bidding on average $560 SGD for this job

@bestit4u

Hi. I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and smart technic with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others). Especially, I am an expert in betting project and gambling games and sites(oddsportal,bet365, bwin, pinnacle, betfair...) ,,, shopping auto buyer(adidas, footlocker, eastbay, supreme and etc) So, I can solve the captcha automatically. Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.

$500 SGD in 7 days

4.8

(98 reviews)

7.0

@developer2581

We can take your work for fulltime, as we can provide you with the dedicated react native developer for your project. We are ready to start as soon as we discuss the details. We can provide you with the quality remote work and developer would update you the task details every day. We have a team of experienced designers and developers who would provide you exactly as per the requirements. We are ready to start as soon as we discuss. We will provide you with the daily progress of the work done. Please check our freelancer profile for our past work and experience. I hope that our experience would provide you with better services saving your time. It would be great if we can discuss more details over the freelancer chat. Looking forward to your response.

$500 SGD in 7 days

4.7

(28 reviews)

6.1

@pandread1

Greeting Singapore, I have experience Web Crawling/Scraping and I find your project very interesting because it involves Tor scraping. It is a good idea. I would like to work for this project no matter how long it takes. The only point that I might find some difficulty is using Elasticsearch and Kibana because I am not used to these technologies. However, I think they are highly documented and guided process. Please get in contact with me to discuss in more detail, MPA

$750 SGD in 12 days

4.9

(17 reviews)

5.2

@bhavesh1508

Hello, I can do the job EASILY, please send me a message so we can discuss more in detail. Thanks!

$500 SGD in 7 days

5.0

(6 reviews)

4.2

@jain602

Hi, I will provide Complete SEO for your website it will improve keywords ranking on Google. I will do complete SEO on-page optimization and off page optimization using white hat method. Within 1 month you will see keywords and traffic improvement and within 3-4 months your keywords in Google 1st page. I am well versed in SEO, Digital Marketing, Internet Marketing and SMO having more than 6 years’ experience. I have done SEO work successfully in many websites locally and globally. I only follow WHITE HAT SEO methods to optimize a website so we can get the best result for a long time. Let’s start discussion for strategy & process over Chat. Waiting for your response. Thank You

$555 SGD in 5 days

5.0

(2 reviews)

2.2

@ncm1978

__ Awaiting for your response!__ Dear Prospective Manager, Greetings! I have gone through your job description and understood it well, Kindly initiate the chat and let's discuss for start this project right away. Looking forward to a positive response! Thanks & Best Regards, Nemi M

$250 SGD in 12 days

2.5

(2 reviews)

3.0

@suvenduswarnokar

I have 8 years of experience on Python web crawling. I can complete your requirements in minimum amount of time.

$250 SGD in 5 days

0.0

(0 reviews)

0.0

@DrumSergio

I find this project really interesting, I have a quite long experience on scraping and Python, along with all the preferred tools you have mentioned. I find myself really prepared for this project and I have a high motivation on finishing it as soon as posible.

$1,620 SGD in 21 days

0.0

(0 reviews)

0.0

@Nahid71

Hey, I am experienced with all the 4 components of this project. I am a Python developer. I am working with Python for the last 4 years. I develop some awesome project using Python scraping framework scrapy. I will develop a bot for automating the 1st two steps of this project (crawling and scraping). furthermore, if you want I will build all the components in a docker image so that you can deploy this project easily in any hosting platform. If you think

$500 SGD in 7 days