We are trying to build the biggest job site online. I am looking to hire a full time employee to
scrap all of the jobs from the internet. Yes the internet. Every job site online you must scrap
and get job description/ job title/ job salaary / job location. So you will get as much detail as
possible from each job site and put it into an xml or mysql database. To start I need you to study
[url removed, login to view] ,that site is like a search engine for jobs if you type in manager jobs you will see
lots of sites listed that has manager jobs. It searches every site and puts all of the jobs there
so first i need you to scrap this site. I need you to write a server based software that will go
to the site and take the jobs you have to go into each individual site or figure out how to do it.
I want every detail from each job divided into different section. So job title/ desceription /
salary /location anything that it has i need you to break into different section. You can look at
the RSS feed as well . So you ahve to write a script that will go through every section.
Now this is for full time employee. To start I will pay you $12 per day * 6 days a week * 4 weeks
a month = $288 per month every month. So I want to hire you to join the team and after we are done
with indeed we will move to another site.
This software must not be windows based it must be linux base becuase it must run on a server. And
i need it to be able to scrap milliosn of jobs. Before I hire you please answer all of the
questions below. After I hire you I will pay you every week and $288 every month.
1. please study [url removed, login to view] very well and tell me how you can get ALL 50 million+ jobs from indeed
2. Please study indeed RSS feed and tell me if you can use that
3. what programming language are you going to program this in?
4. indeed is like a search engine, if you go there and type in manager jobs it list all of the
sites that offer manager jobs and i need you to go into each individual site and scrap the job
title/salary/description/ etc.. i need you to scrap all that info from each site. I do not want
just the site url i need you to go into each specific site and scrap it let me knwo if you can do
5. is this going to be desktop application or can it run from a linux server?
6. i need it to scrap 50 million records from indeed can you do it?
7. how long would it take to scrap 50 million records?
8. what is the largest number of data you have scrapped and from what web site?
9. why do you think i shoudl pick you over other scrappers?
[url removed, login to view] can work any hours you want but you must work 8 hours total per day and send me daily report on what you did if you can please let me know
[url removed, login to view] have to be able to take all fields for each job first/ last name, salary, job descipption , job title every detail you have to take so study indeed before you let me knwo.
12. the site we will be posting info on is [url removed, login to view] so please study both site [url removed, login to view] and [url removed, login to view] and see if you can get it done.
13. indeed has millions of jobs on their site are you able to scrap every job on their site?
14. what if they ban your ip how can you fix this?
15. Can you work full time or just part time?
16. what is the biggest site you have scrapped and how many data have you gotten?
Please ansewr every question above
... so I can pick you and we can start.
Please bid $30 for the first 2.5 days of work and answer all questions above 1 by 1 to start the project.
7 freelancers are bidding on average $169 for this job
I would like to inform you that We have a very good team having sound knowledge in Programming, Databases & Web technologies. Our perl and database experience is 3+ years. We want to work on this project.