Closed

Web Scraping

Hello,

This mini project is in 2 steps:

- First of all, it is a question of retrieving the first XX (50 to 100) URLs (FR in a first step) in Google for specific keywords (possibility to use proxies)

- In a second step, it will be a question of scrapping the urls obtained via Google in order to extract the specific content by excluding any menus, footer, etc in text form.

The output file should be plain text, 1 sentence per line.

The script must be able to run on Linux (scrappy framework?).

Thanks !

Skills: Web Scraping, Data Mining, Data Scraping, Scrapy, Data Extraction

See more: web scraping visual basic, web service send file j2me, web form output xml file, php extract content web page, web scraping download file, extract content web site word, extract content web pages, extract content web site, perl extract content inside tag html file, read web content extract content, web scraping rip content, web scrape extract content, web scraping pdf file, excel vba file web scraping getting result site, python web scraping ajax content, web scraping content extraction, Web scraping, content spinning and data entry -- 2, python web scraping dynamic content, download file using web scraping c#

About the Employer:
( 4 reviews ) Pessac, France

Project ID: #21606377

42 freelancers are bidding on average €150 for this job

mantislin

Hi there, This is Lin, Can we discuss more details about your project? then i can do example data or script for you, we can continue after you checked example data. I did more than 380+ scraping project, please view More

€163 EUR in 5 days
(295 Reviews)
7.6
zekovicm

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the More

€175 EUR in 4 days
(102 Reviews)
7.3
mirniyazuddin92

Hi there, I can scrap those websites. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

€150 EUR in 5 days
(200 Reviews)
7.5
mhmhz

Hi I have a tool that retrieve sites domains from google, then fetch the phone/email from each site. Thanks

€300 EUR in 7 days
(92 Reviews)
7.5
chirgeo

Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do More

€180 EUR in 5 days
(48 Reviews)
6.9
uumarkhalid31

​I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete t More

€150 EUR in 4 days
(251 Reviews)
7.2
devi222

Hi Sir, Scrapy will not be suitable for google, only Selenium is best otherwise frequent blocking even you use proxies. Im a Python Programmer. I have created many Bots to scrape the websites like Google, Alibaba(suppl More

€250 EUR in 3 days
(137 Reviews)
6.8
DeepSyaal

Lets start. Having a team of Professionals. We provide high quality work with accuracy. Would you like to discuss more about your current requirements?

€125 EUR in 7 days
(196 Reviews)
6.5
asifdwan

Hi there! I've read the project details and ready to start it right away. I'm an expert in data entry and data scraping jobs. I have huge experience in working on this type of projects. Look forward to hearing from yo More

€250 EUR in 3 days
(174 Reviews)
6.7
mananraja

hey, I can make this tool using PYTHON to do 1) search by keywords on google and 2) filter them based on criteria. I would love to talk more about this in chat.

€70 EUR in 1 day
(133 Reviews)
6.2
schoudhary1553

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Pl More

€250 EUR in 4 days
(29 Reviews)
6.0
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

€111 EUR in 3 days
(66 Reviews)
5.4
Seeniea

Hello Sir. I'm python scraping expert, I can do it. Let's work together I can show my demo to you. Thanks.

€200 EUR in 3 days
(5 Reviews)
5.0
raminde

Hi we can create a scrapper for google, and provide u with the data from the sites google lists Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it al More

€155 EUR in 5 days
(6 Reviews)
4.9
ranawaqarlx

I have good web scraping skills and I can scrape 50 - 100 links in Google for specific keywords. Secondly I can scrape urls too with specific content by excluding any menus, footer, etc in text form. I will provide all More

€50 EUR in 4 days
(34 Reviews)
4.6
dvcontact

Hi, Would you like to see a quick demo of your project on writing a script compatible to Linux that will extract the first certain numbers of URLs of each certain keywords from Google and then scrape the contents of th More

€150 EUR in 7 days
(7 Reviews)
4.7
manuelmorini

I've already worked on website data scraping, this can be easily done with javascript, both the scraping and output.

€160 EUR in 5 days
(4 Reviews)
4.8
ThilinaG01

Good Day Sir! I read your post. But I have something to ask you.. If you wanna be the success, hire me I am looking forward to keeping touch with you I'm also available at Fiverr ([login to view URL] More

€80 EUR in 3 days
(12 Reviews)
4.3
StephanChebyshev

Hi. Credit is my motto. I am a freelancer working in 24/7 service. I have much experience for 12+ years in Scraping Field. I can do your job with crawler,scrapy, BS4 ,php, Selenium modules of python. I have no any risk More

€30 EUR in 1 day
(8 Reviews)
3.9
pandread1

Hello there, Scraping Python expert here, Im used to Scrapy. What specific content exactly? Webpages are chaotically different from one another? Let me know more about the task in chat Pandelis.

€120 EUR in 5 days
(7 Reviews)
3.7