Screen-scraping comments for academic research purposes

$30-250 USD

Cancelled

Posted

almost 12 years ago

$30-250 USD

Paid on delivery

I am looking for java developers who can write a java code* that screen-scrape a specific site. I am only interested in collecting the comments found in that site for academic research purposes. It is an Arabic news site, where it has major sections like: Political news, Financial News, Sports news, Technology news,... each major section has subsections, e.g. Political News has the following subsections: Middle East News, Global News, ... . Each subsection has news items, and each news item may or may not have comments. The comments are paged. I need the scraping code to collect the comments and put them in the following structure: ID | Section Title | Subsection Title | News Item Title | URL | Comment | Comment Author | Timestamp example: 1 | Political News | Global News | Mission impossible diplomacy in Beijing | [login to view URL] | this is a comment | someone | 2012-03-01 12:00:00 2 | Political News | Global News | Mission impossible diplomacy in Beijing | [login to view URL] | this is 2nd comment | som2 | 2012-03-01 12:00:00 3 | Financial News | Banking | IMF to support Some country | [login to view URL] | this is a comment | someone | 2012-05-11 12:00:00 I will run the script daily, and the output should be a CSV file. The code must be provided. * If you prefer to code in a different language, like Python, you may still bid on this project, but putting in mind that you must then deliver an annotated and explained code to be used and run by someone who only knows java.

Java

Web Scraping

Project ID: 1607444

About the project

18 proposals

Remote project

Active 12 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

18 freelancers are bidding on average $156 USD for this job

@srinichal

I can deliver the scrapper in perl

$190 USD in 3 days

5.0

(41 reviews)

6.3

@procoder898

Hi, I am expert at Data Mining/Web Scraping in Java, and can surely satisfy you. Please check your inbox,

$190 USD in 1 day

5.0

(82 reviews)

6.1

@mantislin

Hi sir, please check PM.

$250 USD in 3 days

4.9

(63 reviews)

6.1

@diepbp

I am confident to handle your project. Please check your inbox for details, thank you.

$150 USD in 4 days

4.7

(76 reviews)

6.0

@sayno2bugs

Hi, This is Nitin having HUGE experience in scraping HUGE data in least amount of time. I code in perl & php, and scrapers written by me are being used to scrape more than 20 million pages per day without being blocked. I would like to help you in getting all the data you are looking for. Please pm me in case you find my bid suitable. And don't forget to check my reviews here : http://www.freelancer.com/users/1303125.html Cheers, Nitin

$200 USD in 3 days

5.0

(12 reviews)

5.9

@ehsankayani

HI, Kindly see details in PMB Thank you

$150 USD in 1 day

5.0

(31 reviews)

5.8

@samitXI

Ready to start now. Thanks

$200 USD in 3 days

4.6

(65 reviews)

5.7

@rhkchathuranga

I have lot of experience in Java Web Scraping. Please check your P.M.B. sir...

$140 USD in 2 days

4.9

(24 reviews)

5.5

@csanuragjain

hi i can do this contact if interested

$150 USD in 7 days

4.9

(21 reviews)

5.1

@MagedGazzar

I'm expert in web data extraction and can help you with all your web researchs

$30 USD in 2 days

5.0

(2 reviews)

4.7

@ruchipuri

Please check PM.

$99 USD in 4 days

4.5

(2 reviews)

1.8

@vitre12

Hi, Thank you for posting. Please check out Private Message for company profile and mentioned project detail. We have been waiting for your reply

$230 USD in 4 days

0.0

(0 reviews)

0.0

@talkadah

Hello, I have the appropriate experience to do well this project. Please see PM for more info

$200 USD in 3 days

0.0

(0 reviews)

0.0

@hijeenu

Expert scrapper here. I am perfect for this job, since I also know only java. I have coded all my scrappers in java only. I am confident to handle this job and provide the required output(csv). Please check your PMB.

$250 USD in 1 day

0.0

(0 reviews)

0.0

@bogwell

I have been writing web scraping applications for about 6 years and am currently employed full time as a software developer. I have approx 10-15 working scrapers currently being used. I have put a low bid for this as I am a new member and want to boost my reputation. I have also put a large delivery time for 3 reasons, 1 I have not seen the website yet, 2 its better to overestimate than under-estimate and 3, I like to take my time and produce something worth paying for. I have also put 0% initial milestone, you can decide what you would like to see from me to improve your confidence in my work.

$100 USD in 10 days