Continuous Scraping

We are looking for a way to scrape public posts and their comments from pages on The goal is to continuously scrape 10.000 pages every hour, so that at most one hour passes until we find a new post. For each post we want to scrape all public comments for 7 days. For both posts and comments, we need several metadata fields additional to the text - most importantly fbid and a unique url (that we can use to find out if we already got this post / comment in an earlier run). Regarding the format of the results many options are possible for us.

We are open for two ways to a solution:

* You provide us with a component for scraping that we deploy and run on our servers. In that case, we need your advise regarding how many servers/ips and what proxy strategy we need to make sure everything runs smoothly.

* You provide us with access (e.g. via API) to a solution running on your servers for a monthly payment. (In that case please write this in your answer.)

Skills: Data Extraction, Data Scraping, Web Scraping

See more: Microsoft Excel Web scraping Data scraping, Email Scraping,Data Scraping,Directory Building, voip south africa seeking or seeker or looking for or in search of or open to or new job or actively pursuing or pursuing new or, looking for a saying regarding marketing communication which goes along this line if i tell you i am beautiful then it is advert, looking for a company that can do marketing for my constraction and supplying business in pretoria, i m looking for a sport shoe designer to create a new product for me company in thailand that could make different sports clothi, we are looking typing expert freelancer for my project we have millions of images to type in ms word files separated use font cl, open source data scraping ebay, looking trader will trade binary options win, looking professional programmer experience website scraping, open source web scraping, sqlite screen format results, looking someone manage small binary options trading account, answer case study questions mba format, comment gagner largent avec les options binaires youtube, web scraping screen scraping, scraping backpage scraping, table format results survey, open source data scraping sql, format results survey

About the Employer:
( 1 review ) Berlin, Germany

Project ID: #17324541

Awarded to:


Hi there! I am an expert scraper can scrape any website in no time I have programs and can do a new script for each new website needed Let me know which website you need to scrape and which fields and I will write More

€30 EUR in 1 day
(17 Reviews)

26 freelancers are bidding on average €3891 for this job


Hello, I can do this in a way of providing you data via api or I can run scraping from your servers using my side as proxy manager. i.e. you don't have to care about proxies on your side - I'll do that on mine. Please More

€4705 EUR in 30 days
(212 Reviews)

Hi, I am interested in your project related to keep scraping facebook pages for posts and their comments. I would choose the first option which is delivering full solution including script,proxies integration,setup,doc More

€3000 EUR in 20 days
(244 Reviews)

Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Windows Desktop Apps Developer (C#, C++), Web Data Extractor & Automator and I'd More

€3500 EUR in 30 days
(184 Reviews)

Hi I can implement a multi-threading scraper with proxies support that fetches data from fb. Can work on a demo if you like. Thanks

€4444 EUR in 30 days
(76 Reviews)

Dear Sir/Ma'am, I can scrape public posts and their comments from pages on fb. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

€5000 EUR in 30 days
(151 Reviews)

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of web scraper development experience such this projects. And I have good skills with this program languag More

€3333 EUR in 30 days
(57 Reviews)

Hi there! I've read the project details and ready to start it right away. I'm an expert in data entry and data scraping jobs. I've huge experience in working on this type projects. I look forward to hearing from y More

€3000 EUR in 30 days
(147 Reviews)

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

€3000 EUR in 5 days
(56 Reviews)

Dear eagleproject, I do have relative experience achieving something like yours "Continuous Scraping" thusly I am expecting discuss and progress. Relevant Skills and Experience I have 10+ years of experience in More

€3000 EUR in 36 days
(7 Reviews)

Hi there, Warm Greetings We came along with your request for Continuous Scraping and we reviewed your project description. We'd like to help you with confidence and satisfying results. We have professional More

€4000 EUR in 30 days
(15 Reviews)

i can do your work and i will show you some example of my work watch and speak with me [login to view URL] and [login to view URL] and [login to view URL] More

€3000 EUR in 10 days
(27 Reviews)

Dear Employer, Hope you are doing well...!!! Coming to your project scope we will scrape public posts and their comments from pages on Ping me via freelancer chat box so that we can discu More

€4705 EUR in 70 days
(2 Reviews)

Hello! This seems like a very large project, so there will be a lot to discuss. My bid and timeframe are simply placeholders until we discuss further details. First off, how would the data need to be exported? In More

€3500 EUR in 30 days
(21 Reviews)

Hi there, I have strong expertise in web crawling, web scraping and b-o-t-s. This should be an easy job for me. Message me, I would like to discuss further details over chat.

€4200 EUR in 30 days
(3 Reviews)

Hello, I am professional web scraper and have done a lot of scraping projects. I am very interested in this project and have confidence on this project. Hope to work with you. Best Regards

€4705 EUR in 30 days
(2 Reviews)

Dear Sir! I am Web Scrapping master with Python and you can find it on my reviews. Web Scraping have several technical problems with using proxies, auto-login, anti-scrapping, big-data processing, multi-threading More

€5000 EUR in 30 days
(17 Reviews)

I have webscraping experience and can provide the requested solution.

€3000 EUR in 30 days
(11 Reviews)

Hello, I just read your job listing and I think I am capable of doing the required tasks at finest quality in short manner of time. If you want your project done, please let me know!

€4500 EUR in 20 days
(4 Reviews)

Hi, I've read the project description and very confidence to develop the scaping tool. I'll definitely provide you the highly-skilled PHP/data scraping expert's team and complete the project in given time. My skill set More

€5000 EUR in 30 days
(1 Review)

Hello. I am very good at web scraping. I have done many scraping works in python and c#. Please check my profile and contact with me. thanks

€4500 EUR in 30 days
(0 Reviews)