Closed

Build a FB Scraper using Macros, PHP cURL or anything else!

** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. **

SUMMARY:

This project is to build a scraper using macros – ie. iMacros – or PHP Curl’s for Facebook’s Newsfeed ("NF") ads OR any other safer method, and other types of ads to be decided later.

GOAL:

Visit specified FB page URLs and collect ads data (e.g. number of likes, comments, shares, number of comments in the past hour of a particular ad, corresponding page info, etc.) and present them neatly and in well-organized manner (e.g. can filter data based on a given rule i.e. show data based on page owner/competitor.

--

IDENTIFYING NF ADS

Facebook's NF ads the ones that show between status updates of your friends here: [login to view URL] The challenge is, there's several different formats of NF ads as can be seen here:

[login to view URL]

[login to view URL]

What we're looking to do is identify story/update DIVs that contain the word "Sponsored" - as this is the common attribute among all NF ads. Then extract data from those DIVs only.

Here are a few sample NF ads:

[login to view URL]

We will provide you with the accounts that are display these ads.

--

LOGGING INTO ACCOUNTS

Application will require the usage of multiple FB accounts to scrape data; hence application must have the ability to link up (and delete) with multiple FB accounts.

When logging in to each account, the macro will need to ensure that the appropriate proxy for each account is used – which we will provide. When switching between accounts, the macro will need to clear all Temporary Internet Files (including Cookies) to ensure that the accounts aren't linked together.

--

EXTRACTING NF ADS

The scraper will need to continue scrolling to the bottom of the page, until it encounters the following messages:

- Old FB Format: "Add your friends to see more of their photos and stories in your news feed."

- New FB Format: "There are no more posts to show right now."

It will then need to identify the DIVs that contain the text "Sponsored" and:

- Identify a unique parameter (to keep track of when it was first seen, last seen, times seen)

- Extract all the content within the DIV

- Click the advertiser's link and record all URL redirects

- Load and save any images displayed within the DIV

- Save which account saw the advertisement

- When the advertisement was first seen

- When the advertisement was last seen - if the same ad has been seen several times

- The number of times the advertisement was seen - if the same ad has been several times

- Record social information such as the number of likes, comments, etc. All this information will need to be saved in the database.

DEVELOPER SKILLS SET (MINIMUM REQUIREMENTS):

1. 3-4 years’ experience in web development using PRIMARILY PHP

2. Profound knowledge of related frameworks (e.g. Laravel for PHP) for faster development

3. 2-3 years’ experience with Facebook Graph API

4. Strong knowledge on writing AJAX requests

5. Must be well-versed in HTML5, CSS3/SASS, and JavaScript

6. Must have experience using git for version control (experience in using some git branching strategy is an advantage)

7. Experience with NPM and task runners is required for faster development

NICE TO HAVE:

1. Experience with some basic project management application like Trello, etc.

** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. **

SKILLS REQUIRED:

AJAX, Anything Goes, PHP, Web Scraping, Website Design

BUDGET: Flexible/Negotiable

Skills: AJAX, Anything Goes, Facebook API, PHP, Web Scraping

See more: myspace rss using php curl, post comment hi5 using php curl forum, system requirements build inventory system using php mysql, build comment system using php, post forum using php curl, build custom application using php joomla, php curl scraper example, using different proxies php curl, post php curl using proxy, connecting facebook using php curl, php curl scraper, access https using php curl, logging facebook using php curl, download youtube using php curl, facebook using php curl, how to build a dashboad using mysqli php javascript and css, Build a Website using html php database

About the Employer:
( 52 reviews ) Sacramento, India

Project ID: #18291027

24 freelancers are bidding on average $2221 for this job

TenStar718

Hello how are you? last time, i have built a php scraper engine for twitter page. twitter page have javascript loading when scroll down. let's discuss more details if this is your concern. Thank you

$2833 USD in 30 days
(225 Reviews)
8.6
omsoftware

Hello, Yes we can definitely do this development of bundling a scraper using macros – ie. i Macros – or PHP Curl’s for Facebook’s News feed ("NF") ads and yes we do have experience in doing this. =>Can you please More

$3000 USD in 30 days
(138 Reviews)
8.9
narmadatech

Hello, Thank you for sharing good information. I am very confident about developing such website. I have 7+ years of experience to build a FB Scraper using Macros, PHP cURL or anything else. I am expertise in P More

$2944 USD in 30 days
(212 Reviews)
8.1
$2100 USD in 36 days
(45 Reviews)
7.0
WebExpertsx

We read your requirement about fb scrapper using php and we want you to know that we have a good past experience in PHP, WordPress,laravel ,angular.js, javascript, Bootstrap, SEO, Online Marketing, Social Media Market More

$1666 USD in 10 days
(18 Reviews)
6.7
brianconey

Hello How are you My name is Xu it is possible on python and selenium it is not a problem for me please buzz me i have full time and I can start to work immediately Please contact me and do let us discuss a More

$2500 USD in 30 days
(145 Reviews)
6.8
suhaa18

Dear [login to view URL] to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautiful soup, mechanize, lxml, urllib2, automation, bots, spi More

$2500 USD in 30 days
(20 Reviews)
6.1
webmantratech

Dear Client, We are expertise in php, core php, CMS, HTML5, CSS3, bootstrap, WordPress, PSD to HTML, Angular JS, Node JS photoshop, OPencart, Codeignitor, Laravel and many other technologies. Please have a look More

$2500 USD in 30 days
(48 Reviews)
6.5
rgvwp

Hi There To understand our expertise and reputation in development arena kindly have a glance on our freelancer profile and portfolio. Best products: POS [login to view URL] nitisharora(a More

$2500 USD in 65 days
(10 Reviews)
5.2
developersperhr

I am expert in PHP, CI and Laravel.I have created ecommerce and job portal website in these [login to view URL] check previous work Laravel [login to view URL] [login to view URL] [login to view URL]

$2500 USD in 30 days
(25 Reviews)
4.8
shivamanjani

Hello, Hope you doing well!!! Yes, I am available with complete expertise and past experience to meet your job requirement and can start right now. So can you please send me the complete detail so that I can ana More

$2500 USD in 15 days
(13 Reviews)
4.9
mcinteersoftware

I currently work part time as a datamining / webscraping developer for amerinfo I built a webcrawler to use 40+ facebook accounts for spamming which helped me build a 35k like fb page with a lifetime reach of 52m am More

$1500 USD in 15 days
(6 Reviews)
4.9
MaryumAkhter1

I am senior python automating expert with 6+ years experience. I have proven skills and practical experience in automating (10M Amazon Images scraping, 365betting bot, Paypal account generator, Nike account generator More

$1841 USD in 30 days
(4 Reviews)
4.1
ilushawebdev

I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest More

$1500 USD in 30 days
(9 Reviews)
3.6
ts199756

Hi, I am python developer with expertise in web automation and data extraction. I use Selenuim and beautiful soup to extract data, Selenuim works as a bot that will take input of facebook id login details and t More

$1666 USD in 30 days
(2 Reviews)
3.6
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

$1500 USD in 7 days
(11 Reviews)
3.2
bruceci

Hello, I am very good at web scraping and network automation tasks. I can scrape almost any website wether it applied anti-scraping mechanism nor not. I hope you can choose me.

$1874 USD in 10 days
(4 Reviews)
3.3
aswadakdas

Customer's satisfaction is my goal *** *** Also 100% Completion is happy of me and client. *** *** Rest 1% is my creative idea and honest effort. *** Looking to be your Good Venture along with your project! Bes More

$2500 USD in 30 days
(4 Reviews)
2.0
CanvasInfotech10

Hello, It looks like you are looking for an experienced PHP developer expertise who can dedicatedly work on your project to build a Web Scraping script using macros or PHP Curl for Facebook’s Newsfeed where it can v More

$2722 USD in 31 days
(1 Review)
1.5
vinodvarma42

We are having 10+ years of experience in Logo & Graphic design, Web design / development, Mobile Apps (IOS & Android) development, Game Development & providing Affordable, Quality solutions / services to all kinds of b More

$2500 USD in 30 days
(1 Review)
0.0