Need some work done? Post a Project Today
the task is to create a scraping process including these steps:
1) scrape gelbeseiten - dot - de for firm data, extract as much as possible firm-addresses.
2) scan firm names for fanpages using google with query (site: facebook.com $firmname)
as the data until now has a lack of quality as not all entries match (google finds fanpages for firms that dont have any or that are better ranked).
3) pull the firm name of the info Tab or Page title of the Fanpage and match it with the firm name that was found in Gelbeseiten - dot - de, calculate a ratio how much letters are similar so there is a linguistic parameter to estimate correctness. express using numbers between 0 and 100 so it can be used to rank data.
4) pull fancount and "talk about" number from Facebook Fanpages as well as info whether its a page, wiki entry or place
I would like to do a test run with 10000 entries, that optimize the data-quality and find the best way to identify the real fanpage of any firm. on that basis we could start scraping data continously.
I will pay one amount for coding the script, and then we will estimate a price for each 10.000 entries of the raw data
that run through the script you have made.