I need a command line based PHP program that will scrape recent posts from Facebook, Twitter, and possibly other available social network for particular keywords. The keyword list will be set in an array and then looped through by the scraping program.
$mySearchArray = ("pizza","#google", "apple");
The program will search for EACH of these keywords
All posts will be entered into a database table. Program must run by Command line.
Program needs to grab GPS data if it is available and put it into the database table as well.
Program needs to check if the post grabbed has any postal address information within the post. If so, it needs add just this information into a separate database table field.
Postal Address Example: 555 TestStreet Ave, New York, NY
If the post has an image, grab the image information too
So the database table needs to have the following database fields.
Post ID number - auto increments
Twitter/Facebook Post message details
GPS location (if available)
Address (if found)
Image (if available)
Timestamp - when the post was inserted into the database table
IMPORTANT: Make sure NOT to save duplicate records. So check to make sure the posted message does not already exist. This program is expected to be ran on command line every 30 minutes.