180352 Basic crawler with curl

Simple project using curl:

Require functionality to be able to crawl a site and save extracted data to a mysql database. Will need a basic admin area where and admin can add a new site to be crawled.

Requirements:

- Ability to specify custom useragent

- Ability to specify how many urls to crawl

- Ability to export a txt file containing the url and title of each entry in the following format: url||title

Extracted data = title, description, keywords, url, pagecontent

MySQL Odd Jobs PHP

Project ID: #1926557

About the project