In Progress

SEO HTML Web Scraper/Parser and Data Extraction

This project is for a web scraper tool. The entire project can be in Python or PHP. I'm interested to hear your thoughts on which is the preferred language.

The idea is to start with a web page that requests email and url on a web form. Once submit is pressed, on-page SEO values such as title, H1, meta description and more would be analyzed for their existence and character counts, all using AJAX/jQuery (no page refresh).

Complete list of data to be analyzed and parsed:

- meta title, description, keyword, robots (count characters on title and desc)

- title and description should be compared to url for keywords

- canonical url exist? what is it?

- is seo friendly url? no variables such as [url removed, login to view]

- facebook open graph tags exist?

- twitter card tags exist?

- h1, h2, h3, number times used and contents

- alt tags on images and contents along with image filename

- existence of facebook, twitter, pinterest, linkedin, youtube, google+ links

- presence of any inline code (javasript and css)

- existence of [url removed, login to view] file at root directory

- does flash exists?

- count W3C validation errors

- count backlinks, get mozrank using SEOMoz API

- grab top keywords using SEMRush

Code should handle large volume as it will be used in a CRM in the future.

Data extracted should have the ability to add to a mysql database and a export to a PDF for display and sent to the email from the starting web form.

See these links for PHP examples:

[url removed, login to view]

[url removed, login to view]

This is a good example of a live site:

[url removed, login to view]

Thank you for reading this project. I'm looking to find a coder for a long term relationship on future projects. NDA will be required to start work and I prefer US/UK developers.

Please let me know if you have any questions on the requirements.

Skills: PHP, Python, Software Architecture

See more: python html parser scraper, semrush, youtube ajax api, www web developers com, www web developers, wpromote, what is seo projects, what is linkedin, web page language, web page errors, web developers requirements, web developers list, web developers in uk, web developers directory, twitter developers api, top web developers, top graph, test for web developers, seo projects in uk, seo friendly web directory, seo export, pinterest web site, pinterest find, pinterest api php, php developers web directory

About the Employer:
( 7 reviews ) Schaumburg, United States

Project ID: #4700241

Awarded to:

cosmicwheels

Hi there, Im a UK based developer with 10 years experience in web development. I am also very experienced with PHP and would have no trouble building your SEO tool for you. Please check your PMB for further details, th More

$2200 USD in 14 days
(6 Reviews)
5.6

18 freelancers are bidding on average $2208 for this job

webexpertz

Dear Sir, I am interested in your project. I request you to visit private message board for our Web 2.0 Portfolio & further discussion. We believe in delivering Quality and Secure Project. Regards Webexpertz Team

$4639 USD in 60 days
(113 Reviews)
8.3
e3d

Hello, I'm partially US / partially Russian developer and interested in your project. Kindly check your PM

$2222 USD in 25 days
(63 Reviews)
7.8
buzzz

hello, I am ready to develop this scraper. I will use php.

$2577 USD in 20 days
(356 Reviews)
7.6
qualifiedcoders

Hi We have read your [url removed, login to view] have completed 80+ big PHP projects in last 5 years. Please check private message board for details.

$3092 USD in 20 days
(18 Reviews)
7.2
onelinewebdeUK

Thanks for your consideration, please see our message and if you would like to discuss the project further do get in touch and I’ll give you a call.

$2886 USD in 35 days
(14 Reviews)
6.8
SICS

Hi, Please check private message. Thanks

$3092 USD in 35 days
(31 Reviews)
6.5
geekydeveloper

Hello Mate, We have 6 years of experience of core development and we have Experienced team

$2268 USD in 30 days
(28 Reviews)
6.5
asarfraz

Please check PM

$2000 USD in 45 days
(67 Reviews)
6.2
nekhbet

Hi, This project seems really interesting and I would love to do it. I have experience in PHP, HTML parsing and working with different APIs (in our case the SEOMoz and SEMRush ones). If you still need help please More

$2472 USD in 10 days
(194 Reviews)
6.2
desigmbooms

Hello Sir, More than 5 years experienced PHP/Mysql Developers here, We are having dedicated teams to start this work ASAP, We always make sure 100% clients satisfaction in both designing and [url removed, login to view] check More

$2631 USD in 35 days
(9 Reviews)
5.7
phpseo

I have already creates several similar kind of SEO tools. details in PM

$1111 USD in 3 days
(32 Reviews)
5.6
ksupport

Hi,Kindly check PMB for detail proposal.Thanks.

$1443 USD in 20 days
(3 Reviews)
5.4
adelline

Hi! I've read your project description and I would like to work on it. I would develop it in PHP, please read the private message for more details.

$2315 USD in 14 days
(64 Reviews)
5.3
miniric3

Kia ora! [url removed, login to view] are a NZ based web and software design company who have seen you here on the freelance market and are really excited about working with you and treating you to the full service, professional experi More

$3092 USD in 30 days
(6 Reviews)
5.3
kailashbuki

Hi, I have more than 3 years of experience working in python as a full stack developer. As far as I understand, your project is just not only about scrapping a page and analyzing it but also about making it work for More

$2222 USD in 14 days
(9 Reviews)
4.7
omaralieissa

Hi, i can do this but in C#, please let me know if you are interested, thanks.

$2000 USD in 10 days
(6 Reviews)
3.7
getveltrod12

Hi, Veltrod Software services is a global software consulting company specialized in providing Mobile applications, Social media frameworks and eCommerce solutions. Leveraging best-in-class people, processes, and te More

$2474 USD in 55 days
(2 Reviews)
0.0
NTechcorporate

Hi, Please check private message.

$1443 USD in 30 days
(0 Reviews)
0.0
imthebanana

I have been doing web scraping scripts for the past couple months for an adult search engine script, Im sure porting them over (I can show you how they work beforehand if you need) and creating the rest of your script More

$1000 USD in 14 days
(0 Reviews)
0.0
felipemunoz

hi im interested in your project

$1111 USD in 5 days
(1 Review)
0.0