SERP Scraper site

Functionality of [login to view URL]

[login to view URL] is a site that dynamically generates webpages based on a keyword search phrase.

When you do a search on e.g. iphone, it scrapes the search results from Google and Bing and displays a mix of these search results on the page. Before and after the organic search results ad-blocks are placed, showing Google Adsense ads and Bing ads.

Requirements:

I probably want the pages built in HTML and Javescript/PHP, although I am not sure about other solutions. I need plain html coding so I can understand the code and make customizations later.

1. For the scraping you can use [login to view URL] (or another good solution if you know of any). I want to be able to change the search settings later, or in a copy, especially the country and language (e.g. search on [login to view URL] instead of [login to view URL]).

2. The pages must be able to handle special characters like Æ Ø Å and others.

E.g. in the screenshot the related searches are not spelled correct - searched on: blækpatromer.

3. Theses are the pages needed, all similar as used in [login to view URL]:

- Frontpage:

Main search bar, clean design similar to [login to view URL]

Not sure if it is possible to show content/news similar like [login to view URL]

- Web results page:

See detailed description below.

- Image search results page:

Image search results scraped from bing/microsoft.

- Video search results page:

Video search results scraped from bing/microsoft.

- News results page:

News search results scraped from bing/microsoft.

- No search results page:

Page shown when no results are found (in news section only?).

See: [login to view URL]

And screenshot.

- About page (in footer):

Some basic html content - will supply.

- Privacy policy page (in footer):

The privacy policy. Basic HTML.

- Cookie Consent (in footer):

A subtle cookie consent functionality.

E.g. from [login to view URL] but I prefer a very subtle one on a small strip at the bottom of the page. Another suggestion: [login to view URL]

DETAILS WEB RESULTS PAGE: (see screenshot):

1. Search Input field. Shows current searched keyword / phrase.

2. Main Menu, showing links to “Web results”, Image results, Video results and news results (like [login to view URL])

3. Google ads block 1

4. Google ads block 2

5. Google ads block 3

6. Bing ads block 1

7. Related Search phrases

(from google)

8. Scraped search engine results - mix between microsoft and google.

Show about 7 results.

9. Bing ads block 2

10. Bing ads block 3 (leave out - only use 2 Bing ads spots)

11. Google ads block 4

12. Same link “Some results by Microsoft” to: [login to view URL]

13. Pages number links

14. Footer links

15. Related searches

16. Logo top right

PHP JavaScript HTML Web Scraping CSS

Project ID: #34879649

About the project