In Progress

Google Trends Perl Command Line Utility

The Script will run from the command line. It will take input and perform a series of searches on [url removed, login to view]

The key functionality of this script is that it will return a file with daily results for the search terms entered. When you search on Google trends over a range of dates greater than 1 month, and download the resulting csv file, the search volume data is presented as weekly. When you search on Google trends over a range of one month, it returns data in the resulting csv file as daily volume search data. I need the daily volume data, but over longer timeframes, hence the need for this script.

The script will take as input several flags:

-q ‘search terms’; This should allow the full functionality of the search options e.g. see [url removed, login to view]

-geo region (a two letter code which can be passed to the search url); “all” by default

-s start date in format YYYY-MM; default value is 2004-1

-e end date in format YYYY-MM; default value is the most recent month

-r the output data will be with fixed scaling by default; this switch will downloads the csv files with relative scaling instead.

The script will then take the input and perform a series of searches on Google trends for each month between the start and end date. It will download the data from each of these searches as a csv file (e.g. the export “CSV with fixed scaling” button at the bottom of the search results). This file contains the daily search data that we need. Once the script has all the data (e.g. every daily search volume between start and end date), it then writes a new file containing all the data. This will be in the following format: A tab delimited file, with a header line “Date SearchTerm StdError”. It will then contain the output from the google searches, in date order. The date will be in the format YYYYMMDD, the next two fields are the search volume and StdError.

Furthermore, the script will need to be logged in to google trends, so it needs some way to handle this. Also, I’m not sure if running all these searches may cause problems with google not liking the large volume of search requests. I have heard that they might start producing captcha codes. So the script may need to overcome this. This could perhaps be achieved by just slowing down the searches. Otherwise, it could pass the captcha codes to the user. If you come across this problem, just solve it the easiest way.

Also, if a rare search term is entered, the script may come across the page “Your terms – blahblahblah - do not have enough search volume to show graphs.” In such a scenario, the data for each day of that month will be made to contain 0.

Skills: Perl

See more: google trends utility, google trends perl download, perl google trends, google search trends perl, search graphs, perl search script, perform line, line problem, graphs problems, date utility, csv codes, code line, about graphs, google trends perl, two letter, take google, letter g, google trends, command, need solve captcha, switch order, region code, perl download script, tab delimited format, script graphs csv files

About the Employer:
( 23 reviews ) Oxford, United Kingdom

Project ID: #1285147

Awarded to:

mz1

I've written this script.

$85 USD in 0 days
(8 Reviews)
4.2

11 freelancers are bidding on average $205 for this job

zeuner

I am writing data scrapers for web sites of all levels of complexity. My bid is for a "Trends" scraper including login and either manual captcha entry or integration of a captcha <b><i>Removed by [url removed, login to view] Admin f More

$1045 USD in 14 days
(5 Reviews)
6.2
gangabass

I can do this for you. See PM for details.

$100 USD in 2 days
(130 Reviews)
5.8
garygoog

I am perl and data scraper [url removed, login to view] check PM

$170 USD in 15 days
(23 Reviews)
5.7
srinichal

I can deliver the script using machanize or perl useragent

$180 USD in 4 days
(23 Reviews)
5.6
aboltinsh

Hello, This is pretty straight forward task for me. My reference - in PM.

$100 USD in 2 days
(7 Reviews)
4.2
programmingzeal

expert Perl developer here.

$120 USD in 7 days
(6 Reviews)
3.2
dolphin3456

I am sure I can finish with in a short span of time with all functionality. Please check PM for more detials

$95 USD in 2 days
(1 Review)
1.5
MiguelLam

Hi Mr, I can deliver this task for you. Best regards.

$85 USD in 7 days
(0 Reviews)
0.0
mailmeakhila

Hi I am an expert in perl programming. I have already worked on script to search various websites. Honor my bid.

$100 USD in 2 days
(0 Reviews)
0.0
edrinb

Dear employer, I have a big experience in Perl and other scripting like languages. I have used various libraries including those for http, ftp interaction. Thnx, Edrin

$180 USD in 10 days
(0 Reviews)
0.0