Completed

Script/program to extract two specific unique elements in source codes of pages from list of URLs

Hello,

I need a simple script/program that goes through a list of URLs (stored in a .txt file, one URL per line), and extracts two pieces of data from the source code on each URL. The bits of source code that need identifying/extracting look like this:

1. "artist":"NAME"

2. "url":"https:\/\/[login to view URL]\/ID\/[login to view URL]

NAME, ID and FILENAME in the examples above will be different for each URL. NAME and FILENAME are the values that should during extraction be saved, preferably to a .csv file, along with the source URL, with the following column order:

URL, NAME, FILENAME

One URL+ extracted values per line.

There may be times a URL doesn't exist, or gives an error message, in which case it should simply be skipped, or output an error message in the .csv file for that particular line.

I'd also like there to be a an adjustable time limit on crawl frequency, if there are request limits for the site. One URL per 0.5 seconds by default.

This script/program needs to run on Windows 7 and later, 64-bit. A graphical interface isn't necessary as long as it's easy to run, it's more important the script/program's lightweight and fast, and budget not too high.

The list of URLs in the .txt file will be roughly 10,000. Can divulge the specific site name for the extraction (will need to be changed in the source code example) upon project start. It's fully legal. Open resource site.

Looking forward to your proposals!

Skills: Web Scraping, Software Architecture, Data Extraction, Web Crawling, Programming

See more: source codes texas holdem games java, outlook macro extract specific body, commerce websites source codes, script program, php script send email specific email address, casino source codes, flash game source codes, vb6 program extract files, extract email addresses html source code, myspace source codes, windows registry cleaner source codes, sell flash source codes, iphone source codes, clamav file scanning source codes, payroll program source codes, extract string pdf file source php script, script extract specific data excel, program extract unique word, freelance php script with open source codes

About the Employer:
( 2 reviews ) Bro, Sweden

Project ID: #29597467

Awarded to:

jeremicdevelope5

Hello I can build a script to extract two specific field quickly I have rich experience in this field. Please discuss with me Best Regard

$15 USD in 7 days
(1 Review)
0.8

14 freelancers are bidding on average $33 for this job

(241 Reviews)
6.9
sumon355

Hello, As an experienced software developer, I can provide you a C# based solution to extract the required values from the URLs. Would you please share some example URLs so that I can check? Thanks

$50 USD in 1 day
(102 Reviews)
6.4
(56 Reviews)
5.6
dany3j

Hi there! Dear colleague. I can help you with this project. I would like to know more about it. Contact me by Chat to get more information. My Best Regards

$50 USD in 3 days
(47 Reviews)
5.0
(52 Reviews)
5.0
b14d35

Hey, I'm experienced in Web Scraping for more than 5 years, I'm interested in your project and would like to get more information.

$30 USD in 1 day
(12 Reviews)
4.5
Lagripe

Hi. I am a freelancer working in 24/7 service. I have much experience of +6 years in Scraping field, I can do your job with Python. I will produce the output in any format you desire. I think this project is for me and More

$50 USD in 1 day
(13 Reviews)
4.2
srdeveloper8988

I am well experienced with these scripts and can complete this in today. payment will be after completion of work only. rest we can discuss on chat. thanks for your time

$35 USD in 1 day
(5 Reviews)
3.7
ai275709

sir i already make this type of program in java in which program read 10000url from file and which urls are working copy into another file which store correct urls . Also seprate urls which contain error 506,401,404 an More

$10 USD in 1 day
(2 Reviews)
2.2
Cintax

Hi there...!!!! We have AI & Data Science team who are highly experienced in Machine learning and Deep Learning who can deliver the products as per the shape of your [login to view URL] done many real time projects like More

$10 USD in 1 day
(1 Review)
0.0
techiestc

Hi, I have been working in this industry for more than 7 years and such tasks are in my daily [login to view URL] this is my first time on this platform and hence you can see I don't have any ratings to show you . I can giv More

$10 USD in 1 day
(0 Reviews)
0.0
Krishnavadhiya

Hello, I have good knowledge of data scraping on tool creating witth python/php language. I will create your tool within 1-2 days but first i need some 4-5 examples from your text file of URLs you want to scrap. all U More

$15 USD in 2 days
(0 Reviews)
0.0
AkarshitMahend

Hi I am a Python and Django Developer having 3 years of professional experience.I have gone through your requirements and I promise if given this task,I will assure you will get the quality work. Looking forward to hea More

$30 USD in 1 day
(0 Reviews)
0.0