script / software to parse file and extract data
Project ID:
463062Project Type:
FixedBudget:
$30-$250 USD
Project Description:
i need a script / software to parse an huge "webcrawler index file", extract some informations and save them into my mysql databasedata to extract:
-link relations: link from site - link to site
-link info: textlink or image link, link text, alt text, title text
-link type: nofollow, (meta tag nofollow), follow link
-some page infos: content encoding, title, domainname...
the index file sizes are between 15GB and 100GB big, please keep in mind that your script can handle this capacity
the script / software should run on our linux root server
i'll give you an mysql database layout
you find can all informations about the index file here: http://www.dotnetdotcom.org/
please send me an pms if you have any question
Skills required:
C Programming, Java, Linux, Perl, Python
Public Clarification Board
1 messages
-
jesuse1998
Why do you want to place the records in a dbms when the authors of the webcraler decided to up flat files, most likely due to performance issues? just wondering...
over 2 years ago
Awarded Bids
All Bids ()
$180
in 2 days
over 2 years ago
Hello,
Please look at the PMB.
Regards,
Sergey
|
|
srinichal
 From India
 Standard Membership
 Offline
|
Freelancer Orientation (90%, 100th percentile)
General Orientation (85%, 95th percentile)
Participated in the 2012 Freelancer.com Scavenger Hunt
$120
in 4 days
over 2 years ago
I can write a bash script for the same
|
|
SigmaVisual
 From Pakistan
Standard Membership
 Online
|
General Orientation (80%, 90th percentile)
Foundation EUFreelance.com Member
$250
in 4 days
over 2 years ago
We can help in your project, please check PMB to see our related experience.
|
|
gangabass
 From Russian Federation
Standard Membership
Online
|
Foundation EUFreelance.com Member
$70
in 3 days
over 2 years ago
I can do this job for you. See PM for details.
|
|
sureshdevi
From India
Standard Membership
Offline
|
Freelancer Orientation (80%, 97th percentile)
Employer Orientation (75%, 97th percentile)
General Orientation (90%, 98th percentile)
Participated in the 2012 Freelancer.com Scavenger Hunt
$200
in 5 days
over 2 years ago
I can do this work. Thanks, Suresh
|
|
ancosys
From Pakistan
Standard Membership
Offline
|
Foundation LimeExchange Member
Participated in the 2012 Freelancer.com Scavenger Hunt
$130
in 3 days
over 2 years ago
Hi,
Please check PM
Thankx
|
|
pawel100
 From Poland
Offline
|
General Orientation (90%, 98th percentile)
Foundation EUFreelance.com Member
$60
in 3 days
over 2 years ago
Hello, I'm interested in your project, Please check PMB for more details.
|
|
edatawiz
From India
Offline
|
General Orientation (80%, 90th percentile)
Foundation EUFreelance.com Member
$150
in 7 days
over 2 years ago
Hi -
Please check PM for details.
$110
in 3 days
over 2 years ago
Please check PM for details.
|
|
ulkas
 From Slovak Republic
Offline
|
General Orientation (95%, 100th percentile)
Foundation EUFreelance.com Member
$100
in 2 days
over 2 years ago
easy task, don't need any more info, just get me an example file and i can start asap and after then you can try it with your own big file.
$100
in 3 days
over 2 years ago
Hello, I can do that quickly and at low price.
Please check the PM, thanks
$100
in 2 days
over 2 years ago
Hello, I understand what needs to be done, and I can start right away. See PM for details.
Dear sir,
I have experience developing parsers for VHDL and C++ using lex/yacc and ANTLR. Can develop a very efficient, cache optimized parser for you in 2 days.
It is and interesting and simple task for me.
Rega... more
Dear sir,
I have experience developing parsers for VHDL and C++ using lex/yacc and ANTLR. Can develop a very efficient, cache optimized parser for you in 2 days.
It is and interesting and simple task for me.
Regards,
Janak less
I am expirienced in Python. I can write such script for you.
can do this easily with perl
$100
in 2 days
over 2 years ago
Hi, I am an information extraction specialist and would be happy to help you with this project. All I require is a small sample of the file to be parsed to proceed.
$200
in 2 days
over 2 years ago
Please see the PM
$99
in 2 days
over 2 years ago
I can do it fast with Python, I have experience with crawlers and other automated systems.
$100
in 4 days
over 2 years ago
I can do this for you.
$35
in 3 days
over 2 years ago
pls see PM.
$140
in 5 days
over 2 years ago
Please see my pm for details. Thanks
$80
in 4 days
over 2 years ago
Hello.
I can develop this software using Java.
I can start the project right now.
Regards.
$100
in 3 days
over 2 years ago
hello ,
i can do this job on python or c/c++
|
|
ThePilgrim
 From Romania
Offline
|
General Orientation (85%, 95th percentile)
Foundation EUFreelance.com Member
$200
in 10 days
over 2 years ago
I'm proficient in ANSI C, C++ and also JAVA, and i the task at hand might or might efficient to complete. Anyway please post in PMB the database structure with a description on the handling of data extracted.
I am expertise in java and sql. And since your file are very large it needs an efficient io for to read.
I and do this for you ...
$120
in 9 days
over 2 years ago
Have looked at the file format, and believe this should be a relatively simple project in Perl.
Thankyou for your consideration.
$100
in 3 days
over 2 years ago
I have experience in web crowler creating and text data mining
$100
in 3 days
over 2 years ago
i can do it in perl/php/python..
$150
in 3 days
over 2 years ago
I have done similar project, Please see the PM
Hi,
I will do this work. I am very well in C/C++. Now i am currentlly working on that also.
$150
in 20 days
over 2 years ago
Recently..i did perl scripts for intel,oregon
converting xml files..,templates..plugging register
values etc..for huge files..
I will be glad to assist..you.
$150
in 5 days
over 2 years ago
hello,
I can help you out.