Closed

build webcrawler for data mining

I'm wondering if it would be possible to build a webcrawler which does the following:

1. Allow the user to enter “advanced search” criteria for following webpage:

[login to view URL]

Advanced Search:

a. business name or UID

b. canton

c. seat

d. legal form

2. Extract complete results, could be list with multiple 1000s entries. The list will contain the following fields:

a. Business name

b. Excerpt

c. UID / UID Register

d. Legal form

e. Seat

f. Canton/rc

 Attention, some of the fields, e.g. “business name” or “UID / UID Register” will provide links which will need to be extracted too

3. Go through each line to follow link link provided in c) “UID / UID Register” and add following data to the result extracted under point 2:

g. Additional name

h. c/o

i. Street / No

j. ZIP / Town

 to be splitt into 2 fields, ZIP and Town

k. Canton

l. Country

m. Commune

n. Legal form

o. Register of commerce data

p. RC status

q. Reference number

r. VAT register status

s. VAT number

t. Start of obligation

u. End of obligation

4. Search web if a company website exists

 Creative Suggestions welcome how this could be done

Skills: Data Mining, Excel, Web Scraping, Web Search

See more: web crawling techniques, web crawling python, web crawler tool, data crawling tools, web crawler tutorial, web crawler open source, web crawler download, web crawler software, build data mining bot, build data mining poker players, data mining commerce, data mining using aspnet, role database developers data mining, screen scraping data mining, dataset data mining association

About the Employer:
( 0 reviews ) Switzerland

Project ID: #17345095

37 freelancers are bidding on average $181 for this job

schoudhary1553

Hi there..... Warm Greetings We came along with your request for build webcrawler for data mining and we reviewed your project description. We'd like to help you with confidence and satisfying results... We ha More

$250 USD in 4 days
(252 Reviews)
7.5
mantislin

Hi sir, This is Lin and I am scraping expert, please check my reviews then you will know. Can we discuss more details about this project? Thanks, Lin

$250 USD in 3 days
(256 Reviews)
7.4
mhmhz

Hi I can implement a desktop application in C# that fetches data from zefix Can finish this in less than 1 day Thanks

$277 USD in 0 days
(76 Reviews)
7.2
SigmaVisual

I need to develop a scrape either in php or python, which will go to the website and do search based on search criteria and extract data from the search results. Data will be stored in required format Relevant Skills More

$250 USD in 3 days
(55 Reviews)
6.7
sohandas

yes possible, i can make a python script or GUI for you where you can customize the advanced search options to get different results.....pm me for more discussion and i will show you POC.

$250 USD in 3 days
(199 Reviews)
6.9
bestit4u

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of web scraper development experience such this projects. And I have good skills with this program languag More

$155 USD in 3 days
(54 Reviews)
6.5
$150 USD in 1 day
(164 Reviews)
6.6
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$222 USD in 3 days
(87 Reviews)
6.8
uumarkhalid31

​I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete More

$250 USD in 3 days
(247 Reviews)
7.0
vincentong07

Hi! I'm script developer that can retrieve data with automation. Speed & 100% accuracy guaranteed! Question : - Do you want a GUI application or just a script? - Windows / Linux / Mac Operating System? Solutio More

$120 USD in 2 days
(75 Reviews)
5.8
rajawi9999

I will create for you the webcarwler using php, I have already created many bot as you can check in my reviews.

$222 USD in 3 days
(13 Reviews)
5.0
teachartdevteam

Hey there! I checked the provided website and reverse engineered it. I took a screenshot of the JSON structure which the website receive from it's internal API: [login to view URL] . So, I can create you a u More

$300 USD in 5 days
(6 Reviews)
4.7
prabakarm23

Greetings for the Day!!! I have 8 years of experience in .NET, VBA Macros, VB script,PS Script and VB creation with application like SAP, Interne More

$277 USD in 5 days
(49 Reviews)
4.7
shingjin

Hello. After reviewing your post, I am very interested in that due to my experience. I am an expert python web scraper. I will satisfy you with high quality. Best regards.

$155 USD in 3 days
(18 Reviews)
5.3
shantanupython

I have done projects exactly like this so you do not need to worry, i will utilize headless browser automation to process the javascript and reliably capture the data, i see you are new here so do not get fooled by the More

$55 USD in 3 days
(15 Reviews)
4.2
lockbox

Hi there, Do You have some sample data for advanced search that return some meaningful results? It's hard to estimate price without seeing actual data. Also, please take a minute to get familiar with my profile and More

$230 USD in 1 day
(9 Reviews)
4.3
kunitsynartem

Hello! I can propose you to make a Python script with desktop GUI to crawl that website. In GUI you could enter parameters as in Advanced Search form in the website. After you press Start button - the crawler will star More

$166 USD in 3 days
(9 Reviews)
4.0
MaMingMing

Hello This is top web scrapper in this platform. Let's discuss about your project so i can start now Thanks

$155 USD in 3 days
(2 Reviews)
4.1
anzarulislam

Hello...! I have been in this industry for 4 years and such jobs are my daily practice. This is my first time on this site and hence you can see that I do not have any ratings/testimonials to show you. More

$50 USD in 1 day
(14 Reviews)
4.3
cranius

Hi there, I can do it. The step I am not sure is #4. What would be the criteria for something to exist or not? Apparently there is no hyperlink for the official website in the UID register correct? Relevant Skills an More

$110 USD in 4 days
(9 Reviews)
3.5