Web scraper(extract) PHP/MySQL script

Budget $30 - $250 USD
Bids 13
Average Bid $152

Need to create PHP(+ Javascript, MySQL) script that extract data from Cr?[url removed, login to view]
It have to consist from two parts:
1) Extract post links
I have number of search links for different cities and categories that need to be extracted.
Search string consist from this link + fixed query with keywords
In this part I need
a) have ability to upload first part links in database from .txt file
b) set up date range(period) of time, so only between that time ad links will be extracted
c) set up dinamicly number of keywords for extract(before press start)
d) see live process of exrtracting like:
Current link: 3 from 10
Links extracted: ...
e) have ability to stop and continue process
f) All extracted links should be saved in database. This data should be removed when press Start each time(exept Continue of process)
g) download extracted links to .txt file
h) delete all duplicate links

2) Extract data from links
In this part I need
a) have ability to upload links from txt file to database(in this case database should be rewrite)
b) save data from each ad links into database, with determinate structure(email, post text, title, date of posting, etc. will be provided)
c) see live process and have ability to Stop - Continue it
d) have ability to download extracted data
e) setup delay time in sec between extracting pages

Post a Project Like This

This project was awarded to

About the Freelancer

Looking to make some money?

  • Set your budget and the time frame
  • Outline your proposal
  • Get paid for your work

Bids on this Project

  • SigmaVisual Profile Picture

    SigmaVisual

    Taxila Cantt,  Pakistan

    Web, Bots, Crawlers, and Scrapers Development. I have expertise in automation services and I can automate any manual process.

    PHP, ASP, C Programming, and Javascript

  • tmminty Profile Picture

    tmminty

    Moscow,  Russian Federation

    ## BIO I'm professional front-end developer. Have a good experience in UI programming. GitHub: https://github.com/tm-minty ## Area of Expertise HTML, CSS, JavaScript

    XML, Python, Website Design, and Linux

  • parthuji Profile Picture

    parthuji

    ahemdabad,  India

    Experienced Developer with better coding style

    PHP, Perl, XML, and Visual Basic

  • manageo Profile Picture

    manageo

    Chisinau,  Moldova, Republic of

    Expert in data mining, data extraction, products import/export into various CMS, eshops, blogs, web portals, etc

    PHP, .NET, Data Processing, and SEO

  • a7v3x Profile Picture

    a7v3x

    Birkdale,  Australia

    ! Note ! Due to my slight OCD, I refuse to do nasty 'hacks' and release substandard code. If this is what you require, please consider somebody else. Strengths: Perfect English Excellent communication Completely professional Preferences: Application structure design JavaScript dominate systems Control of final product quality (see note above) A Challenge (the new, the unique, or the impossible) Skills: (#/10) Windows (9) Linux (5) Apache (6) MySQL (6) PHP (5) JavaScript (8) Photoshop (7) Current Work: I am currently contracted to build a complete Enterprise System (CRM+Estimating+Invoicing+POs+MYOB) for a Brisbane based company which is nearing completion. Samples of the framework/modules can be provided upon request. Additional Information: JavaScript is definitely my language of choice, with PHP simply to do the tasks that JavaScript cannot (MySQL/Auth etc). All of my code is _Extremely_Developer_Friendly_, making it easy to read, modify and enhance without prior knowledge (great for big or ongoing jobs).

    PHP, Javascript, XML, and Windows Desktop

  • kusumosonnetwork Profile Picture

    kusumosonnetwork

    varanasi,  India

    We are the team located in varanasi,india. we are expert in php,mysql,javascript,ajax,jeason etc.

    PHP, Javascript, XML, and Data Entry

  • mantislin Profile Picture

    mantislin

    ChongQing,  China

    Scraping any data from any website with PHP script, and save data to xls, csv, sql xml or json format. Download images from source websites and save to local folder and zip all images. Automatic scrape data with schedule/cron job.

    PHP, Perl, ASP, and Java

  • blackpanther161 Profile Picture

    blackpanther161

    lahore,  Pakistan

    Should be able to work on time

    PHP, Javascript, Adobe Flash, and Website Design

  • bob1982 Profile Picture

    bob1982

    Patiala,  India

    I am a professional newcomer into the area of .NET. I have great experience in the similar areas of Advertising and Android. I have got excellent proficiency and training as a C# Programming Developer and C++ Programming Developer as I have taken up various projects in these areas. I am ready to start working for you. Hire me and I will put in my best effort to bring laurels to your company.

    PHP, Java, XML, and Python

  • ShayanSolutions Profile Picture

    ShayanSolutions

    Lahore,  Pakistan

    ShayanSolutions is located in Lahore, most famous and energetic city of Pakistan. We are in GMT+5 hours timezone. We have our front office located in Briminghum, London. We are in business since 7 years. Our clients are spread in all over the sphere such as USA, UK, Canada, Sweden, Germany, Denmark, Norway, Australia and many other countries. We can self-assuredly provide you our clients references for your assistance in case you want to verify the company reputation and our team capability. No beating around the bush, please go ahead and verify what our clients declare about Shayan Solutions from our Freelancer profile: https://www.freelancer.com/u/ShayanSolutions.html Some useful information about the Company and process of work: - We have 10+ employees working in house on various projects in different technologies along with few Designers, QA person and other staff. You may contact us, if you want to have a visual cues of the office & our staff pictures. - We highly recommend online meetings through Skype or other means to discuss the requirements of projects or overall process of work to fulfill the clients thoughts to ensure the same line of action. We have learned from our past experience that upfront meetings are important and very helpful to understand the requirements, finalization of the details to avoid any confusions or misunderstanding. - Our steady success rolling out the huge projects largely depends on regular communication and interaction with the clients through Skype/Phone or Emails, response time, online progress on our Demo Server to get feedback/comments, revision till the clients satisfaction. - Another hallmark is that we have flexible working hours and timings adjustment according to clients needs & limitations. - Our working hours are Monday to Friday, 10:00 AM till 07:00 PM (Pakistan Standard Time, GMT + 5 hours) but in case of crucial deadlines, we turned on Saturday/Sunday & team can work late hours in the office to achieve the deadline. - Following are few major factors of our success: - 24/7 online communication - Daily updates to get client's feedback - Direct contact with the development team - Safety: NDA, US office, Signed Contract Agreement - Global Client references - Flexible payment method - Payment thru credit cards, PayPal, bank transfers - Hire dedicated virtual team for your long-term projects - Lastly, our team is always there to cater your on-going and future needs to maintain long-term business relationship & we provide 5 months FREE support/maintenance after the completion of the project. Please feel free to contact us and inquire more about our Services and process of work or if you have any other questions. Look forward to hearing from you. Thanks and regards Arslan Ali - CEO

    PHP, C Programming, JSP, and Python