It have to consist from two parts:
1) Extract post links
I have number of search links for different cities and categories that need to be extracted.
Search string consist from this link + fixed query with keywords
In this part I need
a) have ability to upload first part links in database from .txt file
b) set up date range(period) of time, so only between that time ad links will be extracted
c) set up dinamicly number of keywords for extract(before press start)
d) see live process of exrtracting like:
Current link: 3 from 10
Links extracted: ...
e) have ability to stop and continue process
f) All extracted links should be saved in database. This data should be removed when press Start each time(exept Continue of process)
g) download extracted links to .txt file
h) delete all duplicate links
2) Extract data from links
In this part I need
a) have ability to upload links from txt file to database(in this case database should be rewrite)
b) save data from each ad links into database, with determinate structure(email, post text, title, date of posting, etc. will be provided)
c) see live process and have ability to Stop - Continue it
d) have ability to download extracted data
e) setup delay time in sec between extracting pages
This project was awarded to
Looking to make some money?
- Set your budget and the time frame
- Outline your proposal
- Get paid for your work
Bids on this Project
Taxila Cantt, Pakistan
Web, Bots, Crawlers, and Scrapers Development. I have expertise in automation services and I can automate any manual process.
Moscow, Russian Federation
Experienced Developer with better coding style
Chisinau, Moldova, Republic of
Expert in data mining, data extraction, products import/export into various CMS, eshops, blogs, web portals, etc
Scraping any data from any website with PHP script, and save data to xls, csv, sql xml or json format. Download images from source websites and save to local folder and zip all images. Automatic scrape data with schedule/cron job.
Should be able to work on time
I am a professional newcomer into the area of .NET. I have great experience in the similar areas of Advertising and Android. I have got excellent proficiency and training as a C# Programming Developer and C++ Programming Developer as I have taken up various projects in these areas. I am ready to start working for you. Hire me and I will put in my best effort to bring laurels to your company.
ShayanSolutions is located in Lahore, most famous and energetic city of Pakistan. We are in GMT+5 hours timezone. We have our front office located in Briminghum, London. We are in business since 7 years. Our clients are spread in all over the sphere such as USA, UK, Canada, Sweden, Germany, Denmark, Norway, Australia and many other countries. We can self-assuredly provide you our clients references for your assistance in case you want to verify the company reputation and our team capability. No beating around the bush, please go ahead and verify what our clients declare about Shayan Solutions from our Freelancer profile: https://www.freelancer.com/u/ShayanSolutions.html Some useful information about the Company and process of work: - We have 10+ employees working in house on various projects in different technologies along with few Designers, QA person and other staff. You may contact us, if you want to have a visual cues of the office & our staff pictures. - We highly recommend online meetings through Skype or other means to discuss the requirements of projects or overall process of work to fulfill the clients thoughts to ensure the same line of action. We have learned from our past experience that upfront meetings are important and very helpful to understand the requirements, finalization of the details to avoid any confusions or misunderstanding. - Our steady success rolling out the huge projects largely depends on regular communication and interaction with the clients through Skype/Phone or Emails, response time, online progress on our Demo Server to get feedback/comments, revision till the clients satisfaction. - Another hallmark is that we have flexible working hours and timings adjustment according to clients needs & limitations. - Our working hours are Monday to Friday, 10:00 AM till 07:00 PM (Pakistan Standard Time, GMT + 5 hours) but in case of crucial deadlines, we turned on Saturday/Sunday & team can work late hours in the office to achieve the deadline. - Following are few major factors of our success: - 24/7 online communication - Daily updates to get client's feedback - Direct contact with the development team - Safety: NDA, US office, Signed Contract Agreement - Global Client references - Flexible payment method - Payment thru credit cards, PayPal, bank transfers - Hire dedicated virtual team for your long-term projects - Lastly, our team is always there to cater your on-going and future needs to maintain long-term business relationship & we provide 5 months FREE support/maintenance after the completion of the project. Please feel free to contact us and inquire more about our Services and process of work or if you have any other questions. Look forward to hearing from you. Thanks and regards Arslan Ali - CEO