Aggregator crawler jobs
I need a new website. I need you to design and build my online store.
We are looking for a professional web development and design team to deliver in the end to end build out and development of an online merchant and grocer application, this will be an online merchant aggregator where customers can select products from a wide range of merchants and grocers to make their purchases and have items delivered to their doorstep. This project requires a high degree of professionalism and experience with proven credentials to deliver to budget and timelines, it is based on a fully integrated model from purchase to doorstep delivery and will require a working knowledge and experience in front to back end to end operations in the world of ecommerce delivery services. Brief overview of the project scope should include: • Wireframe for website with...
The website is an aggregator for first responder service providers. The website has the following pages and sub-sections 1. Home Page - Booking - Add our youtube video - Before-after Split screen with two Illustrations - Coming soon 2. About us Page - Small description of the company + 1 Illustration 3. Blog display page - Blog layout page with multiple sections 4. Blog page - Blog page design Two more pages if need will be added post-implementation of these 4 pages Need flat design and illustrations to make up the entire website. The illustration icon sets can be handpicked from the internet. But the design has to follow principles of UI/UX. Also, the individual should be available on call for any communication.
Goal :- We want to extract information about important developers who have meaningfully contributed to the repository, based on the filename filters. INPUT A public github repository will be given. Example: A whitelist of filters will also be given. Example: src/*, config/*.json, so on. For the whitelist same syntax as .gitignore will be used. OUTPUT: A ranked list of developers who have contributed. Example dev1 10000 additions | 5000 modifications | 4000 deletions. dev2 …. Steps :- 1. Check all commits which are related to the filters (whitelisted folder/file) 2. Use the “.patch” command on the url to get the following info: (refer: ) a. Name b. E-mail address c. No. of commits d. No. of files changed e. No. of Insertions/changes From the patch, extract develop...
We have a website and a blog site. We used to have, what I understand, a crawler that would take our individual blog postings and populate them on a section already set up on our website. Such that, when we issued a blog post, the 'crawler' would scrape the blog and place it on our website in somewhat real time and automatically. We use Heroku/Ruby on Rails for the website and WIX for the blog site. Looking for someone who is very familiar with this function, please.
We would like to build a job aggregator website. This site should fetch all the jobs from other job website based on the search results in the site. The UX should be upto date. SEO optimisation should also be taken care of. You can refer Glassdoor website, Trivago website. We have the domain name and hosting server. The developer should be available 24/7 on call, whatsapp, zoom meetings. Work should begin from day 1 and daily update needs to be provided.
We are starting our services in South Delhi as a service aggregator , we would like to promote our self using SEO and Social Media Marketing, using organic search not the paid one. We are looking for some one who can build a good image on social media sites like facebook, twitter, quora etc and can permote our website using SEO and other techniques. This will be long term assignment. You can submit your charges on monthly basis.
I need a System like this Incl. Website crawler and all php files to include it into several own Websites.
I require a web crawler which can crawl through below websites 1. 2. Crawl the websites and save the product name, product price, qty (schema in mongoDb) , product category, product image (link is fine) ,website Crawler should be written in node.js/PHP/python Should be deployable to AWS/GCP the code should be well documented If you wish to use different stack, please get in touch project will be considered completed once the demo is given on AWS/GCP Please clear any doubts/requirements before bidding
...at writing this in java and python. You have enough experience in Cloud (AWS). You know Relational as well as NoSQL Data bases. The web crawler is supposed to ; 1. Consider and observe the rules stated of the crawled websites. 2. The crowler is scalable. Can be simultaneously run on many sites 3. The crawler is highly configurable . For example the crawler can : A) search websites based on a search words like handbags, or summer dresses B) or crawl for handbags in websites that have .de ending 4. The crawler gets images and text from websites for example image of a handbag its price, description, etc.. 5. The crawler sends the results to cloud for storage. The crawled text and meta data is also saved in cloud. 6. Each Image...
NOTE: I am NOT scraping the web. I am crawling a list of websites. I have an application has: 1. Front end server 2. Worker server Our application is simple. I put a list of websites and we have a built in crawler that will look for emails and put them in to a database. I have 2 problems. 1. 6 concurrent webcrawlers working at the exact same time crashes the database. speed, regardless of how much ram I add and CPU's, it does NOT increase the speed. I need someone extremely familiar with this setup. I don't have time for someone to tell me they can "figure it out" I need someone who can work FAST with 100% accuracy. I am using a small 2GB server from Digital Ocean for both front end and back end.
...the ability to mirror another person’s voice and ideas? • Do you have strong storytelling abilities? Our firm produces books for professionals, CEOs, entertainers, athletes, politicians, criminals (sometimes those are combined!) and entrepreneurs. Our business is increasing dramatically and we are in need of full-time writers to join our team. You’ll love our proven process. Our journalist, aggregator and admin do much of the work for you, so all you have to do is WRITE! For each project, you’ll be given an overview from our Editor in Chief. To be able to write a sample, you'll need listen to the audio interviews, review the transcripts, notes and the client’s website and/or LinkedIn. You’ll also be given a complete table of contents to ...
There are 2 parts to this assignment however I have done the first one and the second one is build on the first one so I can send part 1 to you. part 2 is to produce a search engine that works over the domain. Use the crawler and indexer from the first assignment (or Part 1 of the reassessment) as the starting point. The tasks are: 1. Develop a simple vector model retrieval system using tf*idf term weighting. The system should: a) Have a simple interface to run search queries. This should allow for (i) a single query to be entered from the keyboard, or (ii) a set of queries to be read from a text file. b) Return a ranked list of URLs to screen or file. The file output should be a CSV file with the same structure as the template provided on Blackboard. 2. When you have
I will need visibility to be arranged for a new on-demand cab aggregator business for the geographic location of Bangalore, India. This new service has a USP on why they have to use my company's cab services rather than the competitors. Availing a 1 lac app download by getting this USP flashed out to the targeted crowd is the core intention. Short and Crispy videos via WhatsApp can also contribute to this. The expectation from you is the visible result of a genuine app download of 100K from Bangalore region alone out of the process of generating customer awareness. "" NOTE "" IF YOU SEND ME A GENERIC RESPONSE BACK, I WILL NOT RESPOND BACK.
...SQL SERVER - Reading and storing data 2 / Python - To modify and fix the Crawler 3 / Python libraries for modify and fix the Crawler Jobs: 1 / Correct 16 Crawler that was developed 6 months ago and that stopped working, because some pages were modified. 2 / Integrate all modules in a single solution 3 / The system will read in a table the information that you will need to search on the websites. Once locating it will store in another three tables. The search table will have the fields: [BL] - Information you will need to seek [SOURCE] - The site to search [DATE_CRAWLERS] - From the date the information was found [WRITE] - Located NUMBER_OF_ATTEMPTS] - Number of attempts (only 5 attempts) Once located, the crawler will store in the SQL database. But inf...
Aggregator model app. The app will be a medium for booking their services.
I want to set up a web crawler to retrieve articles and news announcements, based on a specific company and its competitors in a specified industry.
Looking for a simple PHP crawler that crawls my websites and extracts relevant information. Contact me with text "I can do php crawler script". Any other messages will be ignored. ONLY in PHP. Thanks
crawler extension - as we discussed via chat, i need to be notified/aware when there is a huge variation between subsequent ceawling variations.
E-commerce aggregator application with 6 user interface (including admin.). Reference website, seo, smo and sustainable marketing. Intellectual property protection by binding contract for 20cr.
Website aggregator for a specific industry. Putting together all manufacturers/location from a specific area
Looking for a simple PHP crawler that crawls my websites and extracts relevant information. Contact me with text "I can do php crawler script". Any other messages will be ignored. ONLY in PHP. Thanks
I was thinking of using Apify to perform the webscraping using a crawler, I need to be able to easily add to the list of sites the crawler will scrape. Once the crawler is running it should download a site map of each of the sites in the list. Then the crawler should download the main headings and paragaphrs of texts on each page and put it into a row of cells. Separate pages of the site that the crawler has pulled data for can be put on separate rows of the Google Sheet. On any row should be heading 1,2,3,4,5 etc and pargraphs 1,2,3,4,5 etc. All this data needs sending to a Google Sheet Spreadsheet. The website I would suggest using is If you know of a better method to do it or a free method please suggest and we can discuss.
When user or search engine crawler opens our website there shall be no language specific redirect. You, the freelancer, shall go through our wordpress settings and ensure that there are no language-specific redirects. I don't want to give you access to our website, so we would work with Zoom and screen/sharing+remotecontrol.
Looking to develop an aggregator app for food and grocery development.
reference: 1. gather news from various sources (list of sources will be provided) 2. give credit to the author by backlinking to the original source 3. users can login/sign up for updates 4. highlight topnews, recent news, sponsored posts 5.
Please review the website (Frontpage and 2-3 subpages, frontpage being most important) and draft a list of concrete improvements that will boost load times (and SEO performance subsequently) plus mobile usability (as monitored by Google's Smartphone crawler). You will get full Google Search Console access. Technologies used: - HTML + JavaScript - CloudFlare CDN (excl. Enterprise features) - Wordpress Plugins (Yoast, Autoptimize, instant page, WP Super Cache - doesn't seem to work though) Please let us know: - what you will deliver for the fixed price - what your expertise in the field is (reference URLS!) = why you're the best person for the job - in what time frame you will deliver It is important that we get clear and concrete instructions from you how to impr...
I have 17 crawlers who read a table on the SQL server, search the site and, if they find it, write the information to the SQL Server database. But they were developed separately and I need them to be integrated and to make minor corrections were developed separately. I need it to be integrated into one project only. The system reads a database in SQL Server, searches the site and writes it to the database. The project would be to integrate the modules and make minor corrections.
I want to build a DeFi aggregator that will allow investors to Manage their DeFi position across multiple protocol without compromising your safety or security using third party API
Dear All, I am looking for a uber-like solution for logistics / trucking based on flutter framework. The solution should include the following. User App - For user to book loads Driver App - For drivers to accept and transport loads Transporter App (Fleet Management/Owners) - For fleet owners to assign to drivers and manage their fleet. Back-End Web Panel Website Please contact me for more details. Please ensure to send your company/user profile and portfolio.
Hello there, My English is not very good, so please feel free to contact me if there is something I am not clear about. I need a crawler expert to help me crawl all the listings in a certain city on airbnb.cn. so what I need is the python source code that can achieve this purpose. Here is the details: Let's say Shanghai, there are roughly 50,000 to 60,000 listings. I need the code to be able to capture this amount of data within 2 hours. Considering that one page of airbnb displays 20 listings, and the information I need is all on this page, so even 60,000 listings information only need to be visited about 3000 times, which should not be difficult. The real difficulty is that airbnb can only display 300 listings at a time in a city, so how to grab all the listings in this...
...edit, delete 'Deals API' - customer dashboard - Create Analytics - customer dashboard - Create Billing Page + Stripe API for payments - customer dashboard - Create Account details, editable etc. - customer dashboard - Create How to Claim - Barcode, QR, Phrase API - customer dashboard - Create Locations - Add new customer locations - customer dashboard Backend & Data: - Web Scraping tool - Data Aggregator -> "Deal API" - Data tracking for mobile users (Interests etc.) Admin: - Admin dashboard for internal use which allows us to see the following: Customer information, Deals, User Data tracking and Deal API overview. Documentation: - High level of technical documentation, someone else will have to maintain this code someday. --------------------------...
We need to crawl other sites for news contents & import then into articles on our own word press installation. Periodic checks will be made to other sites to check for updates. You must have good experience with wordpress and fetching contents & importing data. An example site where to crawl could be
Need a web scraper that meets the following requirements: 1) Scans the internet to collect Business Data 2) Business Data is contact information, mainly email addresses, but would like to also collect name, phone number, and domain (as part of email) with the email address. 3) Data should be stored and indexed in database on AWS. 4) Should maintain scanning to know if data has been removed or is still active. 5) End results should allow us to do similar things as (explained in video). 6) Must make sure we are doing things "above board" (legally) and not getting the robot / scan engine banned. Here is a short video explaining the requirements:
I am building a content aggregator site which is focused on trading inside the UK post Brexit for international businesses . I need someone who can write and load the content onto the site and also create weekly news letters . This should become a long term opportunity .
Hello Andrei i have a php crawler. which scrap informating about football match and present it to me. All big jobs are done. Only thing is for some football match data is showing but for some it does not. can you pls fix?
Aggregator model sellers, buyers & admin only for android APP with perfect UI/UX. What would be cost ? interested can share with past projects done email me ; mypranesh@
I want mobile applications for Android and iOS for an aggregator concept
I need a program with a very simple GUI that does the following: Input: Multiple Youtube search result URLs Examples: (youtube com....) /results?search_query=news&sp=CAISAggB /results?search_query=let%27s+play&sp=CAISBAgBEAE%253D /results?search_query=sport Function: 1.) The program accesses the first URL 2.) Scrolls down until all search results are loaded. (Important. Google adds new results multiple times when the end of the page is reached) 3.) Saves all results, thumbnails, and links (links to video and channel) on the local hard drive (in a subfolder of the program) and creates an HTML file for opening the list in the browser at a later time. One file for each input link. (Example list in attachment) 3.1) Waits a user-defined number of seconds to avoid the IP getting fl...
I need web crawlers for about 30 retail shopping sites: , etc. I would like to crawl and save the following fields: sku id, item name, brand, category, price, discount, color, shipping cost, size, image etc. The crawler should be able to run as frequent as possible in order to capture most up to date information.
Sorry Manal I hit hire instead of invite by mistake, I need someone to build a adult tube video aggregator. I know this looks like a cookie cutter project but it needs big data and very fast loading times. I need somone who is experienced with Nosql, Json files etc. If you are uncomfortable with adult content or cannot do it please let me know but if you can please bid or send a message.
Dear Freelancers, I need some one experienced in building crawlers for google maps. major functionalities : - SCRAP DATA FROM GOOGLE MAPS USING KEYWORDS AND LOCATIONS - BYPASS GOOGLE BANNING ( POSSIBILITY TO USE PROXIES) - EXPORT TO CSV FILE Alternatives :
the crawler must scan websites of companies and extract this informations. E-Mail * CompanyName Street Zip City Country Phone WWW URL * keywords (website keywords) do you have any suggestion what more is available ? the Informations must be stored as .CSV (utf8) Filename : you must make sure that the crawler is legal is is not against any law. you can make it in Nodejs,python,c3,c++,delphi … whatever works.
Hi, I want you to build the below: IoS A[[ Only* Food Delivery Aggregator Link to google drive files: List of Restaurants - restaurants and delivery apps to be shown on app MenuTemplate - self delivery restaurant menu items to be displayed in app Food Zone - Flutter template to be used to build Flutter app Logos - logos to be used when building ios app A Sources of menu items/prices (Focus on Toronto Only) data comes from two sources 1) data scraping/crawling food delivery apps 2) static spreadsheet which contains menus for all restaurants the food delivery apps to be data scraped/crawled are: postmates,.com but the menu items fields we capture
Need a freelancer to fetch coupon code using Website Crawling from Developer needs to write a website crawler code that can fetch data from the website and upload to our database. A 'Text Spinner' tool needs to be used to spin the words in that coupon. There should be a duplicate handling process.
