Web crawler details jobs
I'm in need of a detailed, compiled list containing 1000 contact numbers of individuals from the UK who are receiving any form of income benefits. The objective of this collection is for completion of a research study. Accurate data is key to the success of my project, thus, the list must also include the following information: - Full names - Addresses - Date of the last boiler replacement (if this information is accessible) Regardless of the type of income benefits received by the contact – be it Jobseeker's Allowance, Income Support, or Universal Credit – all are relevant and needed. Ideally, the freelancer for this job should have: - Proven experience in data acquisition/research - Familiarity with the UK benefits system and boiler replacement programs - ...
I'm looking for a skilled professional who can crop the complete content of a website and save it in a zip file to be deployed on a new server. The website is a small Wordpress with about 41 pages (as per sitemap). Content must not be saved as Wordpress, but static html to be deployed on another server. Key Requirements: - Crop all website content including subpages. - Save the cropped content in a compressed zip file. - The purpose of this cropping is to save the content for future use. - all files must be included, esprecially but not limited to images, js, css, ... - inner paths must be relative paths. If you're confident in your ability to deliver this and can ensure all the content is correctly saved, please bid accordingly. IMPORTANT READ THIS: Auto-generated bids wil...
I am in need of a proficient Python developer to work on a project that will involve extracting passport details from images. I am using library in python, but in some case its giving wrong result. - I will provide sample images for testing purposes during our chat - At the end we are using this result in PHP/Laravel so we will need api which can take image and return correct json data. Required Skills: - Proficient in Python - Experience with OpenCV - Proficiency in using Tesseract OCR for data extraction Note: Knowledge in image processing and previous experience in similar projects will be an added advantage. Please, when applying, share if you have done similar work. Looking forward to fruitful collaborations. Thank you.
I'm looking for a skilled developer who can help me integrate a reporting pie chart API into my existing React JS project. The pie chart is meant to display our monthly sales data, and it should support hover details for more in-depth information. Key requirements: - Display our sales data in a clear and visually appealing pie chart - Update the pie chart on a monthly basis automatically - Enable hover details on the pie segments, allowing users to easily access specific information Ideal skills and experience: - Proficiency in React JS - Experience with data visualization and charting libraries - Ability to connect with external APIs and automate data updates - Strong understanding of UI/UX principles for interactivity
I'm looking for an expert to design a web crawler to extract email addresses from specific company websites. The ideal candidate should be experienced both in web crawling and email data extraction. Key Tasks: - Crawl targeted company websites for email data extraction - Ensure the accuracy and integrity of all extracted emails Skills and Experience: - Experience with web crawling and data extraction technologies - Proven track record in email data extraction - Excellent analytical and problem-solving abilities - Familiarity with common web interrogatories for more efficient data capture is an asset - Strong attention to detail in order to capture complete and valid email addresses The successful candidate will deliver a list of valid emails ex...
I need the 6 details hand converted to AutoCAD. I am waiting for the correct layers/lineweights, so I will have to do that later or can offer a proposal to update the files when I receive those. So for now, everything can be on one layer. Please do use the CAD file attached to start with though.
I want to create one plugin in WordPress... Which uses Instagram api.. 1. Hashtag search 2. Get all theat post media .. e.g username, image, caption, like count 3. Store that in custom table
As the project lead, I'm seeking a highly skilled developer to construct a Scrapy web crawler for multiple sites. Although I omitted website specifics for now, rest assured we will provide the necessary details post-engagement. The ideal candidate is capable of: - Building an optimized web crawler with Scrapy - Extracting text data proficiently from various web pages, accurately and efficiently For the application, please provide: - Detailed project proposals outlining your approach Experience in web crawling design and Scrapy framework are a must for this project. Your technical capacity to generate the explained particulars is critical for success here. This is a golden opportunity to exhibit your proficiencies and contribute t...
i have design need to upgrad design be more detils like image ai not so simple
i have design need to upgrad design be more detils like image ai not so simple
i have design need to upgrad design be more detils like image ai not so simple
I'm looking for an experienced Java developer to create a simple servlets program using JSP, JAVA, and bare HTML for a school project. The structure should follow a 3-layer architecture with the MVC design pattern. I have already designed the solution, just need some muscles to implement my ideas as I have not much time to do it myself. Key Project Requirements: - Version Control: Git - Database Connection: MySQL - Functionality: User registration and login, product catalog management (store, fetch, and modify products in the database) - Use of Design Patterns: Singleton, Observer, MVC, and any others you feel are necessary Additional Skills and Experience: - JUnit - Netbeans - Password hashing techniques (if time permits, otherwise store passwords as plaintext.) - Experience with i...
i have design i need to add design some details to design
I'm looking for someone with knack for photo editing to take an already realistic image to the next level. Your task will be to remove the background, adjust the brightness, contrast, and perhaps even remove or add objects where necessary. Key considerations should be: - Ensuring the fineness of details is preserved - Maintaining color accuracy - Increasing sharpness and clarity The end result should be a high resolution, professionally edited photo that looks highly realistic. Experience in Photoshop and a keen eye for detail are must-haves for this project. Your portfolio should reflect a strong background in achieving similar results on prior projects.
I'm in need of data entry professionals who have exceptional skills in gathering text data from online resources and flawlessly entering it onto a spreadsheet. Key Responsibilities: - Sourcing text data from specified online resources - Accurately entering data onto a spreadsheet with minimal errors - Ensuring data entries are formatted correctly and uniformly within the spreadsheet Ideal Skills and Experience: - Proficiency in using spreadsheets: Microsoft Excel or an equivalent is required - Strong attention to detail: This is crucial to avoid mistakes in data entry - Experience in online research: Being able to quickly and efficiently find reliable online resources - Previous experience in data entry: A strong foundation in data entry tasks is desired. This project requires...
Currently, I am in need of an illustrious logo designer to create an iconic logo for our American Football League. I attached our current design in the attachements is a football and our state called Baja California Mexico but this design is to simple made. I am in a bit of a rush as it's required ASAP. Here are the details of the project. Logo Words: LIFA BC Competition Logo: ://://www.facebook.com/oefabc/&docid=bW04nRkl5sarEM&w=1631&h=1631&hl=en-US&source=sh/x/im/m1/3&kgs=944815503abde356&shem=abme,trie Key Design Elements: - Main Colors: Blue, Yellow, and White. Certainly, the combination should reflect intensity, energy and teamwork
I require an IAM role with specific permissions to interact with s3, glue, and Athena on AWS. This role will allow for efficient management of the AWS stack, specifically enabling the creation of a crawler to populate a glue catalog database and tables, and also allowing interaction with an Athena workgroup. What I need: - Read-only access: This permission should allow the IAM role to view S3 bucket contents, view Glue catalog information, and view Athena workgroup details. - Write access: This level of permission should enable the IAM role to create or update tables in the Glue catalog and modify Athena workgroup settings. Ideal Experience and Skills: - Solid understanding of IAM roles and permissions on AWS - Experience with AWS s3, Glue, and Athena - Capability to work o...
I need an experienced and proficient website crawler who can help me extract Text content from Database Tables on my website. Key requirements: • Acing in finding, fetching, and structuring data. • Proficient in delivering the retrieved data in Plain text format. • Emphasis on fetching Text content from the Database Table, thus understanding of database structures is a must. Ideal skills include web scraping, data mining, and database understanding. It would be best if you had an eye for detail as accuracy is key in this project. With your expertise, you should be able to navigate through complex website layers to get to the desired content.
I am looking for a skilled web developer to construct an informative website primarily intended for the general public. The main feature should revolve around displaying national weather service data in an easily digestible, accessible manner. Ideal Skills: - Professional understanding of web development - Experience in handling and integrating data API's, specifically weather related. - Strong knowledge in creating user-friendly interfaces. Specific Features: - The website should prominently feature up-to-the-minute national weather service data. - While the focus is on weather data, the inclusion of a contact form is necessary. - The website must be appealing yet functional, easily navigable by the general public. Your experience in developing similar platforms w...
I'm in need of data entry professionals who have exceptional skills in gathering text data from online resources and flawlessly entering it onto a spreadsheet. Key Responsibilities: - Sourcing text data from specified online resources - Accurately entering data onto a spreadsheet with minimal errors - Ensuring data entries are formatted correctly and uniformly within the spreadsheet Ideal Skills and Experience: - Proficiency in using spreadsheets: Microsoft Excel or an equivalent is required - Strong attention to detail: This is crucial to avoid mistakes in data entry - Experience in online research: Being able to quickly and efficiently find reliable online resources - Previous experience in data entry: A strong foundation in data entry tasks is desired. This project requires...
Hi GOHASHINCLUDE PVT. LTD., I noticed your profile and would like to offer you my project. We can discuss any details over chat.
We are seeking a skilled Wordpress developer to create an informational website focused on showcasing our company and product information. The central aim of this project is to provide clear and appealing descriptions of my products to potential customers while making them aware of our company capabilities and the applications of systems. We are a business to business provider and so the site must be professional in appearance however e-commerce functionality is not required. Key elements of the website include: - Maintain theme with provided reference images, colour scheme and brand identity - We have brainstormed and created a FIGMA page for you to review as a basis for the design. We would like feedback on this design prior to implementation as this is a concept only. - Site must be ...
I need a talented android developer/full stack expert to design and develop a product with an integrated AI chatbot component. Key Functions: - The AI chatbot's main function will be information retrieval. - Specifically, the chatbot will retrieve detailed product information. Skills and Experience Required: - Expertise in Android Development and Full Stack Programming. - Proven experience in AI chatbot integration. - A strong understanding of information retrieval strategies. - Skill in designing chatbots that provide in-depth information. Looking forward to a fruitful collaboration. Thanks.
We are in need of a knowledgeable and skillful programmer who can edit on GoLang code. The main task involves Ethereum network crawling. We already have a running code to crawling the Ethereum network. However, we still need to do some changes on GoLang code (designing crawler), such as partition the ID_space into sections, and crawl using multiple crawlers in Ethereum not only single crawler as what we have. In addition, there might be more few changes on the code. The ideal candidate will: - Understand DHT-based network and Kademlia - Knows a little about Ethereum (blockchain) - Have experience in GoLang - Possess a deep understanding of DHT network crawling (p2p) - Have previous experience with crawling networks Your responsibility will be building on top of running code...
...a secure and interactive web portal that will act as a bridge between school administration and students. This portal should allow: 1. Student Profile Creation: Students should be capable to input their personal and academic details such as name, age, address, grade, and subjects. 2. Document Uploading System: The students should be able to upload important documents like ID proof and certificates. 3. Admin Interaction: Once these details are entered, the school administrator should be notified, allowing them to directly message the student through the system. 4. User Authentication: The system should be secured with an email and password login to ensure data privacy and integrity. The ideal freelancer for this role should have significant experience in w...
-Creating a First model according details of Arc simulation pressure and temperture -stress and stain . But this firstly and Secondly I will go ahead according the request of clients.
My project revolves around the manual web scraping technique, specifically for extracting text content from chosen sections of a website. The Ideal Candidate Should: - Be proficient in manual website scraping - Have a keen eye for details as key focus will be on the extraction of product descriptions, part numbers, and filter diameters Job Scope: - Please note, Retailer website has anti-bot scraping protocols. This process will likely have to be done manually - Extract data on all 5300 of the products from specific retailer website - Use manual website scraping techniques to mine text from targeted sections of a website which includes product description sections - The text content to be scraped includes specific details such as product descriptions, filter diameter...
I'm looking for a skilled Data Scraper with strong experience in using Octoparse. As I lack a specific website, I need someone who can ably search and identify platforms to scrape data. The key information I want gathered includes: - Product Pricing - Product Descriptions - Product Images A successful freelancer for this role should have a knack for identifying valuable data sources, solid Octoparse proficiency, and thorough understanding of data crawling & scraping. An eye for detail is highly essential, as this role deals with accurately knitting relevant product data.
I'm in need of a proficient Excel professional who can seamlessly help with the data entry of contact details. The task will primarily involve entering names, phone numbers, email addresses, and postal addresses into an Excel sheet. Ideal Skills: - Proficient in Excel with a focus on data entry. - Thorough, detail-oriented, and committed to accuracy. - Previous experience dealing with similar data entry projects. This project is integral to an ongoing data management task, so a meticulous approach to capturing and organizing data is essential. If a strong rapport is developed, there could be opportunity for further collaboration on upcoming projects.
Hi, I need the following: 1. Get data from a EC website: store name, store details, product details etc. 2. Format: excel file
I'm looking for a skilled Data Scraper with strong experience in using Octoparse. As I lack a specific website, I need someone who can ably search and identify platforms to scrape data. The key information I want gathered includes: - Product Pricing - Product Descriptions - Product Images A successful freelancer for this role should have a knack for identifying valuable data sources, solid Octoparse proficiency, and thorough understanding of data crawling & scraping. An eye for detail is highly essential, as this role deals with accurately knitting relevant product data.
I'm looking for an expert in the Shopify platform who that can seamlessly include a table into my product details page using Shopify's built in Metafields/dynamic sources. The purpose of this addition is to display more elaborate product specifications. The data, already stored within Shopify's product details system, simply needs to be organized in a highly readable and user-friendly table. Understanding code for Shopify's backend dynamics will be instrumental in getting this job done. Ideal skills and experience for this responsibility would be: - Proficiency in Shopify's product details system - Extensive Experience in metafields and dynamic sources coding - Experience in interface and user experience design - An eye for visual detail ...
Hi Vasyl S., I noticed your profile and would like to offer you my project. We can discuss any details over chat.
More details: Which programming language are you more comfortable with? C# or Python or AI What is the level of understanding or background do you have in the chosen programming language? Advanced What type of data are you looking to extract from the website? Contact information, Registration details, Company profiles The website: Is the regulator for estate agents in the UK. They hold information on al estate agents. I would like a script or console app r automated way (could be AI) of extracting all the UK estate agents from this website. I need their sector, address, phone number and name and website. Thank you
I am urgently seeking an experienced web developer to overhaul my existing website. This task includes the following: - Content updates: I want to revise the existing content and logo.
This project entails the vectorization of a specific image with a primary focus on colours, shapes, and details. Ideal candidates should possess: - Expertise in image vectorization, preferably with a strong understanding of SVG and AI formats. - A keen eye for details, with a special emphasis on reproducing colours and shapes in the vectorized output. - Ability to work with an existing SVG/AI base file. Your task will include using the provided SVG/AI base file to produce a detailed, high-quality vectorized image. The final output should prominently emphasize colours, shapes, and intricate details of the original image. Proven track record in similar projects will be a plus.
I am looking for a talented OpenCart web developer to design and develop an eCommerce website with advanced features. Include theme and modules and design in price Key tasks include: - Development of product catalog and shopping cart functionality. - Implementation of a payment gateway. - SEO optimization for increased visibility. - Localization and language support for English and Arabic. - Integration with social media stores for a seamless shopping experience. The target audience for the website ranges from individuals to small and large businesses, so a professional and appealing design is crucial. Ideal skills: A successful candidate will have extensive experience with OpenCart, a deep understanding of eCommerce best practices, and a track record of delivering high-perfor...
Google Jobs Scraper project requiring skills in .NET, Python, Selenium and SQL. The task is to create a crawler to extract job listings based on predefined queries, manage the data in a structured manner, and provide an interface for controlling and monitoring the scraping process. The solution requires adept handling of rate limits and the use of rotating proxies for efficient data scraping. Data To Be Scraped: - Scrape all specified job listing data points. - Store and manage the scraped data in a SQL database for effective access and organization.
I'm currently facing issues with my web crawler code. Specifically, it's not managing to scrape all the required data and it's throwing errors inconsistently. This code has been built to scrape information from certain e-commerce platforms. The ideal freelancer for this task should show: - Proficiency in Node.js - Extensive experience with Puppeteer and web crawling, especially focusing on e-commerce platforms - Exceptional debugging skills Your challenge will be to inspect the code, identify the underlying issues and then fix them to ensure a comprehensive and seamless data scraping process. I look forward to collaborating with someone who can effectively resolve the issues and optimize the performance of this web crawler.
your website is causing the load spikes in question. You can consider reviewing this on your side additionally. We have also noticed that there is a lot of bot/crawler access to the website. Access requests originating from bots are registered every 2 to 5 seconds.
Hi, Today i have created a Scrapy crawler to crawl the website , but i'm not able to crawl the website because when i run the crawler, any request i do to the website, i got the 403 error to me. I just neeed you fix my code to do a request at someway the website return the code 200 instead of 403. I'm sending my code attached. Send me a print screen in the chat showing you received code 200 using the same url, then i will hire you to send me your code.
preferably a VBA solution, as per file, when click the 'generate' button to have multiple customer's details into one row in next sheet
...working Magento 2 site hosted on GCP. Create GCP and Install Magento 2 Open Source - see details See list below - Setup from scratch a Google Cloud Platform VM all the way to installation of the Magento 2 Open Source - that's it. I will deal with front end development separately. 1. Operating System: Ubuntu 22.04.4 LTS (Jammy Jellyfish) 2. LAMP Stack: Apache 2.4.55, MySQL 8.0.33 or the newest version, PHP 8.2.3 3. Elasticsearch 8.7.1 4. APIs: REST API, GraphQL API, Helcim API 5. Google Cloud Platform Setup: GCP Project, Compute Engine (VMs), Cloud Storage, Cloud SQL (Managed MySQL), Additional GCP Services (Optional): Cloud Load Balancing, Cloud CDN, Cloud DNS 6. Magento Installation: Download and Setup, Web Server Configuration, Database Setup, Magento Installe...
Looking for a seasoned AWS expert to assist in optimizing EC2 instances, S3 storage, and Lambda functions for improved performance. The ideal candidate will have: Mainly working on Aws glue jobs , S3,lambda, Crawler, step functions, dynamo DB ,Clouldwatchs, Appflow, parameter store , API Gateways, ETL Jobs,splunk logs CloudFormation - important big bucket,Spunk, Jenkins pipelines* CI/CD * , YAML for creating templates and manifest files * Sql mandatory for date base * using Postman for API calls * Python and spark Musk know
