Web scraper database jobs
I'm looking for a proficient developer who can add a page to my website that interfaces smoothly with my MySQL database. The website already has formatting etc, so I'm not looking for that. The database stores a variety of exercise data, and the webpage needs to display this data in an intuitive and user-friendly manner. Key webpage features include: - Display of exercise data: Each exercise's description and its difficulty level should be displayed. There's also a column in the database containing YouTube URL links, so another important feature the webpage needs is the ability to watch these exercise videos directly from the webpage. It is a simple database with only one table. - Users should be able to select the exercise they want from ...
I urgently require a web scraper proficient in extracting data from xing.de. I will provide a file of specific company names, for which I want to obtain the number of employees. Your task will involve: - Gathering accurate and up-to-date data on the number of employees for each company on the list - Formatting the information suitably for my usability. You need to have proven experience in web scraping, particularly on professional platforms such as Xing. Familiarity with German language platforms is beneficial. The deliverable is a neatly formatted file containing company names and their respective employee numbers.
I am seeking an experienced developer to create a website scraper which is capable of collecting various pieces of data. This savvy tool must be designed to extract from () site: - Text content - Images - Product information - Address - Contact details - Videos It is essential for the scraper to perform its task on a daily basis. Yet, there won't be a need for the gathered data to be automatically integrated into a database. Ideal Skills: - Web scraping - Developing scraping bots - Programming knowledge - Manual data mining expertise Please only apply for this job if you have significant experience in creating web scrapers. This project requires a quick turnaround, so the ability to work under time constraints is key. Let's converse about s...
I'm looking for a web scraper. Your application should include your experience in this field specifically. I'm interested in scraping the following data from a particular website: - Product details - Contact information - Pricing information Please only apply if you have solid experience in web scraping. We will have lots of different webscraping tasks in the following weeks.
I'm seeking an individual who can create a one-time web scraper that can collect text, images, and tables from Website 1. The project involves: - Developing a tool to scrape text, images, and tables from the specified website. - Ensuring the tool can operate efficiently for a one-time scraping process. Key Skills: - Proficiency in web scraping tools and techniques. - Experience in scraping text, images, and tables. - Ability to create a custom scraper for a one-time scraping task.
I need a web scraper to extract specific data from various websites. The project will involve: - Identifying the necessary data to be scraped - Building a scraper to extract this data Ideal skills for this job include: - Proficiency in web scraping tools - Familiarity with web data extraction techniques - Ability to work with and extract data from various websites Please provide your quote for this project.
I'm in need of an experienced backend developer to create a mail parser with the following specifications: - **Email Protocol:** The mail parser should support SMTP, so proficiency in this area is a must. - **Primary Goal:** The primary function of this mail parser should be storing emails in a MySQL database. If you have experience with database integration, this would be a big plus. This project requires expertise in backend development, specifically with an understanding of how SMTP works. You should also be familiar with MySQL and have experience in integrating databases into applications. Please provide examples of similar projects you've worked on in your proposal. Thank you.
I'm looking for a skilled web scraper who can extract detailed information regarding the sellers on the Miravia website. Requirements: - Extracting Seller Data: The main purpose of this project is to gather information about the sellers on the Miravia platform (). This includes the shop_id shop_name Ivl1_cate_name product_number avg_price shipping_duration company_location phone_number email_address vat_number company_name shop_rating shipping_on_time % followers comments etc. I require 10,000 entries of data I require the data to be well-structured and organized into a CSV or Excel file for further analysis. Skills and Experience: - Proficiency in Web Scraping: The ideal candidate should have extensive experience in web scraping and data extraction. ...
I need a VA with Wix store experience, a keen eye for detail, and proficiency in spreadsheet management. You'll be tasked with: - Keyword Optimization: Adjust the product titles on my Wix store to ensure they are optimized for search engines. Experience with SEO would be beneficial for this. - Database Creation: Develop a comprehensive database for all my products. This will include attributes like Product names, Product prices, and Product URLs. - Formatting: The database should contain separate columns for each product attribute. Strong organizational skills and experience with data entry would be ideal. Ultimately, the goal is to streamline the management of my product listings for a smoother business operation. Prior experience with Wix and creating pro...
I'm looking for a skilled individual who has a good understanding of Mechanical Engineering and Data Science to help me set up a database that records the live feed of on-board sensors in a car. Key Responsibilities: - Utilizing an On-Board Diagnostic Tool and an app to record the data - Implementing a database to store the collected sensor data - Analyzing the data primarily for predictive maintenance using statistical analysis Ideal Skills: - Mechanical Engineering background - Proficiency in working with On-Board Diagnostic Tools - Strong experience in statistical analysis - Knowledge of database management systems and data analysis tools - Experience in predictive maintenance is a plus This project requires attention to detail, analytical thinking, and the...
I am searching for a Product Analyst who can apply their knowledge towards data analysis, market research, and performance monitoring. Its a small assignment This assignment involves diving into a snowflake database to explore how customers behave. The goal is to find useful information that can help the Product team make decisions to make the business grow. After you uncover insights, you'll suggest changes to the product, like adding new features, making current features better, or even getting rid of features that aren't working well. You need to do the analysis, create graphs to show your findings, share all the code you used, and also come up with a plan for an A/B test to try out one of your suggested changes. Note: Its a short assignment, not spend more than tw...
...performing poorly with slow website loading times and database slowdowns, which is unacceptable as I regularly have more than 500 concurrent visitors. The primary focus of this project will be optimizing the server's Plesk settings, Postgres and MariaDB databases, and PHP 8.2 configuration. Key tasks will include, but are not limited to: - Configuring Plesk for optimal performance, including adjusting server pool size - Identifying and implementing improvements to Postgres and MariaDB settings to reduce slowdowns - Tuning PHP 8.2 to enhance website speed and performance Ideal candidates for this project will have: - Proven experience in optimizing dedicated servers, particularly with Plesk and Almalinux - A solid understanding of database optimization, including ...
I am seeking a detail-oriented freelancer who can expertly transfer text data from PDF files into a database. The ideal candidate should possess the following skills and experience: - Proficiency in working with PDF files - Expertise in data entry tasks - Experience in formatting and structuring databases - Excellent attention to detail Suitable candidates need to handle copious amounts of text data, accurately convert the text-containing PDF files into a structured and organized database. This includes careful validation to ensure no data is lost or misrepresented during the data entry process.
Hi Ashish, this is for the tasks I emailed about.
We have a website where the homepage currently loads slowly due to multiple API calls. Despite implementing asynchronous API calls, the page load time is still not meeting our target. We are looking for a skilled developer to optimize the homepage to load within 1 second. we need some one who can : Optimized homepage that loads within 1 second. Cron job implementation for fetching and updating api data of tokens price/5%/24%//etc basically - i want to load data everything from DB only , rather than multiple api calls. thakns
I am looking for...Oracle DBA with experience in both Oracle RAC (Real Application Clusters) and standalone Oracle databases. The primary goal of this project is performance tuning. Ideal Skills and Experience: - Proven experience with Oracle RAC - Proven experience with standalone Oracle databases - Specialization in performance tuning - Familiarity with Oracle Database 19c Key Responsibilities: - Implementing performance tuning strategies - Monitoring and optimizing database performance - Troubleshooting issues related to performance - Ensuring the smooth operation of both RAC and standalone Oracle databases The ideal candidate should have a deep understanding of Oracle databases and be able to provide tailored solutions for enhancing performance on both Oracle RAC and s...
...skilled developer who can build a customized matchmaking database for my internal use. The database will primarily focus on matching investors to investment opportunities. Key Features: - Storing Match Preferences: The database should be able to store various match preferences including minimum/maximum investment, minimum/maximum funding amount, geographical preference, and the type of funding. - User Authentication: As this database will be for internal use only, the user authentication should be secure and limited to specific staff members. No external user authentication is required. - Search Criteria: The database should have search functionality based on the geographic location. Ideal Skills: - Proficiency in database management ...
I have an unfinished Flutter app that requires a skilled individual to handle its database connection. The app is designed and now, I need help connecting it to a MySQL database using an API. Key Responsibilities: - Complete the database connection for my Flutter app - Utilize MySQL to store the following data types: user profiles and authentication, transactional records, content and multimedia files Ideal candidate: - Proficient in Flutter and experienced in developing Flutter apps - Skilled in MySQL and API integration - Familiar with handling user data and transaction records securely - Strong background in data storage and retrieval for content and multimedia files This project is not for a business, but rather a personal venture. Your expertise will help me b...
I'm seeking a proficient individual for constructing an Access database for my project. The principal requirements include: - Experience with Access, as that's the selected database management system. - Expertise in data storage and retrieval is essential. - The database will be storing textual and numerical data. Experience in handling these types of data is crucial. Ideal skills would include an in-depth understanding of Access, database design, data storage/retrieval techniques and knowledge in handling both textual and numerical data. This should make for a streamlined and efficient process. I'm excited for us to kickstart this project together!
...a contact "]) In this example, almost all of your code would have been in… "1 of 3 script for scraping and filling in a contact ", and "2 of 3 script for scraping and filling in a contact ", and "3 of 3 script for scraping and filling in a contact " ******* THE NUMBER OF ITERATIONS AND THE LENGTH OF THE PAUSES ******* I don’t want a Google algorithm to ban me for web scraping. Therefore, you will give me a script named, “Trigger main script for scraping and filling in a contact ” which will include something like the following… import subprocess, random, time # Define the Python script file to be executed script_file = "Main script for scraping and filling in a contact " # Define the number of tim...
The database is on the National Environmental Agency's website, and it includes all of the applications submitted for environmental permits. Here is a link to the database: Please go over all of the records, and filter ones that match all criteria: 1. EIA Screening Application/Statement or EIA Scoping Application/Statement and 2. The application is for an activity in the sea Start a new spreadsheet, and for every such record, meeting the above criteria, add a row to the spreadsheet including: date of the record, screening/scoping, title of the application (translated to English), a url linking to the application on the NEA website. In addition, download the screening/scoping report document, translate it to English with Google translate
We would like to hire a freelancer expert in development of Postgres Database and Synchronization of Data from our Headquarter to our Multiple Area Office (10 No.) and to Multiple Local PC (Around 300 Nos.) locations available in Network.
We have attached the details we need to sync our data from Headquarter to Area Office and than to local PCs and back again. for RFID based application.
I am looking for someone experienced in web scraping and data collation. The project will involve scraping blog articles in HTML format and compiling desired information into an Excel file. Key Project Requirements: * The extraction will be from specified URLs, using their individual patterns for efficient and accurate scraping. * For each blog article, I need the title, the full text, and the publish date extracted. * This scraped data must be properly arranged in an Excel file for easy analysis. * List of articles is here: Ideal Candidate Expertise: * Proven experience in web scraping is a must, preferably with full understanding of HTML structures. * Proficiency in Excel and data organization. * Attention to detail to ensure accuracy of the scraped data
i have a form created with HTML and PHP. user has to fill in information and when press submit, it should insert infos in database. But sometimes it doesn't it just clear or keep loading. maybe connection is not good everytime. So i need someone to adjust it to upload data in realtime. as soon as user finished typing in 1 field, it should store data. when uploading, it should show loading icon near input field. if succeed, green vink icon. if not, red cross icon. when user finish, user can click submit button which will echo all data stored in mysql database on same page in lightbox. image attached. Budget is $35. if you want more, please do NOT bid. budget is $35
Create an executable scraper in Python that can extract the SKU (product) list from the following Indonesian online grocery apps: - Astro - Sayurbox - Segari The scraper must be IP-block tolerant, meaning if the scraper gets blocked, execution can be continued from the point where the last row of data was successfully extracted. Scraper Functions Function: list_category_tree Input: competitor_name(astro | sayurbox | segari), existing_csv (optional - CSV file to append to for continuing execution, if the scraper stopped or got IP blocked) Output: CSV of category tree with the following columns (scrape_date, URL, category name, position index, parent_category (null if top level)) Function: extract_sku Input: competitor_name, location (autocomplete pla...
...tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scraped data. Customize the scraper to meet our specific requirements and adapt to any changes or updates in the target websites. Deliver the scraped data in a timely manner, adhering to project deadlines. What We're Looking For: Proficiency in web scraping te...
My WordPress site hosted on AWS is currently down due to a database connection issue. Key requirements: - **Database Connection Issue**: The site is throwing an 'Error establishing a database connection' message. I believe this is related to database connection details in the WordPress configuration file. If you are experienced with AWS and WordPress, this could be a quick fix. - **Backup Restoration**: I have a recent backup of the site. However, I'm not confident about the database connection details in the configuration file. Restoring the backup and ensuring the database connection works correctly is crucial. - **AWS and WordPress Expertise**: Ideal candidates should have experience with both AWS and WordPress. Familiarity wi...
I'm in need of an expert who can help in developing a relational database using SQL and Python. The project will primarily revolve around database management. Consequently, I would appreciate assistance in the following tasks: - Designing a new relational database, ensuring it's optimized for efficiency and performance. - Implementing data import and export capabilities for seamless data movement. - Developing queries to support the database's functionality and ease of use. The ideal candidate for this project should have a strong background in both SQL and Python, with a specific focus on database development. Experience with optimizing databases for performance and some knowledge of data import/export mechanisms would be advantageous. Moreover...
I'm in need of an expert who can fix my corrupted .FIC file in my HFSQL database. Key Project Requirements: - The file is currently not opening and is producing errors, so the main goal is to restore it to its original state and ensure it can be opened without any issues. Please note that I can provide the corrupted .FIC file for analysis. Ideal Skills and Experience: - Proficient in HFSQL database management. - Proven track record in repairing and recovering corrupted database files. - Strong problem-solving skills to identify and rectify the issues within the file. If you're confident in your ability to handle this task efficiently, please provide details of your relevant experience and how you plan to approach this project in your bid.
...tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scraped data. Customize the scraper to meet our specific requirements and adapt to any changes or updates in the target websites. Deliver the scraped data in a timely manner, adhering to project deadlines. What We're Looking For: Proficiency in web scraping te...
...proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories must be contained within the scraper and be automatic
I need a database for the UK market, with a focus on company names and Email ID. Key Points: - The project primarily involves creating a comprehensive database for the UK market - The main data points to be included are company names and Email ID's - Information can be extracted from Yellow Pages, Business Pages, Associations, Business Chambers and similar. - Accuracy of data, specially Emails - Sample File of Required database is attached - To start with we require 10,000 records. - Will pay INR 0.60 per record. Ideal Freelancer: - Prior experience in creating detailed databases - Proficiency in data gathering, scraping and organization - Familiarity with the UK market would be a plus Please include your relevant experience in your application.
Join our team as a Python Selenium Web Scraper responsible for developing scraping scripts using Python and Selenium. You'll gather data from diverse websites, utilizing your expertise in web technologies, HTML, CSS, and JavaScript. Key responsibilities include analyzing website structures, extracting and cleaning data, and collaborating with team members to integrate data into existing systems. Ideal candidates possess proficiency in Python, experience with Selenium, and a strong understanding of web technologies. This role offers competitive compensation, flexible work hours, health benefits, and opportunities for career growth in a dynamic, collaborative environment
I need a skilled professional to assist with a data entry task. The project involves the following: - The task is primarily image data entry. - The images will be provided in digital photo format. - The entered data should be compiled into a database. Ideal candidates should have experience with data entry, particularly with image data. Proficiency in database management is also essential. A keen eye for detail to ensure accurate data entry is a plus.
I'm looking for an experienced web scraper to access and download specific information and images from the Used Inventory section of the White Rock Honda website. Here are the specifics of what I need: - Car make and model - Year of the car - Price of the car For each car listing, I need ALL available images downloaded. Furthermore, I require the images in JPG format. Candidates applying should have successful experience in web scraping, data extraction, and handling myriad images. Efficiency and accuracy are critical for this project.
I'm in need of an expert to assist with the cleanup of our Medicine database. The goal of this project is to accurately remove all duplicate entries improving the overall accuracy of the data. Ideal Skills & Experience: - Strong background in Database / Excel /CSV management, specifically in the medical field. - Proven track record of similar past work. In your application, please include details of similar projects you've worked on. Efficiency and precision are pivotal for this task. Looking forward to a neat and streamlined database!
I need a python scraper that can copy ads from one classified ads website and post it to other website
I am searching for an experienced app developer who excels in designing and implementing Android-based applications. The main functionality required for this task is the creation of a comprehensive employee database system. Key Functionalities: • Instant tracking of employees' online and offline status • Storing and displaying contact details of each employee • Categorizing employees based on their department The developer should have a strong understanding of database structuring and management for Android systems and a proven track record of delivering similar projects. Familiarity with real-time data sync and user-friendly UI design are also desirable.
I need to find a good supplier that can get me all of the buyers and planers from all customers in Asia, Africa, Europe, North America, Central America, South America, Australia. i am in the aircraft industry.
I need assistance in compiling a large, extensive database of more than 5,000 working professionals earning a salary under 3 lakhs per annum. The data profile will include: - Name and contact details - Education and qualifications - Current job title and company Interestingly, these professionals should spread across various industry sectors such as Technology and IT, Healthcare and Medicine, as well as Marketing and Advertising. Particular skills and experience that would set freelancers apart for this job include: - Proven experience in data mining and data scraping - Familiarity with the mentioned industry sectors - Ability to accurately cross-reference and verify data - Excellent attention to detail Freelancers with extensive experience in maintaining data integrity and c...
I'm in need of someone with the expertise, resourcefulness and knowledge to draw up an email lead list from public domain databases. The focus of this project is identifying professionals, specifically those with active websites for contact. Key requirements: - Extraction of email leads from public domain databases - Target demographic: Professionals of various walks with active websites - Experience with large-scale data extraction - Proficiency in managing information databases Your past work in email lead generation will be beneficial for the successful completion of this project. Your ability to provide clean, organized, and verified email lists will also be very important. Please only bid if you have the experience and know-how to deliver on the stipulated requirements.
I'm looking for an experienced data scraper. I need someone with excellent knowledge and expertise in web scraping. I will need the following with regards to mid sized collectible stores around the world: Company Name City Country URL Contact person Email address. Ongoing work for the right candidate/s
...images, news in the cities put together - Scrapped content from other pages into fun engaging content that people click on, comment and share, pr tgat we get them to jump to a web landing page. Local news and stories Experience in 2D and 3D animations, as well as motion graphics, is highly desirable. A background in short-form social media content creation will set you apart. Creativity, attentiveness, and a high level of organisation, speed are also crucial for this task. We run 3 big social media sites, and a web site so the core job is to engage and get comments, reach and shares AND jumps from social media out to tge web site. You must be able to research stories, scrape sites with permission if needed, use Ai big time, report on your videos performance. We d...
The objective of this assignment is to develop a comprehensive database system. The Database should support, among others, member registration, subscription tracking, member services management, and trade references. The system should facilitate data import from Excel and accommodate online and offline accessibility based on the user’s capacity to meet online hosting costs. Member Registration: Develop a module for member registration capturing key details such as Name, address, and any other contact information. Village, group, area, district, province, sub-group affiliation (e.g., Study circle, VSLA, commodity association etc.) Demographic information (age, gender, household size, etc.) Implement functionality to adapt and import member data from Excel sheets. Enab...
I need an experienced Laravel developer to integrate and manage the database for my existing project, www.getyourhomes.in. The task is not only basic CRUD operations but also extends to admin panel updates and AJAX call filters. - Database Management: You should be adept at advanced database management with stored procedures, triggers, and optimization. - Language Proficiency: Strong language skills in either Bengali or Hindi is essential. Your role would be crucial in improving the functionalities of my project. Prior experience in similar projects would be a bonus.
Hello to all talented SQL freelancers! We are seeking an advanced SQL specialist with proven experience in handling multi-level marketing (MLM) databases, as well as knowledge of Dolibarr ERP. We need someone who can understand the complex terms associated with MLM compensation plans and create effective SQL queries to extract the necessary data, as well as integrate with Dolibarr ERP systems. Responsibilities: Develop advanced SQL queries to extract data from MLM databases. Understand and apply concepts of MLM compensation plans. Collaborate closely with the team to understand project requirements and goals. Integrate SQL solutions with Dolibarr ERP systems. Optimize query performance and ensure data integrity. Requirements: Demonstrable experience in SQL and PHP. Deep knowledge of re...
Available driving test slots scraper with autobook for selected dates
I need a skilled developer to create an automation bot for Telegram Channels. This bot will have the essential functions of: - Auto-joining channels - Extracting basic channel information including the description and links I want the bot to be able to extract the following specific information from the channels it joins: - Channel Name - Channel Desc...information from the channels it joins: - Channel Name - Channel Description - Channel Links - Member Count The frequency of this extraction should be set to a weekly basis. Ideal skills and experience for this job would include proficiency in Python or a similar programming language, previous experience with Telegram's API, and prior experience creating chatbots or automation bots. Expertise in web scraping technologies ...
