Scrape data website database jobs
I'm requiring a data scrapping software quickly to extract text content from both websites and PDF documents. It's crucial that the scraped data is directed into Excel or Google Sheets format for my immediate use. Ideal skills for this job would be: - Proficiency in programming languages like Python that are often used for data scrapping. - Familiarity with web scraping libraries or frameworks, e.g., Beautiful Soup or Scrapy. - Experience using APIs to scrape data if necessary. - Previous work in pulling data from PDFs into readable formats in Excel or Google Sheet. - Ability to deliver the project ASAP. Your attention to these requirements will be much appreciated as I need this task done urgently. Please contact me if you need more d...
I am looking for a specialist to create an interactive UI in React Js that provides a seamless user experience. This project will require: - The creation of at least two UI test cases, with a clear emphasis on user interaction tests. - Setting up and integrating Routing and Gua...interactive UI in React Js that provides a seamless user experience. This project will require: - The creation of at least two UI test cases, with a clear emphasis on user interaction tests. - Setting up and integrating Routing and Guard Components for authorization. - Developing a backend in Spring Boot. - Saving credentials in a MySQL database. Ideal candidates should have solid experience with React Js, Spring Boot, and MySQL database. Proficiency in creating user interaction test...
My current server setup is causing slow response times for my web application and database system. This project involves optimizing the server settings to enhance the performance of both the web and database applications. Ideal Skills and Experience: - Proven experience in server performance optimization - Expertise in managing servers running web applications and database systems - Familiarity with Laravel, as the web application is built using this technology - Excellent understanding of server-side technologies and configurations Key responsibilities: - Diagnose the current server setup to identify performance bottlenecks - Implement necessary changes to optimize the server settings - Regularly monitor and fine-tune the server to maintain high performance - Provi...
I am in need of a seasoned data entry professional who can attentively transcribe information from various online databases into Google Sheets. The role is strictly manual data entry. Skills and Experience: - Proficient with Google Sheets and similar spreadsheet management tools. - Past experience with database interaction, particularly online databases. - Must have a keen eye for detail to ensure accurate data transcription. - Excellent time management skills are essential as deadlines are strict. Although this position emphasizes manual data entry skills, experience in data cleaning and validation pave the path for optimal efficiency. The successful candidate must provide proof of prior similar projects. Your ability to maintain high standar...
I'm seeking an experienced developer to assist in optimizing database speed for my Node.js website. Key tasks: - Conduct initial review of current setup, hosted on a Hostinger VPS with a configuration of 16GB - Advise and implement changes to improve response time, usining knowledge of different hosting platforms such as Amazon Web Services, Google Cloud Platform or Microsoft Azure. - Familiarity with MySQL as a database management system is a must. Ideal candidate would possess keen problem-solving abilities, strong knowledge in database management and previous experience with Hostinger VPS. Experience is optimizing Node.js websites is advantageous. Please provide examples of similar assignments in your proposal.
...create a robust AI-driven marketing program. This project aims to optimize the marketing database, generate sales, and increase our revenue. Key requirements include: - Building an AI system for data verification to ensure high-quality, accurate information. This includes email verification, phone number verification, and address verification. - Implementing an AI program to sort and segment lists for each campaign. It should consider the following criteria: - Demographic data: Utilizing data such as age, location, gender, and income level. - Customer behavior data: Tracking and understanding customer interactions with the business, such as preferences, buying habits, and engagement. - Purchase history data: Analyzing past purchases to pr...
My WordPress website is currently displaying "Error establishing a database connection" and I can't access the admin dashboard. I need an experienced freelancer with deep expertise in WordPress troubleshooting and database issues resolution. Tasks will include: - Diagnosing the cause of the database connection issue - Fixing the problem to get the website back online - Ensuring all website features are functioning as they should post-fix I'm using a Cpanel on Godaddy for hosting. So, familiarity with Cpanel and Godaddy is a requirement for this task. Also, I'd prefer someone with immediate availability as this is a high-priority issue. Skills required: - Advanced WordPress proficiency - Strong understanding of databas...
I need you to take the list of 250 companies on a google sheet and search each company online and confirm there website, then search for eaxh comoany and add the data to a google slide. Theee should be 3 cell names on the sheet Company name Website Companies house link
I have an online database searching service and I'm looking to upgrade its current features and introduce some new ones. Key Features to Add: - Advanced Search Options: I'm interested in building on my current search function to offer more refined search capabilities. - Scraping: I'm looking to add a data scraping capability to my service. This will involve extracting data from various websites and integrating it into my existing database. - AI Data Analysis: I'd like to incorporate AI data analysis functionality into my service. Specifically, I'm interested in pattern recognition and data clustering. Other Enhancements: - Batch Searching: I need to implement a batch search functionality. - Additional Databas...
...on MongoDB for data. As of late, there have been noticeable delays during actions that involve fetching data from the MongoDB database, significantly impacting the user experience. I'm seeking a skilled developer who can help me address these performance issues. Key Tasks Include: - Investigating and identifying the root cause of the slowdown when fetching data from MongoDB - Implementing optimizations and solutions to improve the performance of the server actions, particularly those related to database interactions - Testing and validating the improvements before deployment to ensure they effectively address the issue without causing any unintended consequences Ideal Freelancer: - Proficient in and MongoDB - Experienced in optimizing server ...
...create a comprehensive database ( 10,000 to 20,000) of Non-Resident Indians (NRI) working and/or residing in foreign countries like USA, UK, SIngapore, Canada, Australia, Dubai. Their age group may be between 22 years to 42 database will be used for marketing and promotions for my existing business. Key Elements Needed: - Name - Email - Mobile - Company Name (if available) - Country of Residence or Work Data Collection Methods: - Online Surveys - Social Media Platforms - Public Records Skills and Experience Needed: - Experience in data collection and database creation - Proficiency in using online survey tools - Familiarity with social media data mining - Ability to identify and use relevant public records - Attention to detail to ensure acc...
Hello fr...large amount of numeric data into a database. Here's what the ideal candidate would bring to the table: - Expertise in data entry, particularly with a focus on numeric data. - Proficiency with databases; experience with both creating and updating entries is necessary. - Demonstrated ability to manage large datasets, as the volume of data for this project is over 1000 entries. - Strong analytical skills with a propensity for accuracy. Your task will involve accurately capturing the numeric data and ensuring its successful entry into our database system. The success of this project is reliant on not just swiftly completing the task, but maintaining a high level of accuracy throughout the process. Thank you and I look forward ...
I'm in need of a proficient website scraper to gather data from specific fashion retailers. You will scrape the data for a period of about 12 weeks. Starting mid June. We would target the 10 following fashion retailers: Guess, Tommy Hilfiger, Levis, GAP, Calvin Klein, Ralph Lauren, Desigual, Mango, River Island, Pepe Jeans. The data required is - Item characteristics (like audience [male/female/kids] and item type [pants/shorts/tshirt/shirt/...]) - Price points over time (and corresponding discounts) - Out-of-stock data over time (per item, not by size) The collected data should specifically focus on their clothing items (no accessories, shoes, underwear, home wear, gifts,...). The project start deadline is ASAP. A quick turnaroun...
I've run across an issue in my WordPress / WooCommerce site that I'm not sure how to fix. I keep getting the error: "WordPress database error Commands out of sync; you can't run this...". This error is not related to specific actions or queries on my site. It's clear I require someone skilled in problem-solving and debugging with: • Extensive WordPress and WooCommerce experience • Clear understanding of WP databases and commands • Proven ability to address and correct site errors Please, I need this problem solved urgently. Your expertise and prompt attention to this will be greatly appreciated.
I need a Python expert to scrape tabular data from a series of PDFs and store it in a database. Ideal Skills and Experience: - Proficiency in Python. - Strong experience in web scraping with PDFs. - Familiarity with database management. The PDFs are consistent in format and all contain tables. The scraped data needs to be stored in a database.
I need to configure my Postgres database software to authenticate users with local Active Directory (AD) credentials. Key Requirements: - Authentication: Set up the database to authenticate users with their local AD credentials. This is crucial for security and access control. - Seamless Integration: Ensure that the connection between the database and the AD server is seamless and reliable. - User Management: The system should allow for easy management of user privileges, ensuring that the right people have the right levels of access. Ideal Skills and Experience: - Experience with Postgres: You should have a strong background in working with Postgres, particularly in a configuration and security context. - AD Integration: A deep understanding of Active Directory ...
Using RPData, archistar and the eplanning portal spatial viewer Scrape data of 800 meter diameter radius of all properties and place in google sheet Data required Property address, owner details, price purchased, date, land size, zone
...should reverse engineer API from mobile app because lazada blocks and throws captcha on web website is lazada . The script should work like i enter something in search box and it should scrape all the products from that search query Key Responsibilities: - Extract the following information: product names, prices, descriptions, stock, images, seller information, and product URLs. This list encapsulates the attributes you need to pay the most attention to. - Organizing the scraped data: The data, once scraped, must be organized in a well-structured CSV file. Ideal Skills: - Strong experience with Python. - Proficiency in web scraping tools. - Attention to detail to ensure all the mentioned data attributes are included. - Familiarity and experienc...
Function is done, amend the label that is stored and the value show. Only with ftp
I need a skilled professional who can compile a comprehensive spreadsheet of massage and beauty therapists. The data will come from provided databases which include salon details. Key Requirements: - Compile names, addresses, and phone numbers from the databases. - Organize the data in the spreadsheet by type of service (massage or beauty). The ideal candidate for this job should possess: - Proficiency in data entry and management. - Excellent attention to detail to ensure accuracy in the information gathered. - Familiarity with Excel for organizing the data by type of service. - A good understanding of the beauty and massage therapy industry would be advantageous. Please note that the final deliverable should be in Excel format.
...performance issues, database errors and configuration conflicts. Your main responsibilities will include: - Improving slow performance: My website is running slowly, and I need you to identify the bottlenecks causing the slow performance, and fix them efficiently. - Fixing database errors: We are experiencing database errors that need to be addressed promptly to ensure smooth operations. - Resolving configuration conflicts: There are conflicts in the configuration which need to be resolved to avoid further complications. Ideal skills for this project include: - Prior experience with Magento 2: You should have a solid background in working with Magento 2 and optimizing its performance. - Database Management: Strong experience in managing large databas...
I need a program that can scrape for the addresses of homes listed and compile them into a CSV file. The program should include the duration each house has been listed on the site, and have it run every hour to capture new listings. Additionally, I would like duplicates to be automatically eliminated. Key Responsibilities: - Scrape for home addresses - Compile addresses in CSV format - Include the duration each house has been listed - Run the program every hour to capture new listings - Automatically eliminate any duplicate entrie - Run CSV file against another data base that has age and name of owner and contact info. Ideal Skills and Experience: - Experience in web scraping and data extraction - Proficiency in programming languages suitable for web scrapi...
I'm looking for an app developer who can create an alumni database application that will run on both iOS and Android platforms. The primary function of the app will be to provide a comprehensive database of our alumni. Our existing alumni database will need to be integrated into the app. This will require a good level of understanding of database management and integration. I'm seeking a developer who has experience in developing apps for both iOS and Android, and who is also comfortable with integrating and managing large databases. Experience with database management systems and good UI/UX design skills are desirable. Skills Required: - Proficiency in app development for both iOS and Android - Experience with database management ...
...them into a spreadsheet. This job will involve: - Checking the manufacturer's site for specifications of mini PCs. - Accurately inputting the data into a spreadsheet as provided. - The format must be strictly adhered to for example if a mini PC has two RAM configurations, it should be shown as "8GB/16GB" and not "8GB, 16GB". Please open the attached spreadsheet for sample and for list of initial batch of 50 mini PCs. Start a conversation with me if you are interested by telling you have had a look at the spreadsheet and would like to work with me. The purpose of this project is to create a comprehensive database of mini PC specifications. This database will be continually updated with more mini PCs in the future, so a successful completi...
I'm looking for a skilled web scraper to handle challenging websites with advanced detection. The main data you will be required to scrape is text content. Here are the key project details: Ideal candidate should have: - Experience in web scraping, especially from challenging sites - Strong knowledge of web scraping tools and techniques - Proficiency in handling advanced automation detection - Excellent attention to detail to maintain a high level of data accuracy - Ability to deliver monthly updates in a timely manner Please include any relevant past experiences or examples of similar projects in your bid.
I'm seeking a skilled database developer to help me successfully migrate my database from .NET Framework 4.8 + EF6 + AspNet Identity to .NET 6 + EF Core + Identity. The database size is small - less than 1 GB, but it's crucial that user data is meticulously preserved during this transition. Key Tasks: - Perform data migration without any data loss. - Ensure the user login system and roles functions seamlessly in the new system. Ideal candidate should have: - Proven experience in .NET Core and EF Core migrations. - Strong attention to detail, particularly regarding user data. - Proficiency with user login systems in a .NET environment. Attached is the project source.
I'm in need of a web scraping wizard who can help me extract text data and profiles from Twitter website. Key Requirements: - The ability to scrape text data and profile information efficiently and accurately. - Experience in web scraping, with a strong portfolio showcasing past work in similar projects. - The time for scraping a post and profile must be less 3 seconds without using Twitter API. The final deliverable should be in a format that's easy for me to analyze, but I'm flexible on whether it's a CSV file, Excel spreadsheet or a database format. Please describe your past work examples with your application. Write "Blue" on the head of your bid if you are not a bot.
I am in need of an experienced professional who can work hand in hand with me in exporting my old MySQL database into my new Node.js website. There are a few discrepancies in column names that need attention, so attention to detail is crucial. This is a personal project, and the chosen freelancer should be comfortable providing remote assistance through anydesk, and maintaining open communication over a call throughout the duration of the task. I will personally guide you through the necessary steps and the specific level of accessibility that should be set for the new database. Ideal skills and experience: - Solid understanding of MySQL - Experience in Node.js website development - Exceptional problem-solving abilities - Excellent communication skills - Abi...
I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.
I'm looking for a skilled software engineer. THi...task is too large for excel power query, however i want it to operate in a similar fashion. The main purpose of this project is to develop a self-updating database of every racehorse in the state of NSW, Australia, via the website. Key tasks and responsibilities: - Determining the best platform for the software (Web-based/Desktop-based/Mobile application). - Creating a software solution that will automatically update and manage a database of racehorses. Skills and Experience: - Proficiency in at least one high-level programming language i.e., Java, Python, C++ - Experience with automation software - Familiarity with database management - Ability to recommend best software platform based on project requi...
I'm looking to scrape a website using the python package requests. 1) create a session because the site requires a username and pwd login 2) pass an initial URL that will get pagination of results 3) from the results we'll get the URL of the individual person/page we need to get info from 4) we'll make a request call within the session to the persons URL 5) Then we'll parse the HTML from the persons page 6) Then, we'll put the information into a dictionary object and append it to the a list 7) Finally we'll then print out the list of JSON objects to a text file
I am in need of a freelance MIS Executive with strong skills in data analysis and database management. Responsibilities: - Conducting detailed data analysis using the provided tools - Proficiently manage and maintain a database Ideal Candidate: - Proficient in Microsoft Excel and SQL Server - Experience in database management and data analysis - Strong analytical skills - Excellent attention to detail This project requires someone who can work independently, has a good eye for detail, and can deliver high-quality results. A background in MIS or similar field would be a big plus.
I’m seeking a highly skilled data scientist or analyst to develop an innovative AI/ML system with distinct functionalities. Ideal skills should include: • Extensive experience with AI/ML models. • Known for providing solutions with Natural Language Processing (NLP) capabilities, recommendation systems, data analysis, and data visualization. • Proficiency with QR, WhatsApp, LLM, DB, managing user profiles, cataloguing orders, generating recommendations, and facilitating payment systems. 1. Implement a QR code as the entry point for users to access WhatsApp chat. 2. Utilize WhatsApp APIs to initiate chat sessions. 3. Employ Language Model (LM) capable of Hindi, English, and Hinglish for conversational interactions. 4. Integrate LM with backend lo...
Looking for someone to install a specific WordPress theme, do some customization for categories, names, UI, and geographies, and then scrape specific data and enter it into the site. This has to be done ASAP
...week. Key Features: - The bot should be able to identify the tweet with the highest 'views to followers' ratio. The higher the ratio, the more viral the tweet is considered to be. - It should be able to scrape and analyze tweets from the past week. - The bot should be capable of differentiating between tweets based on their views to followers ratio and identify the 'most viral' one. Ideal Skills & Experience: - Proficient in creating Twitter bots. - Strong understanding of Twitter API and scraping tools. - Familiarity with tweet analytics and calculations. - Ability to extract and process data efficiently. The end goal of this project is to have a functional tool that can accurately pinpoint the most viral tweet of the week. It is essential that...
I am looking for a professional who could potentially help me create accountant Databases. Prefer for recent ready database. Ideal skills and experience: • Data entry • Report generation • Customizable fields Contact urgent.
I need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and quality control. - Ability to deliver a scrapin...
I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.
I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.
Our SaaS site () is getting a bit old. We need an experienced designer/front-end developer to completely freshen it up,We operate in the Web Scraping ...Scraping industry and would like our new site to stands out w.r.t. competition. We want a site that's easy on the eyes and presents our product offering better than how it is currently presented. Requirements =========== . New home page should have a section for testimonials/clients and a section for awards/review badges. . Each product (currently scrape and extract) have their dedicated page. Their illustrations need to be redone and the scrape page should have some icons/illustrations on top of each "Applications" box. . We need a new nav menu item for "Resources". The site footer section will al...
...relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid background in data handling, artificial intelligence, and machine learning will be a great advantage. This project has the potential to evolve into more extensive data analysis and prediction modeling. Skills and experience requ...
It is basically an app that helps the sales see the account profile data that is attached. We already have the designs ready, workflow will be decided in collaboration with the freelancer. Expertise required is app development and not design
...developer who can create a functional scraping tool for me. The purpose of this tool is to download JPEG product images from a specified URL that increments numerically. Key Requirements: - Scrape images from a continuously changing URL (i.e., www.****/asdasd/1234 then 1235, and so on). - Ability to tweak URL structure according to my needs. - Images must be saved in JPEG format. The ideal candidate for this task: - Has experience in web scraping and dealing with dynamic URLs. - Understands how to name files after the URL page number. Please note that the key goal is to download product images, not data extraction or process automation. Hence, your proposal should focus on delivering this specific requirement. Your understanding of this project and relevant skills wi...
I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .
I'm in need of a seasoned developer who can design a dynamic, responsive, and custom database synchronization system. Key Requirements: - Custom Data Mappings: The system should allow the designation of unique data mappings for seamless sync across various platforms. - Conditional Sync: The system should support conditional sync to ensure only relevant data is shared. - Automation: The synchronization process should be automated to reduce manual intervention and enhance efficiency. Platforms and Websites: The system should sync data with: - Social media platforms - Mobile devices Ideal Freelancer: - Proficient in database synchronization and mapping - Experienced with integration across websites and devices - Capable of designing automatio...
Follow directions in video. Maidstone and Unity - Janessa and Kenzie Turtleford/Shellbrook/North Battleford - Juan David and Eduardo Meadow Lake - Cody/Tristan
I need a professional who can scrape and compile email lists of high net worth individuals with a particular income level and investment interests. The emails will be used to target our automated trading software offer. Key Requirements: - Income Level Criteria: The emails should target individuals with an income level within the range of $250,000 - $500,000. - Investment Interests: The targeted individuals should have an interest in the stock market, Futures trading, options trading, cryptocurrency, and real estate. Ideal Skills and Experience: - Proficiency in data scraping and email list compilation. - Familiarity with targeting high net worth individuals and their investment interests. - Previous experience in compiling email lists for targeted marketing campaigns.
I want to develop a website similar to and https://www.abasteo.mx. The goal is to automate daily updates of the website's database. Key Requirements: - Daily database updates: The website should automatically update its database every day. - Products and prices: The database should include technology products, such as electronics and computer hardware. - Design and layout: The website should be visually appealing and user-friendly. - Database type: The database can be either SQL or MySQL. Ideal Skills: - Proficiency in SQL or MySQL - Experience in e-commerce website development - Strong understanding of front-end design - Ability to automate database updates - Expertise in handling technology products You...
...professional who can smoothly transition my old database into the new one for my website. There are some extra columns in certain tables in the new database, so understanding the essence of the project is pivotal. Here's what I need assistance with: 1. Importing Data: I have a detailed list of specific tables and columns which need to be brought into the new setup. Your work will heavily rely on this list. 2. Data Combination: While importing the data, some of it requires merging. I won't be able to guide you on how this should be done, so it will fall under your professional judgment. Your proven experience and innovative strategies will come into play here. I am hoping to find someone who has extensive experience in MySQL, d...
