Perl scrape web mysql jobs
We are looking for a Linux developer to join our team. We are all remote workers. We are looking for the following skills, most important at the top: Perl SQL (Mysql/MariaDB) Shell Script PHP / Codeigniter Linux Docker We operate a mixture of web sites (php/apache) and data manipulation scripts (mainly perl).
I am in need of an experienced data miner who can effectively scrape data from a specific website. This task demands a keen attention to detail and utmost accuracy. The exact data to be scraped is not pre-determined at this stage, hence flexibility and adaptability is crucial. The project entails: - Scrapping uncharacterized data sets from a specified website - Cleaning and organizing the scraped data into tables The ideal candidate should demonstrate: - Competency in using scraping tools - Proficiency in data cleaning and organization - A good understanding of tables and data sets - Previous experience on similar projects. I look forward to working with a freelancer who is communicative, reliable, and delivers on time.
A few years ago I got help via this site to scrape a number of web pages. And it worked well, but the problem was that I constantly needed to add new information. So instead I bought help to build my own engine that scraped new pages every time I needed to - which was quite often. The problem here was that the pages changed their layout and I had to ask for help probably once a month. So that wasn't optimal either. Therefore, I have now decided to set up the scrapers myself using Power Automate Desktop. And that's why I need help when I get stuck. It could be weekly or monthly, I don't know in advance. Is there anyone who would consider selling their time from time to time? I am sitting on a Swedish version of PAD so you either need to explain to me how to ...
I'm looking for a freelancer to create an internal calendar (Calender PHP Code already installed) website using Mysql for the data. The website will need to have a basic calendar view to display different dates. I already have the Data in an ERP System. I will provide a function to copy the Data automatically from the local ERP System to the Database on the Webserver.
I have a file of a database (containing .frm .ibd etc files) I can restore it in MySql but there are certain fields in it that are encrypted (I seem to have found the key in a certain table) and these encrypted fields It should show Chinese. qt_name and qt_answer in Figure 01 need to be decrypted, and paper_num in Figure 02 seems to be the key
...proficient developer to create a web application aimed at maximizing user engagement. This project requires immediate attention, with a goal to complete within a month. Here's a detailed outline of my needs: - **Platform Focus**: The application is targeted exclusively for the web. It should be responsive and compatible across various browsers and devices. - **Application Objective**: The core aim is to build an application that captivates and retains user interest, through interactive functionalities and dynamic content. - **Required Skills**: - Strong experience in Spring Boot for the backend, ensuring smooth and efficient server-side functionalities. - Proficiency in Angular for crafting a seamless and interactive front-end user experience. - Knowledge of ...
I'm seeking a skilled web application developer to create a Software as a Service (SaaS) WebApp that is intuitive and accessible to the general public. This project will require the creation of a web application that is engaging, user-friendly, and functional on all devices. Key Features: - **User registration and login:** Essential for creating a personalized experience for each user. - **Responsive design:** Ensuring the WebApp is fully functional and aesthetically pleasing on a variety of devices, from mobile phones to desktop computers. Purpose: The main objective of this WebApp is to serve as a Software as a Service platform, offering specific services directly to users via the web interface. The exact nature of these services will be discussed in further ...
I require a proficient data analyst with advanced MySQL knowledge to handle large dbf files surpassing 10MB. Key responsibilities: - Data import/export from these dbf files - Manipulation of the datasets - Comprehensive data analysis Ideal Skills: - In-depth knowledge of MySQL - Experience handling large data sets - Experience in data manipulation - Advanced analytical skills - Familiarity with dbf files Please be detailed with your relevant experience and approach to handling this project when placing bids.
I require a proficient data analyst with advanced MySQL knowledge to handle large dbf files surpassing 10MB. Key responsibilities: - Data import/export from these dbf files - Manipulation of the datasets - Comprehensive data analysis Ideal Skills: - In-depth knowledge of MySQL - Experience handling large data sets - Experience in data manipulation - Advanced analytical skills - Familiarity with dbf files Please be detailed with your relevant experience and approach to handling this project when placing bids.
I need a specialist who can meticulously scrape EAN and price details from Allegro.Pl. The pertinent details will then need to be organized into an Excel file. Requirements: - Proficient in data scrapping, particularly from - Able to compile relevant data into Excel format - Ensured accuracy in EAN and price information Ideal candidate would have previous experience in scrapping data from eCommerce platforms, with strong familiarity with Excel. I will give you logins where i can find all eans by specific search, example if i enter numbers 59 i get eans with these numbers, but there isn't visible prices, allegro has developer API, but i do not know it it helps.
I'm in urgent need of a Node.js developer with experience in API integrations, specifically Razorpay's API for payment processing. Key Aspects: ihave ubantoserver uneed to setup apache +mysql and nodesjs in server - Implement the Razorpay API in an Ubuntu environment. - Allow for one-time payments through Razorpay. - Integrate the functionality for handling refunds and cancellations in Razorpay. Ideal Skills & Experience: - Proven experience in Node.js and API integration - Familiarity with Ubuntu environments - Prior knowledge of integrating Razorpay's payment processing features.
Python script to scrape data from website nxp
I’m seeking an experienced data scraper for the Financial Conduct Authority (FCA) register. The main purpose of this project is to extract the name and email addresses of the individual designated as the 'contact for complaints' for every registered company on the FCA's list. Accuracy in extraction is crucial. Requirements for the project: - Extensive experience in data scraping, preferably with a proven track record of large-scale projects - Ability to sort the extracted data in alphabetical order Please note that this task involves extracting information on all types of companies listed on the FCA register and not just Banks or Insurance companies. Hence, having a keen eye for detail and organizational skills would be advantageous.
...of dynamic dropdown lists, filled with data from a MySQL table. As this question wasn't elaborated further, I assume the functionality should include: expanding on click and selecting an option from the list. - Additional Columns: The other column fields should showcase an auto-increment number and a date field. - AJAX/ jQuery/ JSON: Ensure the select option within the table operates effectively using AJAX, jQuery, and JSON in PHP and MySQL. - Total Calculations: I require the table to automatically calculate and display the total amount at the bottom. The task is personal in nature, and I am hopeful for completion as soon as possible. The ideal freelancer for this project will have strong experience in PHP, AJAX, jQuery, HTML, and MySQL. An in-depth understa...
As a client, I am on the lookout for a skilled Full Stack PHP/Mysql and HTML developer to co-develop a customer web application for my clientele on a part-time or full-time basis. Key Responsibilities: * Develop a user-friendly web application with key functionalities including: * User registration and management * Payment processing system * Interactive dashboards Skills and Experience: * Proficiency in PHP/Mysql and HTML * Able to work independently and collaboratively as needed * No specific framework experience is necessary but an ability to adapt and learn is crucial Design Preferences: * The design of the web application should be minimalist and clean. Your expertise could make all the difference in meeting my project goals, so I...
I am in immediate need of a web scraper who can extract specific data fields from Local.ch. The specific fields I need include: - Company Name - Phone Number - Address - Languages - Website - E-mail - Listing URL - Category This will be a one-time extract; no repeat scraping is required. As this project is of high urgency, a freelancer who can start immediately and work efficiently is preferred. Key skills for this job are familiarity with web scraping, data extraction, and the ability to deliver accurate data in a short period of time. Experience in similar projects will be a significant plus. Turnaround time is ASAP. Please make an informed bid considering these specifications. Your expertise is highly anticipated.
...candidate: **Key Skills and Experience:** - Proficiency in **C# programming** is a must. - Extensive experience with **.Net Core** and **Entity Framework** to efficiently manage our project needs. - Strong knowledge of both **MySQL and SQL** for effective database management. - Fluent in **Bootstrap**, **HTML5/CSS3** to ensure our applications are responsive and visually appealing. - Capable of utilizing **Jquery** and **Angular** for front-end development. - Experience with **SSIS** and **SSRS** for SQL server integration and reporting services. - Proficiency in developing **web services** and willingness to learn or work with **3rd party APIs** as per project needs (precise APIs will be discussed later). **Project Goals:** We aim to enhance our current applications and...
I'm looking for a knowledgeable ful...take my existing e-commerce website to the next level. The website is built with React and Node.js with Express, and integrated with MySQL for data handling. Key features to put in place: - Product catalog and search functionality. - Shopping cart and checkout procedure. - Addition of other back-end functionalities and API integrations as needed. Another key aspect is integrating a payment gateway. Specifically, integration of Stripe for smooth and secure transactions is my preference. The desired candidate should have: - In-depth knowledge and experience with full-stack development. - Knowledge of React and Node.js. - Experience with Express and MySQL. - Proven ability with back-end functionalities, API integrations and paymen...
I am in need of very specific data extractions from allure/shopping that specializes in skin care and makeup products. My requirement is a comprehensive and accurate scrape of their product catalogue data. Here is what I'm specifically looking for: - I need comprehensive data on the product categories, sub categories, product name, brand, price, size and ingredients etc. I am seeking professionals with: - Proven experience in web scraping tasks focusing on product catalogue extraction. - Prior experience scraping e-commerce or similar platforms. - Someone with attention to detail to ensure the integrity and accuracy of the scraped data. Your task completion will be evaluated based on the comprehensiveness, accuracy, and timeliness of the data delivered.
I would like to have an experienced developer who can build proxy API for me. I can give you a reference link:- I don't need a website, other features or design etc. I just want proxy API with the help of that I can scrape or rotate proxy which I can scrape a website. I just need the code. Experienced developers can apply and new freelancers who can do this can also apply. Thanks in advance.
...focusing on web scrapping. Skills and Experience: - Proficiency in Python for web scrapping - Experience working with images, text content, and contact information - Detail-oriented approach to work to grab colors, sizes, prices, titles, and categories Job Requirements: - Utilize Python tools to scrape specified data from websites. This includes text content, images, color, sizes, price, titles, and categories. - Ensure all collected data is suitable and correctly formatted for content aggregation. - Eliminate errors or irrelevant data during the scraping process to maintain consistency and quality. - We require python source code. Example page: Candidates with previous experience in Python-led web scrapping for
...service based application which will provide various kinds of services to the customers e.g. salon services, etc. What we are looking for ? - flutterflow development application - Simple responsive website, with 1-2 pages – Backend API which will be consumed by both mobile app and website. This must be in Java (Spring boot preferred) - The backend developer will take care of database operations (MySQL/Postgres expertise) **Core Functionalities Required:** - **Appointment Booking:** A seamless interface that allows customers to book, modify, or cancel appointments for various salon services. - **In-app Payment:** Secure and versatile payment options enabling users to pay for services directly within the app. **Platform:** Our main focus is to deliver this application on bo...
At least 10 years ago, I found a script on the web and it has worked great. I moved to a new hosting company and can't get it to work. Would anyone be able to help? On my shared hosting service in /public_html, i have an file with this script below. It allows me to type a subdomain URL of my domain and it would redirect to a URL I set up in the script. Effectively a long list of shortcuts. like would get the ninite chrome installer would go to the youtube live feed. if I type a subdomain that didn't have a shortcut, it would take me to my website. I got it working years ago and would edit it just to deal with shortcut additions, deletions & changes. I really don't know the first thing about programming. I copied my public_html
Requirements: I'm in immediate need of an expert data scraper to scrape all the information (including business names, addresses, city, state, email addresses, phone numbers etc.) on every website with the domain ending with . located in the United States, as well as their corresponding Google Maps listing and info, which can be accessed by clicking into the map in the Contact Us section at the bottom of each page. For example: https://www.google.com/maps/place/White+Mountain+Bagel+Co/@44.038117,-71.6760578,17z/data=!3m1!4b1!4m6!3m5!1s0x4cb4822e42adb391:0xecf31448c825e8f7!8m2!3d44.038117!4d-71.6760578!16s%2Fg%2F1th0xz15?entry=ttu Ideal Skills and Experience: - Proven experience in web scraping, particularly with sites ending in .business.site. and
I have an excel file containing more than 100 ...file containing more than 100 audio components for which I need up-to-date average sold prices collected from HiFi Shark. The project requires the development of an automated scraping tool with the key output is the average sold price for each audio component. Key Responsibilities: - Develop an automated script or tool to scrape HiFi Shark - Extract accurate, up-to-date average sold prices for each listed audio component. Ideal Skills & Experience: - Expert in web scraping, using Python, Scrapy, Selenium, or other scraping tools - Experience with Excel and data extraction - Familiarity with HiFi Shark site structure and means to bypass any potential scraping restrictions - Strong attention to detail to ensure accuracy...
...- Ability to diagnose the issue quickly and implement a solution that is permanent and scalable - Experience with e-commerce sites, particularly in optimizing product pages for performance and user engagement - Excellent communication skills to provide updates and document the changes made **Ideal Skills and Experience:** - Expert understanding of Magento's architecture - Proficiency in PHP, MySQL, HTML, CSS, and JavaScript - Experience with Magento extensions and themes - Knowledge in performance optimization for Magento sites - Familiarity with Magento's latest security practices The issue with product pages has led to a notable decline in user engagement and sales. Timely resolution is paramount. The selected freelancer should be ready to start immediately and hav...
I need an experienced web scraping and data extraction expert for a continuous engagement that will entail web scraping, web crawling, data mining and extraction. You will also upload and publish the relevent data to the website, preferably through automation. The data is to be extracted from multiple sources and pages (websites and social media pages) and will include both text and images. Requirements: - Experience with web scraping tools and software. - Ability to navigate and scrape text and images from different sites and social media. - Knowledge of ethical scraping practices, especially for social media sites. - Proficiency in data cleaning and organization for analysis. - Capability to deliver the project within the specified timeframe. Ideal S...
I'm looking for a skilled individual to repair a critical aspect of my project. Recently, my MySQL database, which is essential for data analysis purposes, has ceased to parse data from a particular website. This issue arose after changes were made to the website, disrupting the functionality of our existing PHP parsing script. **Requirements:** - Proficiency in MySQL and PHP is paramount. The ideal candidate will have extensive experience in managing MySQL databases and writing PHP scripts. - Experience in web scraping and data parsing techniques, especially in cases where the source website has undergone changes. - Ability to quickly diagnose script issues and implement efficient solutions to restore data parsing functionality. - Knowledge in data analy...
I need an experienced web scraping and data extraction expert for a continuous engagement that will entail web scraping, web crawling, data mining and extraction. You will also upload and publish the relevent data to the website, preferably through automation. The data is to be extracted from multiple sources and pages (websites and social media pages) and will include both text and images. Requirements: - Experience with web scraping tools and software. - Ability to navigate and scrape text and images from different sites and social media. - Knowledge of ethical scraping practices, especially for social media sites. - Proficiency in data cleaning and organization for analysis. - Capability to deliver the project within the specified timeframe. Ideal S...
I'm in need of a skilled web scraper who is proficient in extracting data from Twitter. This project revolves around the extraction of user profiles and posts/comments. Given the sheer scale of information available on Twitter, expertise in handling large amounts of data is essential. Your task will be: - To scrape Twitter for user profiles and posts/comments. - To organize the scraped data into a comprehensible and easy-to-navigate format. Ideal Skills: - Strong experience in web scraping and handling large data sets. - In-depth understanding of Twitter's data structure and algorithms. - Proficiency in data extraction tools and software. - Ability to deliver neat and well-organized results on time. This project could be the beginning of a long-term partne...
I am experiencing issues on my WordPress site, specifically with PHP updates. When i try to update the PHP it causes an issue: “Your PHP installation appears to be missing the MySQL extension which is required by WordPress.”
...backend of my website, but unfortunately, it's currently ridden with PHP and database errors that need fixing urgently, preferably within the next few days. Here's a brief outline of what I'm looking for: **Requirements:** - Diagnose and resolve PHP errors - Fix database connectivity and query issues - Ensure website backend operates smoothly post-fix **Ideal Skills:** - Proficient in PHP and MySQL - Experience with troubleshooting and debugging PHP code - Familiarity with website backend workflows - Ability to work quickly and efficiently under time constraints **Objective:** The main goal is to get the website running without any hiccups as soon as possible. Given the urgency, I'm looking for someone who can dive in immediately, identify the issues, an...
...currently in immediate need of a skilled Node.js developer who specializes in backend development, API integration, and database management with a strong emphasis on MySQL. The main objective of this project is to build a robust API that serves as the backbone of our application. This API will need to integrate seamlessly with other software components and facilitate smooth data exchange. Ideal Skills and Experience: - Proficiency in Node.js for creating and managing server-side application logic - Extensive experience in developing APIs, especially RESTful services - Strong background in database management with specific expertise in MySQL, including schema design, querying, and optimization - Familiarity with API security measures and best practices to ensure data prote...
I'm looking for a skilled Node.js developer with a strong background in several key areas to help with my project. The ideal candidate will have extensive experience with Puppeteer for automating web browsing and data scraping, familiarity with ffmpeg for any potential video editing needs, and solid knowledge of WebRTC for real-time communication and video streaming. The project will focus on two main tasks: 1. **Web Browsing and Data Scraping:** - Automate the process to extract specific information from various websites. - Leverage Puppeteer to navigate, simulate user interaction, and scrape data efficiently. 2. **Real-Time Communication and Video Streaming:** - Implement WebRTC to facilitate online meetings and webinars, ensuring stable and seamless ...
...checking the product visibility settings, ensuring they are set to be visible on the site, but this has not resolved the issue. To successfully tackle this project, I believe the following skills and experiences are essential: - **Profound knowledge of OpenCart**: Understanding the backend and structure of OpenCart is crucial for diagnosing and fixing the display issue. - **Experience with PHP and MySQL**: The issue may require diving into code and databases, so proficiency here is necessary. - **Problem-solving skills**: Ability to diagnose problems that aren't immediately apparent and come up with effective solutions. - **Attention to detail**: Ensuring that no other part of the website is affected while fixing the issue. The ideal partner for this project will have a t...
Please scrape into an excel list a list of: - tax managers OR tax directors or Head of Tax; - from Multinational companies (revenue >750 million AND operating in multiple companies) - Head office in Spain; - non service providers like accountancy confirms so no Pwc, KPMG, EY and Deloitte.
...information before it is inserted into the vector database. - **Database Integration:** Develop the necessary code for securely and efficiently inserting the verified data into the RDS MySQL database. This process should be automated and optimized for handling data from multiple users and documents. **Desired Outcomes:** - A fully functional AI-driven application that seamlessly extracts personalized data from user-uploaded documents. - Efficient and accurate interaction with LLM/RAG services to ask predefined questions and verify the responses. - Secure and organized insertion of extracted data into a RDS MySQL database, facilitating easy access and analysis. This project represents an exciting opportunity to apply cutting-edge AI technologies for practical data ext...
...understanding of the concepts of MVC, routing, middleware, etc. Online Gambling Industry Knowledge: Previous experience building features for online casino, sportsbook or other virtual gambling platforms. Familiarity with Backend and Frontend Technologies: Proficiency in working with frontend technologies such as HTML, CSS, JavaScript, as well as in-depth knowledge of relational databases (preferably MySQL). Ability to Work in a Team: Demonstrated ability to work in a collaborative development environment, communicating effectively with other team members and contributing to the overall success of the project. Problem Solving and Creativity: Ability to solve problems efficiently, propose innovative solutions and adapt quickly to changes in project needs. What will you do As a La...
Python code for automation and scrape data from specific website
We are seeking experienced Full Stack Developers with expert knowledge of Laravel, Angular and MySQL to join our project. Your role will prominently involve working on Laravel backend, Angular frontend and database development. Main Goals: - Improve user experience - Work on overall enhancements of the project Key Functionality: - Primarily, you will be tasked with enhancing the data visualization aspect of the project. Ideal Skills and Experience: - Proficient in Laravel, Angular and MySQL - Previous experience in improving user experience - Portfolio of projects that involved enhancing data visualization features. English language required skill
Project Overview: LAMP Web Application Refactoring and Update We have an existing web application that needs to undergo significant changes to ensure compatibility with the latest technology stack and improve user experience. This project involves both refactoring the codebase and updating the application's UI and functionality. Objectives: Compatibility Update: Upgrade the application to be compatible with the latest versions of Linux, Apache, MySQL, and PHP (LAMP stack). Ensure that the application runs smoothly on the updated environment without any compatibility issues. Code Refactoring: Restructure the existing codebase to improve readability, maintainability, and performance. Remove any deprecated or redundant code. Optimize database queries and overall ...
...are most valuable for my objectives. - I envision the software having capabilities to scrape at least the basic fields: Title, Description, Price, and Image from specified segments of Website A. However, we might adjust or expand on these requirements based on our initial results and findings. **Ideal Skills and Experience:** - Expertise in web scraping technologies and frameworks appropriate for desktop software development. - Familiarity with Python, particularly libraries like BeautifulSoup or Scrapy, or any relevant technology stack suitable for this project. - Proven experience in data extraction projects, with emphasis on reliability, speed, and accuracy of the scrape. - Understanding of ethical web scraping practices and how to implement them to ensur...
For this project, I need a CodeIgniter expert who's proficient in PHP and MySQL. The main task revolves around adding a feature to retrieve and display textual data from the database in a specific list format. Key Aspects: - Modify the existing list to fetch and display data from the database. - Ensure that the displayed data is purely textual. No numerical values or images are required. - The organization of the data on the list is flexible and does not need to adhere to alphabetical, chronological, or importance-based parameters. Ideal skills: - Strong understanding of CodeIgniter framework. - Proficiency in PHP and MySQL for seamless database interaction. - Experience in developing user-friendly UI/UX would be a plus. With your expertise, I look forward to presentin...
I am encountering a compatibility issue between PHP 5.6 and MySQL on my Ubuntu 23.10 x64 droplet on Digital Ocean. Here's what I need from you: * Assist me in resolving this issue in real-time while taking control of my screen * Have a deep understanding and working experience of PHP5.6 and MySQL. Familiarity with Ubuntu 23.10 x64 and Digital Ocean will be advantageous * You will be given full admin access to the online server during the process, so experience managing and troubleshooting server environments is crucial Please note that swift and efficient resolution is a high priority for me, and your prompt correspondence will be highly appreciated. Looking forward to working with a reliable and skilled server professional.
Requiring a skilled developer to transition my existing CORE PHP chat application from MYSQL to MONGO DB using NODE JS server. Essentials to the project include integration into our existing PHP application, with key features of real-time messaging, user authentication, message history retrieval, file upload capabilities, notifications, and group chats and other features of chat applications we see in the market. Ideal Skills: * MongoDB * Node.js * PHP * Real-Time Communication The candidate should possess a strong understanding of chat applications and server handling to perform this transition smoothly. My budget is $400
Im looking for someone who can extract "title" "categorie" "price" to excel datasheet please bid only if you can start right now !!
Looking for a python person who is good at browser automation. I don't want to scrape anything. I just want to load up Twitter profile and determine if they have the message icon - see attachment I just need a function that I can pass a URL too... and it returns boolean
I need assistance with creating a custom column in my WooCommerce admin order view. The column should be based on a custom order meta that I've created. - The custom ord...custom order meta that I've created. - The custom order meta should be sortable by date. While I am uncertain about a specific date format, this is something we could potentially discuss and decide upon together. - Ideally, you should have experience with WooCommerce and detailed knowledge of its backend functions. - Any background in web development or in developing custom WooCommerce plugins would be of benefit. Your extensive know-how of PHP, MySQL, and the WooCommerce ecosystem would be crucial to this project. Familiarity with data structuring and an understanding of sorting algorithm...
