Web scraping linux jobs
I wanna create script in extracting or scraping the subscriber data from a large Telegram channel and groups. The ultimate goal is to invite these subscribers to my own channel. Key Results: - Extract or scrape customer data from specified Telegram channels or Groups. - The type of data required is mainly (phone number - user) - Extracting data from private channels or groups - Provides a complete list of extracted customers - Ensure customer data is ready to easily import into my channels for invitations Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Experience with Telegram algorithms - Experience with Telegram API or similar platforms - Proven track record in handling and managing large amounts of data - Strong communication sk...
I am in urgent need of an expert who specializes in setting up and configuring Microsoft Azure tenants. The following deliverables are expected: • Migrate the application from tenant to tenant. • Set up Virtual Machines operating with Windows Server, Ubuntu, and Red Hat Enterprise Linux • Arrange Storage accounts • Provide App Services The main purpose for the creation of this tenant will be to host infrastructure. Preference will be given to those who have vast experience in Microsoft Azure setups, cloud solutions, virtual machine configurations, and infrastructure management. Experience with the specified operating systems will be an added advantage. The project needs a swift turnaround, so those with immediate availability will be preferred.
...professional data extractor to extract leads from websites on a weekly basis. Key Requirements: - Extracting email id and mobile numbers: The task involves scraping textual data only, and not images - Websites as source: The data should be scraped from various websites, so a good understanding of web scraping is crucial. - Weekly updates: The extraction will need to be performed every week, so the ability to automate or efficiently manage unique scraping is essential. Ideal Skills and Experience: - Web scraping: Proficiency with tools and techniques for web scraping, especially for textual data. - Automation: Experience with automating scraping processes for repeated extraction. - Accuracy and reliability: The extracted ...
I'm seeking...project. It primarily involves application data analysis. Key Requirements: - Proficiency in Fluentbit for Application Data Analysis - Linux Operating System expertise - Track record of improving performance of applications This project aims for more efficiency, hence, it's crucial for the candidate to have demonstrable knowledge and experience in enhancing performance. Your role would be to configure Fluentbit to efficiently analyze our application data, consequently speeding up operations and improving overall performance. Please include examples of similar projects you have worked on in your proposal. In-depth knowledge of Fluentbit and Linux is essential. If you're up for this task, let's get started and make the application perfo...
I am looking...pk/agent-locator/). Key Requirements: - I need the data to be delivered in an Excel spreadsheet format. - The specific details that I require for each Jazz locator are the Name and Address, along with the Services offered. - The scraping needs to be done only once; it will not be recurring. Ideal Skills and Experience: - Proficiency in web scraping, particularly using tools like Python's Beautiful Soup or Scrapy. - Experience in extracting data from websites with dynamic content. - Strong attention to detail to ensure accurate data extraction. - Previous experience with similar data scraping projects will be an advantage. I am particularly interested in working with a freelancer who is located in Pakistan, though this is not a strict requi...
I'm seeking a freelancer who can help me deploy my application and website on a Linux-based virtual machine on Microsoft Azure. The ideal candidate should be knowledgeable in server architecture and network design, particularly in the context of Azure. Key Requirements: - Virtual Machine: The deployment should be on a Linux-based VM. - Database: You will be setting up and configuring a PostgreSQL database. - Elastic IP: I need an elastic IP for the deployment. - Application Gateway: Proficiency in setting up an application gateway is required. - Load Balancer: Your expertise in configuring a dynamic load balancer is needed. - Scaling: You should set up dynamic scaling for the deployment. - Traffic: The deployment should be capable of handling medium traffic, estimated ...
I'm currently facing difficulties with the recovery of Bacula backups on CentOS in a vnc session. The version of Bacula I am using is unspecified, so applicants should be experienced with various Bacula versions. Ideally, the freelancer should: - Be proficient in Linux, particularly CentOS - Have expertise in Bacula backup and recovery - Have experience working within vnc sessions Your primary task will be to help me locate and restore Bacula backups.
I am in search of a proficient developer to create a comprehensive digital signage software solution, compatible with Windows, Linux, and Android Operating Systems. This software should support the following functionalities: - Content scheduling and management - Remote content deployment - Customise/Drag and Drop or Canva-like functions - Easy setup and management of software - A streamlined process The ideal software should support various media types including images and videos. I prefer a candidate with an extensive background in software development, particularly with similar digital signage solutions. An exceptional understanding of user interface design and ability to provide an intuitive, user-friendly system is crucial. Efficiency, accuracy, and attention to detail...
I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.
I'm in need of an experienced data scraper to scrape and collect text data from multiple websites including socia...multiple websites including social media platforms. It's a high-volume job with an emphasis on accuracy and efficiency. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience with scraping text data from multiple sources - Familiarity with various types of websites and social media platforms - Fast turnaround time, without compromising the quality of work - Attention to detail is paramount - Previous experience in similar projects would be a plus Please bear in mind, I need someone capable of navigating multiple websites for meaningful extraction, we're not just talking surface-level data scraping. Thi...
I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.
...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...
...information: Opportunity type: • Full Time/Part Time: Full-Time • Project Only Hire: No • Visa Sponsorship Available Firmware Team: Developing Linux application [Main Responsibilities] • Embedded Linux • Linux applications (such as IEC 61850 communication stack, PTP stack, etc.) • Test & Debugging the above [Required Experience and Qualifications] • Education: Above Undergrads. (Including community college) If you are a foreigner, above the master. • Experience: Above 3 years of experience. [Preferred Experience and Qualifications] • Have experience in embedded Linux (Required) • Have experience in embedded QT(Required) • Have experience in IEC 61850 standard (Preferred) • ...
I need a competent AI developer to use OpenAI, Pinecone and Scrapper in order to construct an engaging and intuitive AI chatbot for my website. Require...and conversational. The chatbot should not merely provide answers but engage users in a dialogue to better understand and meet their needs. >- Since we cater to a global audience, the chatbot needs to be multi-lingual, capable of understanding and responding in several languages. Ideal Skills: >- Proven experience in designing and developing AI chatbots. >- Proficiency in OpenAI, Pinecone and Scraping. >- Experience with developing conversational AI. >- Understanding of multi-lingual AI systems. Candidates who have developed similar chatbots in the past and those who can provide samples of their work will have ...
**Your Bidding Amount is Final. No change allowed later**##Please read the attached file for details## I have an existing Online Stamp Inventory for Postal Stamp Collectors in my site. It is made in CakePHP. I need to add some features to it and r...difference is Admin can see user details like their username, email ID and registration date and can export it. No seperate Admin panel needed. See the site: This is very easy Project. Just making Form fields and report generating. Lowest bidder will win this project. You don't need to develop any new website or web design. Just a basic look will do. I need to deploy it in the Linux server. You need to give me the full copyright of the software and source code. Also help me to deploy it in server.
...project is centered around social media analysis and trend prediction. Key Points: - You will only be required to generate a list of followed accounts' IDs for each user that is provided - The data you collect will be used to predict trends in user behavior and preferences Ideal Skills and Experience: - Proficiency in data scraping, particularly from social media platforms - Familiarity with Instagram's API and limitations Further notes - I am very familiar with scraping in general myself. There are many obstacles with Instagram - namely, the endpoint where the 'following' list is found requires a logged in sessionid. I have a very large list of users (11 million overall) that I need this data found for. Honestly, I'd prefer to have the methodo...
I'm looking for a skilled network administrator to help troubleshoot and resolve connectivity issues with my existing VPN setup and firewall. Key Tasks: - Diagnose the root cause of the connection issues affecting the VPN (running on OPNSense/OpenVPN). - Implement the necessary fixes and config...Candidate: - Strong background in network administration, particularly experience with VPN setups and firewall configurations. - Familiarity with OPNSense and OpenVPN. -Understanding Contabo Hosting Platform - Proven track record of resolving connectivity issues. - Excellent troubleshooting skills and attention to detail. The devices that need to connect to the Firewall/VPN are a Windows Server and a Linux Server. It's essential that the connection is secure and reliable for bo...
I'm running a new PHP script on Linux and it's not pulling data correctly from an MSSQL Database. Since the script is new, I'd appreciate some help identifying what went wrong. Skillsets and Experience Needed: - Proficiency with PHP and MSSQL databases - Experience troubleshooting PHP script issues in a Linux environment - Experience with new script debugging - Knowledge of database connectivity issues and their solutions - Ability to communicate complex technical issues clearly
I'm looking for an e...experienced IoT developer who can create an Arduino-based system that triggers actions or alerts based on scraped text data from a website. Key Responsibilities: - Develop a system using Arduino, Raspberry Pi, and ESP32 microcontroller - Implement website scraping functionality to extract specific text content - Design a mechanism to trigger predefined actions or alerts based on the scraped data Ideal Experience: - Proficient in Arduino programming - Familiarity with ESP32 microcontroller and Raspberry Pi - Experience with website scraping techniques - Ability to integrate scraped data to trigger actions or alerts on an IoT system Please note that my preferred programming language wasn't specified. Feel free to suggest the most appropriate...
I'm in need of help with fetching influencer data from Instagram, YouTube, and TikTok. The specific data needs are not completely defined at this moment, so the ability to adapt is essential. The end goal of this data collection is currently open-ended. Key skills and experience needed: - Deep understanding of Instagram, YouTube, and TikTok - Experience in data mining or web scraping - Proficient in data analysis - Flexible and adaptable work approach.
For my project, I need a freelancer with strong skills in data scraping and extraction, particularly with textual content and figures, from a specified public website - Tasks: - Effectively pull relevant textual content and figures - Ensuring the scraped data is comprehensive, accurate, and neatly organized Excel Skills: - The data collected must be meticulously stored in an Excel database - The organization method within the database is by entity An effective freelancer must be detail-oriented, proficient in using Excel and knowledgeable about data scraping techniques from public websites. A background in handling similar tasks would be advantageous. Accuracy and neatness in data organization are also paramount. Please indicate you reviewed the information above and
I need to extract pricing information and con...contact purposes. - Extracting Contact Details: - The project also involves obtaining contact details from the website. This would typically include email addresses, phone numbers, names of suppliers, and any other relevant contact information. - It is important that this data is collected accurately and in a structured format for use in supplier outreach. Ideal Skills: - Proficiency in web scraping and data extraction. - Familiarity with Chinese websites and text. - Experience in market research and supplier sourcing. - Ability to organize data for easy analysis. - Attention to detail and accuracy in data collection. If you have experience in these areas and are comfortable navigating Chinese websites, I would like ...
I'm seeking a developer to help me create a system that can archive web-based content, including text and images, for offline viewing. Key Requirements: - Archive text and images: The system should be able to save text and image content from websites. Use appropriate tools like HTTrack, Wget, or WebCopy to mirror the website. - Single archive process: The content will require archiving only once, as it won't be updated frequently. Ideal Skills: - Proficient in web scraping: Ability to extract and save content from websites. - Experience with archiving systems: Previous work on systems that save web content for offline use. - Knowledge of offline storage: Understanding of how to save and retrieve content without requiring an internet connection. This...
I'm urgently looking for a web scraping expert who can help me gather information from various medical service provider websites. Key Requirements: - Extract doctor names, contact information, medical service details, and additional data such as phone numbers, specialties, and participating plans. - The information should be pulled from three specific websites - Website 1, Website 2, and Website 3. Your deliverable: - The scraped data should be compiled into a CSV format for easy analysis and integration into our system. Ideal Skills: - Proficient in web scraping and data extraction - Advanced knowledge in handling and exporting data formats like CSV - Experience in scraping medical websites or similar domains would be a plus. Please bid only...
I am looking for an expert freelancer to develop a software that will expedite my web scraping process. I have identified the need to automate if possible the solving of image-based reCAPTCHA challenges. Key Requirements: - Practiced experience in automation and CAPTCHA solving. - Familiarity with various web scraping technologies and debugging will be vital to this project's success. The ideal freelancer for this project would have a proven track record in web scraping, specifically with handling reCAPTCHA challenges and previous experience with 2captcha will be considered an advantage. Let's bypass these hurdles together and get the necessary data!
I need a professional to scrape specific information from an one page weblink and present it in an Excel file. The details will include: - IMAGE LINK - Product Name - Price1 -Price 2 - Link to Product Page - Stock Availability (I lager) The freelancer that can deliver fast will be prefered.
We are looking for someone who has knowledge in web scraping and building mobile apps. Please do not apply if you don't have experience in both. As we are in the final stretch of our MVP (native iOS and Android mobile app), this individual will help us finish a critical feature in the app (i.e., web scraping) + other small features and help us launch in app stores. Please take a look at the attached high level SOW before you submit the bid AND include your time commitment (hours/week) and hourly rate. We will select candidates based on the bids. The detailed SOW will then be shared with the selected candidate/s before finalizing timeline & budget. Acceptance criteria will be provided once we move forward with the selected candidates. Tech s...
I am seeking a skilled data scrapper to retrieve specific information from 'Website 1'. a full comprehension of various types of data is nee...for a successful scrape. The types of data required include: - Textual content - Metadata Specifically, within the textual content, I require: - Titles - Descriptions - Prices - Linked products - Related products An ideal candidate would demonstrate extensive experience in data scraping, with a keen focus on retrieving accurate and relevant information. A good understanding of e-commerce sites and familiarity with Metadata and APIs will be advantageous. Please, I urge you to utilize ethical scraping methods in accordance with the rules and regulations of the source website. Looking forward to working with a meticulo...
...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...
I'm seeking an experienced and knowledgeable data scraping professional to collect specific information from three major platforms - RERA websites (specifically Maharashtra, Telangana, Haryana, and Delhi), Google, and Justdial. Here's what I am looking for: Details to Scrape: - Name - Mobile Numbers - Locality - City - Address - Pincode Platforms: - RERA Websites (Maharashtra, Telangana, Haryana, Delhi) - Google (DSA and Loan Agents data) - Justdial (DSA and Loan Agents data) The ideal freelancer for this job will be highly experienced in data scraping and will be able to deliver the results in an organized manner. Proficiency in scraping from Google, RERA websites, and Justdial is particularly important. Delivery Format: - The data should be delivere...
I'm looking for a talented C/Linux developer to create a desktop application. You will develop the project in C/Linux. Project will be tested in Ubuntu 22.04 Linux 64-bit. You will develop a program to access and modify a FAT32 disk image (FAT32 volume). The disk image will be stored as a regular Linux file, which will simulate a disk formatted with the FAT32 file system. Your program will open the Linux file using the standard open() system call and access it directly in raw mode, utilizing the read() and write() system calls, without mounting the FAT32 file system. The program will be named fatmod. Through various options, it will in- teract with a file system image, enabling reading and writing of files. Detailed explanations of the specific sup...
I'm facing a routing issue in my Angular application that's deployed on an Nginx server running inside a Linux box. I'm looking for a professional who can help me resolve this. The issue seems to be connected to the routing of my Angular application on the Nginx server. It's causing errors, and I'm unable to access certain routes on my app. I need assistance in identifying the root cause of this issue and fixing it.
Pls read carefully description below. We will consider only freelancer who will provide a scraping sample (2-3 lines) aligned with the instructions below. Scrape data from this website: Filters to be used: - "CAR": 203 and 16348 - "Anno di Concessione": 2020, 2021, 2022, 2023, 2024 - "Importo": select "Compreso fra 100000 e 200000", "Compreso fra 200000 e 500000" and "Maggiore di 500000" We need to scrape the results from all the possible combinations of the above filters. The outcome table should contain all the columns of the initial table AND all the data contained inside each result (you can access in it by clicking on the magnifiying lens). To be clear: - identificativo di riferimento - numero
...conscious organization, we're hiring a cybersecurity expert for a comprehensive penetration testing on our Linux-based system. Emphasis lies primarily on our web-based applications, with the aim to identify and eradicate any potential vulnerabilities. Key Tasks: - Perform Open Source Intelligence (OSINT) - Port scanning - Man-in-the-middle (MiTM) attack simulation - Focus intensively on injection attacks (SQL, XSS) - Authentication and session management puncturing - Cross-Site Scripting (XSS) evaluation The ideal freelancer will have: - Strong experience in cybersecurity and penetration testing - Excellent knowledge and experience with Linux-based systems - Proven experience in web application security testing - Firm understanding of SQL, XSS and auth...
I'm in need of a professional who can help me with installing the Oracle 23c database on my Ubuntu Linux system. Key Skills: - Proficiency in Oracle database installation - Specific experience with Oracle 23c - Strong understanding of Ubuntu Linux The selected candidate should be able to: - Perform a detailed installation of Oracle 23c database (enterprise version) on Ubuntu Linux - Ensure proper configuration to meet the project's requirements - Provide guidance on any post-installation tasks that may be necessary Is there any possibility to install a 23c oracle database enterprise version not free version on docker?
I'm looking for a skilled data scraping professional to assist me with a project. I had a working script in Python using an API, but the company implemented a Cloudflare protection that is always blocking me. You would need to find a solution how this could be circumvented (e.g. proxies) and large amounts of data be scraped. If you are interested, I am happy to provide more details privately.
I'm seeking a Python developer with experience in Playwright to complete my existing code. Key tasks include: - Reviewing the existing codebase. - Identifying and fixing bugs. - Completing partial functionalities if any. Ideal candidate should have: - Prior experience with Python (Playwright). - A strong understanding of web scraping and UI automation. Please provide examples of your past work in Python (Playwright) along with your bid.
I...pull the pricing information and update it into our system. Key Requirements: - Develop a script that can extract data from a website and automate the pricing update process - The script should be able to run daily, without manual intervention - Ensure the script is robust and can handle occasional changes in the website's layout without breaking Ideal Skills and Experience: - Proficient in web scraping and data extraction - Experienced in script automation, particularly on a daily basis - Familiarity with handling data within a business context - Ability to create a reliable and sustainable solution, accommodating for potential changes in the website's structure If you have a proven track record in similar projects or have the skills needed to deliver this,...
I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.
We are in search of an experienced Web Scraper to uncover price points across multiple websites and categories for us. Key Requirements: * Compile pricing information from the following platforms: Amazon, , , , , , , , , , nykaaman.com. * The scraping project should cater to several products and categories rather than specific ones. * Implement scraped data directly into the backend of our website using PHP. Ideal Skills: * Proficiency in web scraping scripts and tools * Deep knowledge and experience in PHP programming * Familiarity with the aforementioned websites' structures and processes * Ability to handle data scraping projects from a wide range of product categories
data collection as per sample web scraping fro
...hitect There are 566 architect contacts for Sydney, NSW, Australia within 100km. I requirements: - Extracting: I require the following contact information to be extracted: Business Name, Email, Phone number, Full address separated by suburb, postcode and state. - Formatting: All extracted data should be structured and organized into an Excel spreadsheet. Ideal Skills: - Web Scraping: Proficiency in web scraping tools and techniques is essential. - Data Entry: Experience with data entry and extraction. - Attention to Detail: Accuracy in capturing and organizing contact details is crucial. - Excel Proficiency: Ability to create and format an Excel spreadsheet effectively. - Communication: Regular communication and updates on the progress of the task would...
Hello, I have a simple WordPress plugin with 300 lines of code, which scrapes a website. Problem: The website has activated cloudflare and since then the plugin no longer extracts the data. If you can tell me your budget and we will start working immediately. I'll send you the Zip so you can modify it and return it to me, I'll test it and if everything works we'll finish the project. URL of the website that I scrapped:
I need a wide range of details about accommodations on , downloaded for analytical purposes. This data should include room availability, pricing, customer reviews, accommodation rate variances, photos, addresses, and phone numbers. - Essential Skills and Experience: 1. A strong understanding of web scraping tactics and data extraction. 2. Proficiency with 's platform and data structures. 3. Data organizing skills to deliver finalized data in CSV format. The outcome I envision is a well-organized CSV file that can further my research and analysis goals. A successful delivery will require attention to detail to ensure all requested information is included. Please bring forward your innovative solutions and reliable data handling methods.
... and Linux. Key Responsibilities: - Develop a fully functional program that can swiftly scan and exhibit the file system of the given OS's. - The program should be designed to work on each of the mentioned operating systems. While the choice of programming language is flexible, keep in mind the cross-platform compatibility. - The application should be user-friendly, so I am looking for a Graphical User Interface (GUI) based design. - Complete documentation is essential. This includes comprehensive instructions for setting up the environment, installation details, and explaining the purpose and functionality of each file within the codebase. Ideal Candidate: - Experience with cross-platform software development - Strong understanding of file systems for Windows, MacOS, ...
I need a proficient developer to create a Firefox add-on that can scrape specific data from multiple websites.
...need of a skilled professional to set up my Virtual Private Server (VPS) with Alma Linux. The VPS comes with cPanel/WHM preinstalled, and your task will be to configure it for hosting an e-commerce website. Your responsibilities will include, but are not limited to: - Configuring cPanel/WHM for web serving functionality. - Setting up the web server, ensuring optimal site load times and uptime. As the client, I've opted not to specify any particular server security measures at this time. However, your recommendation on securing the server, given its e-commerce function, will be highly appreciated and taken into consideration. Ideal Skills: - Proficiency in server setup and management - Familiarity with Alma Linux and cPanel/WHM - Experience with e-com...
I need an expert in Linux, particularly in the use of SSHFS for remote file access, to expand my existing blog article. The aim is to provide my readers, who are at an intermediate level in their understanding of Linux, with a comprehensive tutorial. Key tasks include: - Detailing the process of automating remote file system mounting using SSHFS in Linux - Providing step-by-step instructions accompanied by useful screenshots to aid comprehension - Ensuring that the tutorial aligns organically with the tone and style of the existing blog article The ideal freelancer for this assignment will have proficient knowledge of Linux, SSHFS, and tech writing skills, with a knack for simplifying complex tech concepts. Additionally, I'm going to share the original b...
I'm experiencing issues with my Ubuntu desktop. When I try to boot the system, I'm unable to access the desktop. I've tried several troubleshooting steps to fix the issue: - Booting from a ...tried several troubleshooting steps to fix the issue: - Booting from a live USB - Accessing recovery mode - Running fsck in terminal Despite these efforts, the problem remains unresolved. I can see error messages during the boot process. I am looking for an experienced Ubuntu specialist who can help me restore access to my Ubuntu desktop. The ideal candidate should have a strong background in Linux system administration and be familiar with troubleshooting boot-related issues on Ubuntu. A deep understanding of Ubuntu recovery processes and file system checks would be highly ...
