Web scraping using curl jobs
I'm in need of a seasoned Apache Solr professional to help me implement search functionality for my project. The ideal candidate has excellent expertise in Apache Solr and can effectively optimize search functionality for text documents. Key responsibilities: - Upgrade from Apache Solr 3.6 to a version supporting wildcard search, Windows server - Multi cores with replication - bulk import via CSV - core creation/deletion across master and slaves Ideal skills and experience: - Prior experience implementing Apache Solr for search functionality - Proficiency in data indexing and faceted navigation with Apache Solr - Strong understanding of optimization techniques for search functionality - Excellent problem-solving and analytical skills - Good communication and collaboration abilities
I'm seeking a pr...followers' ratio. The higher the ratio, the more viral the tweet is considered to be. - It should be able to scrape and analyze tweets from the past week. - The bot should be capable of differentiating between tweets based on their views to followers ratio and identify the 'most viral' one. Ideal Skills & Experience: - Proficient in creating Twitter bots. - Strong understanding of Twitter API and scraping tools. - Familiarity with tweet analytics and calculations. - Ability to extract and process data efficiently. The end goal of this project is to have a functional tool that can accurately pinpoint the most viral tweet of the week. It is essential that the developer is skilled at creating algorithms that can measure and compare the '...
...Magento website. - Creating backup files that encompass all necessary aspects of my website. - Completing a full site transfer using the created backup files to preserve integrity and functionality. You must have: - Expertise in website migration, particularly Magento sites. - Proficient knowledge in creating and using backup files. - Familiarity with hosting environments, specifically VPS. - Strong understanding of Magento 2. I am open to guidance on best practices for site transfers and backup file creation. This project requires a careful and knowledgeable freelancer, who can ensure a smooth and successful website transfer. Need help with setting up a Magento site using back up files. The freelancer should be able to do the following: - Help me set up my h...
I need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and quality control. - Ability to deliver a ...
Need a multi user login where multiple users can connect to my server and access the server using apache gaucomole. It has to be scripted (csh) based as I need to execute on local machine once it is working.
I'm seeking a skilled Python developer proficient in Selenium or other scraping tools, AI and others API integration. The main tasks in this project include: - Integrating APIs: You'll be responsible for seamlessly integrating the following APIs: - Send/reveive data from trained AI - Collect data using scraping - Payment Gateway - Other websites: API to integrate with other websites - Developing B2B Features: We're looking to expand our platform to cater for B2B transactions. Your role will be to create and incorporate features that facilitate B2B interactions. Key skills and experience required: - Proficient in Python - Experienced with Selenium or other scraping tools - Proven track record with API integration - exchange data w...
I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The ...scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.
I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The ...scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.
Our SaaS site () is getting a bit old. We need an experienced designer/front-end developer to completely freshen it up,We operate in the Web Scraping industry and would like our new site to stands out w.r.t. competition. We want a site that's easy on the eyes and presents our product offering better than how it is currently presented. Requirements =========== . New home page should have a section for testimonials/clients and a section for awards/review badges. . Each product (currently scrape and extract) have their dedicated page. Their illustrations need to be redone and the scrape page should have some icons/illustrations on top of each "Applications" box. . We need a new nav menu item for "Resources". The site footer section will also host new ...
I'm looking for a skilled professional who can help me retrieve information from various sources. The ideal freelancer should be well-versed in web scraping, especially from websites, social media platforms such as LinkedIn, publications, and news sites. This will help in gathering relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid bac...
I'm seeking a Python developer who's proficient in web scraping to help me extract data from social media platforms. Key Responsibilities: - Develop and implement a Python script for web scraping data from social media channels. Deliverable: - The scraped data should be compiled and delivered in an Excel spreadsheet for further analysis. Ideal Candidate: - Proficient in Python with a strong background in web scraping techniques. - Prior experience in scraping data from social media platforms will be a big plus. - Ability to deliver the end results in an organized, neat and easily accessible format, such as an Excel spreadsheet. Please reach out if you think you're the right fit with the necessary expertise.
I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.
I need a talented web designer with expertise in APIs, data scraping, and AI to help me build a professional portfolio website. - Design: The designer needs to create an engaging and visually appealing layout for the website, considering it's targeted at professionals. - Integration: I require the integration of API functionalities into the website. - Data Scraping: The designer should implement data scraping. - AI /ML Features: The website will also need AI-based features. The primary goal of the website is to serve as a showcase for my work. It’s important that the design is not only aesthetic but also functional, user-friendly, and professional. I am looking for someone who can bring a high level of creativity, technical skill, and attention t...
I require a proficient and ClickUp builder to automate critical steps in our client acquisition process. The intention is to minimize manual intervention while enhancing our efficiency considerably. Key Tasks: - Designing and implementing an automated system that effectively captures and tracks leads: For now, our website captures leads through a contact form, and we want this process to be automated. - Integrating with our current email marketing service: Currently, we use MailChimp for email marketing. Thus, experience in MailChimp integration is a plus. - Tailor-made sales funnel automation: The new workflow must streamline our sales funnel to ensure a smooth transition from leads to potential clients. Skills and Experience: - Excellent in and ClickUp - Past experience in lead c...
I am in need of a skilled developer who can create a functional scraping tool for me. The purpose of this tool is to download JPEG product images from a specified URL that increments numerically. Key Requirements: - Scrape images from a continuously changing URL (i.e., www.****/asdasd/1234 then 1235, and so on). - Ability to tweak URL structure according to my needs. - Images must be saved in JPEG format. The ideal candidate for this task: - Has experience in web scraping and dealing with dynamic URLs. - Understands how to name files after the URL page number. Please note that the key goal is to download product images, not data extraction or process automation. Hence, your proposal should focus on delivering this specific requirement. Your understanding of this ...
I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .
...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...
I'm looking to build a custom scraper for DeFi exchanges. The main features I'm interested in are: - Historical data analysis: This is crucial for me to make well-informed decisions about the market trends. - Real-time data updates: Although not explicitly...explicitly stated in the questions, the bot will need to be able to update data in real-time. This will help me stay ahead of the market. I currently prefer the output in CSV format, as it is easy and widely used. Given the nature of the DeFi space, experience in cryptocurrency scraping bots is a must. It would be ideal to have experience with DeFi exchanges particularly. This project will require strong skills in programming languages such as Python, R, or JavaScript, as well as experience in data ...
I want an Android app for serial communication (like Hyperterminal). * Well documented source code of the app will be provided. * App will be capable of send...should be able to select a file to read and transmit. * User will be able configure the serial port (i.e. select com port, baud rate (1200, 2400, 4800, 9600, 19200, 38400, 57600, 115200, 256000, Custom) , data bits (5, 6, 7, 8 bits), parity (None, Odd, Even, Mark, Space), stop bits (1, 1.5, 2), handshaking (None, RTS/CTS, XON/XOFF, RTC/CTS+XON/XOFF, RTS on TX) etc.) * App will be written in C++ using Qt. * GUI will be prepared in QML. * GUI will be designed to run both on Android phones and tablets. * For USB-to serial comms, app will use "mik3y/usb-serial-for-android" utility from ""
IMPORTANT!! Start with the word in the atachment. All offers not starting as requested will be removed. We would like to have all fitness websites with embedded YouTube Videos Austria, Germany and Switzerland.
You must be a skilled 3D artist to create a realistic 3D Test character animation that will be used for my video that will be edited on Wonder Studio. The character must look real and have full rigging. the 3D character must be bigger than me so it does not cause blurring around the edges in Wonder Studio. I will send pictures for dimensions the character of the test subject. I will need variations and adjustments of the character made until I am happy with the 3D character design. You will need to send me the sample of the test 3D character and it needs to look real. You will need to show me how to use Wonder Studio and show my what apps or plugins are needed and assist me with the Wonder Studio tests. The Robot must look great and look 100% real. The robot design must work perfectly wit...
I am urgently in need of a freelancer with skills in web scraping, data extraction and web crawling. Your task will be to gather specific information from an online directory of race events throughout the world. Key Responsibilities: - Set up a weekly automated web scraping process. - Extract and deliver the following data points: Event name, Event date, Event location, online registration page, contact form page, and contact information along with some other info that we can grab. Required Skills and Experience: - Proficiency in web scraping and data extraction. - Capable of setting up an automated weekly process. - Ability to perform the task ASAP. - Strong attention to detail to ensure accuracy of information. Please note that timelin...
Looking for qualified performance engineer with experience using Gatling, Scala to work with
*READ ENTIRE FILE AND DO NOT BID UNLESS YOU ARE AN AI EXPERT *DO NOT BID UNLESS YOU CAN COMPLETE THIS WITHIN 7 TO 14 DAYS *BID AMOUNT IS FINAL -------------------------------------------------------- I require an AI expert, preferably well-versed with OpenAI's API, to add an AI virtual assistant to my Learning Management System (LMS). Features the AI Should Have: - Natural Language Processing to understand the queries of our users. - Speech Recognition to interact with student's vocal commands. - Text-to-Speech to read lesson to student and for conversion of audible answers. Integration Requirement: - The AI assistant should be seamlessly integrated with the PDF viewer in the LMS. - Data synchronization between the LMS and the AI virtual assistant needs to be maintained. Int...
I'm in need of a coding solution that can help me keep my email list up to date on an ongoing basis for my membership. I currently use Circle and FloDesk. The issue lies in the fact that Zapier, which I currently use for automation, cannot maintain tags when members unsubscribe. Key Job Requirements: - Integration: The coding solution should be able to synchronize and interact with my Circle and FloDesk accounts in real-time. - Real-Time Updating: The email list needs to be updated continuously as members subscribe and unsubscribe. - Unsubscribed Members: The specific action that should trigger an update is when a member unsubscribes. This action should be reflected in the email list promptly. Appropriate Skills: - Proficient in coding and experienced in working with Circle and F...
Im looking to scrape website I need someone that can log in an then loop through list to create url -> then call that url with request or urllib to get and parse html I’m NOT looking to open each page
if anyone is ready to provide me a work for this title : Panoramic Image Stitching Using CNN by Matlab or Python, pls contact me, we can discuss more.
Building a UI for the previous AI whatsapp bot. Supports multiple agents
I need a professional who can scrape and compile email lists of high net worth individuals with a particular income level and investment interests. The emails will be used to target our automate...target our automated trading software offer. Key Requirements: - Income Level Criteria: The emails should target individuals with an income level within the range of $250,000 - $500,000. - Investment Interests: The targeted individuals should have an interest in the stock market, Futures trading, options trading, cryptocurrency, and real estate. Ideal Skills and Experience: - Proficiency in data scraping and email list compilation. - Familiarity with targeting high net worth individuals and their investment interests. - Previous experience in compiling email lists for targeted marketing ...
I'm looking for a skilled AI artist to help me create a realistic portrait using artificial intelligence. Key Requirements: - The portrait should be crafted with a realistic style. - The color scheme should mainly consist of warm tones. Ideal Skills and Experience: - Proficient in working with AI tools to create portraits. - Strong portfolio that demonstrates the ability to work in a realistic style. - Experience with producing art pieces in warm color tones. Ability to use various AI programs to generate pictures for purposes of comparison
I need a server pro to help me install and configure a Wisp game panel on my Ubuntu 22.04 LTS server. The server is a hosted bare metal server and...of Pterodactyl Panel. The setup should include the installation of the following gaming eggs: - Minecraft - Tmodloader - V for Vampire - Pal World Set up local backup on the second drive located on the server. Set up a full redundant backup with AWS S3 (or another storage solution) Ideal Skills and Experience: - Proficiency with Ubuntu 22.04 LTS or other Linux based server OS's - PHP, MySQL, curl, react - Setting up Linux users and securing root and access - Experience in installing and configuring game panels, specifically Wisp or Pterodactyl Panel - Familiarity with Minecraft server setup - Capability to install and set up ga...
As the developer for this project, you will be creating a state-of-the-art, real-time lipsync model. If you're a Python guru with Machine Learning and AI experience, this project is for you. Requirements: - Develop a real-time lipsync model - Ensure high level of accuracy - Model should support multiple languages Ideal skills: - Proficiency in Python is crucial - Previous experience in AI and machine learning - Strong understanding of speech recognition systems and avatar animations While the client didn't provide answers for preferences on specific tools or purposes, your ability to work with flexibility and adapt to possible changes mid-project will be highly beneficial. Ensure your bid reflects your capacity to handle such dynamic needs. Your expertise and sound technica...
...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...
...to us a completely new device", "that they've built with the help of a company called", "COPMANY,", "which helped thousands of their patients,", "completely get rid of their back pain & sciatica.", "This is the Refresh back stretcher,", "a sturdy accessory that uses lumbar traction", "to comfortably stretch your spine at just the right angle,", "while massaging & rehabilitating your back muscles using", "cleverly designed acupuncture ridges." This is the german text: Dies ist der schnellste Weg, Ischias zu Hause zu behandeln. Wenn Sie mit Schmerzen im unteren Rücken und Ischias zu kämpfen haben, liegt das höchstwahrscheinlich an einem Bandscheibenvorfall ode...
Data scraping projects , payment for month april 2024, LM store scraping
...integration of a web crawler that will search and gather coupon codes from various online sources. Key Requirements: - Development of a coupon code aggregator website - Integration of a web crawler that will search for coupon codes on a daily basis - A search bar where users can enter websites like they are browsing normally and coupon codes will be applied similar to how microsoft edge or Honey does it - The website should have the functionality to automatically apply coupon codes to a shopping cart - Ability for users to sign up and receive daily coupon codes and deals - Ability for the website admin to be able to add deals or coupon codes sourced from advertisers/partners - Payment functionality Ideal Skills and Experience: - Proficiency in web development an...
I'm looking to develop an e-commerce website for my boutique. The primary objective of this project is to create an online platform where I can list my products ...is crucial - The website should provide a smooth customer experience from product browsing to final purchase -It should give admin form to fill details of user and give form for customer to provide details. Ideal Skills: - Proficiency in e-commerce web development using wordpress. - Solid experience in integrating payment gateways like Credit Card, PayPal, and UPI - UI/UX design skills to create an attractive and intuitive website - Attention to detail and understanding of e-commerce best practices This project is a great opportunity for a web developer with e-commerce expertise to work on a boutiqu...
I'm looking for a skilled data scraper who can help me extract contact information from Website 1 and deliver it in Google Sheets. Key Requirements: - Scraping: The primary task is to scrape contact information from Website 1. - Data Delivery: I prefer the scraped data to be delivered in Google Sheets. Ideal Skillset: - Web Scraping: A strong understanding of web scraping techniques and tools is essential. - Data Handling: Proficiency in handling and organizing data in Google Sheets is preferred. Please ensure that you have prior experience with similar projects and can provide a sample of your work for review.
...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...
I'm seeking a .NET Core developer well-versed in fo-dicom or a similar open-source library to create a web-based DICOM viewer. The viewer should be developed using .NET Core web 8.0 with Razor. Key features include: - Image viewing and manipulation: The viewer should allow users to view DICOM images . - Patient information display: It must display relevant patient information in a clear, concise manner. - Measurements and annotations: Users should be able to make measurements and annotations on the images. - Play series: The viewer should support playing a series of DICOM images. The player should be capable to run on Mac, windows and linux i.e. platform independent and should not require any installations on computer. It should run from any external disk like p...
I wanna create script in extracting or scraping the subscriber data from a large Telegram channel and groups. The ultimate goal is to invite these subscribers to my own channel. Key Results: - Extract or scrape customer data from specified Telegram channels or Groups. - The type of data required is mainly (phone number - user) - Extracting data from private channels or groups - Provides a complete list of extracted customers - Ensure customer data is ready to easily import into my channels for invitations Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Experience with Telegram algorithms - Experience with Telegram API or similar platforms - Proven track record in handling and managing large amounts of data - Strong communication sk...
I'm seeking an experienced web developer with proven expertise in Django framework for an advanced web development project. Key Requirements: - Proficient in Django web framework, React.js for building user interfaces, and machine learning technologies. - Expert in HTML/CSS, JavaScript, and React.js for front-end development. Applicants must be able to provide examples of past projects using these technologies. With their comprehensive understanding of Django and front-end technologies, the ideal candidate will deliver quality and maintainable code, and provide insightful recommendations for improving the performance and usability of the website. Previous experience in machine learning is beneficial, though not an overarching requirement. What is the ...
...professional data extractor to extract leads from websites on a weekly basis. Key Requirements: - Extracting email id and mobile numbers: The task involves scraping textual data only, and not images - Websites as source: The data should be scraped from various websites, so a good understanding of web scraping is crucial. - Weekly updates: The extraction will need to be performed every week, so the ability to automate or efficiently manage unique scraping is essential. Ideal Skills and Experience: - Web scraping: Proficiency with tools and techniques for web scraping, especially for textual data. - Automation: Experience with automating scraping processes for repeated extraction. - Accuracy and reliability: The extracted ...
I am looking...pk/agent-locator/). Key Requirements: - I need the data to be delivered in an Excel spreadsheet format. - The specific details that I require for each Jazz locator are the Name and Address, along with the Services offered. - The scraping needs to be done only once; it will not be recurring. Ideal Skills and Experience: - Proficiency in web scraping, particularly using tools like Python's Beautiful Soup or Scrapy. - Experience in extracting data from websites with dynamic content. - Strong attention to detail to ensure accurate data extraction. - Previous experience with similar data scraping projects will be an advantage. I am particularly interested in working with a freelancer who is located in Pakistan, though this is not a stric...
As an e-commerce site that sells physical goods, I am in need of a skilled WordPress Elementor Developer to create an engaging theme using Astra Pro. Key functionalities I'm looking for include: - A strong emphasis on product reviews to boost our user engagement and confidence. Ideal candidates will have a strong background in WooCommerce and experience in creating user-friendly, visually attractive WordPress themes for e-commerce sites. Knowledge and experience with Astra Pro is essential. Other necessary skills include: - Strong UX/UI design experience. - Proficient in HTML/CSS/JavaScript. - Understanding of SEO best practices. Please provide relevant work samples along with your bid.
I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.
I'm in need of an experienced data scraper to scrape and collect text data from multiple websites including socia...multiple websites including social media platforms. It's a high-volume job with an emphasis on accuracy and efficiency. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience with scraping text data from multiple sources - Familiarity with various types of websites and social media platforms - Fast turnaround time, without compromising the quality of work - Attention to detail is paramount - Previous experience in similar projects would be a plus Please bear in mind, I need someone capable of navigating multiple websites for meaningful extraction, we're not just talking surface-level data scraping. Thi...
I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.
I need a proficient Python artificial intelligence expert to fine-tune an already trained lipsync model. There seems to be an undefined glitch that is negatively impacting the overall performance of my model. Key Responsibilities: - Make two models using the code I'll give Ideal Skills and Experience: - Extensive experience in Python - Knowledge and background in AI - A track record of training, troubleshooting, and fine-tuning lipsync models - Focused skills in enhancing the robustness and speed of a model are desirable, but not essential. I am looking for a skilled individual who can swiftly address and rectify this subpar performance issue. A quick resolution will allow me to continue utilizing my lipsync model to its full potential. Your expertise in Python AI and lips...
