Data scraping using jobs

...ideal candidate must be skilled in web scraping and should reverse engineer API from mobile app because lazada blocks and throws captcha on web website is lazada . The script should work like i enter something in search box and it should scrape all the products from that search query Key Responsibilities: - Extract the following information: product names, prices, descriptions, stock, images, seller information, and product URLs. This list encapsulates the attributes you need to pay the most attention to. - Organizing the scraped data: The data, once scraped, must be organized in a well-structured CSV file. Ideal Skills: - Strong experience with Python. - Proficiency in web scraping tools. - Attention to detail to ensure all the mentioned data ...

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

I need a solution that will automate a post to my own managed facebook group. I have a php script that creates the post ready to be sent to the group. The script is run unattended once a day via a cron job. My post will contain text and images. I had a previous system that used an fb app using publish_ to_group that I believe is no longer supported. I need a replacement solution. Happy to use any technology (not just FB app) that may achieve the same result. Please do not bid unless you fully understand the issue and can suggest an alternative. I will not pay for 'learning on the job' so please ensure you know the solution and can implement it within your quote before bidding. DO NOT BID AN AMOUNT YOU UNWILLING TO DO THE WORK FOR.

I have Excel sheet in the are all products added with all the categories in it. I will also share a word file in which I will add that specific category and you have to take out the data from sheet and create the image in Photoshop. I will also give you product images with it's specific name. You have to only remove background and add text and image according to the data. The person must have latest Photoshop and have to create one sample image. You have to leave the space also for the main video and have to choose a shape or space according to the data Here are the links to sample: My budget is Rs.50 per image. There are 10-11 images which you have to create and I need it by today. This

I'm seeking a knowledgeable Node.js to create a specific function. This function should examine a pre-existing React file to identify any import statements that may be missing and automatically add the missing imports. Key responsibilities: - Analyze the React file to identify missing import statements - Add the identified missing imports automatically - Append multiple missing imports as grouped together in a single statement - Code should be in Typescript This task requires a solid understanding of Node.js. Having previous experience with jscodeshift is a must. The solution also need to use a package named @hypermod/utils. () This is the function that I need function fixMissingImports(code: string, importsMapping: Record<string, string>): string The code is a string of a...

Hi there, We are looking for someone who is: - Proficient in Python. - Experienced in automation and data scraping. Our budget is $3/hr for 20 hours on the initial project. This is a one-off task for now but could be ongoing work if successful. Please message with your CV/portfolio if interested

...au, , , , Facebook Market Place) and display the results in one convenient place. Key functionalities should include: - Advanced filtering options - Price range filtering - Location-based search Ideal expertise would entail experience in advanced web scraping and designing search algorithms, along with a deep understanding of diverse automobile databases and SEO. The candidate should be capable of verifying and testing the accuracy of the collected data as well. Efficiency in coding with an ability to manage site speed and response time is crucial, especially considering the breadth of services it will be searching. The final product should be a user-friendly platform that effectively and accurately condenses numerous individual searches into

I'm seeking an expert in reinforcement learning to develop a control system for a differential robot in a simulated environment. The project will be implemented in Python. Key Requirements: - Develop a control system using reinforcement learning for a differential robot - Implement and test the system in a simulated environment - Provide clear documentation and code comments Ideal candidates should have: - Proven experience in reinforcement learning and robotics - Proficiency in Python and familiarity with any relevant libraries - Ability to work in a simulated environment If you have experience in these areas and are confident in your ability to deliver a high-quality project, please reach out.

...analysis of the transcribed texts using NVivo software - Purpose: The main aim is to identify patterns and trends in the data. - Data Organization: The text data is organized by topic. Deliverables: - A comprehensive report: This report should include a statistical breakdown of the identified patterns and trends. Ideal Skills and Experience: - Proficiency in NVivo software: The ability to effectively navigate and analyze data using this tool is essential. - Strong Analytical Skills: The analyst should be able to identify patterns and trends within the data. - Excellent Reporting: The report should be comprehensive and include a statistical breakdown, providing a solid foundation for decision making. The ideal candidate should have a ...

I need a skilled Bot Developer to create a multi-language web bot for me. - Tasks: The bot will mainly be responsible for web tasks like form filling, data scraping, and possibly social media automation. Unlike some bots, it won't interact with APIs or integrate with other web services. - Programming Languages: This is a multi-language project. I am open to using Python, JavaScript or PHP depending on what you think is best for this task. I need someone who is experienced in bot development and can create a reliable and efficient bot that performs these tasks seamlessly. Please have a look at the choices of programming languages I'm considering and let me know which one you think would best suit the goals of this project.

I need help fetching influencer data from Instagram, YouTube, and TikTok. There are other platforms, and the influencers required here are trading influencers. 1 - Those who sell trading indicators. 2 - Who have special channels for trading.. 3 - Who have bots for automated trading Basic skills and experience required: - Deep understanding of Instagram, YouTube and TikTok – Experience in data mining or web scraping - Good at analyzing data - Flexible and adaptable working approach I will attach a file I created as an example of the requirements I want. If you see yourself as suitable for this job, create an example of the same file sent to you, but with different information, and send it to me

I need the names, addresses, and contact information from a specific web map extracted. The purpose of this project is to create a directory of locations from this data, and the information will need to be updated annually. The ideal freelancer for this job will have experience in web scraping and data extraction. Key requirements: - Web scraping experience - Proficient in data extraction techniques - Understanding of directory creation - Reliable and professional with an eye for detail.

I'm looking for a Python expert to help me build a simple yet effective project. I need a program that can scan barcodes of grocery items and then provide me with detailed information about these products. This information should include protein, calories, added sugar, and any other relevant nutritional facts. Key r...sugar, and any other relevant nutritional facts. Key requirements: - The ability to scan barcodes effectively and quickly - Retrieving information about the scanned products from an online source - Displaying this information in an organized and easy to understand manner Ideal skills and experience: - Proficiency in Python - Experience in working with barcode scanning - Familiarity with web scraping for nutritional information - Ability to create a user-fri...

I need a program that can scrape for the addresses of homes listed and compile them into a CSV file....com for home addresses - Compile addresses in CSV format - Include the duration each house has been listed - Run the program every hour to capture new listings - Automatically eliminate any duplicate entrie - Run CSV file against another data base that has age and name of owner and contact info. Ideal Skills and Experience: - Experience in web scraping and data extraction - Proficiency in programming languages suitable for web scraping (e.g. Python, Scrapy) - Knowledge of CSV file creation and data handling - Ability to automate processes for regular data updates Please note that the addresses should be stored in the CSV file with each one on ...

I'm looking for a IoT/WSN security professional to address a Hatchetman attack vulnerability on a RPL protocol network using 6LoWPAN technology. The goal is to implement two robust security solutions that to prevent hatchetman attack occurrence in RPL routing protocol. Ideal Skills and Experience: - In-depth understanding of RPL routing protocols, Contiki 3.0 and Cooja Simulator - Hands-on experience with 6LoWPAN wireless technology - Proven expertise in IoT/WSN solution design and implementation Key Tasks: - Implement Hatchetman attack in Contiki 3.0 - Implement Resolution of Hatchetman attack using 2ACK scheme. - Implement Countermeasure to Hatchetman Attack using Multiple Encryption - Evaluate the two solutions with each other and with the standard RPL (RFC...

I'm looking for a skilled web scraper to handle challenging websites with advanced detection. The main data you will be required to scrape is text content. Here are the key project details: Ideal candidate should have: - Experience in web scraping, especially from challenging sites - Strong knowledge of web scraping tools and techniques - Proficiency in handling advanced automation detection - Excellent attention to detail to maintain a high level of data accuracy - Ability to deliver monthly updates in a timely manner Please include any relevant past experiences or examples of similar projects in your bid.

I'm in need of a proficient data entry specialist to assist with a substantial volume of data entry work. This is a very basic task, a lead scraping website doesn't allow me to export data. So we will copy and paste from one website to a google sheet. There are 2,241 entries needed This project will take ~20 hours I am attaching a screenshot of the picture of the website and of the spreadsheet

I require a specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I ...specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I am looking for: - Proficiency in handling and extracting data from different business sources, specifically focusing on citations. - Advanced skills in programming and web scraping to efficiently channel through high amounts of data. - Understand the "citation" within the context of a business website as a direct link to the company's website. The ideal candidate would be someone with vast experience in data mining, web scraping, and programming. Previou...

I'm in need of a web scraping wizard who can help me extract text data and profiles from Twitter website. Key Requirements: - The ability to scrape text data and profile information efficiently and accurately. - Experience in web scraping, with a strong portfolio showcasing past work in similar projects. - The time for scraping a post and profile must be less 3 seconds without using Twitter API. The final deliverable should be in a format that's easy for me to analyze, but I'm flexible on whether it's a CSV file, Excel spreadsheet or a database format. Please describe your past work examples with your application. Write "Blue" on the head of your bid if you are not a bot.

...signal application. The core of this project will be to implement an LSTM (Long Short-Term Memory) neural network that utilizes techniques like Fourier transform among other signal processing methods to generate buy and sell signals based on historical cryptocurrency data. Key Project Requirements: - Data Handling: The application should be able to import and use cryptocurrency data from this Kaggle dataset: Binance Full History. - Signal Processing: Integrate Fourier transform and other signal processing techniques to analyze the data. - Model Implementation: Develop and train the LSTM neural network model to predict potential buy and sell points. - User Interface: Design a user-friendly GUI that displays graphs, essential text-based information, and allow...

Automated report using dashboard in Excel The report interface should be similar look to the pic attached. The Excel file for data source should be able to be used for Power BI. Two dashboards: 1- for multiple project management status reporting 2- for ad-hoc task management The data source is in an Excel sheet with a manual entry

I'm looking for a skilled professional who can create a 1-minute live video on our website. This live video will be streamed using the front camera and will serve as a product demonstration. The ideal candidate for this project should have experience in: - Video production and live streaming - Web development (to integrate the video on our site) - Understanding of live video interaction features Key requirements: - Create a 1-minute long live video - Use the front camera - Support real-time comments - The video should be engaging and visually appealing - Ability to optimize the video for web streaming - Ensure the video is compatible and functional across different web browsers - Deliver a product demonstration that is clear and concise - Implement interactive elements to enh...

I'm about to get daily PDF forms and need them automatically dumped into a Google Sheets document. The project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each form submission creates a new row in the Google Sheets document. It's essential that: - The data is accurately extracted with no errors. - The system can handle a normal volume of PDF submissions (no more than 150) Ideal qualifications: - Proficient in web scraping and data entry. - Experienced in working with Google Sheets and PDF manipulation. - Ability to create an automated system for seamless data transfer.

I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.

I'm in need of a skilled professional who can create a live video for me. This video will specifically cater to my corporate conference and will be used on Reels and YouTube shorts. The main focus of this video will be on the audience interactions rather than the typical keynote speeches or panel discussions. Key requirements: - Creation of a live video for a corporate conference - Emphasis on capturing and showcasing audience interactions - Targeting Reels and YouTube shorts for the final video Ideal skills and experience for the job: - Proven experience in creating engaging live videos - Understanding of the dynamics of corporate conferences - Ability to highlight audience interactions in a compelling way - Familiarity with the format and requirements of Reels and YouTube short...

I'm looking to scrape a website using the python package requests. 1) create a session because the site requires a username and pwd login 2) pass an initial URL that will get pagination of results 3) from the results we'll get the URL of the individual person/page we need to get info from 4) we'll make a request call within the session to the persons URL 5) Then we'll parse the HTML from the persons page 6) Then, we'll put the information into a dictionary object and append it to the a list 7) Finally we'll then print out the list of JSON objects to a text file

...who is proficient in data analysis, visualization, and data science to work on an array of data types including financial, customer, social media, and pharma data. Key Tasks: - Data Analysis and Visualization: You will be given various sets of data which you will need to efficiently analyze and create meaningful visualizations. - Web Scraping and Automation: Knowledge in this area is desirable but not necessary. - Django Web Development: Again, not a necessity but would be considered a bonus. Objectives: - Efficiency Improvement: Assist in identifying areas of operational efficiency and suggest or implement changes accordingly. - Cost-Saving Opportunities: Use the analyzed data to identify potential areas for reducing costs. - D...

I'm in need of a seasoned Apache Solr professional to help me implement search functionality for my project. The ideal candidate has excellent expertise in Apache Solr and c...and can effectively optimize search functionality for text documents. Key responsibilities: - Upgrade from Apache Solr 3.6 to a version supporting wildcard search, Windows server - Multi cores with replication - bulk import via CSV - core creation/deletion across master and slaves Ideal skills and experience: - Prior experience implementing Apache Solr for search functionality - Proficiency in data indexing and faceted navigation with Apache Solr - Strong understanding of optimization techniques for search functionality - Excellent problem-solving and analytical skills - Good communication and collabor...

I'm seeking a professional programmer to help me create an effect...viral the tweet is considered to be. - It should be able to scrape and analyze tweets from the past week. - The bot should be capable of differentiating between tweets based on their views to followers ratio and identify the 'most viral' one. Ideal Skills & Experience: - Proficient in creating Twitter bots. - Strong understanding of Twitter API and scraping tools. - Familiarity with tweet analytics and calculations. - Ability to extract and process data efficiently. The end goal of this project is to have a functional tool that can accurately pinpoint the most viral tweet of the week. It is essential that the developer is skilled at creating algorithms that can measure and compare the �...

...Magento website. - Creating backup files that encompass all necessary aspects of my website. - Completing a full site transfer using the created backup files to preserve integrity and functionality. You must have: - Expertise in website migration, particularly Magento sites. - Proficient knowledge in creating and using backup files. - Familiarity with hosting environments, specifically VPS. - Strong understanding of Magento 2. I am open to guidance on best practices for site transfers and backup file creation. This project requires a careful and knowledgeable freelancer, who can ensure a smooth and successful website transfer. Need help with setting up a Magento site using back up files. The freelancer should be able to do the following: - Help me set up my h...

I need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and quality control. - Ability to del...

Need a multi user login where multiple users can connect to my server and access the server using apache gaucomole. It has to be scripted (csh) based as I need to execute on local machine once it is working.

...a skilled Python developer proficient in Selenium or other scraping tools, AI and others API integration. The main tasks in this project include: - Integrating APIs: You'll be responsible for seamlessly integrating the following APIs: - Send/reveive data from trained AI - Collect data using scraping - Payment Gateway - Other websites: API to integrate with other websites - Developing B2B Features: We're looking to expand our platform to cater for B2B transactions. Your role will be to create and incorporate features that facilitate B2B interactions. Key skills and experience required: - Proficient in Python - Experienced with Selenium or other scraping tools - Proven track record with API integration - exchange dat...

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

Our SaaS site () is getting a bit old. We need an experienced designer/front-end developer to completely freshen it up,We operate in the Web Scraping industry and would like our new site to stands out w.r.t. competition. We want a site that's easy on the eyes and presents our product offering better than how it is currently presented. Requirements =========== . New home page should have a section for testimonials/clients and a section for awards/review badges. . Each product (currently scrape and extract) have their dedicated page. Their illustrations need to be redone and the scrape page should have some icons/illustrations on top of each "Applications" box. . We need a new nav menu item for "Resources". The site footer section will also host new section...

...in web scraping, especially from websites, social media platforms such as LinkedIn, publications, and news sites. This will help in gathering relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid background in data handling, artificial intelligence, and machine learning will be a great advantage. Th...

I'm seeking a Python developer who's proficient in web scraping to help me extract data from social media platforms. Key Responsibilities: - Develop and implement a Python script for web scraping data from social media channels. Deliverable: - The scraped data should be compiled and delivered in an Excel spreadsheet for further analysis. Ideal Candidate: - Proficient in Python with a strong background in web scraping techniques. - Prior experience in scraping data from social media platforms will be a big plus. - Ability to deliver the end results in an organized, neat and easily accessible format, such as an Excel spreadsheet. Please reach out if you think you're the right fit with the necessary expertise.

I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.

I need a talented web designer with expertise in APIs, data scraping, and AI to help me build a professional portfolio website. - Design: The designer needs to create an engaging and visually appealing layout for the website, considering it's targeted at professionals. - Integration: I require the integration of API functionalities into the website. - Data Scraping: The designer should implement data scraping. - AI /ML Features: The website will also need AI-based features. The primary goal of the website is to serve as a showcase for my work. It’s important that the design is not only aesthetic but also functional, user-friendly, and professional. I am looking for someone who can bring a high level of creativity, technical skill, a...

I require a proficient and ClickUp builder to automate critical steps in our client acquisition process. The intention is to minimize manual intervention while enhancing our efficiency considerably. Key Tasks: - Designing and implementing an automated system that effectively captures and tracks leads: For now, our website captures leads through a contact form, and we want this process to be automated. - Integrating with our current email marketing service: Currently, we use MailChimp for email marketing. Thus, experience in MailChimp integration is a plus. - Tailor-made sales funnel automation: The new workflow must streamline our sales funnel to ensure a smooth transition from leads to potential clients. Skills and Experience: - Excellent in and ClickUp - Past experience in lead c...

I am in need of a skilled developer who can create a functional scraping tool for me. The purpose of this tool is to download JPEG product images from a specified URL that increments numerically. Key Requirements: - Scrape images from a continuously changing URL (i.e., www.****/asdasd/1234 then 1235, and so on). - Ability to tweak URL structure according to my needs. - Images must be saved in JPEG format. The ideal candidate for this task: - Has experience in web scraping and dealing with dynamic URLs. - Understands how to name files after the URL page number. Please note that the key goal is to download product images, not data extraction or process automation. Hence, your proposal should focus on delivering this specific requirement. Your understanding of this ...

Hi Nettyfy Technologies, I noticed your profile and would like to offer you my project. We can discuss any details over chat.

I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .

Redesign few pcb with given spec

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

I'm looking to build a custom scraper for DeFi exchanges....exchanges. The main features I'm interested in are: - Historical data analysis: This is crucial for me to make well-informed decisions about the market trends. - Real-time data updates: Although not explicitly stated in the questions, the bot will need to be able to update data in real-time. This will help me stay ahead of the market. I currently prefer the output in CSV format, as it is easy and widely used. Given the nature of the DeFi space, experience in cryptocurrency scraping bots is a must. It would be ideal to have experience with DeFi exchanges particularly. This project will require strong skills in programming languages such as Python, R, or JavaScript, as well as ...

...provided. * App will be capable of sending and receiving (i.e. full-duplex) serial data via OTG cable with RFD900A device. * The send and receive will be handled simultaneously. * Received data will be displayed on screen as text, hexcode or in binary form depending on user selectable option. * Received data will be saved into a file. User shall be able to enable or disable this option. * User will be able to define the log file name. * App will transmit data typed from a keyboard (similar to Arduino terminal) or should be able to select a file to read and transmit. * User will be able configure the serial port (i.e. select com port, baud rate (1200, 2400, 4800, 9600, 19200, 38400, 57600, 115200, 256000, Custom) , data bits (5, 6, 7, 8 bits), parity (...

IMPORTANT!! Start with the word in the atachment. All offers not starting as requested will be removed. We would like to have all fitness websites with embedded YouTube Videos Austria, Germany and Switzerland.

You must be a skilled 3D artist to create a realistic 3D Test character animation that will be used for my video that will be edited on Wonder Studio. The character must look real and have full rigging. the 3D character must be bigger than me so it does not cause blurring around the edges in Wonder Studio. I will send pictures for dimensions the character of the test subject. I will need variations and adjustments of the character made until I am happy with the 3D character design. You will need to send me the sample of the test 3D character and it needs to look real. You will need to show me how to use Wonder Studio and show my what apps or plugins are needed and assist me with the Wonder Studio tests. The Robot must look great and look 100% real. The robot design must work perfectly wit...