How to scrape website using scrapy jobs

Filter

My recent searches
Filter by:
Budget
to
to
to
Type
Skills
Languages
    Job State
    2,000 how to scrape website using scrapy jobs found, pricing in USD

    I'm looking for a seasoned developer to create and design a minimalist, clean interface for my OpenCart 4 online store. I'm open to design suggestions, but the aesthetic should lean towards a minimalist and clean look. The current design is as Key requirements for this project are: - A mobile-friendly interface. - An intuitive product search mechanism. Ideal freelancers for this job will have proven experience creating and designing OpenCart interfaces, particularly ones that are minimalist in style. Your portfolio should demonstrate your ability to implement the key functionalities mentioned above.

    $101 (Avg Bid)
    $101 Avg Bid
    17 bids

    This is a $15 Job We currently have a perfect working counter but returns {"messages":"1"} As you can see is using JSON_ENCODE But we need more of a normal php echo that returns something like: <?php echo $userNotesRequest, count; ?> 1 below is what we using now ---------------------------------------------------------- <?php include("../../"); if (!isset($_SESSION["id"]) || $_SESSION['usertype'] != "chatusers") { exit(); } else { $userNotesRequest = mysqli_query($linkID, "SELECT COUNT(*) as count FROM chatusersnotes WHERE userToId='" . $_SESSION["id"] . "' AND seen=0 ORDER BY createdAt DESC;"); ...

    $45 (Avg Bid)
    $45 Avg Bid
    25 bids

    Python Script of web spiders to fetch data crawling the web data。familiar with BeautifulSoup or selenium or scrapy ,Request etc What type of data do you want to scrape and crawl from websites? Fbeautiful soup vs selenium vs scrapy The function is easy to design

    $32 (Avg Bid)
    $32 Avg Bid
    42 bids

    I am in need of an expert who is proficient in PFR reactor modeling to assist in a specific project. The project will predominantly involve simulating the behavior of an exothermically reacting system inside a Plug Flow Reactor. Key Tasks: - Drawing up both 1-D and 2-D pseudo homogeneous models of the system - Comparing the 1-D and 2-D models to highlight the differences in behavior - Temperature vs reactor length and conversion of reactant vs reactor length profiles. Ideal Skills & Experience: - Vast experience in reactor modelling - Proficient in using simulation software - Strong understanding of thermodynamics, specifically exothermic reactions Please note: This project requires a strong theoretical background and practical experience in chemical reactor m...

    $112 (Avg Bid)
    $112 Avg Bid
    7 bids

    It need to have BOTH logos in your design (TBOE and RPX) - logos attached. It needs to have the words TBOE and RPX (using the colors and logos of attached files) and the word Venture in the logo you create. I need this by 3/27 at 12 am EST. - Although the logo should be unique, it should also remain professional and reflect our company's principles. Ideal skills and experience: - Excellent in creative logo design - Proficient in typography - Capable of reflecting company's ideals in design

    $35 (Avg Bid)
    Guaranteed
    $35
    202 entries

    I'm in need of a professional web developer with strong skills in affiliate marketing and web scraping. The project involves creating a comparison website featuring products from Amazon. Key requirements: - Develop an intuitive, user-friendly website to compare a range of products - Ability to scrape product data from big websites, specifically, Amazon - Setup of affiliate marketing links for all listed products The product categories would be comprehensive, covering all currently available on Amazon. Thus I would appreciate someone with experience handling expansive database and a meticulous attention to detail. If you've previously completed similar tasks or have a solid understanding of product affiliate marketing, you're the ...

    $158 (Avg Bid)
    $158 Avg Bid
    20 bids

    I need a talented web scraper who can retrieve and organize select information from various recuirtment businesses websites. Key tasks include: - Scrapping contact information such as phone numbers and addresses separately, from assigned accounting firms' websites. - The scraped data should be organized into an Excel file. The ...contact information such as phone numbers and addresses separately, from assigned accounting firms' websites. - The scraped data should be organized into an Excel file. The ideal freelancer for this project would have: - Specific experience in web scraping - Familiarity with handling and organizing data into Excel formats. Your expertise will contribute to my ability to connect and work effectively with accounting firms. I look forwa...

    $70 (Avg Bid)
    $70 Avg Bid
    13 bids

    I am looking for an expert in web scraping, preferably skilled in Beautiful Soup, Selenium, or Scrapy. The task at hand involves scraping 83 distinct URLs and integrating the collected data - specifically showtimes - onto my website's TV channels page. Key aspects of the project include: - Displaying current showtimes on the website - Automatically updating these showtimes This project is needed ASAP, and thus requires a freelancer able to swiftly yet accurately complete the task. Proficiency in Python, PHP and JavaScript would highly benefit the project execution. ----- I require a freelancer with expertise in web scraping to update my existing scraper tools which gather show time information from a multitude of television channel websites. You will us...

    $102 (Avg Bid)
    $102 Avg Bid
    24 bids

    ...seeking a competent and experienced developer to create three interrelated components - a WordPress plugin, a C# service, and an iPhone app, all focused around software activation and tracking. Fix Budget $250. Only Bid if can do this job for this budget. Key components includes: 1. **WordPress Plugin** * Main functionality: Software activation. * Auto Key Generation On Purchase or Trial key (All Has to Be Unique and only 1 device Per Key ) * Trial , Recurring and One Time Purchase options * Should Be Able To Add Multiple Software's for activation * option to add which features to be active for Software Add On Purchase * Manual Key Generation * Needs to Track if Software is Uninstalled in order to...

    $166 (Avg Bid)
    $166 Avg Bid
    36 bids

    More details: I have a AWS IoT Core account where MQTT devices are publishing data to it. I require the assistance to set-up Ignition SCADA V8.0 Mqtt engine to subscribe to the topics within AWS IoT Core.

    $52 (Avg Bid)
    $52 Avg Bid
    3 bids

    I am on a mission to increase the visibility of my entertainment-oriented YouTube channel, targeting primarily adults and older individuals. Therefore, I'm seeking an experienced social media marketer who can bring authentic, engaging subscribers to my platform. Key Roles: - Create and implement strategies for gaining real, active subscribers - Increase channel visibility through engagements Competencies Required: - Proven experience in YouTube Channel growth - Understanding of the YouTube algorithm - Robust knowledge in social media engagement techniques targeting adults and older audiences - Strong track record in the entertainment content sector - Creativity and inventive thinking in audience engagement strategies Your efforts will ideally lead to a signific...

    $28 (Avg Bid)
    $28 Avg Bid
    27 bids

    I'm seeking an experienced programmer with expertise in Lua and MATLAB. This project will involve: • Creating ...experienced programmer with expertise in Lua and MATLAB. This project will involve: • Creating new scripts • Performance optimization • Detailed explanation of code These scripts will cater to: • Data Analysis • Simulations • Automation tasks Since the input/output formats weren't specified, flexibility in handling various formats is a plus, though not necessarily required. Ideal candidates should have a strong background in both Lua and MATLAB programming, with proven experience in efficient coding, optimization techniques, and clear annotation. Previous experience in handling tasks relating to data analysis, sim...

    $516 (Avg Bid)
    $516 Avg Bid
    23 bids

    ...columns (D-J) which needs to be split into 3 sets of data (K-Q), (R-X) & (Y-AE) I already did the first row manually. For this job you need to split the cells into the target rows and also have a QA step and recombines the split data into a "QA Check" concatenation. Then a final check to verify that the original = QA check. This is to verify no data was lost. Here is a read only link to the sheet: https://docs.google.com/spreadsheets/d/1TiyKKNjrEHeCrNySmmiD9xWQXTjd1OAh-8fUluSLRR0/edit#gid=420694380 rows 4-509 need to be done. Only work with the new fields, do not edit the original data This needs to be done with formulas, not manually. For an excel/google sheet expert this should be a 1 hour job. To show...

    $21 (Avg Bid)
    $21 Avg Bid
    12 bids

    ...on the hunt for an experienced app developer to create a personal fitness companion application with GoogleFit API and Open Food Facts API integration. The main goal of this app is to foster healthier lifestyles. It will accomplish this by offering comprehensive functionality that includes: - Tracking exercise progress, specifically by monitoring distance covered during exercise, calories burned during workouts, and the duration of exercises. - Monitoring daily nutritional intake and providing relevant insights about food consumed by using the Open Food Facts API. Ideal Skills & Experience: - Android Java - Proficient with GoogleFit API & Open Food Facts API or similar The overall design and layout of the app should be clean and simple to promot...

    $148 (Avg Bid)
    $148 Avg Bid
    31 bids

    I'm after a labor to help me scrape one of my corporate websites that's dynamically fed from a CMS, and recreate it as a sequence of static pages, preserving the same URL structure. The objective is to replicate the website on a different, preferably static HTML platform. In addition to this, a search utility that enables search by keywords, akin to our existing setup, should be incorporated on the static replica. The ideal candidate for this task would have proficiency in website scraping, experience with CMS, static HTML, and the creation of search utilities.

    $479 (Avg Bid)
    $479 Avg Bid
    183 bids

    Complete Exploratory Data Analysis and Data Cleaning using R/R studio

    $6 / hr (Avg Bid)
    $6 / hr Avg Bid
    1 bids

    More details: Which programming language are you more comfortable with? C# or Python or AI What is the level of understanding or background do you have in the cho...more comfortable with? C# or Python or AI What is the level of understanding or background do you have in the chosen programming language? Advanced What type of data are you looking to extract from the website? Contact information, Registration details, Company profiles The website: Is the regulator for estate agents in the UK. They hold information on al estate agents. I would like a script or console app r automated way (could be AI) of extracting all the UK estate agents from this website. I need their sector, address, phone number and name and website. Thank you

    $156 (Avg Bid)
    $156 Avg Bid
    37 bids

    More details: What specific projects or tasks do you need assistance with? Development, UI design, Figma to UI conversion; API integration; Sign in using OTP based authentication; Logging; Payment gateway integration What platforms or devices should the project be compatible with? Web, iOS, Android How soon do you need your project completed? Within a month

    $370 (Avg Bid)
    $370 Avg Bid
    16 bids

    I'm on the lookout for an individual proficient in mining to educate me in the craft. This inclusive tutorial will cover: - Hardware setup - Mining software installation - Mining efficiency enhancement The ideal applicant for this role should prioritize their previous work experiences in their application. Direct experience in managing hardware, software installation and optimization of Zepher mining rigs would be highly beneficial for this role. I'm excited to learn and dig deep into the world of Zepher mining with your assistance.

    $12 (Avg Bid)
    $12 Avg Bid
    3 bids

    I would like to design and program a database and interfaces for website It contains electronic applications The idea of ​​the site is to combine two projects into one project, that is, merging the direct classified advertising project with the freelancing project in one site. I have a Photoshop design that explains the details of the project, consisting of 244 pages

    $4074 (Avg Bid)
    $4074 Avg Bid
    53 bids

    i will have to collect all 1260 pdf based on your given instruction from

    $350 (Avg Bid)
    $350 Avg Bid
    1 bids

    ...proficient Android developer to construct a feature-rich delivery boy app. The core functionalities should include: - Order Management: Enabling the delivery individual to check assigned orders and update their status in real time. - User Authentication: For security purposes, the app should incorporate Two-factor authentication, specifically OTPs, to ensure each user's identity. The developer ideally should have a wide range of experience in Android development and a deep understanding of these specific features. While knowledge on updating profile features would have been beneficial, this aspect is currently not the main priority. This project requires a developer with a firm grasp on developing user-friendly interfaces and keen attention to detail....

    $78 (Avg Bid)
    $78 Avg Bid
    14 bids

    I am looking for a highly skilled Selenium Python developer to automate certain tasks on Firefox. Ideal Experience and Skills: - Hands-on experience with Selenium Python - Deep understanding of browser automation - Proficiency in form filling and data extraction automation Project Scope: The automation must work specifically on the Firefox browser. It should automatically handle form submissions, perform workflow actions, and extract data as required. Please include in your proposal proof of your experience in automating browser actions.

    $2521 (Avg Bid)
    $2521 Avg Bid
    36 bids

    I'm in search of an expert web developer who can swiftly take on my project on a deadline. Ideal applicants should have: - Mastery over HTML, CSS, JavaScript; under...applicants should have: - Mastery over HTML, CSS, JavaScript; understanding of popular web programming languages is a prerequisite - Familiarity with React, Angular, or Vue.js frameworks; although not mandatory, some experience in these areas can be beneficial - Experience in creating responsive web designs and optimizing for search engines - Ability to work quickly and efficiently to deliver the project ASAP Your role would include using your skills to develop a web-based project, ensuring it is fully responsive and search engine optimized. Candidates with a track record of delivering such...

    $158 (Avg Bid)
    $158 Avg Bid
    68 bids

    Looking for an experienced Python developer to develop a script that can effectively and automatically scrape text content from a scraper should be capable of obtaining various types of information and capable of implementing specific logics Mention your past scrapping projects in your bid. Ideal Skills: - Proficiency in Python programming - Experience with web scrapping tools - Familiarity with various website structures. Responsibilities: - Develop a script to automate data scrapping - Test the script to ensure it functions as intended - Maintain the script to accommodate any website changes. Deliverables: - Efficient Python web scrapping script - Clear documentation on how to use and maintain the script.

    $30 (Avg Bid)
    $30 Avg Bid
    45 bids

    ...objective of this project is to scrape data from given URLs, model the collected data, and then visualize it. The goal is to use these techniques to perform a predictive analysis and identify any emerging trends. - I require the use of Microsoft Power BI for the visualization component of this project. Experience and proficiency with this tool is a must. - The data you will be dealing with will be a variety of types, collected from online databases. Skills required: - Proficiency in Web scraping - Data modeling and visualization - Competence in Microsoft Power BI - Experience working with online databases as data sources An understanding of trend and predictive analysis will also be beneficial in this role. If you think you meet these requirements, I am loo...

    $19 (Avg Bid)
    $19 Avg Bid
    17 bids

    Please instruct how to create video using generative AI

    $96 (Avg Bid)
    $96 Avg Bid
    24 bids

    I am looking for a statistician who has expertise in using R or similar software to run a logistic regression with robust standard errors using the dataset attached. Then, you give me a generally statistically acceptable output. I have already run a primary logistic regression with robust standard errors. The primary model, in all respects, looks okay, but its specificity is 0.000. Have a look at the primary logistic regression output attached and improve the specificity (from 0.000) by adjusting the threshold (from 0.5) in your logistic regression with robust standard errors using the dataset attached. The dependent variable is ELECTIONSTATUS. My target independent variables are ELECTORAL_GOVT and EDM, both of which are categorical variables. I need the effect...

    $12 (Avg Bid)
    $12 Avg Bid
    8 bids

    Quick matlab assignment, statics question solved using Matlab and matrices

    $22 (Avg Bid)
    $22 Avg Bid
    22 bids

    I'm urgently looking for a skilled developer to create a comprehensive web scraper for data-rich websites. This tool should solely focus on extracting and compiling text content. As the work is time-sensitive, I'm seeking someone who is able to hit the ground running. Key requirements include: - Able to create a reliable and efficient web scraper - Strong understanding of various scripts to scrape data websites - Demonstrate a track record in web scraping projects If you've got the skills and can turn this around ASAP, let's connect.

    $123 (Avg Bid)
    $123 Avg Bid
    41 bids

    We are seeking an experienced developer to configure data exchange between a Jetson Nano and another device via the CAN bus, utilizing the RS485 CAN HAT. Documentation and examples for the RS485 CAN HAT for the Jetson Nano are available here: Project Requirements: Data packets to be transmitted are split into frames of 8 bytes each, with the first 7 bytes of the frame encoded in ASCII. The last byte is an integer frame counter that does not convert to ASCII. A checksum is generated from the packet data and appended at the end of the packet using the following function: c Copy code uint16_t crc_chk_value(uint8_t *data, uint16_t size) { uint16_t crc = 0; while (size--) { crc ^= *data++; for (unsigned

    $509 (Avg Bid)
    $509 Avg Bid
    21 bids

    I need an...Python programmer who can craft a script to scrape data from the PowerBall lottery draws at the state level. The details to include are the Jackpot amount, Draw date, Day of the Week, Total Draw Sales, Total PowerPlay Sales, Total Double Play Sales, and the state-level PowerBall, PowerPlay, and Double Play Sales for each American state. Data can be found at this website: And for previous years at similar pages: … Ideal Skills: -Python programming -Data Scraping -CSV file generation The script output should be formatted as a CSV file. I should be able to run it again to generate updated data.

    $26 (Avg Bid)
    $26 Avg Bid
    23 bids

    I am seeking a proficient Sketchup designer adept at creating built-in designs. Key Deliverables: - Blueprint of the built-in design - Inclusion of adjustable shelves and hidden compartments Specific Requirements: - The design should accommodate dimensions of 11 ft long by 9 ft tall - Proven experience in designing furniture or built-ins using Sketchup is necessary. Please provide examples of your previous Sketchup designs while bidding for the project. Let's create unique and functional built-ins together!

    $41 (Avg Bid)
    $41 Avg Bid
    20 bids

    I am in need of a skilled freelancer to carry out web scraping in a professional and timely manner. The ideal candidate will have significant experience in the field of data mining and extraction. Your task will be to scrape text content, images, and product information from specified websites. Please ensure you highlight your experience in your application. Upon completion, I'll need the scraped data to be organized and delivered in an Excel Spreadsheet format for ease of analysis. Key Skills: - Web scraping - Data mining - Data extraction - Proficiency in Excel, for the clean arrangement of data.

    $20 (Avg Bid)
    $20 Avg Bid
    27 bids

    ...seeking an adept, focused and creative web developer to design a sophisticated and interactive website DEMO. BUT this PART OF THE project is ONLY for CREATING the FIgmas using mostly our notes and outlines. Key features of the FIGMAS include: - Event vendor and planner profiles, showcasing their services, past projects and areas of expertise. - An intuitive messaging system to facilitate clear and efficient communication between parties. - A 3-tiered membership system for vendors (Basic, Premium, and Gold), providing varying levels of service and benefits. - An Affiliate program to promote our services and draw new users. - A comprehensive, custom-designed dashboard for each type of user. - All vendors, such as caterers or food truck operators, to...

    $167 (Avg Bid)
    $167 Avg Bid
    55 bids

    I need an individual to handle our company's social media profiles, specifically Instagram, Facebook, and LinkedIn. Your job is to input provided information into premade Canva design templates for regular posting. Responsibilities: - Implement given content into Canva templates. - ensure spelling in grammar is correct and cohesive - post on the social media channels on time Skills: - Familiar with Canva and social media platforms. - Able to post consistently and accurately across multiple platforms.

    $34 (Avg Bid)
    $34 Avg Bid
    54 bids

    I'm in need of an expert with robust website scraping skills, capable of extracting text content from different online platforms, mainly music-related sites. This project not only requires knowledge of these particular platforms but also the skill set to correctly interpret and manage the obtained information. Ideally, you'll have a successful track record in relevant data extraction tasks. Results should be precise and generated in a timely manner. Key attributes needed: - Exceptional web scraping skills. - Profound knowledge of music websites. - Proven experience in data interpretation and management. - Consistent and punctual in job completion. Please, only bid if you're confident in handling these requirements properly.

    $29 (Avg Bid)
    $29 Avg Bid
    21 bids

    ...utilised as a reference during an API call. File types: To include: pdf, ms word, Excel, CSV, text, XML, JSON User acceptance: To be able to query openAI about the file and get responses that relate exclusively to the reference file. Code: Native JavaScript. Can use external libraries. Should run on any server without installing plugins. Specifications: - The file constitutes mixed data, encompassing both numerical and textual information. - The system should seamlessly interact with the entirety of the file. - The primary task involves integrating the API to fetch data from the stored file, read and analyse it as required, and send appropriate responses. Ideal Skills & Experience: - Robust knowledge about APIs, specifically in relation ...

    $185 (Avg Bid)
    $185 Avg Bid
    37 bids

    This project aims to optimize the design of a mechanical component by minimizing three objective functions (F1, F2, and F3) subject to certain constraints. The optimization process is carried out using a Particle Swarm Optimization (PSO) algorithm implemented in Python. The optimized design parameters are then used to create a finite element model of the component using PyANSYS, a Python interface for the ANSYS Parametric Design Language (APDL). The project involves two main tasks: Implementing the PSO algorithm with Pareto optimization to find the optimal design parameters that minimize the three objective functions while satisfying the specified constraints. Integrating the optimized design parameters into the PyANSYS code to create and ...

    $103 (Avg Bid)
    $103 Avg Bid
    8 bids

    Kitchen designer needed ..context is to make it modern , best utilisation. Looking for innovative designer

    $88 (Avg Bid)
    $88 Avg Bid
    55 bids

    I'm after an experienced Article Writer focused on technology, specifically e-commerce technologies. Key roles: - Generate instructive how-to guides revolving around various e-commerce technologies. - General comprehension of technology as a field is desired. Ideal skills: - Extensive background in writing technology and e-commerce related articles. - Proficiency in writing detailed, instructive, and engaging how-to guides. - Deep understanding of e-commerce systems, platforms and trends.

    $374 (Avg Bid)
    $374 Avg Bid
    46 bids

    ...seeking a skilled web scraper/developer to create a tool that will specifically extract data from Zillow. As a trusted online real estate marketplace, Zillow holds a wealth of property data that I need to acquire for my project. Key Deliverables: I need you to extract the address, price of the property and the contact information for all the houses on Zillow listed as for sale by owner that are listed for at least $10,000 less than their estimated market value. Afterwards, I need the information in a csv file formatted address, price, phone number. I want you to scrape every house listed for sale by owner on the entire website. You will have to write the script to scrape the website and then deliver the csv file...

    $199 (Avg Bid)
    $199 Avg Bid
    33 bids

    I need an experienced professional to develop a toll pricing model system that will be efficient in optimizing traffic flow and reducing carbon emissions. This advanced system should: - Feature real-time traffic monitoring with an algorithm for toll revision. - Be integrated with PTV Vissim to accurately depict the effects of toll adjustments on traffic flow. - Include time-based variable or step tolls for flexibility. Ideal Skills and Experience: - Proficiency in traffic modelling software, especially PTV Vissim. - Knowledge of traffic algorithms. - Experience with systems related to toll collection or traffic management. Toll Revision Algorithm: An efficient algorithm should operate based on traffic volume and dynamic pricing. The mechanism should: - Adjust tol...

    $134 (Avg Bid)
    $134 Avg Bid
    4 bids

    ...and financial markets (and maybe machine learning) to create a tool capable of analyzing past price data. This tool should be functional on iPhone app OR Excel Worksheets OR websites. Key observations to derive from the data should focus on identifying trends and patterns. Project Requirements: - I will feed chunks of opening and closing price, and your tool will identify trends or patterns from these past stock price data. Tool should be available on iPhone or Excel or webpage - Key output: Identify trends and patterns If using Excel, no macros unless I am able to analyse and understand there is no bug. I understand a bit of Vba. If I don’t understand the vba I won’t enable macro. If using Website, no special permission is nee...

    $684 (Avg Bid)
    $684 Avg Bid
    34 bids

    I have built out an Alteryx web scraping model that mostly works, however, there are some issues, i think it's due to something related to the latitude and longitude requirements of the API perhaps, some cities work and others don't. I am looking to query by city to see which dental services are available in that city. Within the attached model i have provided the list of cities, the website to query, some additional customizations required and some details on the issues. I mostly just want the Download tool configured to pull from all cities, i can cleanup the JSON outputs myself, though feel free to do that :) I would like to scrape the Sunlife Lumino Website.

    $13 (Avg Bid)
    $13 Avg Bid
    13 bids

    ...knowledge in OpenMP to create a program. This task involves manipulating a 150 KB bitmap image file, carefully inverting the colors to ultimately produce a negative version of the original image. Key Deliverables: - Use OpenMP for task execution, taking advantage of dual-core processing to optimize CPU usage. - Execution of the ~ operator to complement each byte in the character array. Required Skills and Experience: - Extensive understanding of C++ - Familiarity with OpenMP - Experience in image manipulation - Proficient in efficient code writing and maintenance. While there is no strict adherence to a specific coding standard, the successful freelancer must demonstrate a commitment to clean, efficient, and well-documented code. This proje...

    $156 (Avg Bid)
    Urgent
    $156 Avg Bid
    6 bids

    ...aimed at customers to simplify and elucidate the ordering process on our food delivery app. This video will serve as a tutorial and will be primarily displayed on our company website. Requirements: - Extensive experience in creating how-to videos or user guides, ideally for apps or technical products. - Ability to break down complex processes into simple, easy-to-follow steps. - Creativity in capturing audience attention and maintaining interest throughout the video. Video Content: - Detailed step-by-step demonstration of the ordering process. - Tips and tricks for navigating the app effectively. - A clear call-to-action at the end, encouraging viewers to start ordering on the app. Please include links to previous in...

    $296 (Avg Bid)
    $296 Avg Bid
    23 bids