Crawl data website csv jobs
I am looking for a freelancer who can help me with a web crawling project. I will provide a list of websites that I want to crawl, and I do not need the data to be cleaned and structured as I will handle that myself. The intended use of the crawled data is for other purposes. Ideal Skills and Experience: - Proficiency in web crawling and data extraction - Knowledge of programming languages such as Python or Java - Familiarity with web scraping tools and libraries - Attention to detail and accuracy in data collection - Ability to work independently and meet project deadlines
I am looking for a freelancer to help me with creating a CSV file with 800 to 1000 items to import to my Shopify store. Format of the CSV file: - The CSV file should be in comma-separated values (CSV) format. Template for the CSV file: - I will provide a specific template for the CSV file. Data fields in the CSV file: - Only the basic product details need to be included in the CSV file. Ideal skills and experience: - Experience with importing CSV files to Shopify stores. - Knowledge of CSV file formatting and structure. - Attention to detail to ensure accurate data entry. - Familiarity with Shopify product listings and data fields.
I am looking for a developer to create a ChatGPT AI API interface for AI(ChatGPT)-generated create content around worthwhile quotations. Basically, we want to succeed at carefully creating the prompts for a quote and then once we get the prompts working effectively, we want to multiply it across all the quotes. In end, we will want a GIANT CSV spreadsheet filled with quotations with each row that includes the quote and the author and ten topics and then 15-30 columns of AI-generated content filling in the other columns. Once we master it with one or maybe a hundred sample quotes, using the ChatGPT API we will want to run it on THREE MILLION QUOTES. Purpose: - The main purpose of using this interface is to generate creative content using ChatGPT AI. Integration: - The interface ...
I am in need of a freelancer to scrape specific websites and store the information in a database. I am not sure if I need the data to be cleaned and organized or what type of database I prefer this information to be stored in. The freelancer must be able to crawl and gather all the necessary information from the website and store it accurately in a database. Experience with web scraping, cleaning, and transferring data to databases is essential. If you think you can complete this job to the highest standard, please let me know.
I am looking for a freelancer who has experience in web scraping using Python to scrape data from an e-commerce website. - The specific website to be scraped will be provided to the chosen freelancer. - The project requires scraping specific data that the client has in mind. - The preferred method of data delivery is a CSV file. Ideal Skills and Experience: - Proficiency in Python and web scraping libraries such as Beautiful Soup or Scrapy. - Knowledge of HTML and CSS for effectively navigating and extracting data from web pages. - Experience in scraping e-commerce websites would be a plus. - Attention to detail and ability to handle large amounts of data. If you have the necessary skills and experience, please submit your ...
...different dsp sites like Spotify, Beatport, Apple Music, etc and receive music from our industry partners. With functionalities where the user can upload any format of track file like mp3, wav, flac so that it can be encoded into different formats and can be distributed to different dsp sites depending upon required formats. The administrator can upload the royalty files in different formats like xls, csv, txt. provided by dsp sites and calculate the revenues for the artists and label user’s earned by their distributed albums. The encoded tracks need to be stored on cloud storages like amazon S3. The assets can be download from amazon s3 when ever required for distribution. The platform needs a: Distribution software with Release Creation System Catalog management Content ...
...of the dashboard is to analyze accident trends over time. Skills and Experience: - The ideal candidate should have experience in data analysis and visualization. - Proficiency in creating charts and graphs to present the accident data is essential. Features: - The dashboard should provide a comprehensive overview of the car accidents, allowing me to identify trends and patterns. - The data should be presented using charts and graphs, as per my preferred method of visualization. - It should be easy to navigate and filter the data based on different parameters such as location, severity, and time. - The ability to export the data in various formats, such as CSV or Excel, would be a plus. Timeline and Deliverables: - The project should be comple...
Q and A project replace answer with Answer replace keywords with Keywords replace simile with Similes For the dataset replace OTMM-Data_3.csv with For the dataset replace with - Replace search to equat notebook and export and Excel file
...create a content type in Drupal and migrate data from CSV files into the content type. Here are the project requirements: Content Type: - I am open to suggestions for the type of content type to create in Drupal (Article, Event, Product). Design/Specification: - I do not have a specific design or specification for the content type. - I am open to suggestions and would like the developer to provide their expertise in designing the content type. Data Migration: - The data that needs to be migrated is less than 500 records. - The developer should have experience in migrating data from CSV files into Drupal content types. Ideal Skills and Experience: - Strong experience in Drupal development and creating content types. - Proficient in data...
I need someone to scrape data from a website that I will provide. The data includes text and images. The website has 93 pages, each with 4 blocks of text and 1 or 2 images. Ideal skills and experience for this job include: - Web scraping - Data entry - Spreadsheet management We need the data saved into a CSV, an example of how we need the data has been uploaded to this project. Any questions, please just ask.
I am in need of a freelancer who can create a central database for license management across multiple WooCommerce websites. The database system currently in use is MySQL. Requirements: - The central database will be used solely for license management purposes. - The freelancer should have experience with MySQL and database management. - The license management ...who can create a central database for license management across multiple WooCommerce websites. The database system currently in use is MySQL. Requirements: - The central database will be used solely for license management purposes. - The freelancer should have experience with MySQL and database management. - The license management system should have the functionality to import license data from text, CSV, xlsx, or...
Looking for a freelancer to help me with a project to use my .csv database to invite Facebook profiles to my Facebook group. The purpose of this project is to connect with like-minded individuals who are part of a specific interest group. Key requirements for this project include: - Experience in working with databases and Facebook API - Ability to target a specific interest group within the Facebook platform - Familiarity with managing large databases of Facebook profiles - Proficiency in developing scripts or tools to automate the invitation process The ideal freelancer for this job will have previous experience in similar projects and a deep understanding of Facebook's policies and guidelines. They should also have strong communication skills and be able to provide regul...
...to aws server with almost zerodown time and data loss – 1 2. Backup and disaster recovery setup in emergency -1 3. Setup load balancing and auto scaling as per need -1 4. How to do load testing to ensure database performance is best at all times -1 5. How to use database indexing for better performance -1 6. Product upload efficient method over server using excel or csv -2 7. Image upload using google drive url , downloadable link , local file path -2 8. Some que process to upload all books - 2 9. Automation process to optimise database table on regular basis -2 10. Database and data security -2 11. Update important field like stock in que process and download failed report -1 12. Process has to be very efficient and fast, and to ensure data base ...
...create a content type in Drupal and migrate data from CSV files into the content type. Here are the project requirements: Content Type: - I am open to suggestions for the type of content type to create in Drupal (Article, Event, Product). Design/Specification: - I do not have a specific design or specification for the content type. - I am open to suggestions and would like the developer to provide their expertise in designing the content type. Data Migration: - The data that needs to be migrated is less than 500 records. - The developer should have experience in migrating data from CSV files into Drupal content types. Ideal Skills and Experience: - Strong experience in Drupal development and creating content types. - Proficient in data...
I am looking for a freelancer who can help me copy data from a text-based PDF file into an Excel or CSV format. Format of the PDF file: Number of pages in the PDF file: 18 Formatting requirements for the Excel/CSV file: One sheet, only the state name in the first column. Keep the column headers as they are in the PDF. Put a 1 in any cell with a checkbox and a 0 in empty cells. Omit text from the cells. Ideal skills and experience for the job: - Proficiency in data entry and working with PDFs - Familiarity with Excel or CSV files and ability to accurately copy data - It may be possible to automate the PDF to CSV conversion.
Using txt files create a CSV contains file data from separate CSV files using code written in Delphi 7
I am in need of a programmer highly familiar with SEO and web best practices, as well as AI/LLM Automation. The project will require usage of OpenAI Chat Completions API, potentially Pinecone, and other technologies. Initial project will require usage of provide...a programmer highly familiar with SEO and web best practices, as well as AI/LLM Automation. The project will require usage of OpenAI Chat Completions API, potentially Pinecone, and other technologies. Initial project will require usage of provided prompt sequences to generate highly optimized SEO content, that is then automatically posted to select CMS platforms, or exported in plain text word, csv, etc formats as necesary. Project Info
Hi, I am using a fragrance supplier called fragrancex and selling his items on eBay. ** I need a solution to automate the inventory and pricing daily updates from the supplier data feed to my eBay accounts. to import Datafeed products from to my eBay accounts. I need you will create the Csv Datafeeed file with daily updates from both and automated inventory updates on my eBay accounts. The datafeed use FTP includes the following information: 1) Name of the fragrance and gender. 2) Picture and product description (if available). 3) Wholesale cost and suggested selling price. I will provide more details when needed. thank you. Tom
I am looking for a data analyst to help make sense of an important set of structured data. The primary goal is to identify patterns and trends that will help inform our business decisions. The data will be provided in the form of an Excel spreadsheet or CSV. We do not have any specific statistical methods or data analysis tools in mind; the freelancer is free to choose their own methods and tools as they feel most comfortable with. Ultimately, the aim is to find actionable insights that will allow us to make smarter and more informed decisions about our business.
I'm looking to build a comprehensive address list directory based on (Sabai) Directory Pro. The list available is in CSV format and contains geolocation data for each address. I cannot get the import settings right in Directory Pro to also later view the imported address in a locations overview page. There will be more than 20000 entries in the list that need to be imported. Only candidates that have knowledge of (Sabai) Directories Pro plugin for WP should respond
...are blacklisted on the issue for this website is after several attempts you'll be asked to do captcha to check the ip, and you can only check one ip at a time, I want it to bypass the captcha and be able to check at least 100 IP at once and give me the result if IP is blacklisted or not. List of IPs: - The client already has a list of IPs to check. Desired output format: - The client wants the results to be in a CSV file format. Automation: - The client does not require the script to be automated and will manually run it. Ideal skills and experience: - Proficiency in scripting languages such as Python or Perl. - Experience with web scraping and API integration. - Familiarity with CSV file handling. - Attention to detail and accuracy in checking the blackl...
1. **CSV File Generation**: - Combase will generate and output a `.csv` file to a designated folder on the server. 2. **File Import**: - The application will automatically detect and import the new `.csv` file from the folder. 3. **Data Conversion**: - The application will process the data from the `.csv` file and convert it into a JSON format. 4. **API Interaction**: - The application will upload the JSON data to the Smart Pay API: - Once the upload is complete, the application will retrieve a result code to confirm whether the upload was successful. 5. **Delayed Data Retrieval**: - Approximately three days after the initial upload, the application will request a JSON list from the API, which will contain payment information. 6...
Note: please tell me about the name of the game and parameters that you will provide me Project Description: I am looking for a dataset that captures player behavior from any online multiplayer game. The dataset should be in CSV format. Requirements: - Dataset must include information about player behavior in online multiplayer games - Any online multiplayer game is acceptable - Dataset should be in CSV format Ideal Skills and Experience: - Experience in collecting and analyzing game data - Proficiency in working with CSV files - Familiarity with online multiplayer games and player behavior analysis
I am looking for a data analyst to help make sense of an important set of structured data. The primary goal is to identify patterns and trends that will help inform our business decisions. The data will be provided in the form of an Excel spreadsheet or CSV. We do not have any specific statistical methods or data analysis tools in mind; the freelancer is free to choose their own methods and tools as they feel most comfortable with. Ultimately, the aim is to find actionable insights that will allow us to make smarter and more informed decisions about our business.
...client database from all incoming client's data. Range of programming languages and technologies, with expertise in both front-end and back-end development. • Database Management Systems (DBMS) like Oracle, Microsoft SQL Server, MySQL, or PostgreSQL • Proficiency in designing efficient and scalable relational database schemas is essential to ensure proper organization and structure of client data. • Data Integration e.g., CSV, XML, JSON • Data Cleansing and Quality Assurance • Familiarity with data warehousing concepts and methodologies to create optimized data structures for efficient reporting and analysis. • Proficiency in ETL tools and processes • Familiarity with NoSQL databases like Mongo...
I am looking for a WooCommerce expert who can help me upload variable products with variations. The details are in csv to be uploaded, formatting required as per import. There is a specific deadline for the completion of this project. Ideal skills and experience: - Proficiency in WooCommerce and WordPress - Experience with uploading variable products and managing product variations - Attention to detail to ensure accurate and consistent product information - Ability to meet deadlines and work efficiently
Task Overview: We're seeking a proficient data scraper to collect information on specific medical treatments across various U.S. cities. The data should include details like the facility name, street address, city, state, zip code, and phone number. Key Requirements: Familiarity with scraping tools Ability to format data into a CSV file Deliverables: A CSV file with the scraped data, formatted as per guidelines. A brief summary report of the findings.
...not 100% update it to be accurate based on the fidelity history(see csv) Delete column T Delete Column I Change the log to make it on a yearly basis ( I want to close out existing year and start new for calendar year (based on date of transaction) all calculations will be saved by calendar year and start new. Make the formulas so they cannot be manually overwritten and cause errors ( so user errors do not occur) Hide the line numbers on the left Make the entry at the top of the page instead of the bottom(reverse order adding a blank line after entry of new line) PLEASE CHECK THE REQUIREMENTS CAREFULLY THIS IS A COMPLEX GOOGLE SHEET In terms of assistance, I only need help with the creation of the sheet, not with data entry. Ideal Skills and Experience: - Proficient ...
I am looking for a freelancer to help me complete the documentation for my CSV GAMP5 project (EDC platform for Clinical Research). The project involves creating documentation for a CFR 21 Part 11 EDC system. Current Status: - The project documentation is partially completed. Specific Sections Requiring Attention: - Validation Plan - Test Plans finalization - Risk Analysis - User requirements specification Ideal Skills and Experience: - Experience in creating documentation for CSV GAMP5 projects - Knowledge of CFR 21 Part 11 regulations and requirements - Strong attention to detail and ability to accurately document technical information Deadline: - The completion of the documentation is expected within a month.
...customization, with pre-built components that will meet my needs. It should be able to generate complex data analysis, and design interactive dashboards. The report designer should also have the ability to work with existing Excel and CSV files. I want the report designer to be easy to use, intuitive, and provide the user with the ability to customize and manipulate reports with minimal effort. It should also provide customizable versions so that I don’t have to start from scratch each time I need to make a report. This project requires a thorough understanding of report designing, database systems, and software development, so experience in these areas is a must. Experience with Excel/CSV, SQL databases, and report software such as Crystal Reports or Table...
I would like to create a tool that enables me to extract particular data from a website. I'm not interested in retaining the data itself, but rather, I'm looking to build a straightforward software that permits me to retrieve the specified information from the website whenever I need it and extract it as CSV file to be used.
Project Description: - I am looking for a freelancer who can help me with a scraping project. - The website that I need to scrape data from is Website A. - Specifically, I am interested in scraping product data from this website. - The intended use for this data is product comparison. - The ideal freelancer for this job would have experience in web scraping and data extraction. - Knowledge of Python or other programming languages commonly used for web scraping is required. - Attention to detail and accuracy in scraping the data is crucial. - The freelancer should also be able to deliver the scraped data in a structured format, such as CSV or Excel. - Experience in market analysis or product comparison would be a plus. -...
We are seeking a skilled translator who can assist us in translating a CSV file from English to Mandarin and Japanese. This project is crucial for our business expansion efforts into new markets and requires precise and accurate translation work. If you are proficient in both Mandarin and Japanese and have experience with CSV files, we'd like to hear from you. Responsibilities: Translate CSV file content from English to Mandarin and Japanese while maintaining data integrity and formatting. Ensure accurate translation of text, product names, descriptions, and any other relevant information within the CSV file. Verify the translated content for consistency, grammar, and context accuracy. Handle any special characters, symbols, or formatting issues that...
I am looking for a freelancer who can help me import more than 500 configurable products to my Magento 2 website. Skills and Experience: - Proficiency in Magento 2 and product import/export - Experience with importing configurable products - Ability to collect and organize product data - Familiarity with CSV/Excel file formats - Attention to detail and accuracy in data collection and import process
I am looking for a skilled Python developer with experience in web scraping on a Linux system. The project involves creating a script for scraping data from website(s). Requirements: - Ability to scrape data from single or multiple websites - Familiarity with scraping both structured (e.g. tables, lists) and unstructured data (e.g. text, images) - Proficiency in Python and Linux - Strong understanding of web scraping techniques and libraries Deliverables: - The scraped data should be delivered in the desired format (CSV, JSON, or Excel) Please provide examples of previous web scraping projects you have completed.
I am in need of a programmer highly familiar with SEO and web best practices, as well as AI/LLM Automation. The project will require usage of OpenAI Chat Completions API, potentially Pinecone, and other technologies. Initial project will require ...a programmer highly familiar with SEO and web best practices, as well as AI/LLM Automation. The project will require usage of OpenAI Chat Completions API, potentially Pinecone, and other technologies. Initial project will require usage of provided prompt sequences to generate highly optimized SEO content, that is then automatically posted to select CMS platforms, or exported in plain text word, csv, etc formats as necesary. The developer selected for this project will be contacted for future projects and support assuming success, I am ver...
...GUI design using Java Swing. • Integration with a MySQL database for data storage. • Reporting functionality (specify the types of reports you need). • QR code generation and scanning capabilities. • Data input and validation. • Modify, Search and retrieval of data. • Data export options (e.g., CSV, PDF). • Report generation • User roles and permissions. • Operating systems is windows Database Schema: • Provide a detailed description of the database schema, including tables, columns, relationships, and random sample data. User Interface (UI) Design: Pesudeocode Flowcharts or Diagrams: • Use flowcharts or diagrams to illustrate the workflow and how different components/modules interact with...
I have a list companies with the full legal address. I need a scraping tool which enables me to upload the list of companies (max ...legal address. I need a scraping tool which enables me to upload the list of companies (max 500) and then get the scraper to add the data in the missing columns, including website (the website is not available in my list, it will need to be found by the scraper based on the legal address given)! company linkedIN profile link company office email company phone number separate scraper: if we have all of the above, search for personal email or phone for managing director As a result of the scraping work, provide a data table that I can import as csv or similar format to Excel with all the data. I attach a sample file w...
I am looking for a freelancer who can help me scrape product images and specifications from an e-commerce website. This project is for personal use and I have a specific need for these data fields. The ideal candidate should have experience in web scraping and be familiar with extracting images and specifications from websites. Requirements: - Experience in web scraping and data extraction - Proficiency in CSV file handling - Knowledge of HTML and CSS for website scraping - Attention to detail and ability to accurately scrape product images and specifications Skills: - Web scraping - Data extraction - CSV file handling - HTML and CSS - Attention to detail
Hello, This is the proposal for the desired script : "PDF to CSV Table Data Extraction with Python". I used the library Camelot for extracting the pdf tables and saving it to excel. In case you want to generalize to more PDF, you will have to modify the row : # date_formats = [ # r'd{2}-d{2}-d{4}', # FORMAT1: 02-04-2019 # r'd{2}/d{2}/d{2}', # FORMAT2: 25/08/21 # r'd{2}-[A-Za-z]{3}-d{4}', # FORMAT3: 23-APR-2023 # r'd{2}-d{2}-d{4}', # FORMAT4: 01-05-2018 (Same as FORMAT1, update if it differs) # ] It indicates the date format you want. This script extract tables when there is a table with date. DELIVERABLES : I'm going to give you the folder I was working on. I...
...extract data from HTML files. Need to extract specific fields. will discuss over call with sample data. Ping me/text me on chat conversation. Need to follow below simple and basic rules. • ExtractHtmlData should be multi-threading/multiprocessing to process html files fast. • ExtractHtmlData script will be in a folder name Script1. • In Script1 folder there will be ExtractHtmlData script written by you and a Folder named “inputfolder”. • There will be 2 items in Script1 folder which are ExtractHtmlData and “inputfolder”. • Inputfolder Consists of List of folders. Each folder consists of list of .html files. • Script should loop through all folders from Inputfolder. • Script should loop through all .html files fr...
I am looking for a skilled Laravel developer who can complete a small project within 8 hours. The main functionality of the project is to import a CSV file using best practices. Requirements: - Experience with Laravel framework - Strong knowledge of importing CSV files - Ability to create a simple CRUD system - No need for user authentication or complex design - Familiarity with best practices for CSV file importing Budget: - The budget for this project is less than $35. If you are an experienced Laravel developer who can deliver high-quality work within the given timeframe, please submit your proposal. (Please contact me so i can send you the project description)
I am looking for a freelancer who can copy and paste text data from a website into a CSV file. This project involves transferring about 100 entries of text data from a website into a CSV file. The freelancer will need to navigate the website, locate the data, and copy and paste it into the appropriate columns in the CSV file. Accuracy and attention to detail are essential to ensure that the data is transferred correctly. There are three columns needed: Type, Name, and Link. The source is here: So, the first entry would be: "House Standing Committee","Agriculture and Natural Resources","" Please note that three of the lists have two tabs. Quick and easy, get
...x After accessing each site, the system should find specific legal cases using process numbers provided in a CSV file. CSV format: Site - Process number ; 10026526852787245829 ; 274157715592754419 Once the search is done, the system should log in and access the private area of each case. Within the private area, the system should click on the "contract" tab, which will open a PDF in the web browser. With the PDF open, the system should extract the following information from the PDF: CPF (Brazilian ID number), Phone, and Email. (Content formats: CPF 34262772676 or CPF 123.728.564-24) After extracting all the information, the system should generate a CSV file on the source PC's desktop in the following format: Process number; CPF; Phone; Email ...
...freelancer to develop a comprehensive music database and analytics platform for our music industry-focused service. This platform will allow users to access valuable data and insights related to artists, radio stations, labels, and music charts. Users will have various roles such as Artist, Publisher, Broadcaster, and Record Label, each with specific access to relevant information. Roles and Access Levels: Artist: Users with this role can view data related to their own songs and statistics. Publisher: Users in this role can access data on artists, radio airplay, and charts. Broadcaster: Users in this role can access radio-related data, including station details and played songs. Record Label: Users with this role can view label-specific information and arti...
...units, etc) Use the SKU code to lookup the matching product details in a CSV database/spreadsheet. The database contains at minimum: SKU code Product name Unit price Weight Build a quote table containing: SKU code Product name Quantity requested Unit price Line total (quantity x unit price) Weight per unit Total weight for the line item (weight per unit x quantity) Add a grand total and grand weight total for the full quote at the bottom of the table. Populate an email template with the formatted quote table and totals. Email the quote back to the customer who requested it. So in summary, the script would: Continuously check for new quote request emails Extract key details like SKU code and quantity Lookup product data by SKU code Build a formatted quote table Populate ...
Scraping data from a website - I am in need of a freelancer who can scrape data from a specific website - The website will be provided in messenger for confidentiality - I have a specific data that needs to be scraped from the website - The scraped data should be delivered in CSV format 1 item per line. - Ideal skills and experience for this job include: - Proficiency in web scraping techniques - Experience with data extraction and parsing - Knowledge of HTML and CSS - Familiarity with the chosen programming language for scraping - Attention to detail and accuracy in data extraction and formatting
I am looking for a freelancer who can help me scrape product details from websites and compile them into a CSV file. I would require the python script as well. Specific requirements for the project include: - Scraping product details from multiple websites - Compiling the scraped data into a CSV file - The ability to work with a provided list of websites Ideal skills and experience for this job include: - Proficiency in web scraping techniques and tools - Experience with data extraction and manipulation - Knowledge of CSV file formatting and data organization If you have the necessary skills and experience, and are interested in this project, please submit your proposal.