Open source data scraping sql jobs
I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively
We are looking for 5-10 years of .Net experienced developer who can also have experienced in React and .Net based web development. Long terms multiple projects development. Using Mainly Azure SQL server database with Visual Studio .Net Core API. Graph QL and EF. Worked on Azure Key Vault, Azure Logic app, Azure function is bonus.
do not ask more than $100 use Oracle PL SQL teach me how to free install on my local windows 11 you have 2 days to do you simulate input data -> transactions data *****you provide SQL code to calculate per day summary for each day for each product for each store for 3 years suggest your columns also more needed columns will be provided simulate tables with store transactions take to account - promotions -store location -state -usa holydays simulate lookup tables for 1 promotion 2 store locations 3 prices changes each 3 months etc data simulation may be done in python and then upload to SQL DB (but better in SQL) you provide both sql and python code for both simulation (sql or python ) and main table creations (o...
..., but before I proceed, I need a thorough background check on the company and its owner. The ideal freelancer for this job should: - Have expertise in Open-source Intelligence methods - Be able to investigate and provide comprehensive information on the company's reputation, the owner's background, and the overall trustworthiness. - Have the ability to cross-check for financial fraud, legal issues, and misconduct. - Be able to cover a global perspective in their research, especially focused on the regions of United States, Europe, and Asia. Please provide details on your relevant experience with Open-source Intelligence, as well as any similar tasks you've completed in the past. Your familiarity with conducting such research on companies ...
I'm in need of a skilled developer who can create a Telegram bot for scraping user data and automatically inviting them to join a specific channel Key Requirements: - Ability to work with multiple telegram accounts (multithreaded). - The bot should be able to scrape usernames and phone numbers from specific Telegram groups or channels already added into relevant accounts. - The scraped data should be used to automatically send invites to join a specified group. Ideal Skills & Experience: - Proficiency in Java or Python and the Telegram API for bot development. - Experience with web scraping and data extraction. - Proven ability in creating Telegram bots for automatic interaction. Please note that the bot will be used for legitimate purposes...
I need to Extract followers of group members of the link I will provide
I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would like the project to ...
I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.
Want to extract a list of profiles including name, country, city, email, phone numbers, link to profile for a list of followers for total output should be around 100K profiles that will be used to feed meta audience (customer list)
...ready, and the SQL tables have been set up. The main features of this project include: - **Dashboard:** This should display data from the other 3 pages in a list format as well as in a bar chart. - **Page 1 - Callback List:** A simple list of data from the 'callback' table. - **Page 2 - Token List:** A simple list of data from the 'token' table. - **Page 3 - Name List:** A simple list of data from the 'name' table. For the dashboard, I'm looking for a clean, professional design and prefer the use of bar charts for the graphical representation of the data. User authentication should be straightforward, requiring only an email and password for access. Ideal Skills and Experience: - Proficient in Laravel ...
We have a project developed with VS2022, c#, datatables, SQL database, javascript and similar.... The user experience is not good. We need a professional and nice interface and user experience, but, mantain our actual code and funcionality.
Hi, I am looking for a developer to maintain, make upgrades and fix bugs on my current website and booking system. The system has been done in SQL written in C# by my old developer. He has had a change of career and can no longer work on things but is happy to do a handover to make things easier. This will be an ongoing business relationship and not a one off thing so will need someone with good communication and accurate times of completion. Thanks, Luke.
...CodeIgniter 4, ensuring all features and functionalities remain intact. Optimize SQL Queries: Review and optimize all SQL queries to handle heavy loads efficiently. The current system experiences performance issues during peak times, and the new version should resolve these. Fix Bugs and Security Issues: Identify and fix any existing bugs and security vulnerabilities in the current project. Ensure the new version adheres to the latest security standards. API Integration: Connect the backend with the frontend using APIs. The APIs should be well-documented, secure, and efficient, allowing seamless communication between the backend and frontend. Requirements: Proven experience with CodeIgniter 3 and 4. Strong knowledge of SQL query optimization. Expertise in ident...
Hi there! I'm seeking an expert in Python and VBA who can develop a real-time data statistical analysis tool for use on Windows. The tool must be able to process financial data. Though the format of my data wasn't specified, please be ready to handle a diverse range of formats, including but not limited to CSV files, SQL databases, and Excel files. Skills and Experience: - Mastery of Python and VBA - Experience with statistical data analysis - Familiarity with financial data - Proficiency in handling diverse data formats. - Skill in working on Windows OS. Ultimately, I require a reliable system for my ongoing financial data analysis needs. Your track record of similar successful tasks will be a plus.
...functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or only ...
I'm seeking an expert in Python and VBA who can develop a real-time data statistical analysis tool for use on Windows. The tool must be able to process financial data. Though the format of my data wasn't specified, please be ready to handle a diverse range of formats, including but not limited to CSV files, SQL databases, and Excel files. Skills and Experience: - Mastery of Python and VBA - Experience with statistical data analysis - Familiarity with financial data - Proficiency in handling diverse data formats. - Skill in working on Windows OS. Ultimately, I require a reliable system for my ongoing financial data analysis needs. Your track record of similar successful tasks will be a plus.
...script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scrapi...
I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!
I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you
...comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including breadcrumbs for hierarchical structure) --Title --Price --Availability ...
Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA
...list of sanctions data from OpenSanctions database. Once the data is obtained, the script needs to perform a comprehensive database search, identify any country-specific sanctions, and provide a detailed report of these connections as well as a option to show a visual mapping. Key Requirements: - Download the complete list of sanctions data from Open Sanctions database - Conduct a thorough database search to identify country-specific sanctions - Create a report summarizing the identified connections The final report should be in an interactive web page format. The visualization should be clear and easy to comprehend, allowing for an intuitive exploration of the connections found. Ideal Skills & Experience: - Proficiency in scripting and data re...
I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.
Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501
I find myself in need of a highly skilled individual capable of assisting with numerous projects across a variety of areas. Given the breadth of tasks, a versatile set of skills is vital. Specifics haven't been decided yet, but your experience may help mould these into reality. Key skills and experiences: - Website development - Mobile app development - Graphic design Tasks may include, but are not limited to: - Designing user interfaces - Developing backend functionality - Implementing payment gateways While I don't have a concrete vision for design, flexibility and a keen eye for aesthetics are beneficial. Whether it's a minimalistic, bold and colorful, or clean and professional look, the ability to adapt to different styles is key. Your input, initiative and cr...
I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or port...
I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.
Hi, I am looking for expert to connect SQL database togoogle looker studio so we can analise data and creat reports, it is a long term coopartion. Please provide implementation cost and hourly charge. Best.
...programmer who is well-versed in SQL Server 2019. The primary task is to ensure that new columns added to the database are correctly displayed in the Excel report generated by the application also fix some minor areas that will discuss in detail Key Responsibilities: - Troubleshoot and fix the issue of new columns not being displayed in the Excel report - Ensure that all relevant data is correctly fetched from the SQL Server 2019 database - Implement a seamless solution that does not affect the overall functionality of the application Ideal Skills and Experience: - Strong proficiency in C# programming language - Expert knowledge of SQL Server 2019, including stored procedures and functions - Prior experience with similar tasks involving Excel report generat...
We are seeking an experienced freelance developer to design and develop an online service booking platform targeted at legal professionals. The project includes creating both a web application and a mobile applicati...(drivers, couriers, movers, locksmiths), and administrators. Integrate a real-time booking system with calendar and availability management. Implement secure payment systems and automatic notification features. Ensure compatibility between the web and mobile to best practices for security and data protection. Required Skills:Proven experience in web and mobile in front-end and back-end technologies (e.g., React, Node.js).Experience with SQL or NoSQL understanding of UX/UI design to meet deadlines.
...standards of code quality and push for continuous improvement. **What You Need:** - BS/MS in Computer Science, Engineering, or related field. - 2-3 years of full-stack development experience, with significant focus on mobile apps. - Strong proficiency in Flutter or similar, front-end technologies (HTML5, CSS3, JavaScript), and backend development (Node.js, Django). - Experience with databases (SQL & NoSQL), cloud services (AWS, Google Cloud, Azure), and versioning tools like Git. **Why Join Us?** - Flexible working hours and a chance to work in a dynamic, fast-paced environment. - Continuous learning and professional development opportunities. ? **Apply Now!** Send your resume, a cover letter, and work samples/portfolio demonstrating your expertise relevant to the role. ...
...user login/signup, in-app messaging, push notifications, photo and file upload. Advanced features should also include GEO Fencing, QRCODE/Barcode scanning and face recognition. The app should be supported by SQL and allow user details to be saved and retrieved from a database. Furthermore, the app needs to integrate with Google services like Maps and Calendar. The design of the app should be minimalistic but seamless for easy user interface. Therefore, a developer with design skills would be perfect for this task. - ESSENTIAL SKILLS: - Android app development - Knowledge of SQL - Minimalistic app design - Experience in GEO Fencing, QRCODE/Barcode scanning, Face Recognition - API integration with Google services This project will require rigorous testing to...
I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Spee...
I'm in need of a skilled developer with strong experience in NodeJS, React, and Next/NestJS. The project I have in mind ...The application will have a search feature that allows users to find specific content or items efficiently. This will require robust search algorithms and user-friendly interfaces. - Payment Gateway Integration: The application needs to support payment processing. You'll need to integrate a payment gateway to handle transactions securely and seamlessly. Your experience in SQL will also be valuable to ensure efficient data management and integration with the web application. Please provide examples of your past work that demonstrate your expertise in these areas. I'm looking for a reliable, communicative individual who can deliver a high-...
...diagram, relational schema, database dump, SQL files, and queries for a library database system. Requirements: - ER Diagram: An ER diagram is required with rationalities similar to the example provided in this link: - Relational Schema: Develop a relational schema that effectively models the database. - Database Dump: Provide a database dump for the system. - SQL Files and Queries: The project should include a set of SQL files and queries that effectively interact with the database. - Managerial Queries: Develop a minimum of 20 managerial queries that will be used to analyze and manage the library database. Deadline: This project must be completed by Monday. Ideal Skills: - Proficiency in database design and SQL - Experience with ER diagram creation - A...
I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.
I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant experience in your bid.
I am seeking a professional to develop a software that can efficiently extract and present the s...require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a reliable and efficient tool that can handl...
I am seeking an expert capable of efficiently and accurately pulling LinkedIn data from a list of companies and cataloging employees who previously worked at a specified set of organizations. The ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant sho...
I'm looking for a seasoned AWS Data Engineer with over 8 years of experience to support me in handling data extraction and transformation tasks. Key Responsibilities: - Data Extraction: The engineer will be responsible for extracting structured data held in SQL databases. - Data Transformation: You will be required to transform the extracted data into a usable format for our analytics and reporting. Skills and Experience: - 8+ years of experience as an AWS Data Engineer. - Proficient in working with structured data, in particular, SQL databases. - Extensive experience in data transformation. - Expertise in AWS services, especially Amazon S3 and Glue. Your support will be essential in ensuring the smooth fl...
I'm looking for a skilled Visual Basic 6 programmer to adjust functionality within my VB6 source code. The task primarily involves expanding reporting functions to include more tables. Ideal applicants should have: - Extensive experience in VB6 programming. - Previous work involving functionality adjustments, particularly in Reporting and Data Management. - A keen eye for detail to maintain existing code integrity while implementing changes. - Strong understanding of data management and manipulation in VB6. Your role will be solely focused on altering the existing VB6 code and ensuring the changes don't disrupt the software's operational flow. Familiarity with VB6 and past projects involving Reporting changes are crucial.
I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler
...effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task. I val...
I need a proficient grant writer who can assist in making grant applications for different sectors: Government, Foundations and Corporate. Although I've not identified specific opportunities or funding sources, I'm seeking funding for corporate software development. Here's what I'm looking for: - Previous experience in writing and sourcing grant opportunities - Proven success in securing funding in government, foundation or corporate sectors - Strong research skills - Excellent written communication skills - Familiarity with software development sector would be a bonus. The writer should identify which grants we fit with, and then chart out strategy for approval. This is an opportunity for someone who understands the complexity of crafting successful grant applicatio...
I need a skilled Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're
I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.
I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format
I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+
