ScreenScraping a website and generating an ouput

$250-750 AUD

Completed

Posted

11 months ago

$250-750 AUD

Paid on delivery

Introduction This document articulates the functional requirements for a screen scraping project aimed at gathering biller code, Biller Short, and Biller Long Name data from [login to view URL] Scope The primary purpose of this project is to automate the process of searching and extracting data from a predefined list of biller codes. The output should be a comprehensive, well-structured spreadsheet containing the biller code, Biller Short, and Biller Long Name associated with each biller code in the list. Requirements 1. Input List 1.1 The system must accept an input list containing multiple biller codes. 2. Web Interaction 2.1 The system must navigate to the specified website: [login to view URL] 2.2 The system should be able to handle any network or loading issues encountered while accessing the website. 3. Search Functionality 3.1 The system must sequentially search each biller code from the list in the website's search functionality. 3.2 If a particular biller code does not return any result, the system should log it for review. 4. Data Scraping 4.1 Upon successful search, the system should scrape the following details: Biller code Biller Short Name Biller Long Name 4.2 The system should ensure the accuracy of the scraped data. 5. Data Storage 5.1 The system should store the scraped data in a structured format such as a CSV or Excel file. 5.2 The output file should contain separate columns for Biller Code, Biller Short Name, and Biller Long Name. 5.3 The system should validate the accuracy of the saved data in comparison to the scraped data. 5.4 If the system fails to save any scraped data correctly, it should log an error and continue with the next biller code. Non-Functional Requirements Acceptance Criteria The project will be considered successful when: The system can accurately and reliably scrape data for biller codes from the specified website. The system can handle large lists of biller codes and provide a structured and accurate output file. The system gracefully handles errors and edge cases. The system complies with all stated non-functional requirements. The end-users express satisfaction with the system's ease of use, reliability, and performance. This will ONLY be a one off exercise

Software Architecture

Project ID: 36763402

About the project

43 proposals

Remote project

Active 11 mos ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@Datasolution4you

$0 AUD in 1 day

5.0

(300 reviews)

7.1

43 freelancers are bidding on average $471 AUD for this job

@bilalmaher053

hi, can u pls share list which need to search ?

$500 AUD in 7 days

4.9

(349 reviews)

7.4

@ESOLUTIONSSS

Hello, I'll be glad to assist you with this ScreenScraping a website and generating an ouput project. I can work with you during the next hours to have this done. I will complete this project with 100% accuracy. Click on the "CHAT" button so we will discuss it in detail. I'm always online and available. Please feel free to contact me at any time. I am available 24/7 for support. Best Regards Sandeep

$250 AUD in 1 day

4.9

(201 reviews)

6.9

@ShrineWeb

I have some questions regarding the specs of the project. Could we please have a word? My Skills: Software Architecture, PHP, Web Scraping, JavaScript and Excel

$250 AUD in 10 days

4.8

(137 reviews)

6.8

@usmanbashir12100

Hi, I do Logical Building, Apply Data Structures and Algorithms. I Do web scraping using Python. I can develop games (simple games) in most of the languages like JS, Java, Python.

$500 AUD in 7 days

4.8

(22 reviews)

6.0

@dataspro

Nice to meet you teddydavant, My name is Anthony Muñoz, I express my interest in working on your project after carefully reading the requirements and concluding that they match my area of knowledge and skills. I am currently the lead engineer for the IT agency DSPro and I have more than 10 years of experience in the field. I have successfully completed a large number of similar jobs and I consider your project to be a challenge in which I would like to work and be able to make it a reality. Please feel free to contact me, it will be my pleasure to help you. I greatly appreciate the time provided and I remain attentive to any questions or concerns. Greetings

$936 AUD in 7 days

4.7

(8 reviews)

5.9

@veselidevelop

Hello I just checked your job description basically. SPECIALLY I complete very similar project before so I'm sure I can do your project with 100% quality in short time. As a full stack web & mobile developer I have 7+ years of strong experiences in Excel, PHP, Web Scraping, Software Architecture and JavaScript. If you are looking for a software developer to help you with your project, I would be more than happy to discuss it in further detail. I am confident that I can deliver a quality solution that meets your needs and exceeds your expectations. Thank you for your time and consideration. I look forward to hearing from you soon. Sincerely, David

$555 AUD in 5 days

4.8

(18 reviews)

4.9

@maksabakanovich

Hi, Dear. Thanks for posting. I am familiar with Web Scraping and I am sure I can do it. Please contact me. thanks. Maksim

$550 AUD in 5 days

5.0

(9 reviews)

4.8

@Npg04

Hi there! I hope you are having a wonderful day so far. I am Paul a professional C# .NET developer, and I specialize in automation. I have taken quite the interest working on your project since I specialize in automation and have created systems for web automation. This one is quite straightforward, I have handled creating from scratch full-fledged automation systems. This one is more of a tool to streamline the process of scraping data, rather than a full-blown company automation software. I would need to see how you want the spreadsheet formatted so I know how to structure the scraped data from the aforementioned website. One more thing, this is not an automatically generated bid unlike some people out there. So I hope you take your time considering my proposal as well. This can be done in 3 working days or less, and cost 269 AUD. I won't ask for payment until you are satisfied with the output software. Although I cannot release the source codes until feedback has been given. Thank you! Kind Regards, Paul G. (Professional C# .NET Software Developer)

$269 AUD in 3 days

5.0

(11 reviews)

4.5

@afowzi7

Hi there, Going through job description, It seems that you are looking for a professional web developer with rich experiences in Web scrapping. As your project requirement align with my skillset, so it strongly attracts me. I'd like to discuss your project in detail so I can get clear idea. Thanks

$400 AUD in 3 days

5.0

(1 review)

4.3

@mwikalicarolyne2

Hi Teddy D.! Good morning After reading your job posting, I am convinced that I am the best person to help you. I have skills in Software Architecture, PHP, Web Scraping, JavaScript and Excel. I have worked in many projects similar to yours, making this an interesting task for me. Please message me for more information on how I will complete this project. Thank You Carol M.

$555 AUD in 1 day

5.0

(1 review)

4.0

@sachokdev

Hi, there. Nice to meet you. As a senior python developer, I'm very interested in this job. So far, I've done many scrap project without any failure and so will your project, I'm sure. While doing scrap, I used to use Selenium and it's the best package I think and will do your project with this. Looking forward to hearing from you. Regards.

$500 AUD in 7 days

5.0

(7 reviews)

3.9

@MohammadKassem01

Hi there, thanks for considering me for this project! As you must know, Python is a programming language that I use frequently and that I am very skilled in. With my extensive experience in web scraping and data entry, I believe that I am the perfect person for this project.

$250 AUD in 1 day

5.0

(23 reviews)

4.1

@syedazainab339

Hi, I am ready to start your project. Can we discuss more about your project over the chat?

$500 AUD in 7 days

5.0

(4 reviews)

3.5

@synfini

Hello, I have been working as a web developer for 7+ years now. I've checked your project description carefully and I am sure that I am very suitable for this project. I'd like to have a brief chat, call to discuss further details about your project soon. Looking forward to working with you together on this project. Thanks!

$700 AUD in 7 days

4.4

(5 reviews)

4.1

@uzzairkhan

Dear Sir/Madam, Greetings! I am a Senior software developer who has hands on experience of 10+ year in creating and implement Web and software applications. I have strong expertise in PHP and JavaScript. I went through your project requirements. I understand that you are looking for a way to screen scraping a website and generating an output that can be used for the project requirements. I believe me expertise can help you get the job done quickly and accurately. To ensure your satisfaction, I am willing to provide a free demonstration of the solution even before the project is awarded. Thank you for your time and consideration. I look forward to speaking with you about this opportunity.

$500 AUD in 7 days

5.0

(4 reviews)

3.6

@RadoDevelopment

Hi, I prefer working with Australia clients. I am excited to submit my proposal for your project,ScreenScraping a website and generating an ouput. As a skilled PHP, JavaScript, Web Scraping, Software Architecture developer with 7 years of experience, I am confident that I have the expertise and knowledge necessary to complete this project to your satisfaction. My experience in PHP, JavaScript, Excel, Web Scraping, Software Architecture has prepared me to handle the challenges of this project and ensure that it is completed on time and within budget. In addition to my technical skills, I am also a strong communicator and collaborator. I understand the importance of clear communication and will keep you updated throughout the project to ensure that we are on the same page. I am based in Serbia, and I am familiar with the cultural nuances and business practices of clients in Australia. I am confident that my experience working with clients from around the world will enable me to provide you with the best possible service. Lets connect in chat so that We discuss further. Regards

$300 AUD in 7 days

5.0

(9 reviews)

3.2

@KevinC100

Greetings! As a skilled freelancer, I specialize in web scraping, Python, HTML/CSS, Shopify/WordPress, and MySQL. With my expertise, I can deliver quality work within your timeline. Here's what I offer: Web Scraping: I can scrape data from any website and deliver it to you in any format you require. I can also set up automated web scraping scripts to regularly scrape data from websites and update your database. Python: I can develop custom scripts and applications to meet your specific needs, using libraries and frameworks like Pandas and NumPy. HTML/CSS: I can design and develop responsive, mobile-friendly websites that look great on any device. I can also customize Shopify and WordPress themes to meet your branding and design requirements. Shopify/WordPress: I can help you set up and configure your Shopify or WordPress store to optimize it for conversions and sales. MySQL: I can design and maintain databases to store and manage your data efficiently. Let's discuss your project and how I can help you achieve your goals. Please feel free to reach out to me if you have any questions or require further information. Thank you for considering my proposal, and I hope to hear from you soon. Best regards, Kevin

$250 AUD in 7 days

5.0

(9 reviews)

3.3

@bearxdev18

Dear Teddy D., I have gone through the requirements of your project and I am confident that I can deliver the desired results with perfection. As an experienced PHP and JavaScript developer with expertise in web scraping, I can help you automate the process of searching and extracting data from the specified website. I can create a script that will sequentially search each biller code from the list in the website's search functionality, scrape the required details accurately, and store them in a structured format such as a CSV or Excel file. The output file will contain separate columns for Biller Code, Biller Short Name, and Biller Long Name. I will also ensure that the system gracefully handles errors and edge cases. I would like to connect with you in chat to discuss more about your exciting project and understand your specific requirements. Please feel free to ask me any questions or provide any additional information that you may have. Looking forward to hearing from you soon. Best regards, Ivan

$750 AUD in 7 days

5.0

(2 reviews)

3.0

@leomarcoabon

Hello. I have carefully reviewed the project requirements and I am confident in my ability to deliver a reliable and efficient solution. I am a skilled and experienced freelancer specializing in web scraping and data extraction. I understand the importance of automating the process of gathering biller code data, and I am committed to delivering a high-quality output that meets your expectations. I am committed to delivering a high-quality solution that meets your specific requirements. Thank you. Regards. Leo.

$500 AUD in 7 days

5.0

(2 reviews)

2.8

@vitaliipopkov

★★★ Dear, Teddy ★★★ I just read job description carefully and noticed that you are looking for a skilled developer who can help you, so your project attracts me. I am enough qualified for this project because I have built up diverse range of skills over the years. I'd like to discuss your project on chatting so we can get clear idea with each other. Best regards, Vitalii

$500 AUD in 7 days