Completed

Screen scraping travel portal

I need to automate getting information from a travel portal, to be build as Chrome Browser extension.

I will release the portal's name privately during project discussions.

What the user would do:

- Enter start Airport

- Enter destination Airport

- Select one-way

- Select only directs

- Select 'one adult'

- Select date

(in automation, this can be formulated as one GET with parameters, like: [login to view URL] )

The browser opens the next page, where some ajax calls are getting information about all available flights.

As soon this process is done, the user sees a list (List No 1) of flights, each presenting the airline, times, and the best price option for this particular flight and a button to get more information.

By clicking on these buttons, the user gets a new view with the flight number and a list (List No 2) of all offers for this particular flight.

The flow in the browser automation must be:

Once started, it should run infinite, until I stop it.

1. Get flight (start/dst/date) to be queried from my backend server. This will be a HTTP GET and I will answer a JSON

2. Get the information from the travel portal by issuing the above URI

a. Wait for the AJAX' to be finished with List No 1

b. For every item

i. 'klick' on every Button to get the results of List No 2

ii. Collect all information of List No 2

iii. 'klick' on 'back' Button

c. After collecting all information, post a JSON to my backend server

3. Wait for x seconds (the number odf seconds is sent in the JSON in step 1)

4. Start over at step 1

Some hints/information:

- All information in LIST No 2 has been received by the GET in step 2. 'Klicking' on the Button in step 2.b.1 does not get new information from the travel portal. So, step 2.b may be much easier for automation.

- Instead of waiting x seconds, you may have a better idea. Let's talk.

- Using Chrome seems to be the best option to pretend being a user. I don't rely on Chrome, but the portal must not be able to detect automation.

- I need meaningful logging, so we can detect errors in case the portal changes design/path/names …

- the chrome extension requires a configuration field to set up a USER ID and PWD, which (if set) will be used in the queries to my back-end for basic authentication

Skills: PHP, Web Scraping, Javascript, Software Architecture, Java

See more: python flight scraper, web scraping, screen scraping banking, screen scraping psd2, screen scraping plus psd2, screen scraping vs api, screen scraping security issues, screen scraping open banking, php, java, software architecture, javascript

About the Employer:
( 2 reviews ) Kaarst, Germany

Project ID: #21723709

Awarded to:

bertythomas

Hi, I have a suggestion. Instead of the Chrome browser extension, I could create for you an API (basically, a link). I can create provisions for you to add the airport details, etc based on which the API will perform More

€750 EUR in 7 days
(7 Reviews)
4.4
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

€750 EUR in 3 days
(75 Reviews)
5.6

71 freelancers are bidding on average €1288 for this job

arhamsoftltd

Hi, I can create chrome browser for your travel portal, I have gone through the brief in detail [login to view URL] [login to view URL] [login to view URL] [login to view URL] More

€4000 EUR in 45 days
(176 Reviews)
9.1
wpoppo

Hello, As per need, you need a Screen scraping travel portal, we have shared our company portfolio please go through it: We have a team of professional Full Stack developers with an experience of more than 8+ years i More

€1500 EUR in 20 days
(191 Reviews)
8.4
r4rony

Hello, Greetings! WORK SAMPLES: • [login to view URL] • [login to view URL] • [login to view URL] • [login to view URL] I have gone through your job description. We will definitely assist More

€1500 EUR in 30 days
(187 Reviews)
8.5
dreamci

Hello there We are top quality full-stack developers and we are ready to work on this project, we use Version Control Systems, Staging Servers, Team Slack Channel and Task Management Tool To be able to give clients w More

€1125 EUR in 5 days
(192 Reviews)
8.5
mhmhz

Hi I checked the requirements. Can you specify the site. Thanks

€1500 EUR in 15 days
(221 Reviews)
7.9
malviyamanish

Hello Sir, After reading the job description, I am ready to provide you a Screen scraping travel portal same features and workflow that you have mentioned. We are a company of web and mobile app developers, and ready More

€1500 EUR in 30 days
(226 Reviews)
7.7
mascotindia123

please initiate the chat and share the details that i need, i am expert in developing the scripts i understood your project for chrome extension , ( i have some questions regarding this ) please message me so i can More

€1200 EUR in 14 days
(267 Reviews)
7.5
AxonTech

Hello, I read that you want to develop a travel portal and yes, our similar work for this is: - [login to view URL] - [login to view URL] - [login to view URL] - [login to view URL] More

€850 EUR in 12 days
(121 Reviews)
7.5
AzzkaNoor

Greetings of the day. Hope this proposal finds you in the best of your health. It is my humble offer to present my services to you for this Plugin/extension development project. I have passed 15 certifications here ( More

€1125 EUR in 7 days
(48 Reviews)
7.6
hawkscodeaus

I CAN HELP YOU IN YOUR PROJECT. ----- WORK SAMPLE ----- 1. [login to view URL] 2. [login to view URL] 3. [login to view URL] 4. [login to view URL] 5. [login to view URL] 6. http:// More

€800 EUR in 5 days
(132 Reviews)
7.7
Sunxiyong0116

How are you? I am expert in mobile/web field. Especially,I have strong skills in java in android studio, swift, objective-c in xcode. Also have good skills in Xamarin, C#. Tool/IDE for development - Android studio - X More

€1125 EUR in 7 days
(44 Reviews)
7.2
flance9

Hi there, Thank you for sharing your requirement. Hope you are doing good and having a nice day. We are a team of technocrats having 8+ years of experience in Web and Mobile design plus development and primarily deal More

€1126 EUR in 7 days
(33 Reviews)
6.9
artistixeit

Hello, Greetings! It gives me great pleasure to send a proposal of appreciation to the A devoted client like you. Please check our work below:- Weather/travel/GoogleMap/Ionic: [login to view URL] https://pla More

€1125 EUR in 7 days
(18 Reviews)
6.6
naravila

⭐⭐⭐Dear sir!⭐⭐⭐ ✅I am very interested in your project and I am exciting. ✅I read your project details carefully and I thought that I am the best fit developer for your project. ✅I have rich experience with your project More

€1000 EUR in 15 days
(59 Reviews)
6.5
pvsysgroupinc

Dear Sir, As per your requirement we will make your website best and also we will support after work is live as well please allow us to share our services to you hope you will be happy and we will have long term busin More

€750 EUR in 30 days
(34 Reviews)
6.7
nitinsaluja98

Hi, ⭐⭐My understanding⭐⭐ I have thoroughly reviewed you job description. I can automate this scarping task through browser extension. Well, I have created many scraping chrome extension for popular websites like ama More

€1000 EUR in 10 days
(48 Reviews)
6.2
wonwon424

Hi, employer. I am a automation and web scraping expert. Very familiar in PYTHON and Node.js. I've read your proposals carefully. I have made many browser automation tools. my github [login to view URL] More

€1125 EUR in 10 days
(61 Reviews)
6.7
imphasys

Hi there,  I have read your description, I see that you, you’re looking for a Screen scraping travel portal ' We are experts in Website Development with a solid track record of serving international clients. My years o More

€1125 EUR in 30 days
(70 Reviews)
6.5
krishaweb

Hello, Hope you are doing well! I am glad to say that we have worked on similar projects for our clients. You will get benefits of same experience team which saves your time and cost. Similar: [login to view URL] More

€5125 EUR in 30 days
(22 Reviews)
6.2
borneovw

Hi, I'm experienced software engineer and I can help you achieve your goals. I will start by noting some of your suspicious assumptions: 1.) Use of chrome extension - even tho it seems like a good option, the truth is More

€1200 EUR in 7 days
(20 Reviews)
6.1