Closed

Need An Amezon Web Services Expert

Establishing the connection between On-premises Oracle DB to AWS VPC

Requirement1: (AWS +EMR)

1. Setting up the AWS EMR cluster using VPC and once the EMR cluster is up.

2. Connecting to Hadoop Master node in AWS using Putty.

3. Run the query sqoop to list the tables in the on premises oracle DB.

4. Details will be provided the jdbc connection string, IP, port no, user id and password in the sqoop query.

5. Import the one database table from Oracle DB which is in Dubai HO and one Branch oracle DB.

Observations:

[url removed, login to view] are getting the error and did not connect to the oracle DB.

Note: The oracle JDBC driver has placed manually in the /usr/lib/sqoop/lib directory.

Error:

Please set $ACCUMULO_HOME to the root of your Accumulo installation.

17/12/03 10:34:00 INFO [url removed, login to view]: Running Sqoop version: 1.4.6

17/12/03 10:34:01 WARN [url removed, login to view]: Setting your password on the command-line is insecure. Consider using -P instead.

17/12/03 10:34:01 INFO [url removed, login to view]: Data Connector for Oracle and Hadoop is disabled.

17/12/03 10:34:01 INFO [url removed, login to view]: Using default fetchSize of 1000

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/[url removed, login to view]!/org/slf4j/impl/[url removed, login to view]]

SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/[url removed, login to view]!/org/slf4j/impl/[url removed, login to view]]

SLF4J: See [url removed, login to view] for an explanation.

SLF4J: Actual binding is of type [[url removed, login to view]]

17/12/03 10:35:02 ERROR [url removed, login to view]: Got exception running Sqoop: [url removed, login to view]

[url removed, login to view]

at [url removed, login to view]([url removed, login to view])

at [url removed, login to view]([url removed, login to view])

at [url removed, login to view]([url removed, login to view])

at [url removed, login to view]([url removed, login to view])

at [url removed, login to view]([url removed, login to view])

at [url removed, login to view]([url removed, login to view])

at [url removed, login to view]([url removed, login to view])

at [url removed, login to view]([url removed, login to view])

Requirement2: (Qubole ‘s QDS Business edition)

[url removed, login to view] to create a Bastion Node On-premises/AWS and white list the IP address mentioned by the Qubole ‘s QDS which is required as part of importing the on-premises Oracle DB to AWS S3.

* Please ensure that the following ip(s) '[url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view]' have access privileges to your database.

- If your database is in a virtual network please check the bastion node flag and enter the bastion node details, this will enable us to connect to this database.

2. Create a datastore using Qubole’s QDS and see that able to create active datastore by using the details like ip, user id and password.

3. After creating the active datastore we are able to see the tables in Oracle DB to import the selected table to AWS S3 using Qubole’s import panel.

Problem Statement:
Establishing the connection between On-premises Oracle DB to AWS VPC

Requirement1: (AWS +EMR)

1. Setting up the AWS EMR cluster using VPC post the EMR cluster is up.
2. Connecting to Hadoop Master node in AWS using Putty.
3. Run the query using sqoop to list the tables from oracle DB present in Dubai
4. Establish a JDBC connection between AWS and onpremise Oracle DB present in Dubai.
Details will be provided: Jdbc connection string, IP, port no, user id and password in the sqoop query.
5. Post Connection establishment, Import one database table from Dubai HO and Branch oracle DB from Dubai
6. Provide the solution architecture and queries to setup connection for other region (Kuwait, Qatar and Oman)


Requirement2: (Qubole ‘s QDS Business edition)

1.Need to create a Bastion Node On-premises/AWS and white list the IP address mentioned by the Qubole ‘s QDS which is required as part of importing the on-premises Oracle DB to AWS S3.


* Please ensure that the following ip(s) '54.204.43.32/32, 54.243.39.255/32, 23.23.178.159/32, 54.243.29.190/32, 54.243.128.178/32, 23.21.153.231/32, 23.21.191.84/32, 34.205.91.155/32, 34.205.91.156/30, 34.205.91.160/28, 34.205.91.176/29, 34.205.91.184/31, 34.205.91.186/32' have access privileges to your database.
- If your database is in a virtual network please check the bastion node flag and enter the bastion node details, this will enable us to connect to this database.

2. Create a datastore using Qubole’s QDS and see that able to create active datastore by using the details like ip, user id and password.

3. After creating the active datastore we are able to see the tables in Oracle DB to import the selected table to AWS S3 using Qubole’s import panel.

Skills: Amazon Web Services, Linux, Network Administration, Oracle

See more: amezon web services, Need an expert JS developer to develop webviews and modifying a web bot, need an marketing online shop expert consultant sydney, amazon web services consultant, aws expert, amazon expert for hire, amazon freelance work, aws part time jobs, freelance amazon web services jobs, aws consultant hourly rate, amazon freelance careers, need an fresh web devloper without an experience in waco, i need an microsoft outlook 2016 expert, need an experienced web developer, i need an experienced retired global health expert to volunteer in dallas, i need an excel expert, i need an excel expert to organize some data for me i need to combine a long list of 1000 items into model units etc this is a s, i need an excel expert to come to my office, i need an editor who is expert in turabian indwinston salem, i have an excel spreadsheet that needs some final touches to be ready i need an absolute expert at working an excel

About the Employer:
( 0 reviews ) India

Project ID: #15911061

6 freelancers are bidding on average ₹9074 for this job

skynatstech

Hello, We can help you to fix the issue with Oracle DB and make all your requirements working properly. We are a team of server administrators having many years of experience in the field of Linux/Windows adminis More

₹10000 INR in 3 days
(205 Reviews)
6.3
hitgon

AWS expert Relevant Skills and Experience Oracle certified DBA

₹7777 INR in 3 days
(1 Review)
1.0
₹7777 INR in 3 days
(0 Reviews)
0.0
emetropoli

A proposal has not yet been provided

₹6666 INR in 30 days
(0 Reviews)
0.0
dineshrajputit

A proposal has not yet been provided

₹10000 INR in 3 days
(0 Reviews)
0.0
ranjitshinde91

I have worked on similar project where we used to import our Dimensional data stored in Oracle DB to Amazon S3 using Sqoop. I have extensively worked on AWS with posses good knowledge of AWS VPC, EMR, S3. I have good More

₹12222 INR in 4 days
(0 Reviews)
0.0