Completed

Database Script for Data Warehouse

***Context & Introduction***

I am part of a small team whose mission is to help improve lives by reducing the delivered cost of energy. Ready access to high quality data is an important first step to achieving these aims; this project is aimed squarely at addressing that challenge.

***Project Overview***

We are looking to develop a database (data warehouse) to contain a large amount of historical data, which will have data added to it incrementally, approximately every 30 minutes via automated processes. The scope of work consists of:

(1) database setup (table creation / structuring etc...),

(2) creation of an automated process to back-fill historical data, and ,

(3) creation of an automated process to add real-time data via push service.

Both of the scripts (2, 3) would interact with an API. The API description and instructions can be found at: [url removed, login to view]

***Additional Details***

The database should contain all of the data items listed in section 8.5.1 of the document at the link above. Both the script used to backfill data and the script used to acquire realtime data via push service should include all of the message types listed in this section.

Examples of script implementation are provided in Java in Appendix A of the document link above.

In order to avoid duplicate record creation the scripts should be sophisticated enough not to add data which has already been retrieved (data validation / duplicate avoidance).

***Deliverables***

(1) A means by which to receive or reconstitute the database shell (tables / structure / etc.); this can be via an SQL script.

(2) A script capable of back-filling the database with all of the messages contained in section 8.5.1 of the document linked above, executable on-demand.

(3) A script/daemon capable of adding new data via PUSH service (outlined in section 6 of the document linked above) to keep each of the data streams listed in section 8.5.1 updated on a half-hourly basis.

(4) Any pertinent instructions for the setup of the database or scripts

***Timing***

We would like to receive the deliverables no later than February 28th, 2018.

***What we're looking for in RFP responses***

We will be carefully reviewing all responses submitted to this request for proposals. In addition to standard demographic, credential and commercial information, it would be advantageous for you to include some content that would illustrate your initial thoughts on an approach to tackling the project. We spend a lot of time exploring and expanding the conceptual "art of the possible" in the course of our day-to-day work and so it's important to us in selecting a Freelancer that we pick someone who can clearly articulate a design concept.

Skills: Database Programming, MySQL, Software Architecture, SQL

See more: import data csv mysql database script php sample, php small database script, script access database update data, small mysql database script, script data imdb database, simple php data database script, data warehouse project bid, simple database script, create database script, php create install database script, create database normalize data, access database web data capture, role database developers data mining, database script php user friendly, simple web database script, data warehouse optimization, rental database script

About the Employer:
( 0 reviews ) Calgary, Canada

Project ID: #16307035

Awarded to:

WilliamArispe

I could implement PosgreSQL Foreign Data Wrapper (FDW). [login to view URL] . [login to view URL] . Advantages wi More

$1388 CAD in 15 days
(10 Reviews)
4.1

21 freelancers are bidding on average $1167 for this job

$1250 CAD in 20 days
(23 Reviews)
6.8
ihgstudios

Hi, I'm interested. Ok, so how much data are we talking about? This the #1 question, because from that answer flows the design. There a re a couple of options to consider, but we need to review pricing and features, More

$1498 CAD in 15 days
(57 Reviews)
6.5
tsebro

Good day. I can help you to develop a database containing a large amount of historical data according to your requirements. As for me, I am a professional Web-Developer with 15+ years experience. My main specializat More

$1052 CAD in 20 days
(9 Reviews)
5.7
moeed10

We have designed C# applications for big data analysis. Which include visual data as well. Sir i believe we can provide you an efficient time saving and generic system for the purpose you require for data comparison. A More

$1250 CAD in 20 days
(15 Reviews)
5.7
BitSDestiny

With my 9+ years of Software Development experience like to work on your project,Please see my reviews to consider me as your development member. ASP.Net, C#, VB.Net, MVC, WPF, Visual Basic, Excel VBA, MS SQL Server More

$1250 CAD in 20 days
(43 Reviews)
5.8
AzzkaNoor

I am confident that i can do this project. Would you please message me so i can ask some directed questions to gather all the details for this project before project's initiation? Looking forward to show you my skill More

$1250 CAD in 20 days
(2 Reviews)
5.0
scroom

Hi, What's the amount of information that you plan on storing in the database? If you're expecting big amount of data it might be worth setting up a solution for writing fast the information in the database from the More

$1250 CAD in 12 days
(13 Reviews)
5.0
sid0

Hi sir. We have read ur requirement and this can be done with MySQL and php in wonderful way. You will get work before deadline, 28 Feb. Relevant Skills and Experience Php, MySQL. Data management software

$1333 CAD in 10 days
(32 Reviews)
5.6
nileshbakotiya

Hi let me help you for Database Script for Data Warehouse i have skill ,Database Programming,MySQL,Software Architecture,SQL which is very suitable to your project So send me Private message at PMB so we can dis More

$1250 CAD in 20 days
(18 Reviews)
4.7
king18yat

I can do your task . Please contact to discuss the project scope and to get started . Waiting for your message .

$750 CAD in 20 days
(4 Reviews)
4.6
AllProgs

Dear, I have extensive experience in databases and developing applications, I have done similar work using APIs I can do the work you need, I can start the work immediately, I am attentive to your comments, kind regard More

$900 CAD in 13 days
(15 Reviews)
3.9
AbubakarHashmi

Hello, i have read your job description and fully understand your requirements. It looks like I’ll be the perfect candidate for this job because I have hands on experience in this field. Could you provide us more More

$1250 CAD in 20 days
(7 Reviews)
4.0
bnrajumnc

A proposal has not yet been provided

$1111 CAD in 20 days
(7 Reviews)
3.4
sreenivas2903

I would like to learn your business rules and implement the same in DW . please let me know if you have any questions regarding my work . I am expertise in ETL

$1250 CAD in 14 days
(1 Review)
0.6
$750 CAD in 10 days
(0 Reviews)
0.0
Aliasim85

Hi I have gone through the above mentioned details. I have got plenty of experience in these kind of projects and i am also available from now for this task. Looking for a positive response. Thanks.

$1250 CAD in 20 days
(0 Reviews)
0.0
Shetty13

A proposal has not yet been provided

$1111 CAD in 10 days
(0 Reviews)
0.0
aolmoJBS

Hi, i'm a data integration expert with more than 10 years of experience. I think that I can help you with this process. We are a Consultant Services Company, you can see our web page [login to view URL] Can we talk about t More

$1222 CAD in 15 days
(0 Reviews)
0.0
sabaitsolution

SABA IT Solutions specialized technology startup in Data Engineering providing Solutions and Services focused on enriching data value. We provide customized services for giving you competitive advantage and help you im More

$900 CAD in 8 days
(0 Reviews)
0.0
researchMSBI

A proposal has not yet been provided

$1250 CAD in 20 days
(0 Reviews)
0.0