We are receiving various kinds of excel file weekly based and we need to transform to upload to server. I want to have a solution which automatic data layout and also monitoring data collection and transforming status. I prefer to use tool like pentaho for this purpose.
You can contact me on +1 814-314-9419 Want good SQL knowledge first + decent experience in some kind of ETL/ELT tool (if not Informatica) like any of the following: Ø SSIS (SQL Server Integration Services) Ø DTS (Data Transformation Services – the old Microsoft SQL integration tool) Ø IBM Infosphere Ø Oracle Data Integrator Ø Talend Open Studio for Data Integration Ø Pentaho Data Integration (also known as Kettle) Ø CloverETL Ø SAP BusinessObjects Data Integrator Ø SAS Data Integration studio Ø AB Initio Ø Or any other professional ETL tool not listed Individuals within the Data Engineering role work closely with business stakeholders and EITS team members to understand the business requirements that drive the analysis and design of quality data solutions. These solutions must be aligned with business and IT strategies and in compliance with the organization’s architectural standards. Data Engineers are involved in the full systems life cycle and therefore responsible for designing, coding, testing, implementing and supporting data platforms and processes that are delivered on time and within budget. Responsibilities may also include participation in component and interface design, technology planning, product evaluation, advanced testing processes and buy vs. build recommendations. Individuals also provide input to project plans related to their responsibilities. They ensure data availability, integrity and compliance by performing data cleansing and data validations. They provide data that is congruent, synchronized and reliable, and facilitate user access to data in a semantically meaningful way. They analyze and develop logical and physical data models; data sourcing, transformation and aggregation logic; and semantic data access layers in support of corporate, customer and/or business partner business analytics requirements. They maintain data catalogues and metadata to facilitate self-service access by business users, other data engineers, data visualization specialists and data scientists. When data related system problems occur, they also perform root-cause analysis and recommend or execute corrective action. Data Engineers understand the methodologies and technologies that manage the flow of data within and between technology systems and business functions/operations. They identify opportunities to reduce data redundancy, improve efficiencies and enhance business value, and monitor trends in data uses. Knowledge of current and emerging data architecture products, services, platforms and processes is required. Individuals in this role understand how information is turned into knowledge and how this knowledge supports and enables key business processes. They must have a solid understanding of logical data warehousing design principles and data access requirements for business analytics and exploration. Also required are analytical skills, the ability to establish and maintain effective working relationships with team members, as well as an innate curiosity around wanting to understand business processes, business strategy and strategic business initiatives to help drive incremental business value from enterprise data assets.
Use your imagination to develop your own data visualization that displays several dimensions with a single plot. (For example, color of data points can be used to categorize one dimension, while the size of the data point can represent a dimension related to magnitude.)
The project will focus on harmonizing and cleansing of data from the pilot agencies and produce templates of the API's and standard reports that will be made reusable and accessible to the remaining attached agencies enabling each to be on-boarded following the completion of the project. The project also aims to have a designed user interface and user experience of the information portal and executive dashboard and design and develop standard reports, ad hoc reports and visual dashboards.
Hello, Let me introduce my problem towards you people. We are running our e-commerce business on different channels as well as we are about to start our own e-commerce business. We are right now doing business in books category. Process we need to automate is Product pricing calculation and stock feed generation for different platforms and , Procurement, Dispatch. Whole process need to be automated so that the manpower cost can be reduced