Openerp etl jobs

...guidance especially in the area of ETL processes. I need to focus on: - This is an interview support role, You are supposed to help in live interviews. • Extraction techniques – The primary data sources of my interest are platforms like Spark, AWS, Azure, GCP, and Hive. I want to understand effective methods for data extraction from these particular sources. Ideal Skills and Experience: - Expertise in ETL tools for data extraction - Hands-on experience with Spark, AWS, Azure, GCP, Hive - Profound knowledge in data engineering - Experience in career coaching or mentoring will be a bonus - SQL -Python This assistance will give me a competitive edge in my upcoming interviews by providing me with practical skills, knowledge, and confidence in addressing ETL...

We are looking for Full Time employee who can work on our payroll. Responsibilities: ETL Development: ● Design, develop, and implement robust ETL processes using AWS Glue, AWS Data Pipeline, or custom scripts as needed. ● Ensure the efficient extraction, transformation, and loading of data from diverse sources into our data warehouse. Data Warehousing: ● Design and maintain data warehouse solutions on AWS, with a focus on scalability, performance, and reliability. ● Implement and optimize data models for efficient storage and retrieval in AWS Redshift. AWS Service Utilization: ● Leverage AWS services such as S3, Lambda, Glue, Redshift, and others to build end-to-end data solutions. ● Stay abreast of AWS developments and recommend the adoption of new services to enhance ou...

I'm in need of a skilled developer with experience constructing ETL pipelines that extract data from CSV files. Main project tasks: - Extract data from CSV file source - Perform necessary transformations including data cleaning and data enrichment. Required experience and skills: - Proven track record in developing ETL pipelines - Proficiency in handling and processing CSV files - Expertise in performing data cleaning and data enrichment actions. This task requires fine attention to detail and a pragmatic approach to data management. I'm expecting an efficient and error-free pipeline construction. Your responsibility will be to ensure high-quality, cleaned, and enriched data output from the provided CSV files.

Require ETL script to be written in Python /Django Task :Pull data from source and transform it into desired response API endpoint would be final delivery

...management, Triggers etc. ü Proven expert in Modeling enterprise-grade databases and architecture. Very strong at Entity Relationship. ü 5+ years of experience modeling loosely coupled relational databases that can store tera or petabytes of data. ü 3+ years of proven expert in working with large Data Warehouse. ü Must have ability to conceptualize ideas and data streams to schemas. ü Expert at ETL transformations using SSIS. ü Good knowledge of analytics tool like AWS Quick Sight. ü 4+ Years of proven experience working with high volume multi-client SAAS solutions. ü Must be expert at communicating technical issues to non-business users. ü Must have business-oriented thought process. ü Proven expert at setting up standards and co...

...train others. If you're skilled in data analysis, visualization, SQL, programming (Python, R), and other BI essentials, join us for global projects. What We're Looking For: Business Intelligence Experts with Training Skills: Data analysis, visualization, and SQL Programming (Python, R) Business acumen and problem-solving Effective communication and domain expertise Data warehousing and modeling ETL processes and OLAP Statistical analysis and machine learning Big data technologies (Hadoop, Spark) Agile methodologies and data-driven decision-making Cloud technologies (AWS, Azure) and data security NoSQL databases and web scraping Natural Language Processing (NLP) and sentiment analysis API integration and data architecture Why Work With Us: Global Opportunities: Collab...

We're looking for an amazing python dev to take over work on an a Python Flask container - mainly responsible for ETL and data analysis. You: - A strong developer with experience in data pipeline and data analysis work. - Expert in libraries like Pandas, NumPy, and other python data manipulation libs. - A familiarity with networking protocols such as Websockets, HTTP, and FTP. - Familiarity with Data Warehouses like BigQuery - Familiarity with Looker - Ability to support US West Coast hours Do you do your own coding, or do you coordinate development through an agency? Can you describe a recent project where you utilized Pandas and NumPy for data analysis or manipulation? What challenges did you face and how did you overcome them? Can you explain a scenario where you had to ...

...manage and organize data within it. - Ability to ensure data security and integrity throughout the extraction and integration process. **Ideal Skills and Experience:** - Proven track record of working with POS systems, especially Clover, for sales data extraction. - Strong background in cloud-computing platforms, specifically Azure. - Comfortable with setting up and managing data pipelines and ETL processes. - Experience in setting up automated workflows between different technological platforms. - Knowledge of data visualization and interpretation, to guide the final format of sales data within Snowflake. This project requires a freelancer who can swiftly understand our data infrastructure and implement a solution that minimizes manual intervention and maximizes data utility f...

...Intelligence (MS BI) technologies for over 8 years, we're in search of a consultant who has a strong background in Power BI and particularly in SQL Server Integration Services (SSIS,SSRS,SSAS). While expertise in other MS BI areas is appreciated, SSIS should be your main strength. Tasks will revolve around data modeling and visualization, report creation and customization, as well as data integration and ETL processes depending upon the demand of the projects on hand. Please note, however, that all the mentioned tasks are equally important in this role. Ideal candidate should: - Have proven experience with Power BI and SSIS,SSRS - Be comfortable tackling both the big picture and diving into the details - Provide examples of past work showcasing their expertise in these ar...

I require an ETL Informatica IDQ specialist for my project. The Ideal Candidate: - Should have extensive experience in ETL Informatica IDQ specifically. 5+ Years IDQ experience recent 10.4 5+ years Data warehousing 5+ years informatica Share RESUME.

I've got a 2GB CSV file with a JSON column that I need processed using the Azure synapse ETL pipeline. The JSON structure would need to be exploded into all their respective columns. - The desired output format should be in Parquet. Familiarity with creating Parquet files is therefore essential. - Must be capable of extracting all columns from the JSON structure. - Experience with Azure Synapse and ETL pipeline is important. - Strong JSON understanding and manipulation skill is necessary. - This project needs to be completed ASAP, so a prompt response and swift action will be appreciated.

I am looking for a skilled Informatica professional to set up Informatica 12.x on my enterprise-level. Informatica admin needed to: Platform Setup: Des...efficient data processing. Security and Access Control: Implement robust security measures and access controls to safeguard sensitive data and ensure compliance with industry regulations. Performance Tuning: Monitor system performance, identify bottlenecks, and implement optimization strategies to ensure the platform operates at peak efficiency. Workflow and Job Scheduling: Create and manage ETL workflows and job schedules, troubleshoot issues, and ensure data processing jobs are executed successfully. Backup and Recovery: Develop and maintain backup and disaster recovery plans to safeguard critical data and ensure business c...

Build a glue etl using pyspark to transfer data from mysql to postgres. facing challenges in column mappings between the 2 sources, the target database has datatypes enums and text arrays. should solve the erros in column mappings Should have prior experience ingesting data into postgres enum datatype

...proficiency for implementing ETL (Extract, Transform, Load) processes. - Profound knowledge of Power BI for crafting interactive data visualizations. - Experience handling Microsoft Access database and extracting relevant data for reporting. - Ability to identify and integrate essential database tables, such as Student Information, Attendance Records, and Grades Data, into comprehensive Power BI reports. Ideal Skills: - Experience with Azure Services and Power BI. - Expertise in database management, particularly Microsoft Access. - Strong analytical skills to derive insights from educational data. - Proven track record of developing performance-tracking reports. The project will involve: - Reviewing and extracting the necessary data from Access database tables. - Setting up ...

...engaging and informative data engineering lectures. - Experience in Azure Data Factory, Databricks, Snowflake - Design and implement hands-on exercises and projects. - Provide constructive feedback and support to students. - Stay updated on industry trends and technologies. ? Requirements: - Proven experience in data engineering. - Strong knowledge of relevant tools and languages (e.g., Python, SQL, ETL, Tableau, Power BI, Machine learning) - Excellent communication and teaching skills. - Bachelor's degree in a related field (Master's preferred). ? Benefits: - Flexible schedule. - Opportunity to impact and inspire future data engineers. - Stay connected with industry professionals. Together, we will empower students with the knowledge and skills they need to succee...

...engaging and informative data engineering lectures. - Experience in Azure Data Factory, Databricks, Snowflake - Design and implement hands-on exercises and projects. - Provide constructive feedback and support to students. - Stay updated on industry trends and technologies. ? Requirements: - Proven experience in data engineering. - Strong knowledge of relevant tools and languages (e.g., Python, SQL, ETL, Tableau, Power BI, Machine learning) - Excellent communication and teaching skills. - Bachelor's degree in a related field (Master's preferred). ? Benefits: - Flexible schedule. - Opportunity to impact and inspire future data engineers. - Stay connected with industry professionals. Together, we will empower students with the knowledge and skills they need to succee...

In need of a skilled individual to assist with enhancing my company’s data warehouse. I'm specifically looking for expertise in a few critical areas: - **Data Integration & Transformation:** - Unify disparate sources - Cohesive data flow creation - ETL processes for structured data - **Data Modeling & Design:** - Implement Snowflake Schema efficiently - Optimize for scalability and performance **Ideal Skills and Experience:** - Proficiency in SQL and ETL tools - Experience with Snowflake Schema modeling - Strong understanding of structured data integration - Familiarity with data warehousing best practices By applying your knowledge and skills, you will directly contribute to the robustness and intelligence of our data warehousing solutio...

I'm seeking a skilled freelancer to help me transfer data from a MongoDB database Either display as json object or export to a SQLExpress database as a one-time operation. Here are my requirements: Note: MongoDB is located at a...efficiently in an SQLExpress table. - Proficiency in both C#.NET and VB.NET is required, as I am open to using either language. Ideal Candidate Skills: - Strong experience in C#.NET and/or VB.NET - Familiarity with MongoDB and its document structure - Experience with SQLExpress and data integration techniques - Ability to write clean and well-documented code - Understanding data migration and ETL processes Your proposal should display your relevant experience and suggest an approach for the development of this application. Let's ensure a sea...

You would play an integral part in an SQL Server Integration Services project, focusing primarily on ETL (Extract, Transform, Load) processes. Key Responsibilities: - Manage a wide variety of data sources involved in this process; this will include database tables, Excel spreadsheets as well as CSV files. - Carry out necessary data transformations such as data cleansing, aggregation and formatting. I'm keen to engage with individuals experienced in data handling, data transformation and SQL Server Integration Services. Proficiency in working with various data sources like database tables, Excel, and CSV files is critical. Additionally, anyone with a background in data cleansing, aggregation and formatting would be highly desirable. The job requires meticulous attention to de...

Hello, I've been working as a dat...guidance once found, and answering my questions when I encounter challenging situations. Apart from that, I will handle the jobs on my own. My goal is to create a win-win strategy by combining the mentor's knowledge with my dedication to work and learning. If interested individuals reach out, we can discuss the details, and I am open to different offers. Regarding my expertise, I have worked on ETL, ELT, and DWH projects. The tools I have used so far include SQL Server, T-SQL, SSIS, Azure Data Factory, Oracle SQL, Apache Airflow, Apache Spark, Power BI, etc. I am an open-minded person eager to learn and extremely enthusiastic about personal development. I believe that by finding the right mentor, we can achieve great things together. T...

I'm in need of a talented individual who can expertly transform strings of various data into clearly defined columns. My project involves multiple formats of data, and your skills will play a crucial role in organizing this information efficiently. Required Skills: - Proficiency in data parsing ...Skills: - Proficiency in data parsing - Familiarity with different data types (numeric, date/time, text) - Ability to handle various separators (comma, tab, space) - Adaptability to work with undefined structures - Attention to detail for accurate data organization Experience: - Extensive experience with data manipulation - Proficient in scripting languages (e.g., Python, Perl) - Knowledge of ETL processes is a plus This project may consist of many separate jobs at different times...

We seek an experienced AWS developer to construct a comprehensive ETL (Extract, Transform, Load) pipeline, focusing on consumer behavior analysis in the consumer industry. The project involves working with a large taxonomy table containing over 5400 rows and transforming this data for effective querying and analysis using AWS Athena. Project Objectives: --ETL Pipeline Development: Develop an automated ETL pipeline that handles a large taxonomy table. The pipeline should extract data from source files, transform it (including generating over 5,400 binary flag columns based on the taxonomy), and load the processed data into an AWS Athena-compatible format. --User Database Creation: Construct a database with unique user identifiers, incorporating binary flags for each ta...

...Deployment Specialist to play a pivotal role in our dynamic team. In addition to the responsibilities mentioned earlier, the successful candidate will be entrusted with deploying Talend solutions in both testing and production environments. If you possess hands-on experience in deploying ETL solutions and ensuring their seamless operation in varied environments, we encourage you to apply. Responsibilities:- Talend Job Design: Develop efficient and scalable Talend job designs for various data integration and ETL processes. Implement best practices for job design to ensure maintainability, reusability, and performance. Version Control: Implement version control for Talend jobs to manage changes, updates, and rollbacks effectively. Ensure proper documentation of changes ma...

...Payment - You will be paid for those hours while you will be working, You will be informed in advance if there is no work and for those hours you will not be paid. Budget = 500 INR /hr I'm on the lookout for an Expert level GCP Data Engineer with at least 7+ years in the field. While the specific skills weren't marked, we'll need someone with a good blend of: - Data modeling and schema design, - ETL/ELT pipelines, and - Data warehousing. Our project has some specific requirements. While these weren't marked, it's safe to assume we'll require proficiency in BigQuery and solid experience with GCP Dataflow and DataProc. The ideal candidate would already be familiar with these. I am looking forward to working with a seasoned professional who can suppo...

...Saturday 10AM to 12PM EST ? Responsibilities: - Deliver engaging and informative data engineering lectures. - Design and implement hands-on exercises and projects. - Provide constructive feedback and support to students. - Stay updated on industry trends and technologies. ? Requirements: - Proven experience in data engineering. - Strong knowledge of relevant tools and languages (e.g., Python, SQL, ETL, Tableau, Power BI, Machine learning) - Excellent communication and teaching skills. - Bachelor's degree in a related field (Master's preferred). ? Benefits: - Flexible schedule. - Opportunity to impact and inspire future data engineers. - Stay connected with industry professionals. Together, we will empower students with the knowledge and skills they need to succeed ...

...Payment - You will be paid for those hours while you will be working, You will be informed in advance if there is no work and for those hours you will not be paid. Budget = 500 INR /hr I'm on the lookout for an Expert level GCP Data Engineer with at least 7+ years in the field. While the specific skills weren't marked, we'll need someone with a good blend of: - Data modeling and schema design, - ETL/ELT pipelines, and - Data warehousing. Our project has some specific requirements. While these weren't marked, it's safe to assume we'll require proficiency in BigQuery and solid experience with GCP Dataflow and DataProc. The ideal candidate would already be familiar with these. I am looking forward to working with a seasoned professional who can supp...

I need a proficient freelancer who exhibits excellent expertise in SQL Server and SSIS. Key tasks include: - Writing intricate SQL database queries - Designing and implementing ETL processes Specific features for these tasks must include data validation and cleansing to ensure the highest quality and most reliable data possible. You'll be handling structured data such as SQL and spreadsheets. The ideal freelancer would have extensive experience in handling and manipulating structured data, with a strong foundation in error handling, logging, and performance optimization.

We are building a data warehouse which will gather data from different endpoints holding the same database (40+ servers). This data warehouse will live on AWS The data will be sent from the servers to S3 and then processed by AWS Glue The data lives on a SQL server DB on all different servers (schema is the same) We already have the plan laid out, we just need a devops / solutions architect to take the lead Proeficcient on: Batch / Powershell scripting AWS Glue AWS S3 AWS RDS AWS VPC / networking

...experience in building function & store procedure using ODI tool. Design Data warehouse table and applicable documentation. Develop table creation scripts and execute the scripts for the Database Administrator (DBA). Analyze data sources and determine data relationships to pair with the business requirements documentation (BRD). Familiarity with data quality issues and Exact, Transform, Load (ETL) processes Design and develop Extract Load Transform (ELT) process and load data from source tables into staging tables and then into target fact and dimension tables utilizing Oracle Data Integrator (ODI). Validate data loaded into various tables utilizing Structured Query Language (SQL) and other analysis. Knowledge and understanding of the applicable tools and practices use...

Project: We are developing a financial product including Europe's largest debt exchange and financial forecasting. Main job: - extending and updating the data set while meeting product targets - creating data flow diagrams Skills we are looking for: - Data Science, Big Data, Statistics, Business Analysis - Quantitative and qualitative research - Cartography&MapApps, Spatial data analytics. - Programming (Excel macro, Delphi, SPSS, Python (Jupiter Notebook)) - Statistical analysis - SPSS, Python, Excel. - Business analysis - Forecasts, ML, DSS, SEM. - Databases development (SQL, MySql, Access, VBA). - Data flows schemes Nice to have: - work with financial products nice to have - work with registry data nice to have - social and Marketing Research

Data Engineer with ETL, AWS EMR, and GLUE experience needed for interviewing candidates remotely via [Removed by Freelancer.com Admin for offsiting - please see Section 13 of our Terms and Conditions]. Skills required: - ETL - AWS EMR - GLUE Number of candidates to be interviewed: 4-7.

I am looking for an experienced Power BI consultant who is well-versed with the ETL process, Synapse, Fabric, DWH, and more. - Data source: As a part of the project, you will be needed to work on the local SQL database, which acts as my current data source. Familiarity with SQL databases is a must. - Data extraction and transformation: The project requires the extraction and transformation of data In conclusion, candidates with a strong understanding of SQL databases, data extraction/ transformation processes, azure, microsoft service awill be the best fit for this role.

Seeking a seasoned Python expert to handle the transformation of customer data, organized in mu...expert to handle the transformation of customer data, organized in multiple spreadsheets, into seamlessly compiled PDF reports. This is a Windows 10 project requiring proficiency in data organization, understanding of business data structures, and adeptness at Python coding for PDF generation. - Python experience: Proven experience writing scripts for data extraction, transformation, and loading (ETL) in Python - Report generation prowess: Solid skills in producing PDF reports from data held in spreadsheets - Data management: Strong comprehension of handling and manipulating customer data to create meaningful information Please respond with relevant project experience and examples, if...

I'm see...designer to construct a clean, minimalistic user interface for our Software as a Service (SaaS) application. The primary goal of our application is to streamline workflow, hence the design should reflect an interface that promotes efficiency and user-friendly navigation. Key functionalities that the application should support include: - Data Analysis - Project Management - Data Migration (ETL) The ideal freelancer should have notable experience in designing SaaS interfaces, with a keen understanding of clean, minimalist design principles. They should demonstrate a strong capability to design interfaces that effectively accommodate the specified functionalities. Knowledge and experience in creating designs that encourage streamlined workflow are essential fo...

I'm in need of a skilled ETL developer with at least 7 years of experience to conduct integration testing on Unix scripts and develop mappings. Your duties will include: - Conducting comprehensive integration testing. - Validating data transformations in unit testing. - Ensuring data accuracy during unit testing. You should have a strong background in Unix and ETL development, with a focus on data accuracy and transformation validation. It would be advantageous if you have an in-depth understanding of load performance testing. An ability to work within time constraints is essential. If you're a skilled problem-solver with a keen eye for detail, please consider bidding on this project. I look forward to working with a knowledgeable professional who can ensure o...

This project aims to visualize customer behavior data leveraging AWS's key services. The data will be processed, queried, and analyzed using a combination of AWS Glue, Athena, and Sagemaker. The ultimate goal is to develop data-driven insights that can guide future business decisions. • AWS Data Services: This project requires the use of AWS Glue for ETL, bucketing data, and making it query-ready. AWS Athena for an interactive query service will also be crucial. Lastly, AWS Sagemaker is necessary for potential machine learning aspects. Proficiency and practical experience in these specific AWS services are essential for successful project execution. • Data Analysis: This project will involve a substantial amount of customer behavior data. Due to this, strong experie...

Seeki...Responsibilities include: - Developing a robust API to manage attack surfaces using #Python, #Restful, #Fast-API, and #PostgreSQL. - Creating specialized #darkweb and #deepweb scrapers to gather data from specified sites. - Obtaining data from 5-10 public websites through APIs/feeds (e.g., Telegram, - Twitter, Discord). - Building a server to oversee and manage scrapers. Implementing fundamental #ETL processes, integrating NLP analysis tools like weaviate (#vectordb ) and #AI. - Configuring #AWSservices to host the platform and establishing access controls and #IAMroles for secure operations. We're looking for an individual well-versed in cybersecurity and software development, proficient in Python, Fast-API, PostgreSQL, web scraping, NLP, AWS, API development, and ser...

I'm in need of a skilled Informatica Teradata developer who can assist me with multiple tasks including data integration, ETL (Extract, Transform, Load) processes, and data warehousing. The primary objective of this project is to enhance reporting and analytics capabilities. Therefore, the ideal candidate will have solid experience in using Informatica Teradata for similar purposes. Skills and Experience: - Extensive knowledge in Informatica Teradata - Proven experience in data integration, ETL and data warehousing - Strong capability in enhancing reporting and analytics Data Sources: The project will involve working with both structured and unstructured data sets. Therefore, a successful track record dealing with these types of data sources is highly desirable...

...Description: I am looking for a freelancer who can build a SAS Query builder for data analysis in a contact center environment Place of work: Barcelona. 40% at home. 60% in client offices. Purpose: Develope a ETL script based on SAS query Builder Preferred Format for Analysis Results: The preferred format for the analysis results is ETL (Extract, Transform, Load). Skills and Experience: The ideal freelancer for this job should have the following skills and experience: - Strong proficiency in SAS programming and query building - Experience in data analysis and data management - Familiarity with ETL processes and techniques - Attention to detail and ability to deliver accurate and reliable results - Effective communication skills to understand project requiremen...

I am seeking a job support for a DataStage ETL developer. The specific tasks that I need assistance with are developing ETL jobs. I am looking for someone with beginner level experience who can provide support for less than 10 hours per week. Ideal Skills and Experience: - Experience with DataStage ETL development - Strong understanding of ETL concepts and best practices - Proficiency in troubleshooting and debugging ETL jobs - Knowledge of installation and configuration of DataStage - Ability to work independently and provide guidance and support on ETL development tasks

...Datastage ETL developer for personal use Skills and Experience: - Expertise in IBM Datastage ETL development - Strong knowledge of ETL concepts and best practices - Experience in full project development using IBM Datastage - Ability to understand and analyze data requirements - Proficient in creating and maintaining ETL jobs - Familiarity with data integration, transformation, and loading processes - Strong problem-solving and debugging skills - Excellent communication and collaboration skills Responsibilities: - Develop and implement end-to-end ETL solutions using IBM Datastage - Collaborate with stakeholders to understand data requirements and project objectives - Design, develop, and test ETL jobs to ensure data accuracy and completenes...

We are looking for some Generative AI expert who can write a code which can convert Tableau dashboards to Power BI. While we convert Tableau to Power bi it has 4 major components,... ETL work, modelling, Formulas and visualisation any idea using tool how much conversion would be perfect 99%, 95%, 90% or what ? I have a plan of this project like below. 1. Data Source Identification - Use some way to identify and replicate data sources in Power BI. - Apply code generation for data modeling. 2. Formula Conversion - Leverage NLP for Tableau formula identification. - Develop a mapping system and use code generation to translate formulas to Power BI DAX. 3. Visualization Conversion - Utilize NLP to recognize Tableau visualizations. - Develop mappings and use code generation to recreate ...

I am in need of a skilled tutor who can help me enhance my abilities in data integration and ETL (SSIS), reporting and visualization (SSRS), and database querying and management (TSQL). My main goal is to improve data integration processes. In this project: - You will support my learning to drive more efficient data integration operations. - In-depth knowledge and practical training on how to generate insightful reports and visualizations will be expected. - The training must cater to an intermediate level familiarity with SSIS for data integration. Ideal Skills and Experience: - Experience in SSIS, SSRS, and TSQL. - Ability to impart knowledge effectively. - Experience working with intermediate learners. - Familiarity with different learning styles.

As someone set to attend a technical interview soon, I'm seeking the services of an experienced data engineer. I need particular guidance on AWS services like EC2, S3, and RDS; Azure services; and Pyspark data processing and transformations. Essential Skills: - Proficient in AWS, specifically on EC2, S3, RDS with strong understanding of data storage and retrieval. - Expert in Azure services such as Azure SQL Database and Blob Storage. - Highly experienced in writing efficient data transformations using Pyspark. Ideal Experience: - Minimum 7 years in the field with solid experience in technical interviews and coaching. Your task will be to provide actionable insights, best practices, and expert advice to nail my upcoming technical interview. Having been on the other side of the inte...

...solution requirements. Ensure solutions are scalable and adaptable for future modifications, considering the organization's goals. Qualifications And Experience Minimum 4 yrs+ experience with snowflake- snowflake SQL, Snow pipe, streams, Stored procedure, Task, Hashing, Row Level Security, Time Travel etc. Proficiency in SQL, data structures, and database design principles. Strong experience in ETL or ELT Data Pipelines and various aspects, terminologies with Pure SQL like SCD Dimensions, Delta Processing etc. 3+ years of Experience of working with AWS cloud services- S3, Lambda, Glue, Athena, IAM, CloudWatch, Redshift etc. 5+ years of proven expertise in creating pipelines for real time and near real time integration working with different data sources - flat files,...

Experienced Python + SQL +AWS +AZURE data engineer (7+ years) for evening IST timings. For guiding in interview preparation specially for data engineering. Tasks: Should have good knowledge of pyspark, sql, pandas Should have written multiple ETL pipeline in aws and azure. Note: The freelancer must be available during evening ist timings.

...data warehouse implementation, specifically in the area of cloud-based data warehouses. Skills and experience required for this project include: - Strong knowledge of data warehousing concepts and principles - Experience with cloud-based data warehousing platforms, such as Amazon Redshift or Google BigQuery - Proficiency in data modeling and designing data warehouse schemas - Understanding of ETL (Extract, Transform, Load) processes and tools - Ability to analyze and integrate data from multiple sources - Familiarity with SQL and other programming languages for data manipulation and analysis The deliverable for this project is a comprehensive report that summarizes the research findings and provides recommendations for implementing a cloud-based data warehouse. The report sho...

...programming language in data engineering contexts. Proficiency in Apache Spark is essential, as we rely heavily on this powerful analytics engine for big data processing. Experience with PySpark, the Python API for Spark, is also crucial. In addition to these core skills, we require expertise in AWS cloud services, particularly AWS Glue and Amazon Kinesis. Experience with AWS Glue will be vital for ETL operations and data integration tasks, while familiarity with Amazon Kinesis is important for real-time data processing applications. Furthermore, the candidate should have a solid understanding of Amazon Redshift, our data warehousing solution, to manage and analyze large datasets efficiently. The Senior Data Engineer will be responsible for designing and implementing scalable d...

Job Title: Digital Technolo...Boomi or other available integration services • Experience in creating and maintain data structures in Snowflake Data warehouse • Experience working with Data Analysts to ensure data is prepared and available through development of queries, views, schemas, etc. • Understand integration points in other products and design data transformations • Manage ETL processes and systems • Recommend improvements to data architecture to improve utilization and performance • Exposure to WordPress, NetSuite Commerce Advanced (SCA), Boomi, Snowflake and Experience working with Web Technologies (JavaScript’ • Knowledge of NetSuite, Dynamics 365 CRM or ...

...interaction for solutioning – Cloud Data Quality (CDQ), Cloud Data Integration (CDI), Cloud Application Integration (CAI), and other microservices. • Strong experience with MDM Solution Design, Data Integration, Data Modelling, Customization and Configuration, Data Governance, Performance Optimization, Collaboration and Documentation • In-depth knowledge of data integration, ETL processes, and data quality management. • Familiarity with Salesforce and SAP data structures and integration methods. • Excellent problem-solving skills and the ability to troubleshoot complex data issues. • Strong communication and collaboration skills, with the ability to engage with both technical and non-technical s...