Find Jobs
Hire Freelancers

GCP & Airflow DAG Creation Specialist

$30-250 USD

Closed
Posted 10 days ago

$30-250 USD

Paid on delivery
I'm looking for an expert in GCP & Airflow who understands the intricacies of creating an Airflow DAG in Project-A (cloud composer) and triggering it via Project-B's service account. Work encompasses: - Crafting an Airflow DAG implementing Python script to create BigQuery tables. - Making the DAG operative within the confines of Project-A. - Leverage the service account of Project-B to trigger the DAG. - The BigQuery tables need to be created within Project-C. Ideal skills and experience: - Proficient in Python Scripting. - Experience in creating and managing workflows using Airflow. - Extensive knowledge of Google Cloud Platform. - Familiarity with BigQuery is a must. - Proven ability to script and manage service account interactions between multiple cloud projects.
Project ID: 38029102

About the project

16 proposals
Remote project
Active 3 days ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
16 freelancers are bidding on average $176 USD for this job
User Avatar
I am a GCP and Airflow specialist with extensive experience in creating Airflow DAGs and managing workflows. I have proficient Python scripting skills and a deep understanding of Google Cloud Platform. I can craft an Airflow DAG to create BigQuery tables, operate within Project-A, and utilize the service account of Project-B to trigger the DAG. I ensure the seamless interaction between multiple cloud projects for effective workflow management.
$250 USD in 2 days
5.0 (179 reviews)
7.9
7.9
User Avatar
Having worked primarily in Python since 2019, with a keen focus on web scraping, data mining, and developing well-fitted APIs, my experiences are aligned squarely for your GCP & Airflow DAG creation project. My knowledge extends to DJANGO, FLASK and Beautifulsoup which are all valuable skills when interfacing with the cloud-based Project-A of your task. In fact, one of my most unique accomplishments was a flask API I developed to communicate with an Android app using REST API; this experience involved significant data processing and accurate delivery of computational results - skills that would translate nicely to your GCP environment. Moreover, as a prolific web scraper for over 300 websites (including complex platforms like Facebook and Instagram) automated through Scrapy, I've honed superior problem-solving proficiency necessary to overcome the even most intricate scenarios that might arise in your Project-A setup. On the GCP front,I've also deployed several Google Cloud service projects working through cloud environments. This experience enables me to easefully interact with Project-B's Thanks,
$140 USD in 7 days
5.0 (38 reviews)
6.2
6.2
User Avatar
Hello. I read your requirement i will do that. Please come on chat we will discuss more about this. I will waiting your reply.
$150 USD in 3 days
4.9 (20 reviews)
4.5
4.5
User Avatar
Hi Harshitha P., How are you doing? As a professional developer with expertise in Linux, Python, Google Cloud Platform, Web Scraping and Google App Engine, I eagerly anticipate the opportunity to complete this project for you. Please drop me a message to discuss the project detail. Thank you for considering my services.
$50 USD in 6 days
5.0 (3 reviews)
3.9
3.9
User Avatar
Hi there,Good evening I am Talha. I can work with your project skills Google App Engine, Linux, Google Cloud Platform, Python and Web Scraping I am excited to present my proposal, which centers around a personalized approach designed to elevate your project. We will start with an in-depth consultation to gain a deep understanding of your project's unique requirements, goals, and constraints. Our commitment to customization means that we will tailor our services to align perfectly with your project, and we will explain how this approach will meet your expectations. Please note that the initial bid is an estimate, and the final quote will be provided after a thorough discussion of the project requirements or upon reviewing any detailed documentation you can share. Could you please share any available detailed documentation? I'm also open to further discussions to explore specific aspects of the project. Thanks for considering my proposal. I'm eager to collaborate and contribute to your project's success. Let me know if you need any more information. Regards. Talha Ramzan
$30 USD in 11 days
5.0 (4 reviews)
3.3
3.3
User Avatar
Hello I understand your request that you’re demanding GCP & Airflow DAG Creation Specialist As a Professional Geeks, I can avail creative, proactive and high-tech solutions to your development needs. I have excellent experience in Metatrader (4 And 5),Ninjatrader (7 And 8),Indicators & Trading Robots Development,Tradingview (Pinescript & Strategy),Python Trading Api,Machine Learning,,Python, Odoo, HTML, Javascript, PHP,CSS, Laravel,Java,Joomla,Angular.js,MySQL, Node.js, React.js,Wordpress,linux Ruby on Rails, Database, Objective-C and Swift,C, C#, C++, Qt, Linux, Arduino and raspberry. My Engineering skill are unimaginable with lot of success in engineering task My page is clear about my professionalism with awarded task Don't hesitate to contact me to create awesome products! Thanks
$30 USD in 1 day
3.6 (8 reviews)
4.1
4.1
User Avatar
Hi Dear, I know you are looking for someone with Facebook ads, Google ads, Social Media Marketing, Facebook Pixel conversion API, Google Analytics 4 (GA4), and a Google Ads Conversion Tracking Expert To set up Google Ads Conversion Tracking & Google Analytics 4 (GA4). Don't worry about Your Website Measuring. I Will Help You Very Quickly & Properly setup the Google ads,Google Ads Conversion Tracking Facebook ads, Facebook pixel conversion tracking, Google Analytics 4, Google Tag Manager, and All Social Media Marketing for your website, you can Track which ads are Driving Conversion and Optimize Your Campaign Accordingly. Google Analytics 4: to track GA4 E-commerce Events and Important Events like Button Click, Form Submit, and Purchase, so you can gain insights into user behavior and Improve your Business Accordingly. My Services: -Facebook Ads -Google Ads -Social Media Marketing -Setup Google Analytics 4 -Google Ads Conversion Tracking -Enhanced Conversion Tracking With User Data -GA4 Ecommerce Tracking Using Data Layer -Setup GA4 Standard Event (Page_view,View_item,AddToCart,Checkout,Purchase) -Lead Form Tracking (Contact Form, HubSpot Form, Celendly, Iframe) -Google Ads Remarketing Tag Setup -Fix any Kind of Issue GA4 Events and GAds Conversion Tracking Please send a message and I am waiting for your responses Regards Naimor Rahman
$66 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Skills and experience working with HTML, PHP, CSS, Python,web designing,database SQL,Artificial Intelligence & JavaScript. Ive worked with frameworks like bootstrap & jquery. With 3 years of experience in the field. Ive worked wiithin web projects such as Ive managed databases using MySQL, PostgreSQL & MySQLi.
$200 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear client, I have a solid background in cloud computing and workflow management and I am confident in my ability to deliver exceptional results for your project. Throughout my career, I have successfully crafted complex Airflow Directed Acyclic Graphs (DAGs) to orchestrate various data workflows. Leveraging Python scripting, I have developed robust solutions, including automating the creation of BigQuery tables, ensuring seamless data processing and analysis. My experience extends to working within the confines of multiple GCP projects, understanding the intricacies of permissions, and effectively leveraging service accounts for cross-project interactions. I have previously integrated Airflow DAGs into Google Cloud Composer (Project-A) and orchestrated them to execute tasks using service accounts from different projects, such as Project-B. Furthermore, my familiarity with BigQuery allows me to optimize data storage and querying processes, ensuring efficient utilization of resources within Project-C. Whether it's designing DAGs, managing workflows, or optimizing cloud infrastructure, I am dedicated to delivering high-quality solutions tailored to your project's requirements. I look forward to the possibility of discussing how I can add value to your organization. Sincerely, Roman
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, Dear client! I am well-versed in this area and confident that I can successfully complete your project. I have extensive experience working with GCP and Airflow, and have successfully implemented Python scripts to create BigQuery tables using Airflow DAGs. I am well-versed in managing workflows using Airflow and have a deep understanding of Google Cloud Platform. To ensure a successful execution of the project, I would like to ask a few technical questions: 1. What are the specific requirements for the Python script to create the BigQuery tables within the Airflow DAG? 2. Can you provide more details about the service account of Project-B and how it should be leveraged to trigger the DAG? 3. Are there any specific security or access control considerations that need to be taken into account when interacting between multiple cloud projects? I am prepared to talk about your project and can begin right away. Best regards, Roy Henderson
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello. As an experienced and accomplished full-stack developer, I have not only a profound understanding of the Google Cloud Platform (GCP), but also substantial hands-on involvement in crafting and managing workflows using Airflow. I have leveraged my expertise in Python scripting to create BigQuery tables in various contexts; given this, creating an Airflow DAG for your Project-A is comfortably within my skillset. One of the key distinguishing factors about my capabilities is my adeptness in integrating service account interactions between multiple cloud projects. I can ensure a seamless, efficient, and secure means of triggering your Airflow DAG via Project-B’s service account, then creating BigQuery tables for Project-C. Rest assured that if selected, your project will not only be executed flawlessly, but also efficiently - saving you both time and costs. So let's join forces and turn that project idea into a sterling reality! Thanks.
$750 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I'm an Assistant Data Engineer with significant GCP experience. That includes multi-account setups. My typical pipelines are written in Airflow and use PySpark for the heavy lifting and submitting the data either to data warehouses or data lakes. Also experienced with Docker and have an understanding of BigQuery. Knowing my strengths and weaknesses, I'm not asking for significant sums - but for an occasion to showcase my skills in a professional endeavour. I will not need tutoring, but I may need some research time if you - hence the longer delivery time.
$30 USD in 14 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear client I have expertise in cloud computing, particularly in GCP services. With a proven track record of successful implementations and a deep understanding of GCP's capabilities, incoupled with complete exposure towards data engineering and machine learning. I am well-equipped to deliver optimal solutions tailored to your project's needs.
$340 USD in 15 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Team, I am writing to express my keen interest in the position at your Company. With my strong background in data engineering, particularly in data migration and GCP technologies, I am confident that I possess the skills and experience necessary to excel in this role. In my previous role as a GCP Data Engineer at Datametica Solutions Private Limited, I spearheaded data migration projects with a focus on efficiency and accuracy. Optimizing data pipelines: I implemented Apache Airflow to orchestrate data extraction from Oracle to BigQuery, ensuring timely and reliable data transfer. Enhancing data quality: I championed data integrity by developing comprehensive testing procedures, leading to a 95% increase in data reliability. Facilitating seamless data migration: I possess expertise in transforming data mappings for BigQuery compatibility, achieving an 80% reduction in processing time for a client. My skill set includes proficiency in Python, SQL, Shell Scripting, GCP, BigQuery, and various other data technologies. I am also a GCP Certified - Professional Data Engineer, demonstrating my commitment to staying current in the field. I have attached my resume for your review and welcome the opportunity to discuss my qualifications further. Thank you for your time and consideration. Sincerely, Omkar Patole
$200 USD in 2 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Frisco, United States
0.0
0
Member since Apr 24, 2024

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.