Lead Data Transformation Engineer - Google Cloud Platform (Remote or Hybrid)

Job Overview:

We are seeking a highly skilled Lead Data Transformation Engineer to join our team, driving the transformation of our client's legacy system to a cutting-edge Google Cloud Platform. As a seasoned data engineering expert, you will play a key role in rearchitecting, transforming, and redesigning data pipelines, collaborating with software engineers to deliver innovative solutions.

Key Responsibilities:

• Design and implement large-scale data pipelines using Google Cloud Platform, Dataproc, Spark, and PySpark
• Collaborate with architects to develop architecture solutions using Composer and Spark
• Lead the migration of legacy systems to Google Cloud Platform, ensuring seamless integration and optimal performance
• Develop and maintain CI/CD pipelines, ensuring efficient and reliable data processing
• Work closely with cross-functional teams to identify and solve complex data engineering problems

Requirements:

• 10+ years of experience in data engineering, with a strong focus on data architecture and pipeline redesign
• 3+ years of experience with Google Cloud Platform, including migration expertise and experience with Dataproc and Spark
• 3+ years of experience with Apache Airflow and/or Composer
• 5+ years of experience with CI/CD pipelines
• Strong proficiency in at least one OOP language, with Java preferred
• Experience with databases, SQL, and large-scale batch processing using cloud services
• Excellent collaboration and problem-solving skills, with the ability to work effectively with architects and engineers

What We Offer:

• Competitive salary and benefits package
• Remote or hybrid work arrangement, with the option to work from our Phoenix, AZ office
• Opportunity to work with a leading client, driving innovation and transformation in their industry
• Collaborative and dynamic work environment, with a team of experienced professionals

How to Apply:

If you are a motivated and experienced data engineering professional, looking to take your career to the next level, please apply now. We look forward to hearing from you!

Apply To This Job