Experienced Full Stack Data Engineer – Cloud-Based Data Pipeline Development and Real-Time Analytics
At arenaflex, we're on a mission to revolutionize the way businesses approach data-driven decision-making. As a seasoned Full Stack Data Engineer, you'll play a pivotal role in shaping our data engineering function, driving innovation, and empowering our teams with cutting-edge data solutions. If you're passionate about data engineering, cloud computing, and real-time analytics, we want to hear from you!
About arenaflex
arenaflex is a leading innovator in the private sector, dedicated to harnessing the power of data to drive business growth and success. With a strong focus on data-driven decision-making, we're constantly pushing the boundaries of what's possible with data engineering, cloud computing, and real-time analytics. Our team is passionate about delivering exceptional results, and we're committed to creating a work environment that's collaborative, inclusive, and inspiring.
Job Summary
We're seeking an experienced Full Stack Data Engineer to join our team and contribute to the development of our cloud-based data pipeline solutions. As a key member of our data engineering function, you'll be responsible for designing, developing, testing, and maintaining data pipelines and data products that enable real-time business analytics, data exploration, and data preparation. If you have a strong background in data engineering, cloud computing, and real-time analytics, and are passionate about delivering high-quality results, we encourage you to apply.
Key Responsibilities
As a Full Stack Data Engineer at arenaflex, you'll be responsible for the following key activities:
- Design and Development: Design, develop, test, and maintain data pipelines and data products that enable real-time business analytics, data exploration, and data preparation.
- Data Engineering: Demonstrate deep knowledge of data engineering concepts, including non-interactive (batch, distributed) and real-time data, data pipelines, and data products.
- Optimization: Optimize data products to meet client personas, Data Science, AI/ML, and data visualization requirements.
- Knowledge Sharing: Provide training and lead the implementation of complex projects.
- Documentation: Develop and maintain documentation for all assigned structures and projects.
- Root Cause Analysis: Perform root cause analysis to identify permanent solutions to software or business process issues.
Essential Qualifications
To be successful in this role, you'll need to possess the following essential qualifications:
- Bachelor's Degree: Bachelor's degree in Computer Science, Data Science, or related field, or equivalent work experience.
- Technical Skills: Strong/Professional Spark (PySpark) using Jupyter Notebooks, Colab, or DataBricks, hands-on data pipeline development, ingest styles in Azure, orchestration tools (ADP or Airflow), SQL, and denormalized data modeling for large data structures.
- Soft Skills: Collaborative, capable of working remotely, and an engaging team member, strong analytical and design skills, and 7-10 years of experience in architecting and designing large-scale high-performance distributed systems.
Preferred Qualifications
While not essential, the following qualifications are highly desirable:
- 7-10 years of experience: 7-10 years of experience in SQL Platform, 3+ years of experience in No-SQL Platform, 3+ years of experience in Spark, 3+ years of experience in data platform implementation on Azure or AWS, and 2+ years of experience in CI/CD.
- Exposure to SOA Architecture: Exposure to Service-Oriented Architecture (SOA) is a plus.
What We Offer
As a Full Stack Data Engineer at arenaflex, you'll enjoy a competitive salary range of $55 to $80 per hour, a comprehensive benefits package, and opportunities for career growth and professional development. Our work environment is collaborative, inclusive, and inspiring, with a strong focus on work-life balance and employee well-being.
How to Apply
If you're passionate about data engineering, cloud computing, and real-time analytics, and are looking for a challenging and rewarding role, we encourage you to apply. Please submit your resume and a cover letter outlining your experience, skills, and qualifications. We can't wait to hear from you! Apply Now! Apply for this job