Experienced Big Data Engineer – Software Development and Team Leadership for Innovative Technology Solutions at arenaflex

Introduction to arenaflex and the Industry

arenaflex is a leading player in the technology industry, committed to delivering innovative solutions that make a significant impact on our clients' digital lives. As part of our diverse tech group, you will have the opportunity to engineer, code, and develop programming that sets us apart as a fundamental piece of our clients' digital ecosystem. Our team is dedicated to working in an open, stable, and comprehensive environment where your voice is valued, and you have the autonomy to make your own decisions on what tech to use to tackle challenging problems.

About This Job

As a Big Data Engineer at arenaflex, you will be an integral part of our engineering team, responsible for developing and testing software applications, driving continuous improvement in code structure and quality, and leading a small team of developers to achieve their full potential. You will have the opportunity to work with the latest technologies, including Hadoop, Big Data, Information Science, ML, Python, SQL, and UNIX, and contribute to the development of innovative solutions across multiple lines of business.

Key Responsibilities

• Develop and test software applications, including ongoing refactoring of code and driving continuous improvement in code structure and quality
• Lead a small team of developers and inspire them to achieve their full potential
• Participate in code reviews and digital testing
• Troubleshoot basic software components and identify code defects for remediation
• Enable the deployment, support, and monitoring of software across test, integration, and production environments
• Automate solutions in test or production environments
• Scale applications based on demand projections

Essential Qualifications

• Bachelor's degree in Engineering or Computer Science or equivalent
• 3 years of software development experience and leading teams of developers and scrum teams
• 3 years of hands-on experience working with Map Reduce, Hive, Spark (core, SQL, and PySpark)
• Strong Data warehousing concepts
• Knowledge of Financial reporting environment will be an plus
• Expertise in Distributed environment
• Hands-on experience with programming using Core Java or Python/Scala
• Expertise in Hadoop and Spark Architecture and its working principle
• Hands-on experience with writing and understanding complex SQL (Hive/PySpark-dataframes), optimizing joins while handling large amounts of data
• Experience in UNIX shell scripting

Preferred Qualifications

• Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be a benefit
• 3 years of experience with designing and building solutions using Kafka streams or pipelines
• Experience with GitHub/Bitbucket and using CI/CD pipelines
• Experience with NoSQL i.e., HBase, Couchbase, MongoDB is good to have
• Amazing technical and analytical fitness
• Excellent communication skills
• Exceptional Project management skills

Career Growth Opportunities and Learning Benefits

At arenaflex, we are committed to helping you grow and develop your skills and career. You will have access to dedicated opportunities to invest in your professional development, including training, mentorship, and education programs. Our team is passionate about innovation and continuous learning, and we encourage you to stay up-to-date with the latest technologies and trends in the industry.

Work Environment and Company Culture

arenaflex is a dynamic and innovative company that values diversity, inclusion, and creativity. Our work environment is open, collaborative, and supportive, and we encourage our employees to think outside the box and come up with innovative solutions to complex problems. We believe in work-life balance and offer flexible working hours, remote work options, and a comprehensive benefits package to support your well-being and success.

Compensation, Perks, and Benefits

arenaflex offers a competitive salary and benefits package, including a salary of $28/hour, comprehensive health insurance, retirement savings plan, and paid time off. We also offer a range of perks and benefits, including flexible working hours, remote work options, and access to the latest technologies and tools.

Conclusion

If you are a motivated and talented Big Data Engineer looking for a challenging and rewarding role, we encourage you to apply for this exciting opportunity at arenaflex. As a member of our team, you will have the chance to work on innovative projects, develop your skills and career, and contribute to the success of our company. Don't miss out on this opportunity to join our dynamic and innovative team and take your career to the next level. Apply now and become a part of the arenaflex team!