Big Data Integration/IOT Tech Lead
Job Title: Big Data Integration / IoT Tech Lead Job Summary We are seeking an experienced Big Data Integration / IoT Tech Lead to architect, design, and lead the implementation of scalable data integration and IoT data platforms. This role is responsible for end-to-end ownership of data ingestion, processing, and analytics pipelines that handle high-volume, high-velocity IoT and enterprise data. The ideal candidate combines strong technical leadership with hands-on expertise in big data, cloud platforms, and IoT ecosystems.
Key Responsibilities
- Technical Leadership: Lead the design and delivery of Big Data and IoT integration solutions; provide technical guidance to development teams.
- Architecture & Design: Define scalable, secure, and fault-tolerant architectures for IoT data ingestion, streaming, storage, and analytics.
- IoT Data Integration: Integrate data from IoT devices, sensors, gateways, and enterprise systems using real-time and batch pipelines.
- Big Data Pipelines: Design and implement ETL/ELT pipelines for structured and unstructured data using modern big data frameworks.
- Streaming & Real-Time Processing: Build and manage real-time data processing solutions for telemetry, alerts, and operational analytics.
- Cloud & Platform Management: Deploy and optimize big data and IoT solutions on cloud platforms (AWS, Azure, or arenaflex Cloud Platform).
- Performance & Scalability: Ensure high availability, low latency, and scalability of data platforms handling massive data volumes.
- Security & Governance: Implement data security, access controls, and governance standards for IoT and enterprise data.
- Collaboration: Work closely with product owners, data scientists, architects, and business stakeholders to translate requirements into technical solutions.
- Mentoring & Code Review: Mentor engineers, enforce best practices, and conduct design and code reviews.
- Innovation & Continuous Improvement: Stay current with emerging trends in IoT, big data, cloud services, and analytics technologies. Required Skills & Qualifications
- Big Data Technologies: Strong experience with Hadoop ecosystem, Spark, Kafka, Flink, or similar frameworks.
- IoT Platforms & Protocols: Experience with IoT platforms and protocols such as MQTT, AMQP, OPC-UA, REST APIs.
- Data Integration: Expertise in building batch and streaming data pipelines; experience with ETL tools and custom integrations.
- Cloud Platforms: Hands-on experience with AWS (Kinesis, IoT Core, EMR), Azure (IoT Hub, Event Hubs, Databricks), or arenaflex Cloud Platform equivalents.
- Databases & Storage: Experience with data lakes, NoSQL databases (Cassandra, MongoDB), and time-series databases.
- Programming: Proficiency in Java, Scala, Python, or similar languages.
- DevOps & Automation: Experience with arenaflex/CD pipelines, containerization (Docker, Kubernetes), and infrastructure as code.
- Leadership & Communication: Strong ability to lead technical teams and communicate complex concepts to non-technical stakeholders. Education & Experience
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in big data engineering or data integration roles.
- 3+ years in a technical lead or architecture role involving IoT or large-scale data platforms.
Preferred Qualifications
- Experience with edge computing and device lifecycle management.
- Exposure to advanced analytics, AI/ML pipelines, or digital twin solutions.
- Knowledge of data governance, compliance, and industry standards (e.g., ISO, GDPR).
- Experience in industries such as manufacturing, energy, automotive, healthcare, or smart cities. Apply tot his job
Apply tot his job Apply To this Job