Big Data Integration/IOT Tech Lead

Job Title: Big Data Integration / IoT Tech Lead Job Summary We are seeking an experienced Big Data Integration / IoT Tech Lead to architect, design, and lead the implementation of scalable data integration and IoT data platforms. This role is responsible for end-to-end ownership of data ingestion, processing, and analytics pipelines that handle high-volume, high-velocity IoT and enterprise data. The ideal candidate combines strong technical leadership with hands-on expertise in big data, cloud platforms, and IoT ecosystems. Key Responsibilities • Technical Leadership: Lead the design and delivery of Big Data and IoT integration solutions; provide technical guidance to development teams. • Architecture & Design: Define scalable, secure, and fault-tolerant architectures for IoT data ingestion, streaming, storage, and analytics. • IoT Data Integration: Integrate data from IoT devices, sensors, gateways, and enterprise systems using real-time and batch pipelines. • Big Data Pipelines: Design and implement ETL/ELT pipelines for structured and unstructured data using modern big data frameworks. • Streaming & Real-Time Processing: Build and manage real-time data processing solutions for telemetry, alerts, and operational analytics. • Cloud & Platform Management: Deploy and optimize big data and IoT solutions on cloud platforms (AWS, Azure, or arenaflex Cloud Platform). • Performance & Scalability: Ensure high availability, low latency, and scalability of data platforms handling massive data volumes. • Security & Governance: Implement data security, access controls, and governance standards for IoT and enterprise data. • Collaboration: Work closely with product owners, data scientists, architects, and business stakeholders to translate requirements into technical solutions. • Mentoring & Code Review: Mentor engineers, enforce best practices, and conduct design and code reviews. • Innovation & Continuous Improvement: Stay current with emerging trends in IoT, big data, cloud services, and analytics technologies. Required Skills & Qualifications • Big Data Technologies: Strong experience with Hadoop ecosystem, Spark, Kafka, Flink, or similar frameworks. • IoT Platforms & Protocols: Experience with IoT platforms and protocols such as MQTT, AMQP, OPC-UA, REST APIs. • Data Integration: Expertise in building batch and streaming data pipelines; experience with ETL tools and custom integrations. • Cloud Platforms: Hands-on experience with AWS (Kinesis, IoT Core, EMR), Azure (IoT Hub, Event Hubs, Databricks), or arenaflex Cloud Platform equivalents. • Databases & Storage: Experience with data lakes, NoSQL databases (Cassandra, MongoDB), and time-series databases. • Programming: Proficiency in Java, Scala, Python, or similar languages. • DevOps & Automation: Experience with arenaflex/CD pipelines, containerization (Docker, Kubernetes), and infrastructure as code. • Leadership & Communication: Strong ability to lead technical teams and communicate complex concepts to non-technical stakeholders. Education & Experience • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. • 8+ years of experience in big data engineering or data integration roles. • 3+ years in a technical lead or architecture role involving IoT or large-scale data platforms. Preferred Qualifications • Experience with edge computing and device lifecycle management. • Exposure to advanced analytics, AI/ML pipelines, or digital twin solutions. • Knowledge of data governance, compliance, and industry standards (e.g., ISO, GDPR). • Experience in industries such as manufacturing, energy, automotive, healthcare, or smart cities. Apply tot his job Apply tot his job Apply To this Job