DevOps Engineer - Data Ops
<p><strong>We're Hiring:</strong> </p><p> </p><p><strong>DevOps Engineer – DataOps (SF Bay Area)</strong> </p><p>Do you get excited about turning complex ideas into sleek, responsive interfaces that just work? We’re building the next generation of web applications and looking for a <strong>DataOps Engineer</strong> to enhance developer productivity by building scalable data platforms. You’ll craft scalable, high-performance enterprise platform that feel effortless for users, working side by side with designers and backend engineers to translate vision into elegant, maintainable solutions. </p><p> </p><p><strong>About Us</strong> </p><p>We’re a well-funded AI startup ($25M seed round) in the San Francisco Bay Area, led by serial entrepreneurs with decades of success in cybersecurity (achieving > $3B valuations). We have paying customers and are partnering with Fortune 500 companies on a mission to transform the cybersecurity landscape with cutting-edge AI, including AI agents and Generative AI. </p><p> </p><p><strong>Why This Role Matters</strong> </p><p>This role focuses on automating workflows, improving platform reliability, and supporting data engineering teams with efficient development and deployment practices. In a world where digital experiences shape trust and adoption, DataOps increases development productivity which directly drives product success and customer confidence. </p><p> </p><p><strong>What You’ll Do</strong> </p><ul><li>Design, deploy, and operate scalable data platforms and pipelines, primarily on Azure (Databricks, ADF, ADLS) </li><li>Build, manage, and optimize Apache Spark clusters and workloads for batch and streaming data processing across Azure and AWS environments. </li><li>Implement CI/CD pipelines for data engineering code, Spark jobs, and pipeline configurations using Azure DevOps/GitHub Actions </li><li>Automate infrastructure using Infrastructure as Code (Terraform) and manage containerized workloads with Docker and Kubernetes </li><li>Monitor data pipelines and platforms to ensure data reliability, quality, observability, and cost optimization across Azure and AWS data platforms. </li><li>Enforce security, governance, and best practices, collaborating closely with data engineers and platform teams in Azure-first, multi-cloud environments. </li></ul><p> </p><p><strong>What We’re Looking For</strong> </p><ul><li>6+ years of professional experience in data engineering, Data DevOps, or Data platform engineering roles </li><li>Proven experience supporting production-grade data platforms in enterprise environments </li><li>Proven ability to design, build, deploy, and maintain scalable data pipelines (ETL/ELT) </li><li>Deep understanding of Apache Spark for batch and streaming workloads </li><li>Experience creating, configuring, and managing Spark clusters, including performance tuning and cost optimization </li><li>Practical experience with at least one major cloud provider: AWS, Azure, or GCP. </li><li>Strong experience using Terraform for infrastructure automation. </li><li>Proven ability to diagnose and resolve system and infrastructure issues. </li><li>Bonus Skill: Experience deploying and managing <strong>Spark workloads on Azure Databricks or Azure Synapse</strong> </li></ul><p> </p><p><strong>Why Join Us?</strong> </p><ul><li>Early-stage impact with the stability of $25M in seed funding </li><li>World-class leadership across AI, Engineering, and Product </li><li>Traction with Fortune 500s already in motion </li><li>Highly competitive comp & equity </li><li>Health, wellness, and professional development benefits </li><li>Access to the latest tools in AI/ML development </li></ul><p> </p><p><strong>Work Location – San Jose, CA (5 days in the office, founding team)</strong> </p><p> </p><p><strong>Let’s Build the Future of Cybersecurity Together</strong> </p><p>If you're excited about AI, enterprise cybersecurity, and shaping a category from the ground up, we’d love to hear from you</p>
[ad_2]
apply to this job