Senior Data Engineer - GCP

Who are we?Equinix is the world's digital infrastructure company®, shortening the path to connectivity to enable the innovations that enrich our work, life and planet.A place where bold ideas are welcomed, human connection is valued, and everyone has the opportunity to shape their future.Help us challenge assumptions, uncover bias, and remove barriers-because progress starts with fresh ideas. You'll find belonging, purpose, and a team that welcomes you-because when you feel valued, you're empowered to do your best work.Job SummaryAs a Senior Data Engineer at Equinix, you will be responsible for driving end-to-end delivery of enterprise-scale data solutions on Google Cloud Platform. This role combines hands-on technical expertise, requiring you to design sophisticated system architectures, lead cross-functional teams, and mentor Staff and other data engineers. You will be responsible for solution design and ensuring the successful delivery of mission-critical data products. The ideal candidate demonstrates exceptional technical depth in GCP data technologies, proven leadership in guiding engineering teams through complex challenges, and the ability to translate strategic business objectives into scalable, innovative technical solutions. Knowledge of AI, Machine Learning Operations, and emerging technologies like Agentic AI and Model Context Protocol (MCP) is highly valued.ResponsibilitiesSystem Design & Architecture LeadershipArchitect complex, distributed data systems capable of handling petabyte-scale workloads with fault tolerance and high availabilityDesign data platform architectures considering scalability, performance, cost optimization, and operational excellenceEvaluate and recommend emerging technologies, tools, and architectural patterns to drive innovationCreate comprehensive architectural documentation, design patterns, and best practices guidelinesTechnical Solutioning & DeliveryOwn end-to-end delivery of complex data engineering initiatives from conception to productionDesign and implement sophisticated solutions leveraging BigQuery, Cloud Dataflow, Composer, Dataform/dbt, Pub/Sub, and Vertex AIArchitect and build real-time streaming data pipelines using Cloud Pub/Sub, Kafka, and Apache BeamDevelop advanced data transformation frameworks and custom processing enginesDesign microservices-based data platforms with containerization (Docker/Kubernetes)Establish comprehensive observability, monitoring, and alerting frameworksDrive performance optimization, cost management, and operational efficiency initiativesTeam Leadership & MentorshipLead and mentor Data Engineers and other team members, fostering technical excellence and professional growthGuide teams through complex technical challenges and architectural decision-makingConduct technical design reviews and ensure adherence to architectural standardsEstablish coding standards, quality assurance processes, and engineering best practicesLead technical training programs and knowledge-sharing initiativesDrive continuous improvement in team processes, tools, and methodologiesParticipate in technical hiring processes and team capability buildingData Governance & ComplianceEstablish data classification systems, access control policies, and encryption strategiesImplement automated data quality frameworks, lineage tracking, and metadata managementEnsure regulatory compliance across data workflows (GDPR, SOX, industry-specific regulations)Design privacy-preserving techniques, data anonymization, and secure data sharing mechanismsStrategic Collaboration & Stakeholder ManagementPartner with business stakeholders to translate strategic objectives into technical solutionsLead cross-functional initiatives spanning multiple engineering teams and business unitsPresent technical concepts and architectural decisions to executive leadershipDrive alignment between technical implementations and business outcomesQualificationsTechnical ExpertiseGCP Platform Mastery: 8+ years of hands-on experience with Google Cloud Platform, including deep expertise in BigQuery (advanced SQL, scripting, optimization, ML integration), Cloud Dataflow, Cloud Composer, Cloud Storage, Pub/Sub, Dataproc, and Vertex AIProgramming Excellence: Expert-level Python/Java programming, proficiency in Python/Scala for Spark developmentAdvanced Data Technologies: Deep expertise in Apache Beam, Apache Spark, Airflow, Kafka, and distributed computing architecturesInfrastructure: Extensive experience with Terraform, CI/CD pipelines, and cloud infrastructure managementDatabase & Data Modeling: Advanced knowledge of relational databases (PostgreSQL, MySQL) and NoSQL systems (BigTable, Firestore, MongoDB); expertise in data modeling, normalization, and performance optimizationSystem Design: Proven ability to architect complex, distributed systems with considerations for scalability, reliability, security, and cost-effectivenessProfessional Experience & LeadershipBachelor's degree in Computer Science, Engineering, or related technical field (Master's degree preferred)8+ years of data engineering experience with 6+ years specifically on Google Cloud PlatformProven track record of leading end-to-end delivery of complex, enterprise-scale data platform initiativesExperience designing and implementing data governance, compliance, and security frameworksStrong architectural thinking with ability to make sound technical decisions and trade-offsExcellent communication skills with ability to present technical concepts to both technical and non-technical audiences, including executive leadershiProven ability to translate business requirements into scalable technical architectures and solutionsExperience managing cross-functional projects and building strong stakeholder relationships Preferred QualificationsGoogle Cloud Professional Data Engineer and/or Cloud Architect certificationsExperience with AI/ML technologies, MLOps practices, and machine learning pipeline development on GCPKnowledge of emerging AI technologies including Agentic AI frameworks, LLM integration, and Model Context Protocol (MCP)Experience with feature stores, model serving infrastructure, and AI/ML observabilityUnderstanding of data science workflows, statistical analysis, and advanced analyticsExperience with BI and visualization tools (Looker, Tableau, Power BI)Contributions to open-source data engineering projects or technical publicationsExperience with multi-cloud or hybrid cloud architecturesKnowledge of data mesh, data fabric, or other modern data architecture patternsEquinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.We use artificial intelligence in our hiring process. Learn more here. Apply tot his job Apply To this Job