Senior Production Engineer

Job description

Job responsibilities

• Diagnose and fix stability vulnerabilities in core platform services that cause cascading failures under multi-replica, multi-tenant operation
• Implement resilience patterns (leader election, circuit breakers, failure domain isolation) directly in service code
• Design multi-replica support for services that currently assume single-instance operation
• Collaborate with service owners on contract testing and upgrade validation
• Trace cascading failures across service boundaries and drive them to root-cause fixes
• Contribute to observability platform improvements to support service stability
• Light infrastructure work: Terraform/Kubernetes changes to support service fixes (~20% of time)

Job requirements

• Production-quality Go — you'll be modifying core platform services, not writing scripts
• Practical experience with distributed systems: leader election, consensus, replication, failure modes
• Kubernetes — enough to understand how services run (not necessarily cluster administration)
• Debugging complex systems — tracing cascading failures across service boundaries
• 4+ years in SRE, platform engineering, or backend development roles
• Must be a U.S. Person due to required access to U.S. export controlled information or facilities
• Eligible to obtain and maintain an active U.S. Secret security clearance
• Rust (some platform services use it)