Senior Data Engineer

Job description

Job responsibilities

• Design the data capture lanes, storage tiers, and pipeline layout
• Re-design the ingestion service with something that scales
• Build the transform machinery. You own the engine and what it guarantees; the team writes the transforms that run on it.
• Build the durable path for what the system does and has to remember
• Build the ID keying and crosswalk tables that connect a stored fact to its site, robot, hardware revision, calibration, layout, and pallet
• Own retention, cost, and egress as policy instead of plumbing. Retention policies per record and the site-to-cloud replication path.
• Run what you build. These services run in our cloud and inside customer sites, so you own their CI/CD, monitoring, and alerting.