Data Infrastructure Engineer

Job description

Job responsibilities

• Build and scale ingestion pipelines for high-volume, high-dimensional sensor data.
• Build and maintain data quality and curation systems, including both manual review workflows and auto-labeling.
• Contribute to storage and retrieval design for large-scale multimodal datasets, including format choices and versioning/lineage.
• Build and operate distributed processing infrastructure (batch and streaming).
• Debug production issues in live data pipelines — data corruption, schema drift, backpressure, and failures that only show up at scale.
• Work with modeling/research partners to understand data quality, format, and structure needs, and translate them into working pipelines.
• Participate in design and code review across the data infrastructure stack.

Job requirements

• 2+ years of software engineering experience, with some exposure to data pipelines, data engineering, or backend systems.
• Strong programming fundamentals in Python, with the ability to write performant, production-grade data processing code.
• Experience with at least one distributed data processing framework (e.g., Spark, Ray, Dask, or Flink), or strong fundamentals and willingness to ramp up quickly.
• Familiarity with data storage concepts — object storage, data lake table formats, and warehouse vs. lake tradeoffs.
• Bias for ownership: you've taken features or systems from prototype to production.
• Clear communicator who collaborates well with research/modeling partners and more senior teammates.
• Experience with workflow orchestration tools (e.g., Airflow, Dagster, Prefect) is a plus.
• Experience with streaming ingestion for high-volume, near-real-time data is a plus.