Technical Lead Manager, ML Dataset Platform

Highlights

• Define APIs and storage formats making datasets a shared, first-class asset.
• Build versioning and incremental updates without full dataset rebuilds.
• Make data lineage automatic from raw data through to trained models.

Ideal candidate

Hands-on platform leader who loves building shared infrastructure and driving adoption across ML teams. Collaborative mentor who thrives balancing technical direction with people growth in fast-paced autonomy.

Requirements

• Designed and built large-scale data infrastructure for ML training at petabyte scale
• Very strong Python skills and comfortable in PyTorch training loops
• Strong software engineering fundamentals with distributed systems and cloud storage
• Experience with data processing frameworks such as Spark, Ray, or Beam
• Proven technical leadership defining platform APIs and driving adoption across teams
• Experience managing or tech-leading engineers including hiring and mentoring
• Clear communicator who builds consensus and delivers in fast-paced environments