Senior Software Engineer II, Inference

Highlights

• Lead architecture for large-scale inference platform with strict P99 SLAs.
• Drive reliability with SLIs/SLOs, autoscaling and graceful degradation.
• Optimize throughput and latency while mentoring engineers across teams.

What they offer

• Discretionary bonus and equity awards
• Medical, dental and vision insurance 100% paid by CoreWeave
• Company-paid life insurance plus voluntary supplemental life insurance
• Short and long-term disability insurance
• Flexible Spending Account and Health Savings Account
• Tuition reimbursement
• Employee Stock Purchase Program (ESPP)
• Mental wellness benefits through Spring Health
• Family-forming support through Carrot and paid parental leave
• Childcare support with Kinside
• 401(k) with generous employer match
• Flexible PTO and catered daily lunch

Ideal candidate

A distributed-systems owner who obsesses over tail latency and reliability, enjoys leading designs across teams and mentoring others to raise engineering standards.

Requirements

• 3-5 years (IC3) or 5-8 years (IC4) building distributed systems or cloud services
• Strong coding in Python or Go with deep familiarity with networked systems and performance
• Hands-on Kubernetes at production scale with CI/CD and observability stacks
• Practical knowledge of inference internals including batching, caching and streaming delivery
• Track record improving P95/P99 tail latency and reliability through metrics-driven work
• Bachelor's or Master's in Computer Science or equivalent practical experience