Technical Support Engineer (Inference)
Together AI · Pune or Bangalore, India · Remote
Infrastructureremotesenior
At a glance
Highlights
- Support customers building training, fine-tuning and inference on Together AI.
- Ensure customer inference endpoints stay healthy, stable and performant.
- Turn support insights into roadmap input with Engineering and Go-To-Market teams.
What they offer
- Competitive compensation
- Startup equity
- Health insurance
- Remote work flexibility
Ideal candidate
Deeply technical, customer-obsessed engineer who thrives solving complex infrastructure challenges and communicating clearly. Passionate about AI and ownership in fast-paced, innovative environments.
Requirements
- 6+ years in customer-facing technical, SRE, DevOps or infrastructure role, including 1+ year supporting an AI service
- Knowledge of AI, ML, GPU technologies in high-performance computing (HPC) environments
- Production-level experience with Kubernetes, SLURM, Ansible, network fabrics, NFS storage and containers
- Familiarity operating Vast and Weka storage systems in HPC environments
- Ability to diagnose network-layer issues and read traces
- Strong Python, TypeScript and/or JavaScript with curl and Postman-like debugging
- Expertise with observability tooling like Prometheus and Grafana at scale
- Deep familiarity with REST API debugging and HTTP semantics
- Experience with LLM inference frameworks, LoRA fine-tuning and training failure modes
- Experience with Infrastructure as Code and Git-based workflows
- Background in GPU cluster management
- Strong ownership, willingness to learn and cross-functional collaboration for customer success
- Excellent communication explaining complex concepts to non-technical stakeholders
- Ability to operate in dynamic environments managing multiple projects and priorities
- Flexibility for holiday, night and weekend support coverage as needed
- remote policy
- Flexible remote work within hiring region
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs
Posted · Last seen