Member of Technical Staff Infrastructure
LlamaIndex provides AI document-processing and knowledge-agent infrastructure, centered on LlamaParse for parsing, extraction, indexing, and retrieval over unstructured enterprise documents.
About LlamaIndex
A San Francisco AI company offering a developer-first platform and commercial APIs for document workflows and knowledge agents. Its active products include LlamaParse, agentic OCR and structured extraction software, and the open-source local document parser LiteParse.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, build, and scale foundational infrastructure for a high-volume data platform. You will manage cloud and Kubernetes resources, improve deployment processes, implement security controls, and operate infrastructure for production LLM applications, including inference, evaluation, observability, and agentic workflows.
Requirements
- Infrastructure engineering
- Platform engineering
- Cloud infrastructure
- Terraform
- CDKTF
- Kubernetes
- Helm
- Test infrastructure
- Release management
- Observability
- Cloud resource optimization
- LLM tooling
- Model API
- Agent framework
- RAG framework
- Evaluation
- Tracing
- LLM workload
- Prometheus
- Grafana
- New Relic
- GitOps
- ArgoCD
- Flux
- Continuous deployment
- Security compliance
- SOC2
- Python
- PostgreSQL
- Multi-cloud deployment
Responsibilities
- Build and maintain foundational systems that support developers and product growth
- Design scalable infrastructure for SaaS, single-tenant, and private deployments
- Manage and optimize cloud resources and Kubernetes clusters
- Maintain infrastructure boundaries and principles for customer deployments
- Improve release and deployment processes
- Implement security measures and regulatory compliance across deployment environments
- Build and operate infrastructure for production LLM applications, inference workloads, evaluation pipelines, observability, and agentic workflows
Benefits
- Equity compensation
- Medical coverage
- Dental coverage
- Vision coverage
- Unlimited paid time off
- Daily catered lunch
- Snacks