Join us and help shape the future of AI by defining the narrative around document understanding.
LlamaIndex's backend application platform team is hiring for an experienced (4+ years) backend engineer excited to build new features and scale out our ingestion and AI systems! LlamaIndex is backed by Greylock and has grow significantly in the last year from a combination of open source and private enterprise interest. Our teams and positions offer terrific growth and ownership opportunities as we expand our engineering team to power our next phase of growth!
[Primary] Build out new features and scale our backend capabilities focused scaling out our core APIs
Backend stack: Python, Node.JS, K8s, Terraform, Postgres, Temporal, etc.
[Secondary] Work closely with prospects and customers to build production solutions.
Experience with shipping completely new product features from scratch. Have gone from prototype to production serving end users in a short amount of time.
Shipped or otherwise interested in AI/LLM-native applications.
Iterated rapidly with customers or other engineers - translate user feedback into features back to proactive user discovery. Help jointly develop and iterate on product roadmap for core features.
Shipped applications at scale
We offer a hybrid-friendly culture based out of our downtown San Francisco office.
Impactful Mission: Work on innovative AI products that redefine how knowledge is accessed and utilized.
Collaborative Team: Join a team of passionate individuals committed to pushing the boundaries of technology.
Growth Opportunities: Be at the forefront of the AI revolution, with ample opportunities to grow alongside our scaling organization.
Competitive base salary and equity compensation
Comprehensive medical/dental/vision coverage for you and your family
Unlimited paid time off policy
Daily catered lunch and snacks in the San Francisco office
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.
","descriptionPlain":"Join us and help shape the future of AI by defining the narrative around document understanding.\n\n\n\n\nABOUT THE ROLE\n\nLlamaIndex's backend application platform team is hiring for an experienced (4+ years) backend engineer excited to build new features and scale out our ingestion and AI systems! LlamaIndex is backed by Greylock and has grow significantly in the last year from a combination of open source and private enterprise interest. Our teams and positions offer terrific growth and ownership opportunities as we expand our engineering team to power our next phase of growth!\n\n\n\n\nRESPONSIBILITIES\n\n - [Primary] Build out new features and scale our backend capabilities focused scaling out our core APIs\n \n - Backend stack: Python, Node.JS, K8s, Terraform, Postgres, Temporal, etc.\n\n - [Secondary] Work closely with prospects and customers to build production solutions.\n\n\n\n\nQUALIFICATIONS\n\n - Experience with shipping completely new product features from scratch. Have gone from prototype to production serving end users in a short amount of time.\n\n - Shipped or otherwise interested in AI/LLM-native applications.\n\n - Iterated rapidly with customers or other engineers - translate user feedback into features back to proactive user discovery. Help jointly develop and iterate on product roadmap for core features.\n\n - Shipped applications at scale\n\n\nLOCATION\n\nWe offer a hybrid-friendly culture based out of our downtown San Francisco office. \n\n\n\n\nWHY JOIN US?\n\n - Impactful Mission: Work on innovative AI products that redefine how knowledge is accessed and utilized.\n\n - Collaborative Team: Join a team of passionate individuals committed to pushing the boundaries of technology.\n\n - Growth Opportunities: Be at the forefront of the AI revolution, with ample opportunities to grow alongside our scaling organization.\n\n\n\n\nADDITIONAL BENEFITS\n\n - Competitive base salary and equity compensation\n\n - Comprehensive medical/dental/vision coverage for you and your family\n\n - Unlimited paid time off policy\n\n - Daily catered lunch and snacks in the San Francisco office\n\n\n\n\n\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.\n\n\n\nLlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.","compensation":{"compensationTierSummary":"$180K – $250K • Offers Equity","scrapeableCompensationSalarySummary":"$180K - $250K","compensationTiers":[{"id":"f86a1577-58da-478c-bf2e-5d11f836af4e","tierSummary":"$180K – $250K • Offers Equity","title":null,"additionalInformation":null,"components":[{"id":"a8480791-9afd-4989-808b-41aa168a3c6f","summary":"Offers Equity","compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":null,"maxValue":null},{"id":"5fb02e74-7617-471b-8ed5-95eb574ce0e9","summary":"$180K – $250K","compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":180000,"maxValue":250000}]}],"summaryComponents":[{"compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":null,"maxValue":null},{"compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":180000,"maxValue":250000}]}},{"id":"b0a0e9d0-9826-46c5-b3a6-8ef3feb9cd9d","title":"Developer Evangelist, Technical Content","department":"Marketing","team":"Marketing","employmentType":"FullTime","location":"San Francisco","shouldDisplayCompensationOnJobPostings":true,"secondaryLocations":[],"publishedAt":"2026-10-16T17:36:56.392+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/llamaindex/b0a0e9d0-9826-46c5-b3a6-8ef3feb9cd9d","applyUrl":"https://jobs.ashbyhq.com/llamaindex/b0a0e9d0-9826-46c5-b3a6-8ef3feb9cd9d/application","descriptionHtml":"Join us and help shape the future of AI by defining the narrative around document understanding.
LlamaIndex builds LlamaParse, the world's best agentic OCR and document parsing engine for AI applications. Enterprises and developers use LlamaParse to turn their hardest documents, including dense PDFs, scanned files, tables, and forms, into clean structured data their AI systems can actually use, at a scale of millions of pages a day. Document ingestion is one of the most underestimated problems in AI, and LlamaParse is how teams solve it.
We're looking for a Developer Advocate to be the public face of LlamaParse, out in the world in front of real developers and real teams, showing what the product can do.
This is a role for someone who does their best work in person and on camera. You'll spend your time at events, running demos, and posting on social media, and you'll evangelize the product by showing it in action: real documents going in, real structured data coming out. The most convincing thing you can do is share concrete, lived experience that makes developers want to try LlamaParse themselves.
We see this as an open-level role. We care far more about how compelling you are in a room and how well you can demo a product than about years on a résumé.
Get out into the world. Represent LlamaParse at conferences, meetups, hackathons, and workshops by speaking, demoing live, and meeting developers and teams face to face. This is the core of the job.
Evangelize the product through real experiences. Walk through actual document-parsing problems, show LlamaParse handling messy real-world files, and tell the stories of how teams use it in production.
Be highly active and visible on social media, including X, LinkedIn, and YouTube. Post demos, before-and-after parsing examples, launch content, and threads that show developers what LlamaParse does.
Create technical content across formats, including video walkthroughs, livestreams, blog posts, and conference talks, all centered on LlamaParse and the document-ingestion problem.
Build sharp, convincing demos and example apps that prove the product on hard, realistic documents.
Partner with product and engineering on LlamaParse launches so every release lands with content and demos that drive adoption.
Stay close enough to the developer community to answer questions and bring feedback back to the team. This is a steady part of the role, though the focus of the job is being out evangelizing.
A natural evangelist. You like being on stage, on camera, and in the room, and you can make a technical product genuinely interesting to watch.
Strong, consistent presence on social media, with a track record of technical content developers find useful.
Real enthusiasm for events, including speaking, live demos, and travel, and a knack for being approachable and memorable in person.
Enough technical depth to build with LlamaParse and write working code in Python and/or TypeScript, so your demos are real and your credibility is earned.
Clear technical communication. You can explain document parsing and structured extraction to a beginner and to a senior engineer.
Working knowledge of the AI application landscape, including LLMs, RAG, OCR, and document pipelines.
Based in or willing to be in the San Francisco Bay Area for a hybrid schedule, with real willingness to travel for events.
Existing audience or reputation in the AI or developer community.
Experience speaking at or organizing developer conferences and hackathons.
Video production or livestreaming skills.
Hands-on experience with document-heavy AI use cases.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.
","descriptionPlain":"Join us and help shape the future of AI by defining the narrative around document understanding.\n\n\n\n\nABOUT LLAMAINDEX\n\nLlamaIndex builds LlamaParse, the world's best agentic OCR and document parsing engine for AI applications. Enterprises and developers use LlamaParse to turn their hardest documents, including dense PDFs, scanned files, tables, and forms, into clean structured data their AI systems can actually use, at a scale of millions of pages a day. Document ingestion is one of the most underestimated problems in AI, and LlamaParse is how teams solve it.\n\n\n\n\nABOUT THE ROLE\n\nWe're looking for a Developer Advocate to be the public face of LlamaParse, out in the world in front of real developers and real teams, showing what the product can do.\n\nThis is a role for someone who does their best work in person and on camera. You'll spend your time at events, running demos, and posting on social media, and you'll evangelize the product by showing it in action: real documents going in, real structured data coming out. The most convincing thing you can do is share concrete, lived experience that makes developers want to try LlamaParse themselves.\n\nWe see this as an open-level role. We care far more about how compelling you are in a room and how well you can demo a product than about years on a résumé.\n\n\n\n\nWHAT YOU'LL DO\n\n - Get out into the world. Represent LlamaParse at conferences, meetups, hackathons, and workshops by speaking, demoing live, and meeting developers and teams face to face. This is the core of the job.\n\n - Evangelize the product through real experiences. Walk through actual document-parsing problems, show LlamaParse handling messy real-world files, and tell the stories of how teams use it in production.\n\n - Be highly active and visible on social media, including X, LinkedIn, and YouTube. Post demos, before-and-after parsing examples, launch content, and threads that show developers what LlamaParse does.\n\n - Create technical content across formats, including video walkthroughs, livestreams, blog posts, and conference talks, all centered on LlamaParse and the document-ingestion problem.\n\n - Build sharp, convincing demos and example apps that prove the product on hard, realistic documents.\n\n - Partner with product and engineering on LlamaParse launches so every release lands with content and demos that drive adoption.\n\n - Stay close enough to the developer community to answer questions and bring feedback back to the team. This is a steady part of the role, though the focus of the job is being out evangelizing.\n\n\nWHAT WE'RE LOOKING FOR\n\n - A natural evangelist. You like being on stage, on camera, and in the room, and you can make a technical product genuinely interesting to watch.\n\n - Strong, consistent presence on social media, with a track record of technical content developers find useful.\n\n - Real enthusiasm for events, including speaking, live demos, and travel, and a knack for being approachable and memorable in person.\n\n - Enough technical depth to build with LlamaParse and write working code in Python and/or TypeScript, so your demos are real and your credibility is earned.\n\n - Clear technical communication. You can explain document parsing and structured extraction to a beginner and to a senior engineer.\n\n - Working knowledge of the AI application landscape, including LLMs, RAG, OCR, and document pipelines.\n\n - Based in or willing to be in the San Francisco Bay Area for a hybrid schedule, with real willingness to travel for events.\n\n\nNICE TO HAVE\n\n - Existing audience or reputation in the AI or developer community.\n\n - Experience speaking at or organizing developer conferences and hackathons.\n\n - Video production or livestreaming skills.\n\n - Hands-on experience with document-heavy AI use cases.\n\n\n\n\n\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.\n\n\n\nLlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.","compensation":{"compensationTierSummary":"$130K – $250K","scrapeableCompensationSalarySummary":"$130K - $250K","compensationTiers":[{"id":"51f01d4b-cfe8-42fd-b38e-6375284103cb","tierSummary":"Based on Experience $130K – $250K","title":null,"additionalInformation":null,"components":[{"id":"f2118f92-5a6a-4021-934c-7b0f8af236e0","summary":"Based on Experience $130K – $250K","compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":130000,"maxValue":250000}]}],"summaryComponents":[{"compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":130000,"maxValue":250000}]}},{"id":"0b618d29-e04c-44d9-a2d4-d403e6e88ce8","title":"Don’t See Your Role?","department":"General","team":"General","employmentType":"FullTime","location":"San Francisco","shouldDisplayCompensationOnJobPostings":true,"secondaryLocations":[],"publishedAt":"2026-07-08T19:49:37.747+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/llamaindex/0b618d29-e04c-44d9-a2d4-d403e6e88ce8","applyUrl":"https://jobs.ashbyhq.com/llamaindex/0b618d29-e04c-44d9-a2d4-d403e6e88ce8/application","descriptionHtml":"Join us and help shape the future of AI by defining the narrative around document understanding.
Don’t see a role that feels like the right fit? We’d still love to hear from you. Submit your application here, and we’ll keep you in mind as new opportunities open up!
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.
","descriptionPlain":"Join us and help shape the future of AI by defining the narrative around document understanding.\n\n\n\nDon’t see a role that feels like the right fit? We’d still love to hear from you. Submit your application here, and we’ll keep you in mind as new opportunities open up! \n\n\n\n\n\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.\n\n\n\nLlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.","compensation":{"compensationTierSummary":"$100K – $200K • Offers Equity","scrapeableCompensationSalarySummary":"$100K - $200K","compensationTiers":[{"id":"4d47f6d5-f8e4-4596-a907-f107fd6121da","tierSummary":"$100K – $200K • Offers Equity","title":null,"additionalInformation":null,"components":[{"id":"af0df50c-8ff4-4a67-816b-130efa2d7ee1","summary":"$100K – $200K","compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":100000,"maxValue":200000},{"id":"4a5ccf91-b796-4f89-a51d-6d1b68417a2e","summary":"Offers Equity","compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":null,"maxValue":null}]}],"summaryComponents":[{"compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":100000,"maxValue":200000},{"compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":null,"maxValue":null}]}},{"id":"5ef32675-090d-4eb2-bca0-ddb6fbde0215","title":"Member of Technical Staff, Applied Research","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","shouldDisplayCompensationOnJobPostings":true,"secondaryLocations":[],"publishedAt":"2026-07-08T01:11:47.282+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/llamaindex/5ef32675-090d-4eb2-bca0-ddb6fbde0215","applyUrl":"https://jobs.ashbyhq.com/llamaindex/5ef32675-090d-4eb2-bca0-ddb6fbde0215/application","descriptionHtml":"Join us and help shape the future of AI by defining the narrative around document understanding.
We are looking for an AI Research Engineer to join our document understanding team.
This role is ideal for someone who sits between applied research and strong engineering. You will work on vision-language models, document processing, data curation, synthetic data generation, benchmarking, training, fine-tuning, and post-training. The goal is simple: make our document AI systems more accurate, faster, and more cost-effective in production.
You should be excited by frontier AI work, but equally motivated by practical product impact. This is not a pure research role where ideas stay in papers. You will be expected to prototype quickly, evaluate rigorously, and help turn promising approaches into production systems used by customers.
Develop and train vision-language models for document processing and document understanding.
Build data pipelines for data curation, synthetic data generation, labeling, and benchmark creation.
Evaluate base models and perform post-training or fine-tuning to hit specific performance targets.
Improve model accuracy, latency, and cost-effectiveness across real-world document workflows.
Design and maintain benchmarks to measure extraction quality, layout understanding, OCR performance, reasoning accuracy, and end-to-end system reliability.
Work with messy real-world documents, including PDFs, scanned documents, tables, charts, forms, and multi-page enterprise documents.
Collaborate with engineering to move successful research prototypes into production.
Work directly with customers when needed to translate product requirements into benchmarks, experiments, and model improvements.
Stay close to the latest research in vision-language models, document AI, post-training, synthetic data, and agentic systems.
Use modern AI coding workflows and tools to move quickly.
3–7 years of experience in machine learning engineering, applied research, or research engineering.
Strong ML foundation, including hands-on experience benchmarking and training models.
Strong Python skills and comfort with modern ML tooling, especially PyTorch.
Experience with computer vision, vision-language models, NLP, document AI, OCR, extraction, or agentic AI systems.
Ability to build experiments, evaluate results, and iterate quickly toward measurable performance improvements.
Strong engineering judgment and ability to write clean, production-quality code.
Comfort working in a fast-paced startup environment with high ownership and limited structure.
Adaptable, scrappy, and self-directed — someone who can figure things out without waiting to be told.
Strong technical writing and communication skills.
Prior startup experience, especially at an early-stage or high-growth AI company.
Experience as a founder or early startup engineer.
Experience building or improving document processing systems.
Experience with synthetic data generation, post-training, fine-tuning, or benchmark design.
Familiarity with tools such as vLLM, Pydantic, uv, ruff, mypy, Claude Code, Cursor, or similar modern AI engineering workflows.
Experience with open-source AI infrastructure or developer tools.
You will work closely with the CTO and the document understanding team, partnering across research, engineering, product, and customer-facing teams.
Work on a core AI infrastructure problem: making complex documents understandable and actionable for AI systems.
Build production systems at the frontier of vision-language models and document AI.
Join a fast-growing startup with strong open-source adoption and commercial traction.
Work directly with technical founders and a highly ambitious engineering team.
Have real ownership over model quality, product capability, and technical direction.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.
","descriptionPlain":"Join us and help shape the future of AI by defining the narrative around document understanding.\n\n\n\n\nABOUT THE ROLE\n\nWe are looking for an AI Research Engineer to join our document understanding team.\n\nThis role is ideal for someone who sits between applied research and strong engineering. You will work on vision-language models, document processing, data curation, synthetic data generation, benchmarking, training, fine-tuning, and post-training. The goal is simple: make our document AI systems more accurate, faster, and more cost-effective in production.\n\nYou should be excited by frontier AI work, but equally motivated by practical product impact. This is not a pure research role where ideas stay in papers. You will be expected to prototype quickly, evaluate rigorously, and help turn promising approaches into production systems used by customers.\n\n\n\n\nWHAT YOU’LL DO\n\n - Develop and train vision-language models for document processing and document understanding.\n\n - Build data pipelines for data curation, synthetic data generation, labeling, and benchmark creation.\n\n - Evaluate base models and perform post-training or fine-tuning to hit specific performance targets.\n\n - Improve model accuracy, latency, and cost-effectiveness across real-world document workflows.\n\n - Design and maintain benchmarks to measure extraction quality, layout understanding, OCR performance, reasoning accuracy, and end-to-end system reliability.\n\n - Work with messy real-world documents, including PDFs, scanned documents, tables, charts, forms, and multi-page enterprise documents.\n\n - Collaborate with engineering to move successful research prototypes into production.\n\n - Work directly with customers when needed to translate product requirements into benchmarks, experiments, and model improvements.\n\n - Stay close to the latest research in vision-language models, document AI, post-training, synthetic data, and agentic systems.\n\n - Use modern AI coding workflows and tools to move quickly.\n\n\n\n\nWHAT WE’RE LOOKING FOR\n\n - 3–7 years of experience in machine learning engineering, applied research, or research engineering.\n\n - Strong ML foundation, including hands-on experience benchmarking and training models.\n\n - Strong Python skills and comfort with modern ML tooling, especially PyTorch.\n\n - Experience with computer vision, vision-language models, NLP, document AI, OCR, extraction, or agentic AI systems.\n\n - Ability to build experiments, evaluate results, and iterate quickly toward measurable performance improvements.\n\n - Strong engineering judgment and ability to write clean, production-quality code.\n\n - Comfort working in a fast-paced startup environment with high ownership and limited structure.\n\n - Adaptable, scrappy, and self-directed — someone who can figure things out without waiting to be told.\n\n - Strong technical writing and communication skills.\n\n\n\n\nNICE TO HAVE\n\n - Prior startup experience, especially at an early-stage or high-growth AI company.\n\n - Experience as a founder or early startup engineer.\n\n - Experience building or improving document processing systems.\n\n - Experience with synthetic data generation, post-training, fine-tuning, or benchmark design.\n\n - Familiarity with tools such as vLLM, Pydantic, uv, ruff, mypy, Claude Code, Cursor, or similar modern AI engineering workflows.\n\n - Experience with open-source AI infrastructure or developer tools.\n\n\n\n\nWHO YOU’LL WORK WITH\n\nYou will work closely with the CTO and the document understanding team, partnering across research, engineering, product, and customer-facing teams.\n\n\n\n\nWHY JOIN LLAMAINDEX\n\n - Work on a core AI infrastructure problem: making complex documents understandable and actionable for AI systems.\n\n - Build production systems at the frontier of vision-language models and document AI.\n\n - Join a fast-growing startup with strong open-source adoption and commercial traction.\n\n - Work directly with technical founders and a highly ambitious engineering team.\n\n - Have real ownership over model quality, product capability, and technical direction.\n\n\n\n\n\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.\n\n\n\nLlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.","compensation":{"compensationTierSummary":"$180K – $250K • 0.1% – 0.4%","scrapeableCompensationSalarySummary":"$180K - $250K","compensationTiers":[{"id":"3e3ccfc1-5ba0-4349-8fc9-667d392c1c23","tierSummary":"$180K – $250K • 0.1% – 0.4%","title":null,"additionalInformation":null,"components":[{"id":"ab12b716-32d2-4f58-8627-81f709bebdfe","summary":"$180K – $250K","compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":180000,"maxValue":250000},{"id":"ffa8d2ae-1680-4f49-a4d5-536a5b74bcf0","summary":"0.1% – 0.4%","compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":0.1,"maxValue":0.4}]}],"summaryComponents":[{"compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":180000,"maxValue":250000},{"compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":0.1,"maxValue":0.4}]}},{"id":"0f8bdc04-5d1d-4db1-a888-3f367cb4469e","title":"Head of Engineering","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","shouldDisplayCompensationOnJobPostings":true,"secondaryLocations":[],"publishedAt":"2026-10-08T23:26:16.411+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/llamaindex/0f8bdc04-5d1d-4db1-a888-3f367cb4469e","applyUrl":"https://jobs.ashbyhq.com/llamaindex/0f8bdc04-5d1d-4db1-a888-3f367cb4469e/application","descriptionHtml":"Join us and help shape the future of AI by defining the narrative around document understanding.
LlamaIndex makes enterprise data useful for AI applications.
You will own engineering execution, technical direction, hiring, and team development. You will work closely with company leadership and product teams to decide what we build, how we build it, and how we deliver it reliably to customers.
This is a hands-on role. You should be comfortable reviewing code and architecture, debugging production issues, and writing code for critical systems. We are looking for someone who has shipped and operated B2B API products and understands both model serving and model training—from experimentation and evaluation to deployment and production operations.
Lead and develop our engineering team, setting clear priorities, ownership, and accountability.
Partner with company leadership to translate customer needs into a focused roadmap and deliver software predictably.
Stay directly involved in architecture, code reviews, production debugging, and implementation of critical changes.
Set technical direction across application services, APIs, data pipelines, and ML infrastructure, balancing immediate customer needs with long-term maintainability.
Work with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment, ensuring model improvements translate into better production outcomes.
Guide model serving decisions across latency, throughput, GPU utilization, capacity, reliability, and inference cost.
Improve engineering practices for testing, observability, security, incident response, and releases.
Hire strong engineers, coach technical leaders and managers, and build a culture of direct communication, customer focus, and responsibility for results.
Experience leading multiple engineering teams in B2B SaaS, at a scope comparable to a 20–30-person organization, with responsibility for delivering and operating customer-facing products.
Strong, current hands-on engineering skills: you can read and write production code, review architecture, and diagnose complex technical problems.
Practical familiarity with model serving and model training, including training or fine-tuning workflows, evaluation, deployment, and production operations.
Understanding of the tradeoffs between model quality, latency, throughput, GPU resources, reliability, and cost.
Strong background in backend systems, APIs, distributed systems, and cloud infrastructure.
A track record of hiring and developing engineers, setting clear expectations, and giving constructive feedback.
Good product judgment, including knowing when to move quickly and when to invest in correctness, reliability, and security.
Clear written and verbal communication with technical teams, customers, and company leadership.
Experience scaling engineering at a Series A–C startup.
Experience with document processing, OCR, extraction, retrieval, indexing, or other systems that work with enterprise data.
Experience with LLMs or multimodal models, evaluation datasets, and model quality monitoring.
Experience with GPU infrastructure, distributed training, inference optimization, or model serving frameworks.
Experience building developer tools or API-first products.
Experience with enterprise requirements such as multi-tenancy, access controls, auditability, and security reviews.
Experience developing engineering managers while staying closely involved in technical execution.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.
","descriptionPlain":"Join us and help shape the future of AI by defining the narrative around document understanding.\n\n\n\n\nABOUT THE ROLE\n\nLlamaIndex makes enterprise data useful for AI applications.\n\nYou will own engineering execution, technical direction, hiring, and team development. You will work closely with company leadership and product teams to decide what we build, how we build it, and how we deliver it reliably to customers.\n\nThis is a hands-on role. You should be comfortable reviewing code and architecture, debugging production issues, and writing code for critical systems. We are looking for someone who has shipped and operated B2B API products and understands both model serving and model training—from experimentation and evaluation to deployment and production operations.\n\n\n\n\nRESPONSIBILITIES\n\n - Lead and develop our engineering team, setting clear priorities, ownership, and accountability.\n\n - Partner with company leadership to translate customer needs into a focused roadmap and deliver software predictably.\n\n - Stay directly involved in architecture, code reviews, production debugging, and implementation of critical changes.\n\n - Set technical direction across application services, APIs, data pipelines, and ML infrastructure, balancing immediate customer needs with long-term maintainability.\n\n - Work with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment, ensuring model improvements translate into better production outcomes.\n\n - Guide model serving decisions across latency, throughput, GPU utilization, capacity, reliability, and inference cost.\n\n - Improve engineering practices for testing, observability, security, incident response, and releases.\n\n - Hire strong engineers, coach technical leaders and managers, and build a culture of direct communication, customer focus, and responsibility for results.\n\n\nREQUIRED QUALIFICATIONS\n\n - Experience leading multiple engineering teams in B2B SaaS, at a scope comparable to a 20–30-person organization, with responsibility for delivering and operating customer-facing products.\n\n - Strong, current hands-on engineering skills: you can read and write production code, review architecture, and diagnose complex technical problems.\n\n - Practical familiarity with model serving and model training, including training or fine-tuning workflows, evaluation, deployment, and production operations.\n\n - Understanding of the tradeoffs between model quality, latency, throughput, GPU resources, reliability, and cost.\n\n - Strong background in backend systems, APIs, distributed systems, and cloud infrastructure.\n\n - A track record of hiring and developing engineers, setting clear expectations, and giving constructive feedback.\n\n - Good product judgment, including knowing when to move quickly and when to invest in correctness, reliability, and security.\n\n - Clear written and verbal communication with technical teams, customers, and company leadership.\n\n\nPREFERRED QUALIFICATIONS\n\n - Experience scaling engineering at a Series A–C startup.\n\n - Experience with document processing, OCR, extraction, retrieval, indexing, or other systems that work with enterprise data.\n\n - Experience with LLMs or multimodal models, evaluation datasets, and model quality monitoring.\n\n - Experience with GPU infrastructure, distributed training, inference optimization, or model serving frameworks.\n\n - Experience building developer tools or API-first products.\n\n - Experience with enterprise requirements such as multi-tenancy, access controls, auditability, and security reviews.\n\n - Experience developing engineering managers while staying closely involved in technical execution.\n\n\n\n\n\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.\n\n\n\nLlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.","compensation":{"compensationTierSummary":"$200K – $300K • Offers Equity","scrapeableCompensationSalarySummary":"$200K - $300K","compensationTiers":[{"id":"caf3620f-074f-4713-9dc1-4fa746d9da91","tierSummary":"$200K – $300K • Offers Equity","title":null,"additionalInformation":null,"components":[{"id":"e551f4d5-75df-4ec6-91c5-f7d846d9d745","summary":"$200K – $300K","compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":200000,"maxValue":300000},{"id":"aa9016fb-86ae-4d2d-8e79-9b13b7670d2c","summary":"Offers Equity","compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":null,"maxValue":null}]}],"summaryComponents":[{"compensationType":"Salary","interval":"1 YEAR","currencyCode":"USD","minValue":200000,"maxValue":300000},{"compensationType":"EquityPercentage","interval":"NONE","currencyCode":null,"minValue":null,"maxValue":null}]}}],"apiVersion":"1"}