About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role:
Anyscale is growing its Sales Team! We're looking for a Bay Area based Enterprise Account Executive to build out our enterprise-level client relationships. This is a Hunter role, so you will be prospecting, developing, and closing new business while focusing on the clients’ requirements. The Enterprise AE’s must have the confidence and ability to negotiate and close agreements with clients and support new customers.
This role is a unique opportunity to contribute in a meaningful way to high visibility, high impact projects at a very exciting time for the company. Anyscale is an innovative, high-growth, customer-focused company in a large and growing market. If you are an energetic, self-managed professional with experience managing a complex sales process and possess excellent presentation and listening skills, organization and contact management capabilities, we’d love to hear from you.
As part of this role, you will:
Achieve sales quotas for named accounts on a quarterly and annual basis by developing a sales strategy in the allocated territory with a target prospect list, and a regional sales plan
Develop marketing plans with the marketing team to drive revenue growth
Be the trusted advisor to the customer by understanding their existing and future roadmap to drive the Anyscale solution within the marketplace
Prospect qualification and the development of new sales opportunities and ongoing revenue streams
Arrange and conduct initial Executive and CxO discussions and positioning meetings
Sales process management and opportunity closure
Ongoing account management to ensure customer satisfaction and drive additional revenue streams.
Be familiar with solution-based approach to selling, have experience managing a complex sales process and possess excellent presentation and listening skills, organization and contact management capabilities
Some understanding of the data, compute, ML space and an ability to carry a technical conversation on these topics
We'd love to hear from you if you have:
A track record of success in driving consistent activity, pipeline development and quota achievement
5+ years of full cycle sales experience selling software or cloud based applications
Emphasis on ML, Cloud, and Infrastructure solutions
Ability to generate meetings, build your own pipeline while running strategy engagemehnts with prospects and potential customers
Experience determining customer requirements and presenting appropriate solutions
Proactive, independent thinker with high energy/positive attitude
Excellent verbal and written communication, presentation, and relationship management skillsAbility to thrive in fast-paced startup environment
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\nAbout the role:\n\nAnyscale is growing its Sales Team! We're looking for a Bay Area based Enterprise Account Executive to build out our enterprise-level client relationships. This is a Hunter role, so you will be prospecting, developing, and closing new business while focusing on the clients’ requirements. The Enterprise AE’s must have the confidence and ability to negotiate and close agreements with clients and support new customers.\n\nThis role is a unique opportunity to contribute in a meaningful way to high visibility, high impact projects at a very exciting time for the company. Anyscale is an innovative, high-growth, customer-focused company in a large and growing market. If you are an energetic, self-managed professional with experience managing a complex sales process and possess excellent presentation and listening skills, organization and contact management capabilities, we’d love to hear from you.\n\n\n\nAs part of this role, you will:\n\n - Achieve sales quotas for named accounts on a quarterly and annual basis by developing a sales strategy in the allocated territory with a target prospect list, and a regional sales plan\n\n - Develop marketing plans with the marketing team to drive revenue growth\n\n - Be the trusted advisor to the customer by understanding their existing and future roadmap to drive the Anyscale solution within the marketplace\n\n - Prospect qualification and the development of new sales opportunities and ongoing revenue streams\n\n - Arrange and conduct initial Executive and CxO discussions and positioning meetings\n\n - Sales process management and opportunity closure\n\n - Ongoing account management to ensure customer satisfaction and drive additional revenue streams.\n\n - Be familiar with solution-based approach to selling, have experience managing a complex sales process and possess excellent presentation and listening skills, organization and contact management capabilities\n\n - Some understanding of the data, compute, ML space and an ability to carry a technical conversation on these topics\n\n\n\nWe'd love to hear from you if you have:\n\n - A track record of success in driving consistent activity, pipeline development and quota achievement\n\n - 5+ years of full cycle sales experience selling software or cloud based applications\n\n - Emphasis on ML, Cloud, and Infrastructure solutions\n\n - Ability to generate meetings, build your own pipeline while running strategy engagemehnts with prospects and potential customers\n\n - Experience determining customer requirements and presenting appropriate solutions\n\n - Proactive, independent thinker with high energy/positive attitude\n\n - Excellent verbal and written communication, presentation, and relationship management skillsAbility to thrive in fast-paced startup environment\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"02ed9406-2b43-4009-a80f-2dd94e2f6e96","title":" Staff Software Engineer, Platform Infrastructure (Foundations)","department":"Engineering","team":"322 Infra","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-05-04T21:36:58.957+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/02ed9406-2b43-4009-a80f-2dd94e2f6e96","applyUrl":"https://jobs.ashbyhq.com/anyscale/02ed9406-2b43-4009-a80f-2dd94e2f6e96/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
Anyscale is seeking a Staff Software Engineer to lead the technical vision for our Infrastructure team. As a Staff Engineer, you will be responsible for the architectural evolution of our control plane and data plane, ensuring that our \"infinite laptop\" vision scales to meet the most demanding distributed AI workloads in the world. You will act as a force multiplier, setting the standards for Kubernetes-based cloud-native infrastructure while mentoring engineers and driving cross-functional alignment across the Ray open-source community and our proprietary product teams.
Architectural Leadership: Define and drive the multi-year technical roadmap for services that orchestrate Ray clusters across diverse cloud and on-premises environments.
Systemic Optimization: Lead the design and optimization of high-performance control plane components specifically tailored for large-scale, heterogeneous AI/ML workloads.
Platform Reliability: Establish the organization-wide standards for the reliability, scalability, and observability of Anyscale-managed infrastructure.
Strategic Integration: Direct the long-term strategy for accelerator integration (GPUs, TPUs) and container management to ensure seamless execution of distributed workloads.
Technical Governance: Lead complex design and architecture discussions, resolving deep technical debt and ensuring engineering excellence across the organization.
Cross-Functional Influence: Partner with ML experts and customer-facing teams to translate market needs into robust infrastructure foundations.
Experience: 5+ years of experience writing high-quality production code and leading complex distributed systems projects.
Architectural Depth: Proven track record of designing and maintaining highly available, scalable, and secure cloud-native platforms (AWS, Azure, or GCP).
Kubernetes Mastery: Deep expertise in Kubernetes-based deployments and container orchestration at massive scale.
System Foundations: Advanced knowledge of Linux kernel, networking, and low-level operating system foundations.
Technical Proficiency: Mastery of Go and Python, with the ability to set coding standards and best practices for the team.
Leadership Skills: Demonstrated ability to mentor senior engineers, influence technical direction without direct authority, and navigate complex trade-offs in a fast-paced environment.
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\n\nABOUT THE ROLE\n\nAnyscale is seeking a Staff Software Engineer to lead the technical vision for our Infrastructure team. As a Staff Engineer, you will be responsible for the architectural evolution of our control plane and data plane, ensuring that our \"infinite laptop\" vision scales to meet the most demanding distributed AI workloads in the world. You will act as a force multiplier, setting the standards for Kubernetes-based cloud-native infrastructure while mentoring engineers and driving cross-functional alignment across the Ray open-source community and our proprietary product teams.\n\n \n \n\n\nKEY RESPONSIBILITIES\n\n - Architectural Leadership: Define and drive the multi-year technical roadmap for services that orchestrate Ray clusters across diverse cloud and on-premises environments.\n\n - Systemic Optimization: Lead the design and optimization of high-performance control plane components specifically tailored for large-scale, heterogeneous AI/ML workloads.\n\n - Platform Reliability: Establish the organization-wide standards for the reliability, scalability, and observability of Anyscale-managed infrastructure.\n\n - Strategic Integration: Direct the long-term strategy for accelerator integration (GPUs, TPUs) and container management to ensure seamless execution of distributed workloads.\n\n - Technical Governance: Lead complex design and architecture discussions, resolving deep technical debt and ensuring engineering excellence across the organization.\n\n - Cross-Functional Influence: Partner with ML experts and customer-facing teams to translate market needs into robust infrastructure foundations.\n\n \n \n\n\nQUALIFICATIONS\n\n - Experience: 5+ years of experience writing high-quality production code and leading complex distributed systems projects.\n\n - Architectural Depth: Proven track record of designing and maintaining highly available, scalable, and secure cloud-native platforms (AWS, Azure, or GCP).\n\n - Kubernetes Mastery: Deep expertise in Kubernetes-based deployments and container orchestration at massive scale.\n\n - System Foundations: Advanced knowledge of Linux kernel, networking, and low-level operating system foundations.\n\n - Technical Proficiency: Mastery of Go and Python, with the ability to set coding standards and best practices for the team.\n\n - Leadership Skills: Demonstrated ability to mentor senior engineers, influence technical direction without direct authority, and navigate complex trade-offs in a fast-paced environment.\n \n \n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing\n\n"},{"id":"0c2602bc-3fb7-41a0-9837-afb03f7c9503","title":"Technical Program Manager","department":"Engineering","team":"Technical Program Management","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-06-16T18:49:46.402+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/0c2602bc-3fb7-41a0-9837-afb03f7c9503","applyUrl":"https://jobs.ashbyhq.com/anyscale/0c2602bc-3fb7-41a0-9837-afb03f7c9503/application","descriptionHtml":"The Anyscale Technical Program Management (TPM) team is expected to play a critical role executing high impact programs while continuously improving processes to sustainably grow and increase the effectiveness of the Tech organization spanning Design, Engineering and Product teams.
As a Technical Program Manager focused on Anyscale’s core product solution, you’ll help lead complex application development in service of enhancing our product platform. In this role, you'll support and help scale the technical solutions that make Anyscale’s products and services possible. As part of the overall development life cycle you’ll plan requirements, identify risks, manage schedules, and communicate clearly with project stakeholders on complex projects with significant bottom line impact.
Your Program management contributions will span prioritization, planning of projects and features, stakeholder management, tracking of external commitments while contributing to the organization's technical culture by highlighting and espousing best practices. You’ll learn and grow alongside talented teammates who share your commitment to excellence and appetite for innovative problem-solving. This is a rare opportunity to join in the leadership of a team that will be responsible for building a successful commercial ML/AI oriented solution from the ground up!
As part of this role, you will:
Help us build, track and ship our Commercial / OSS product
Will work closely with the software development and product teams to deliver high quality, scalable products used by customers around the world
Collaborate with the product teams and align all the stakeholders to assemble project teams, assign responsibilities, identify appropriate resources needed, and develop schedules to ensure timely completion of projects by meeting project milestones
Assess risks, anticipate bottlenecks, provide escalation management, make tradeoffs, balance the business needs versus technical constraints and encourage risk taking behavior to maximize business benefit
Work on a diverse technology stack spanning multiple leading commercial cloud providers, big-data solutions and ML algorithms
Track programs that span multi-team and run weekly program reviews for leadership team.
We'd love to hear from you if you have:
Bachelor’s degree in Engineering or equivalent technical work experience
6+ years of technical work experience
3+ years of experience with Machine Learning projects & cloud platforms
3+ years of experience with leading enterprise SaaS organization
Strong communication skills and can effectively share your work with a broader audience through writing and speaking
Ability to handle multiple competing priorities in a fast-paced environment
A deep understanding of software development in a team, and a track record of shipping software on time
An obsession with contributing to the development of high-performance engineering organizations, are detail driven with excellent problem solving abilities
About Anyscale
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role
The Customer Engineer will play a crucial role in the customers’ post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption.
Anyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It’s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space.
In this role, you’ll be able to
Resolve customer issues and help in their successful adoption of Anyscale platform
Be a technical advisor, and internal champion for our key customers
Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution
Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets
Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution
Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc. based on observed patterns
Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience
Build and maintain strong relationships with technical stakeholders within customer accounts
Qualifications
7+ years of experience in a Machine Learning role in a dynamic, fast-paced, startup-like environment
Strong organizational skills and ability to manage multiple customer needs simultaneously
Proficient at developing data pipelines for training, fine-tuning and inference/serving of LLMs
Experience running and optimizing infrastructure for distributed ML workloads on the major cloud platforms (AWS/EKS, GCP/GKE or Azure/AKS)
Excellent communication and interpersonal skills.
Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things
Willingness to up-level the knowledge and skills of your peers through mentorship, trainings and shadowing
Bonus
Experience with Ray
Knowledge of MLOps platforms
Knowledge of container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g. Terraform), CI/CD tools (e.g. Github Actions)
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review theNotice of E-Verify Participation and theRight to Work posters in English and Spanish
","descriptionPlain":"About Anyscale\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\nAbout the role\n\nThe Customer Engineer will play a crucial role in the customers’ post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption.\n\nAnyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It’s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space.\n\nIn this role, you’ll be able to\n\n - Resolve customer issues and help in their successful adoption of Anyscale platform\n\n - Be a technical advisor, and internal champion for our key customers\n\n - Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution\n\n - Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets\n\n - Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution\n\n - Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc. based on observed patterns\n\n - Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience\n\n - Build and maintain strong relationships with technical stakeholders within customer accounts\n\nQualifications\n\n - 7+ years of experience in a Machine Learning role in a dynamic, fast-paced, startup-like environment\n\n - Strong organizational skills and ability to manage multiple customer needs simultaneously\n\n - Proficient at developing data pipelines for training, fine-tuning and inference/serving of LLMs\n\n - Experience running and optimizing infrastructure for distributed ML workloads on the major cloud platforms (AWS/EKS, GCP/GKE or Azure/AKS)\n\n - Excellent communication and interpersonal skills.\n\n - Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things\n\n - Willingness to up-level the knowledge and skills of your peers through mentorship, trainings and shadowing\n\nBonus\n\n - Experience with Ray\n\n - Knowledge of MLOps platforms\n\n - Knowledge of container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g. Terraform), CI/CD tools (e.g. Github Actions)\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.\n\nAnyscale Inc. is an E-Verify company and you may review theNotice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and theRight to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"1cf38233-8aa0-47f8-9d85-65ce27bc3047","title":"Distributed LLM Inference Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[{"location":"Palo Alto","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"Palo Alto"}}}],"publishedAt":"2026-05-27T23:45:11.194+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/1cf38233-8aa0-47f8-9d85-65ce27bc3047","applyUrl":"https://jobs.ashbyhq.com/anyscale/1cf38233-8aa0-47f8-9d85-65ce27bc3047/application","descriptionHtml":"About Anyscale
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role
As a Distributed LLM Inference Engineer, you will help systems and optimizations that push the boundaries of performance for inference at large scale. This is an incredibly critical role to Anyscale as it allows us to achieve a market leading position for AI infrastructure.
As part of this role, you will
Iterate very quickly with product teams to ship the end to end solutions for Batch and Online inference at high scale which will be used by open-source Ray users and customers of Anyscale
Work across the stack integrating Ray Data and LLM engine providing optimizations achieving low cost solutions for large scale ML inference
Integrate with Open source software like vLLM, work closely with the community to adopt these techniques in Anyscale solutions, and also contribute improvements to open source
Follow the latest state-of-the-art in the open source and the research community, implementing and extending best practices
We'd love to hear from you if you have
Familiarity with running ML inference at large scale with high throughput and low latency
Familiarity with deep learning and deep learning frameworks (e.g. PyTorch)
Solid understanding of distributed systems, ML inference challenges
Bonus points!
ML Systems knowledge
Experience using Ray
Work closely with community on LLM engines like vLLM, TensorRT-LLM
Contributions to deep learning frameworks (PyTorch, TensorFlow)
Contributions to deep learning compilers (Triton, TVM, MLIR)
Prior experience working on GPUs / CUDA
Compensation
At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. As the market data changes over time, the target salary for this role may be adjusted.
This role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following:
Stock Options
Healthcare plans, with premiums covered by Anyscale at 99% for both employees and dependents
401k Retirement Plan
Education & Wellbeing Stipend
Paid Parental Leave
Fertility Benefits
Paid Time Off
Commute reimbursement
100% of in-office meals covered
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\n\nAbout the role\n\nAs a Distributed LLM Inference Engineer, you will help systems and optimizations that push the boundaries of performance for inference at large scale. This is an incredibly critical role to Anyscale as it allows us to achieve a market leading position for AI infrastructure.\n\n\n\n\n\nAs part of this role, you will\n\n - Iterate very quickly with product teams to ship the end to end solutions for Batch and Online inference at high scale which will be used by open-source Ray users and customers of Anyscale\n\n - Work across the stack integrating Ray Data and LLM engine providing optimizations achieving low cost solutions for large scale ML inference \n\n - Integrate with Open source software like vLLM, work closely with the community to adopt these techniques in Anyscale solutions, and also contribute improvements to open source\n\n - Follow the latest state-of-the-art in the open source and the research community, implementing and extending best practices\n\n\n\n\n\nWe'd love to hear from you if you have\n\n - Familiarity with running ML inference at large scale with high throughput and low latency\n\n - Familiarity with deep learning and deep learning frameworks (e.g. PyTorch)\n\n - Solid understanding of distributed systems, ML inference challenges\n\n\n\n\n\nBonus points!\n\n - ML Systems knowledge\n\n - Experience using Ray \n\n - Work closely with community on LLM engines like vLLM, TensorRT-LLM\n\n - Contributions to deep learning frameworks (PyTorch, TensorFlow)\n\n - Contributions to deep learning compilers (Triton, TVM, MLIR)\n\n - Prior experience working on GPUs / CUDA\n\n\n\nCompensation\n\nAt Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. As the market data changes over time, the target salary for this role may be adjusted.\n\nThis role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following:\n\n - Stock Options\n\n - Healthcare plans, with premiums covered by Anyscale at 99% for both employees and dependents\n\n - 401k Retirement Plan\n\n - Education & Wellbeing Stipend\n\n - Paid Parental Leave\n\n - Fertility Benefits\n\n - Paid Time Off\n\n - Commute reimbursement\n\n - 100% of in-office meals covered\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing\n\n"},{"id":"23733eb9-f839-4209-b191-36cb0ff5b973","title":"Senior Site Reliability Engineer, Platform Infrastructure (Foundations)","department":"Engineering","team":"322 Infra","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[{"location":"Palo Alto","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"Palo Alto"}}}],"publishedAt":"2026-06-17T22:03:24.050+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/23733eb9-f839-4209-b191-36cb0ff5b973","applyUrl":"https://jobs.ashbyhq.com/anyscale/23733eb9-f839-4209-b191-36cb0ff5b973/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role:
Anyscale is looking for a Senior Site Reliability Engineer to join the Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the Infra team, we build the scalable, secure, and robust backbone that enables this vision.
Our team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads.
We are seeking a talented engineers with a strong background in control plane and data plane development, along with expertise in Kubernetes, container orchestration, and cloud-native infrastructure. You will play a crucial role in designing, implementing, and optimizing the critical infrastructure that powers Anyscale’s cloud platform.
You will have the opportunity to work on open-source Ray, contribute to our infinite laptop proprietary product, and develop seamless integration between the two, while also delivering high-impact features for our customers.
A snapshot of projects you may work on
Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments
Optimize control plane components for large-scale, distributed AI/ML workloads
Build intelligent scheduling and resource management systems for heterogeneous compute clusters
Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
Support and optimize accelerator integration (e.g., GPUs, TPUs).
Handle container image management and dependency resolution for distributed workloads
Participate in code reviews, design and architecture discussions
Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues
Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure
We'd love to hear from you if have
Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
3+ years of experience writing high-quality production code
Hands-on experience in building and maintaining highly available, scalable, and performant distributed system
Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
Deep understanding of networking, security, and authentication mechanisms in cloud environment
Familiarity with observability stacks (Prometheus, Grafana etc)
Proficiency in Go and Python
Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\nAbout the role:\n\nAnyscale is looking for a Senior Site Reliability Engineer to join the Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the Infra team, we build the scalable, secure, and robust backbone that enables this vision.\n\n\n\nOur team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads.\n\n\n\nWe are seeking a talented engineers with a strong background in control plane and data plane development, along with expertise in Kubernetes, container orchestration, and cloud-native infrastructure. You will play a crucial role in designing, implementing, and optimizing the critical infrastructure that powers Anyscale’s cloud platform.\n\n\n\nYou will have the opportunity to work on open-source Ray, contribute to our infinite laptop proprietary product, and develop seamless integration between the two, while also delivering high-impact features for our customers.\n\n\n\nA snapshot of projects you may work on\n\n - Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments\n\n - Optimize control plane components for large-scale, distributed AI/ML workloads\n\n - Build intelligent scheduling and resource management systems for heterogeneous compute clusters\n\n - Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads\n\n - Support and optimize accelerator integration (e.g., GPUs, TPUs).\n\n - Handle container image management and dependency resolution for distributed workloads\n\n - Participate in code reviews, design and architecture discussions\n\n - Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues\n\n - Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure\n\n\n\n\n\nWe'd love to hear from you if have\n\n - Bachelor's degree in Computer Science, Engineering, or equivalent practical experience\n\n - 3+ years of experience writing high-quality production code\n\n - Hands-on experience in building and maintaining highly available, scalable, and performant distributed system\n\n - Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments\n\n - Deep understanding of networking, security, and authentication mechanisms in cloud environment\n\n - Familiarity with observability stacks (Prometheus, Grafana etc)\n\n - Proficiency in Go and Python\n\n - Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)\n\n\n\n\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"2d76cfa2-f857-42b2-9c74-c07beca01458","title":"Software Engineer, Ray Data","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"Bengaluru, Karnataka","secondaryLocations":[],"publishedAt":"2025-09-10T02:25:20.496+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/2d76cfa2-f857-42b2-9c74-c07beca01458","applyUrl":"https://jobs.ashbyhq.com/anyscale/2d76cfa2-f857-42b2-9c74-c07beca01458/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role:
Ray aims to provide a universal API for building distributed applications (e.g. a machine learning pipeline of feature engineering, model training, and evaluation). Data is usually a core element connecting these different stages, and therefore plays a critical role in Ray’s usability, performance, and stability. We are looking for strong engineers to build, optimize, and scale Ray’s Datasets library and data processing capabilities in general.
About the Ray Data team:
The Ray Data team currently develops and maintains the Ray Datasets library, which is already powering critical production use cases (e.g. large scale data compaction at Amazon, and ML pipeline at Alibaba). Ray Datasets is a Python library built on top of Apache Arrow and Ray Core (Ray’s C++ backend), and the Ray Data team interacts closely with Ray Core components including the scheduler and the memory & I/O subsystems. The Ray Data team also works closely with Ray’s ML libraries including Train, RLlib, and Serve.
A snapshot of projects you will work on:
- Performance of Ray Datasets at large scale (leveraging Arrow primitives, optimizing Ray object manager, etc.)
- Integration with ML training and data sources
- Stability and stress testing infrastructure
- Lead future work integrating streaming workloads into Ray such as Beam on Ray
- Differentiate Data operations in Anyscale hosted Ray service
As part of this role, you will:
Develop high quality open source software to simplify distributed programming (Ray)
Identify, implement, and evaluate architectural improvements to Ray core and Datasets
Improve the testing process for Ray to make releases as smooth as possible
Communicate your work to a broader audience through talks, tutorials, and blog posts
We'd love to hear from you if have:
At least 5 years of relevant work experience
Solid background in algorithms, data structures, system design
Experience in building scalable and fault-tolerant distributed systems
Experience with data processing, database internals including Spark or Dask (streaming is a plus)
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\n\nAbout the role:\n\nRay aims to provide a universal API for building distributed applications (e.g. a machine learning pipeline of feature engineering, model training, and evaluation). Data is usually a core element connecting these different stages, and therefore plays a critical role in Ray’s usability, performance, and stability. We are looking for strong engineers to build, optimize, and scale Ray’s Datasets https://docs.ray.io/en/latest/data/dataset.html library and data processing capabilities in general.\n\n\n\nAbout the Ray Data team:\n\n\n\nThe Ray Data team currently develops and maintains the Ray Datasets https://docs.ray.io/en/latest/data/dataset.html library, which is already powering critical production use cases (e.g. large scale data compaction at Amazon https://www.anyscale.com/events/2022/01/20/ray-meetup-is-back-in-the-new-year-2022, and ML pipeline at Alibaba https://www.anyscale.com/blog/building-an-end-to-end-ml-pipeline-using-mars-and-xgboost-on-ray). Ray Datasets is a Python library built on top of Apache Arrow and Ray Core (Ray’s C++ backend), and the Ray Data team interacts closely with Ray Core components including the scheduler and the memory & I/O subsystems. The Ray Data team also works closely with Ray’s ML libraries including Train, RLlib, and Serve.\n\n\n\nA snapshot of projects you will work on:\n\n- Performance of Ray Datasets https://docs.ray.io/en/latest/data/dataset.html at large scale (leveraging Arrow primitives, optimizing Ray object manager, etc.)\n\n- Integration with ML training and data sources\n\n- Stability and stress testing infrastructure\n\n- Lead future work integrating streaming workloads into Ray such as Beam on Ray\n\n- Differentiate Data operations in Anyscale hosted Ray service\n\n\n\n\n\nAs part of this role, you will:\n\n - Develop high quality open source software to simplify distributed programming (Ray)\n\n - Identify, implement, and evaluate architectural improvements to Ray core and Datasets\n\n - Improve the testing process for Ray to make releases as smooth as possible\n\n - Communicate your work to a broader audience through talks, tutorials, and blog posts\n\n\n\n\n\nWe'd love to hear from you if have:\n\n - At least 5 years of relevant work experience\n\n - Solid background in algorithms, data structures, system design\n\n - Experience in building scalable and fault-tolerant distributed systems\n\n - Experience with data processing, database internals including Spark or Dask (streaming is a plus)\n \n \n\n\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"2fe9a481-4c31-4652-82f9-56ce0f34e64e","title":"Recruiting Coordinator ","department":"General & Administrative","team":"760 Recruiting","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-10T17:25:00.930+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/2fe9a481-4c31-4652-82f9-56ce0f34e64e","applyUrl":"https://jobs.ashbyhq.com/anyscale/2fe9a481-4c31-4652-82f9-56ce0f34e64e/application","descriptionHtml":"At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
We're looking for a Recruiting Coordinator to be the operational engine behind our hiring process. You'll own interview scheduling and logistics, ensure a smooth and delightful candidate experience, and support our recruiters and hiring teams to keep the hiring process moving efficiently.
Own end-to-end interview scheduling and logistics across multiple roles and time zones
Be a primary point of contact for candidates, ensuring a warm, professional, and well-communicated experience
Coordinate onsite/virtual interview loops, including prep for interviewers and candidates
Maintain accurate and up-to-date candidate records in the ATS
Support offer logistics and background check processes
Identify opportunities to improve recruiting workflows and candidate experience
Partner closely with recruiters and hiring managers to keep hiring processes on track
1–3 years of experience in recruiting coordination, HR, or a related operations role
Excellent organizational skills and attention to detail
Strong communication skills and a service-oriented mindset
Ability to manage multiple priorities and calendars in a fast-paced environment
Experience with Ashby
We believe in transparent pay practices. The anticipated base salary range for this role is $100,000 - $120,000 annually. Final salary depends on experience, relevant skills, qualifications, and market considerations. In addition to base pay, eligible employees receive equity awards and enjoy a comprehensive benefits package designed to support their health, well-being, and financial future.
We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
We offer flexible time off, paid parental leave, and mental health support
About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role:
Anyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the Infra team, we build the scalable, secure, and robust backbone that enables this vision.
Our team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads.
We are seeking a talented Software Engineer with a strong background in control plane and data plane development, along with expertise in Kubernetes, container orchestration, and cloud-native infrastructure. You will play a crucial role in designing, implementing, and optimizing the critical infrastructure that powers Anyscale’s cloud platform.
You will have the opportunity to work on open-source Ray, contribute to our infinite laptop proprietary product, and develop seamless integration between the two, while also delivering high-impact features for our customers.
A snapshot of projects you may work on
Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments
Optimize control plane components for large-scale, distributed AI/ML workloads
Build intelligent scheduling and resource management systems for heterogeneous compute clusters
Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
Support and optimize accelerator integration (e.g., GPUs, TPUs).
Handle container image management and dependency resolution for distributed workloads
Participate in code reviews, design and architecture discussions
Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues
Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure
We'd love to hear from you if have
Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
3+ years of experience writing high-quality production code
Hands-on experience in building and maintaining highly available, scalable, and performant distributed system
Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
Deep understanding of networking, security, and authentication mechanisms in cloud environment
Familiarity with observability stacks (Prometheus, Grafana etc)
Proficiency in Go and Python
Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\nAbout the role:\n\nAnyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the Infra team, we build the scalable, secure, and robust backbone that enables this vision.\n\n\n\nOur team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads.\n\n\n\nWe are seeking a talented Software Engineer with a strong background in control plane and data plane development, along with expertise in Kubernetes, container orchestration, and cloud-native infrastructure. You will play a crucial role in designing, implementing, and optimizing the critical infrastructure that powers Anyscale’s cloud platform.\n\n\n\nYou will have the opportunity to work on open-source Ray, contribute to our infinite laptop proprietary product, and develop seamless integration between the two, while also delivering high-impact features for our customers.\n\n\n\nA snapshot of projects you may work on\n\n - Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments\n\n - Optimize control plane components for large-scale, distributed AI/ML workloads\n\n - Build intelligent scheduling and resource management systems for heterogeneous compute clusters\n\n - Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads\n\n - Support and optimize accelerator integration (e.g., GPUs, TPUs).\n\n - Handle container image management and dependency resolution for distributed workloads\n\n - Participate in code reviews, design and architecture discussions\n\n - Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues\n\n - Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure\n\n\n\n\n\nWe'd love to hear from you if have\n\n - Bachelor's degree in Computer Science, Engineering, or equivalent practical experience\n\n - 3+ years of experience writing high-quality production code\n\n - Hands-on experience in building and maintaining highly available, scalable, and performant distributed system\n\n - Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments\n\n - Deep understanding of networking, security, and authentication mechanisms in cloud environment\n\n - Familiarity with observability stacks (Prometheus, Grafana etc)\n\n - Proficiency in Go and Python\n\n - Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)\n\n\n\n\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"469054d6-da2d-4945-8ea1-63ff5bc8007e","title":"Head of Customer Engineering ","department":"Customer Solutions Group","team":"Customer Solutions Group","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-03T00:09:02.669+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/469054d6-da2d-4945-8ea1-63ff5bc8007e","applyUrl":"https://jobs.ashbyhq.com/anyscale/469054d6-da2d-4945-8ea1-63ff5bc8007e/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role
Anyscale is looking for an experienced and hands-on engineering leader to lead our Customer Engineering team. This is a critical leadership role within our Go-To-Market organization, responsible for delivering exceptional technical support while helping ensure customer experiences directly influence the evolution of our platform.
You will lead a highly technical team responsible for supporting customers running production AI workloads on Anyscale. Your team will resolve complex technical issues, manage customer escalations, and partner closely with Product and Engineering to ensure customer feedback is translated into meaningful product improvements.
Success in this role requires balancing operational excellence with strong technical leadership. Beyond resolving individual customer issues, you will help the team identify recurring patterns, improve support workflows, expand customer self-service, and leverage automation, diagnostics, and engineering best practices to improve both the customer experience and the product over time. As opportunities arise, your team may also contribute tooling, documentation, automation, or occasional product fixes that help eliminate recurring sources of customer friction.
This role is ideal for someone who enjoys leading highly technical engineers, working closely with customers, and partnering across Engineering and Product to continuously improve how customers adopt and operate AI infrastructure at scale.
You'll be responsible for
Lead a high-performing Customer Engineering team responsible for technical support, customer escalations, and technical issue resolution.
Own the operational health of the Customer Engineering team, including customer satisfaction, support quality, response times, and engineering effectiveness.
Coach and mentor a team of highly technical engineers, fostering a culture of customer focus, technical excellence, collaboration, and continuous improvement.
Build robust reporting and analytics to identify recurring customer challenges, measure operational performance, and drive continuous improvement.
Partner closely with Product Management and Engineering to communicate customer pain points, identify systemic issues, and influence product improvements based on customer feedback.
Guide the team through complex debugging, root-cause analysis, and customer escalations involving distributed systems, cloud infrastructure, and AI workloads.
Drive initiatives that reduce repeat customer issues through improved documentation, diagnostics, automation, operational improvements, and customer enablement.
Encourage the team to contribute tooling, automation, documentation, and, where appropriate, product improvements that reduce long-term customer friction.
Contribute as a key member of the Field and Customer Engineering leadership team, helping shape Anyscale's customer experience strategy.
We'd love to hear from you if you have
8+ years of engineering experience, including 3–5+ years leading Support Engineering, Customer Engineering, Developer Support, Site Reliability Engineering, or related technical teams.
Experience leading customer-facing engineering teams in a high-growth SaaS or infrastructure software company.
Strong technical background with experience supporting cloud infrastructure, distributed systems, Kubernetes, AI/ML platforms, or developer infrastructure.
Demonstrated success improving the effectiveness of technical customer organizations through operational improvements, technical leadership, and strong cross-functional partnerships.
Experience partnering closely with Product Management and Engineering to communicate customer needs and influence product improvements.
Strong understanding of operational metrics and experience using data to improve customer outcomes and team performance.
Exceptional communication skills, with the ability to work effectively with customers, executives, product managers, and engineers.
Demonstrated success leading teams through complex customer escalations and technical problem solving.
Entrepreneurial mindset with a strong sense of ownership, pragmatism, and bias for execution.
Bonus points if
You've led a Support Engineering, Customer Engineering, Developer Experience, or Site Reliability Engineering team.
You have experience contributing software, tooling, automation, or diagnostics while working in a customer-facing engineering organization.
You have experience with Ray or other distributed computing frameworks.
You have experience supporting AI/ML infrastructure or modern cloud platforms.
You've worked at a Series C or Series D startup.
You have experience working with open-source communities or partnering closely with engineering teams to improve products based on customer feedback.
Why Anyscale
Lead a talented team solving some of the most challenging technical problems in AI infrastructure and distributed computing.
Help shape how customers successfully deploy and operate AI applications at scale.
Partner closely with Product and Engineering to ensure customer feedback directly influences the evolution of the platform.
Join a collaborative engineering culture that values technical excellence, customer obsession, and continuous learning.
Be part of a high-growth company building the infrastructure powering the next generation of AI applications.
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role:
As a Forward Deployed Engineer - AI/ML Platforms at Anyscale, you’ll partner with some of the world’s most sophisticated AI organizations to design, deploy, and operate the infrastructure powering their production AI workloads.
In this role you will work directly with customer platform, infrastructure, and ML engineering teams to solve complex technical challenges. You will help customers build scalable AI platforms, modernize ML infrastructure, and operationalize distributed AI applications on Ray and the Anyscale platform.
You will combine deep cloud infrastructure expertise with strong customer engagement skills, serving as both a trusted technical advisor and a hands-on engineer. You will work closely with customer teams throughout implementation, from architecture and deployment through production operations. Your work will provide feedback that directly influences the evolution of the Anyscale platform.
In this role, you will:
Design and implement production-grade AI platform architectures on Kubernetes and public cloud infrastructure (AWS, Azure, and GCP).
Partner directly with customer platform, infrastructure, and ML engineering teams to deploy, operate, and optimize distributed AI workloads.
Lead implementation engagements that include platform installation, networking, security, observability, scaling, upgrades, and operational readiness.
Troubleshoot complex distributed systems issues spanning infrastructure, Kubernetes, networking, storage, and AI applications.
Develop automation, tooling, reference implementations, and infrastructure-as-code that accelerate customer success and improve repeatability.
Build trusted relationships with technical leaders, platform teams, and executive stakeholders, translating business objectives into robust technical solutions.
Collaborate closely with Product and Engineering to communicate customer requirements, identify product improvements, and shape future platform capabilities.
Share best practices through technical documentation, architecture guidance, workshops, and enablement.
We'd love to hear from you if you have:
5+ years of experience in cloud infrastructure, platform engineering, DevOps, Site Reliability Engineering, or software engineering.
Experience building, deploying, or operating ML/AI platforms that support model training, inference, or large-scale data processing workloads.
Strong expertise with Kubernetes and containerized production environments.
Experience operating cloud infrastructure on AWS, Azure, or GCP, including networking, security, IAM, storage, and infrastructure automation.
Experience with Infrastructure as Code and modern DevOps tooling such as Terraform, Helm, GitOps, CI/CD pipelines, or similar technologies.
Strong software engineering skills in Python, Go, Java, or a comparable language, with experience building automation or production services.
Experience working directly with enterprise customers in consulting, professional services, field engineering, solutions architecture, or another customer-facing engineering role.
Excellent communication skills and the ability to work effectively with both executive and deeply technical stakeholders.
Familiarity with distributed computing frameworks such as Ray, Spark, Dask, or Kubernetes-native distributed systems is a strong plus.
A passion for solving difficult customer problems and building reusable technical solutions.
Willingness to travel as needed to work alongside strategic customers.
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role:
As a Forward Deployed Engineer at Anyscale, you will partner directly with our most strategic customers, including Spanish-speaking customers across Latin America and other regions, to ensure they achieve meaningful business outcomes with Ray and the Anyscale platform. Embedded within customer teams, you’ll act as a trusted advisor, aligning technical solutions with customer priorities, accelerating time-to-value, and driving adoption at scale.
You’ll work across customer organizations — from technical leadership to individual contributors — to scope and deliver impactful solutions. By connecting insights from the field back to our product and engineering teams, you’ll help shape Anyscale’s roadmap and ensure we remain focused on solving our customers’ most critical challenges.
In this role, you will:
Work onsite with key customers to lead proof-of-value engagements, deployments, and enterprise adoption
Translate business objectives into technical solutions that demonstrate clear ROI and strategic impact
Build and deliver high-impact demos, reference architectures, and enablement programs tailored to customer needs
Act as a trusted advisor across all levels of the organization, ensuring confidence in Anyscale and Ray
Collaborate closely with sales, product, and engineering to accelerate deals, unblock challenges, and drive long-term success
Provide structured feedback from customer engagements to influence product direction and go-to-market strategy
We’d love to hear from you if you have:
Fluency in Spanish and English is required, with the ability to work directly with Spanish-speaking technical and executive stakeholders
5+ years of customer-facing experience in forward deployed engineering, solutions architecture, field engineering, or software engineering
Strong technical foundation with Ray, or the demonstrated ability to ramp quickly and apply Ray to real-world use cases
Hands-on experience with ML training and inference workloads, including distributed training, model serving, and the performance and cost tradeoffs involved
Working knowledge of Kubernetes and container orchestration, including deploying and operating workloads in Kubernetes-based environments
Proven success driving enterprise adoption of complex SaaS, infrastructure, or ML/AI solutions
Experience engaging both executive and technical stakeholders, tailoring communication to each audience
A customer-first mindset with a track record of delivering measurable business impact
Willingness to travel frequently and spend extended time embedded with customers
Anyscale is seeking a Senior / Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI workloads.
This is a uniquely challenging role that requires balancing open source growth with commercial differentiation - driving rapid adoption in the open source Ray Data ecosystem while building compelling proprietary features for Anyscale RunTime, our high-performance commercial engine.
You'll own the entire Ray Data product roadmap in a competitive landscape, working closely with the engineering team, the field team, enterprise customers, and the open source community. Success requires:
Deeply ingraining yourself into the end-user experience to understand the nature of the product and its gaps and tradeoffs
Working closely with customers and open source users to draw the subtle line between growth and commercialization
Strategic thinking about which parts of the ML/Data lifecycle to focus on, identifying opportunities where our architectural strengths create the most value.
Thinking deeply about and clearly articulating the product strategy to stakeholders
Drive the Ray Data product roadmap - Balance open source Ray Data feature development with Anyscale Runtime commercial differentiation to ensure that both Ray Data becomes the open source standard for AI data processing and Anyscale Runtime remains sufficiently compelling.
Drive open source Ray Data adoption - Focus on community growth, developer experience, and ecosystem integrations
Market Positioning & Enablement - Work closely with Product Marketing on strategic market positioning, field enablement, and competitive analysis to maintain differentiation.
Customer engagement - Drive key customer engagements assisting sales and field engineering teams.
4+ years of product management experience with technical products
Strong technical background in distributed systems, ML infrastructure, or data processing
Experience working with developer and enterprise audiences
Strategic thinking with ability to balance competing priorities and stakeholder needs
Located in or willing to relocate to the Bay Area
Prior experience with open source products and commercial monetization strategies
Background in ML tooling, data infrastructure, or developer tools
Ray Data is a scalable data processing library built on Ray Core that provides flexible and performant APIs for distributed data processing. It enables offline batch inference and data preprocessing for ML training, scaling data processing to large clusters while maintaining ease of use for developers.
","descriptionPlain":"ABOUT THE ROLE\n\nAnyscale is seeking a Senior / Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI workloads.\n\nThis is a uniquely challenging role that requires balancing open source growth with commercial differentiation - driving rapid adoption in the open source Ray Data ecosystem while building compelling proprietary features for Anyscale RunTime, our high-performance commercial engine.\n\nYou'll own the entire Ray Data product roadmap in a competitive landscape, working closely with the engineering team, the field team, enterprise customers, and the open source community. Success requires:\n\n - Deeply ingraining yourself into the end-user experience to understand the nature of the product and its gaps and tradeoffs\n\n - Working closely with customers and open source users to draw the subtle line between growth and commercialization\n\n - Strategic thinking about which parts of the ML/Data lifecycle to focus on, identifying opportunities where our architectural strengths create the most value.\n\n - Thinking deeply about and clearly articulating the product strategy to stakeholders\n\n\nKEY RESPONSIBILITIES\n\n - Drive the Ray Data product roadmap - Balance open source Ray Data feature development with Anyscale Runtime commercial differentiation to ensure that both Ray Data becomes the open source standard for AI data processing and Anyscale Runtime remains sufficiently compelling.\n\n - Drive open source Ray Data adoption - Focus on community growth, developer experience, and ecosystem integrations\n\n - Market Positioning & Enablement - Work closely with Product Marketing on strategic market positioning, field enablement, and competitive analysis to maintain differentiation.\n\n - Customer engagement - Drive key customer engagements assisting sales and field engineering teams.\n\n\nREQUIRED QUALIFICATIONS\n\n - 4+ years of product management experience with technical products\n\n - Strong technical background in distributed systems, ML infrastructure, or data processing\n\n - Experience working with developer and enterprise audiences\n\n - Strategic thinking with ability to balance competing priorities and stakeholder needs\n\n - Located in or willing to relocate to the Bay Area\n\n\nPREFERRED QUALIFICATIONS\n\n - Prior experience with open source products and commercial monetization strategies\n\n - Background in ML tooling, data infrastructure, or developer tools\n\n\nABOUT RAY DATA\n\nRay Data is a scalable data processing library built on Ray Core that provides flexible and performant APIs for distributed data processing. It enables offline batch inference and data preprocessing for ML training, scaling data processing to large clusters while maintaining ease of use for developers."},{"id":"73a973b1-6377-4144-a6e5-610b78719882","title":"Software Engineer (Ray Core)","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[{"location":"Palo Alto","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"Palo Alto"}}}],"publishedAt":"2026-05-14T20:19:28.935+00:00","isListed":true,"isRemote":true,"workplaceType":"Hybrid","address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/73a973b1-6377-4144-a6e5-610b78719882","applyUrl":"https://jobs.ashbyhq.com/anyscale/73a973b1-6377-4144-a6e5-610b78719882/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role
Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend.
About the Ray Core Team
The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray.
A snapshot of projects you can work on:
Optimizing performance of large-scale workloads on Ray
Stability and stress testing infrastructure
Improving fault tolerance (HA)
As part of this role, you will:
Leading cross-team projects while mentoring junior team members
Develop high quality open source software to simplify distributed programming (Ray)
Identify, implement, and evaluate architectural improvements to Ray core
Improve the testing process for Ray to make releases as smooth as possible
Communicate your work to a broader audience through talks, tutorials, and blog posts
We'd love to hear from you if you have:
At least 5 year of relevant work experience
Experience in building scalable and fault-tolerant distributed systems
Extensive experience working in C/C++ and on low level operating systems
Solid background in algorithms, data structures, system design
Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred
Knowledge of GPU programming is preferred
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\nAbout the role\n\nRay aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend.\n\n\n\n\nAbout the Ray Core Team\n\nThe Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray.\n\n\n\nA snapshot of projects you can work on:\n\n - Optimizing performance of large-scale workloads on Ray\n\n - Stability and stress testing infrastructure\n\n - Improving fault tolerance (HA)\n\n\n\nAs part of this role, you will:\n\n - Leading cross-team projects while mentoring junior team members\n\n - Develop high quality open source software to simplify distributed programming (Ray)\n\n - Identify, implement, and evaluate architectural improvements to Ray core\n\n - Improve the testing process for Ray to make releases as smooth as possible\n\n - Communicate your work to a broader audience through talks, tutorials, and blog posts\n\n\n\n\n\nWe'd love to hear from you if you have:\n\n - At least 5 year of relevant work experience\n\n - Experience in building scalable and fault-tolerant distributed systems\n\n - Extensive experience working in C/C++ and on low level operating systems\n\n - Solid background in algorithms, data structures, system design\n\n - Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred\n\n - Knowledge of GPU programming is preferred\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"8691daef-bfe5-4d01-871f-cf2226ba0c82","title":"Software Engineer, Infrastructure","department":"Engineering","team":"Foundations","employmentType":"FullTime","location":"San Francisco or Palo Alto, CA","secondaryLocations":[],"publishedAt":"2026-07-10T18:05:49.429+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/8691daef-bfe5-4d01-871f-cf2226ba0c82","applyUrl":"https://jobs.ashbyhq.com/anyscale/8691daef-bfe5-4d01-871f-cf2226ba0c82/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role
Anyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the Infra team, we build the scalable, secure, and robust backbone that enables this vision.
Our team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads.
We are seeking a talented Software Engineer with a strong background in control plane and data plane development, along with expertise in Kubernetes, container orchestration, and cloud-native infrastructure. You will play a crucial role in designing, implementing, and optimizing the critical infrastructure that powers Anyscale’s cloud platform.
You will have the opportunity to work on open-source Ray, contribute to our infinite laptop proprietary product, and develop seamless integration between the two, while also delivering high-impact features for our customers.
A snapshot of projects you may work on
Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments
Optimize control plane components for large-scale, distributed AI/ML workloads
Build intelligent scheduling and resource management systems for heterogeneous compute clusters
Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
Support and optimize accelerator integration (e.g., GPUs, TPUs).
Handle container image management and dependency resolution for distributed workloads
Participate in code reviews, design and architecture discussions
Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues
Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure
We'd love to hear from you if have
Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
3+ years of experience writing high-quality production code
Hands-on experience in building and maintaining highly available, scalable, and performant distributed system
Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
Deep understanding of networking, security, and authentication mechanisms in cloud environment
Familiarity with observability stacks (Prometheus, Grafana etc)
Proficiency in Go and Python
Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\n\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\n\nAbout the role\n\n\n\n\nAnyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the Infra team, we build the scalable, secure, and robust backbone that enables this vision.\n\n\n\n\nOur team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads.\n\n\n\n\nWe are seeking a talented Software Engineer with a strong background in control plane and data plane development, along with expertise in Kubernetes, container orchestration, and cloud-native infrastructure. You will play a crucial role in designing, implementing, and optimizing the critical infrastructure that powers Anyscale’s cloud platform.\n\n\n\n\nYou will have the opportunity to work on open-source Ray, contribute to our infinite laptop proprietary product, and develop seamless integration between the two, while also delivering high-impact features for our customers.\n\n\n\nA snapshot of projects you may work on\n\n - Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments\n\n - Optimize control plane components for large-scale, distributed AI/ML workloads\n\n - Build intelligent scheduling and resource management systems for heterogeneous compute clusters\n\n - Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads\n\n - Support and optimize accelerator integration (e.g., GPUs, TPUs).\n\n - Handle container image management and dependency resolution for distributed workloads\n\n - Participate in code reviews, design and architecture discussions\n\n - Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues\n\n - Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure\n\n\n\nWe'd love to hear from you if have\n\n - Bachelor's degree in Computer Science, Engineering, or equivalent practical experience\n\n - 3+ years of experience writing high-quality production code\n\n - Hands-on experience in building and maintaining highly available, scalable, and performant distributed system\n\n - Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments\n\n - Deep understanding of networking, security, and authentication mechanisms in cloud environment\n\n - Familiarity with observability stacks (Prometheus, Grafana etc)\n\n - Proficiency in Go and Python\n\n - Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"8b29c5e5-d56f-4c52-8887-a6a1827cf042","title":"Software Engineer, Ray Core","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"Bengaluru, Karnataka","secondaryLocations":[],"publishedAt":"2025-10-06T15:56:30.558+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/8b29c5e5-d56f-4c52-8887-a6a1827cf042","applyUrl":"https://jobs.ashbyhq.com/anyscale/8b29c5e5-d56f-4c52-8887-a6a1827cf042/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About the role
Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend.
About the Ray Core Team
The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray.
A snapshot of projects you can work on:
- Optimizing performance of large-scale workloads on Ray
- Stability and stress testing infrastructure
- Improving fault tolerance (HA)
As part of this role, you will:
Develop high quality open source software to simplify distributed programming (Ray)
Identify, implement, and evaluate architectural improvements to Ray core
Improve the testing process for Ray to make releases as smooth as possible
Communicate your work to a broader audience through talks, tutorials, and blog posts
We'd love to hear from you if have:
At least 2 year of relevant work experience
Solid background in algorithms, data structures, system design
Experience in building scalable and fault-tolerant distributed systems
Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred
Knowledge of GPU programming is preferred
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\n\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\n\nAbout the role\n\nRay aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend.\n\n\n\n\nAbout the Ray Core Team\n\nThe Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray.\n\n\n\n\nA snapshot of projects you can work on:\n\n- Optimizing performance of large-scale workloads on Ray\n\n- Stability and stress testing infrastructure\n\n- Improving fault tolerance (HA)\n\n\n\nAs part of this role, you will:\n\n - Develop high quality open source software to simplify distributed programming (Ray)\n\n - Identify, implement, and evaluate architectural improvements to Ray core\n\n - Improve the testing process for Ray to make releases as smooth as possible\n\n - Communicate your work to a broader audience through talks, tutorials, and blog posts\n\n\n\nWe'd love to hear from you if have:\n\n - At least 2 year of relevant work experience\n\n - Solid background in algorithms, data structures, system design\n\n - Experience in building scalable and fault-tolerant distributed systems\n\n - Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred\n\n - Knowledge of GPU programming is preferred\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"a83ce0ba-44ab-4d81-9c8c-bfda757377cd","title":"Software Engineer (Ray Data)","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-10T19:25:51.779+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/a83ce0ba-44ab-4d81-9c8c-bfda757377cd","applyUrl":"https://jobs.ashbyhq.com/anyscale/a83ce0ba-44ab-4d81-9c8c-bfda757377cd/application","descriptionHtml":"About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
About Ray Data Team:
Ray Data is Python-native data processing engine that is a one stop shop for all AI data processing needs. Ray Data provides performant, first-class integration with cutting edge AI frameworks using both multi-modal and structured data.
The Ray Data team currently develops and maintains Ray Data. We are a team of engineers passionate about building a Data processing engine which is a one-stop shop for all of your ML/AI needs. We are looking for exceptional engineers to build, optimize, and scale Ray for modern and increasingly complex AI workloads.
As part of this role, you will:
Improve the performance of Ray Data and multi-modal batch inference use cases.
Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.
Building data loading solutions for production training workloads.
Focus on stability and fault tolerance at high scale
Working with customers and new age AI native companies in scaling their AI workloads.
We'd love to hear from you if have:
At least 3-4 years of relevant work experience
Solid background in building scalable and fault-tolerant distributed systems
Experience with data processing, database internals.
Passionate about large scale systems and performance for AI.
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\nAt Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.\n\n\n\nAbout Ray Data Team:\n\n\n\nRay Data https://docs.ray.io/en/latest/data/dataset.html is Python-native data processing engine that is a one stop shop for all AI data processing needs. Ray Data provides performant, first-class integration with cutting edge AI frameworks using both multi-modal and structured data.\n\n\n\nThe Ray Data team currently develops and maintains Ray Data https://docs.ray.io/en/latest/data/dataset.html. We are a team of engineers passionate about building a Data processing engine which is a one-stop shop for all of your ML/AI needs. We are looking for exceptional engineers to build, optimize, and scale Ray for modern and increasingly complex AI workloads.\n\n\n\nAs part of this role, you will:\n\n - Improve the performance of Ray Data https://docs.ray.io/en/latest/data/dataset.html and multi-modal batch inference use cases.\n\n - Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.\n\n - Building data loading solutions for production training workloads.\n\n - Focus on stability and fault tolerance at high scale\n\n - Working with customers and new age AI native companies in scaling their AI workloads.\n\nWe'd love to hear from you if have:\n\n\n\n - At least 3-4 years of relevant work experience\n\n - Solid background in building scalable and fault-tolerant distributed systems\n\n - Experience with data processing, database internals.\n\n - Passionate about large scale systems and performance for AI.\n\n\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing\n\n"},{"id":"afdb934e-8b40-4f44-a572-7301e842a18f","title":"Senior Recruiter ","department":"General & Administrative","team":"760 Recruiting","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-10T17:05:25.123+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/afdb934e-8b40-4f44-a572-7301e842a18f","applyUrl":"https://jobs.ashbyhq.com/anyscale/afdb934e-8b40-4f44-a572-7301e842a18f/application","descriptionHtml":"At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
We're hiring a Recruiter to help us find and close exceptional talent. You'll own full-cycle recruiting for a portfolio of roles, partnering closely with hiring managers to build strong pipelines, deliver a great candidate experience, and help us hire efficiently as we scale.
Manage full-cycle recruiting: sourcing, screening, interview coordination, and closing across both technical and non tech roles
Partner with hiring managers to build and refine role scorecards, interview loops, and hiring plans
Build and manage strong candidate pipelines through sourcing, referrals, and outbound outreach
Deliver a high-touch, high-quality candidate experience from first touch through offer
Use data to track pipeline health and hiring metrics, and continuously improve process and time-to-fill
Act as a trusted advisor to hiring managers and interviewers on interview best practices and calibration
Help build and refine recruiting processes, tools, and employer brand as the team scales
Manage agency relationships
8-10 years of full-cycle recruiting experience, with at least 5 years recruiting technical talent in high-growth startup environments
Proven track record sourcing and closing competitive candidates
Experience owning recruiting programs beyond individual reqs (headcount planing, employer branding, interview process design, agency management, etc.)
Strong stakeholder management skills; comfortable partnering with senior hiring managers and executives
Data-driven approach to pipeline management, reporting, and process improvement
Excellent communication skills and a strong sense of ownership
Experience building recruiting processes from the ground up
Management experience
We believe in transparent pay practices. The anticipated base salary range for this role is $175,000 - $245,000 annually. Final salary depends on experience, relevant skills, qualifications, and market considerations. In addition to base pay, eligible employees receive equity awards and enjoy a comprehensive benefits package designed to support their health, well-being, and financial future.
We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
We offer flexible time off, paid parental leave, and mental health support
About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
Anyscale is actively seeking talented engineers to join our team and contribute to the development of next-generation, high-performance machine learning serving systems. We value diversity and inclusion, and we encourage individuals from underrepresented groups to apply.
Many existing ML serving tools are inherited from previous infrastructure generations, but emerging ML applications present new requirements, such as high compute demands, specialized hardware needs, and the integration of multiple models and business logic within a single request. At Anyscale, our mission is to provide a powerful yet simple set of tools that enable the seamless deployment of complex ML applications in production.
The Challenge
What if you could build the infrastructure that powers AI applications for millions of users worldwide? Ray Serve is the production-grade serving framework that makes this possible—and we need exceptional engineers to push its boundaries.
You'll be working on problems that sit at the intersection of distributed systems, machine learning, and high-performance computing. This isn't about maintaining CRUD apps or tweaking configurations—this is about solving fundamental computer science problems that directly impact how the world deploys AI.
What You'll Actually Build
Example projects:
Asynchronous inference: Let the client submit a request and get a request handle that asks for its requests completion while not blocking the client side. Really important for image, video, or audio generation applications.
Sub-millisecond Model Routing: Design and implement intelligent request routing systems that dynamically balance load across thousands of model replicas while maintaining strict latency SLAs
Zero-Downtime Model Updates: Build sophisticated traffic management systems that seamlessly transition between model versions at scale, handling terabytes of inference requests without dropping a single query
State Management at Scale: With many models and many replicas deployed into production, the control loop’s state management can become the bottleneck for events such as routing, autoscaling, etc. What are the architectural improvements that can shift the envelop of scale by 10x going from 1000s replicas to 10,000s replicas, etc.
Multi-Model Orchestration: Architect frameworks for complex ML pipelines where dozens of models need to communicate, share resources, and maintain end-to-end latency guarantees
Observability & Debugging: Build deep introspection tools that make it trivial to debug distributed ML applications—because \"works on my laptop\" doesn't cut it at scale
The Tech You'll Work With
Deep Systems Programming: You'll write performance-critical code in Python (with Cython optimization paths) and potentially C++ for the hot paths
Distributed Systems at Scale: Work directly with Ray Core's actor system, gRPC, and custom networking protocols to handle millions of requests per second
Cloud-Native Infrastructure: Kubernetes, service meshes, and custom operators—you'll need to understand and extend the cloud native ecosystem
ML/AI Systems: TensorFlow, PyTorch, JAX, transformers—you don't need to be an ML expert, but you'll develop deep system-level knowledge of how these frameworks work under the hood
Production Reliability: OpenTelemetry, Prometheus, distributed tracing, and chaos engineering to ensure 99.99% uptime. Availability and performance are our key objectives as a serving infrastructure.
Using AI coding agents: We are an AI-forward company, leveraging coding agents to scale our-selves while keeping the team lean and highly utilized.
What We're Looking For:
Must-Haves
Strong Systems Fundamentals: You understand operating systems, networking, concurrency, and distributed systems at a deep level and the trade-offs that different design options imply
Production Experience: You've built and maintained systems that serve real users at scale
Code Quality: Have a good taste in code quality, simplicity, generality, testing coverage. AI-agents write a lot of code in short time, you should be able to instruct them to output what is golden standard
Ownership Mindset: You take responsibility for your code in production—from design to deployment to incident response
Nice-to-Haves
Experience with distributed systems frameworks (gRPC, Ray)
Background in ML/AI systems or serving infrastructure
Contributions to major open source projects
Experience with performance optimization and profiling
Knowledge of cloud-native technologies (Kubernetes, Istio, etc.)
What Really Matters
We care more about how you think and solve problems and whether you have shown patterns of end to end ownership in your past stages of career than checking boxes. If you're intellectually curious, love building elegant solutions to hard problems, and want to work on infrastructure that matters—we want to talk to you.
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
","descriptionPlain":"About Anyscale:\n\n\n\nAt Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\n\n\n\nWith Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\n\n\n\nProud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.\n\n\n\nAnyscale is actively seeking talented engineers to join our team and contribute to the development of next-generation, high-performance machine learning serving systems. We value diversity and inclusion, and we encourage individuals from underrepresented groups to apply.\n\n\n\nMany existing ML serving tools are inherited from previous infrastructure generations, but emerging ML applications present new requirements, such as high compute demands, specialized hardware needs, and the integration of multiple models and business logic within a single request. At Anyscale, our mission is to provide a powerful yet simple set of tools that enable the seamless deployment of complex ML applications in production.\n\n\n\nThe Challenge\n\n\n\nWhat if you could build the infrastructure that powers AI applications for millions of users worldwide? Ray Serve is the production-grade serving framework that makes this possible—and we need exceptional engineers to push its boundaries.\n\n\n\nYou'll be working on problems that sit at the intersection of distributed systems, machine learning, and high-performance computing. This isn't about maintaining CRUD apps or tweaking configurations—this is about solving fundamental computer science problems that directly impact how the world deploys AI.\n\n\n\nWhat You'll Actually Build\n\n\n\nExample projects:\n\n\n\n - Asynchronous inference: Let the client submit a request and get a request handle that asks for its requests completion while not blocking the client side. Really important for image, video, or audio generation applications.\n\n\n\n - Sub-millisecond Model Routing: Design and implement intelligent request routing systems that dynamically balance load across thousands of model replicas while maintaining strict latency SLAs\n\n\n\n - Zero-Downtime Model Updates: Build sophisticated traffic management systems that seamlessly transition between model versions at scale, handling terabytes of inference requests without dropping a single query\n\n\n\n - State Management at Scale: With many models and many replicas deployed into production, the control loop’s state management can become the bottleneck for events such as routing, autoscaling, etc. What are the architectural improvements that can shift the envelop of scale by 10x going from 1000s replicas to 10,000s replicas, etc.\n\n\n\n - Multi-Model Orchestration: Architect frameworks for complex ML pipelines where dozens of models need to communicate, share resources, and maintain end-to-end latency guarantees\n\n\n\n - Observability & Debugging: Build deep introspection tools that make it trivial to debug distributed ML applications—because \"works on my laptop\" doesn't cut it at scale\n\n\n\nThe Tech You'll Work With\n\n\n\n - Deep Systems Programming: You'll write performance-critical code in Python (with Cython optimization paths) and potentially C++ for the hot paths\n\n\n\n - Distributed Systems at Scale: Work directly with Ray Core's actor system, gRPC, and custom networking protocols to handle millions of requests per second\n\n\n\n - Cloud-Native Infrastructure: Kubernetes, service meshes, and custom operators—you'll need to understand and extend the cloud native ecosystem\n\n\n\n - ML/AI Systems: TensorFlow, PyTorch, JAX, transformers—you don't need to be an ML expert, but you'll develop deep system-level knowledge of how these frameworks work under the hood\n\n\n\n - Production Reliability: OpenTelemetry, Prometheus, distributed tracing, and chaos engineering to ensure 99.99% uptime. Availability and performance are our key objectives as a serving infrastructure.\n\n\n\n - Using AI coding agents: We are an AI-forward company, leveraging coding agents to scale our-selves while keeping the team lean and highly utilized.\n\n\n\nWhat We're Looking For:\n\n\n\nMust-Haves\n\n\n\n - Strong Systems Fundamentals: You understand operating systems, networking, concurrency, and distributed systems at a deep level and the trade-offs that different design options imply\n\n\n\n - Production Experience: You've built and maintained systems that serve real users at scale\n\n\n\n - Code Quality: Have a good taste in code quality, simplicity, generality, testing coverage. AI-agents write a lot of code in short time, you should be able to instruct them to output what is golden standard\n\n\n\n - Ownership Mindset: You take responsibility for your code in production—from design to deployment to incident response\n\n\n\nNice-to-Haves\n\n\n\n - Experience with distributed systems frameworks (gRPC, Ray)\n\n\n\n - Background in ML/AI systems or serving infrastructure\n\n\n\n - Contributions to major open source projects\n\n\n\n - Experience with performance optimization and profiling\n\n\n\n - Knowledge of cloud-native technologies (Kubernetes, Istio, etc.)\n\n\n\nWhat Really Matters\n\n\n\nWe care more about how you think and solve problems and whether you have shown patterns of end to end ownership in your past stages of career than checking boxes. If you're intellectually curious, love building elegant solutions to hard problems, and want to work on infrastructure that matters—we want to talk to you.\n\n\n\n\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. \n\n\n\nAnyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing"},{"id":"e4d03815-133e-4af2-b1b3-1af7c7543215","title":"People Operations Manager ","department":"General & Administrative","team":"750 People Team","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-10T16:53:16.437+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/anyscale/e4d03815-133e-4af2-b1b3-1af7c7543215","applyUrl":"https://jobs.ashbyhq.com/anyscale/e4d03815-133e-4af2-b1b3-1af7c7543215/application","descriptionHtml":"At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
We're looking for an People Operations Manager to build and run the operational backbone of our People function. You'll own the systems, processes, and data that keep the employee lifecycle running smoothly, from onboarding through offboarding, and act as the go-to person for scaling HR operations as the company grows.
Own end-to-end HR operations: onboarding/offboarding, HRIS administration, benefits administration, and compliance
Manage and continuously improve our HRIS (Rippling experience preferred) and related People systems, ensuring data accuracy and integrity
Design and document scalable processes and workflows as the team grows
Partner with Finance, Legal, and IT to ensure smooth payroll, benefits, and compliance operations
Serve as the primary point of contact for employee questions related to policies, benefits, and HR systems
Own compliance with federal, state, and local employment laws, and manage required filings and reporting
Build and maintain dashboards/reporting on key People metrics (headcount, attrition, time-to-fill, etc.)
Lead or support People programs such as performance review cycles, engagement surveys, and compliance training
8+ years of experience in HR Operations, People Ops, or a related HR generalist role, ideally at a high-growth startup
Hands-on experience owning an HRIS and related People tech stack
Strong knowledge of employment law and compliance requirements (federal and multi-state)
Excellent process and project management skills; comfort building things from scratch
High attention to detail and strong judgment handling confidential information
Clear, empathetic communicator who can support employees at all levels
Experience scaling HR operations through a period of rapid headcount growth
Experience with global/international HR operations
We believe in transparent pay practices. The anticipated base salary range for this role is $175,000 - $210,223 annually. Final salary depends on experience, relevant skills, qualifications, and market considerations. In addition to base pay, eligible employees receive equity awards and enjoy a comprehensive benefits package designed to support their health, well-being, and financial future.
We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
We offer flexible time off, paid parental leave, and mental health support