Tokens-as-a-Service (Taas) Software Engineer
OpenAI
Technical Community Lead, Campus Leaders
OpenAI
Engineering Manager, Core Services
OpenAI
Workload Porting & Performance Engineer
OpenAI
Security Engineer, Application Security
OpenAI
AI Success Engineer - Tokyo
OpenAI
Recruiter, AI/ML Research
OpenAI
SMS Prototype Handling Specialist
OpenAI
Developer Marketing Lead, India
OpenAI
Customer Marketing Manager, Enterprise and Digital Natives
OpenAI
Technical Threat Investigator, Threat Intel Engineering
OpenAI
Performance Modeling Lead
OpenAI
Manager, AI Success Engineers - San Francisco
OpenAI
Market Research Lead
OpenAI
Software Engineer, Youth Well-Being
OpenAI
Program Manager, Outreach & Audiences
OpenAI
Software Engineer, GPU Infrastructure - HPC
OpenAI
Software Engineer, Cloud Agents
OpenAI
Product Manager, Cyber Safety
OpenAI
Workday Engineer
OpenAI
Threat Modeler, Preparedness
OpenAI
Software Engineer, Data Infrastructure
OpenAI
Security Engineer, Insider Threat Detection & Response
OpenAI
AI Deployment Engineer, Startups
OpenAI
Account Director, Federal Partnerships
OpenAI
Software Engineer, Privacy
OpenAI
AI Deployment Engineer
OpenAI
Product Manager, API Agents
OpenAI
Data Scientist, Business
OpenAI
Technical Sourcer, Research
OpenAI
Showing 30 of 5,931 roles
Load more rolesOpenAI
Tokens-as-a-Service (Taas) Software Engineer
About OpenAI
AI research and deployment company.
About the role
About the Role
We are seeking a Tokens-as-a-Service (TaaS) Engineer to help build the systems that convert large-scale infrastructure capacity into measurable, reliable token throughput for OpenAI workloads.
In this role, you will work across performance benchmarking, tokenomics, model porting, infrastructure integration, systems tooling, and operational monitoring. You will help connect partner and first-party compute environments into OpenAI’s infrastructure stack, ensuring GPU capacity can be onboarded, measured, monitored, and optimized against real workload outcomes.
Key Responsibilities
Develop systems and tooling to measure, monitor, and improve token throughput across first-party and partner-owned compute environments.
Support performance benchmarking, tokenomics analysis, and model porting across heterogeneous infrastructure environments.
Build tooling to integrate external or partner infrastructure into OpenAI’s internal compute, observability, and workload management systems.
Develop and monitor operational metrics including billing, usage, SLAs, utilization, reliability, and throughput.
Identify bottlenecks across hardware, networking, software, and workload enablement that prevent capacity from becoming productive tokens.
Partner with compute, infrastructure, networking, finance, and operations teams to translate raw capacity into usable workload-serving capacity.
Build dashboards, automation, and reporting systems that provide clear visibility into TaaS capacity, performance, and business outcomes.
Qualifications
Strong software engineering background with experience building systems, tooling, automation, or infrastructure platforms.
Experience working across compute infrastructure, distributed systems, performance engineering, or production operations.
Ability to reason about token throughput, utilization, benchmarking, infrastructure efficiency, and workload performance.
Comfortable integrating external systems or partner environments into internal infrastructure stacks.
Strong analytical and debugging skills across hardware, networking, software, and operational domains.
Preferred Skills
- Apply now
Feel the pull?
Apply directly on the company's site.