Available Locations: Austin, New York, Lisbon, London (Hybrid or Remote)
About the Department
Emerging Technologies & Incubation (ETI) is where new and bold products are built and released within Cloudflare. Rather than being constrained by the structures which make Cloudflare a massively successful business, we are able to leverage them to deliver entirely new tools and products to our customers. Cloudflare's edge and network make it possible to solve problems at massive scale and efficiency which would be impossible for almost any other organization.
About the Team
Workers AI is Cloudflare's AI inference service, enabling customers to use a wide variety of AI models both within Cloudflare's Workers development platform and via API. The Workers AI team owns the whole stack that powers the product, from front-end development all the way to low-level inference code. Accordingly we're a team with a diverse array of technical skills, but everyone on the team is curious and passionate about the possibilities of generative AI.
What You'll Do
The Workers AI platform team is responsible for scheduling models and routing requests to the best model instance to handle it. Our stack is built using Rust and Typescript and takes advantage of Cloudflare's internal container platform. You will be a technical leader using quantitative metrics to help the team deliver improved flexibility and performance across the platform. This is a distributed systems role, and you will bring experience and expertise to the team in the areas of load balancing, scheduling, and resource sharing.
What You'll Do
The Workers AI platform team is responsible for scheduling models and routing requests to the best model instance to handle it. Our stack is built using Rust and Typescript and takes advantage of Cloudflare's internal container platform. You will be a technical leader using quantitative metrics to help the team deliver improved flexibility and performance across the platform. This is a distributed systems role, and you will bring experience and expertise to the team in the areas of load balancing, scheduling, and resource sharing.
Examples of desirable skills, knowledge, and experience
- Experience setting the architecture and technical direction of large, cross-team and cross-functional engineering projects
- Strong communication skills
- Comfortable with tight deadlines and short release cycles
- Strong systems-level programming skills
- Experience building large-scale distributed systems
- Expert-level knowledge in a modern compiled language like Go, Rust or modern C++
Equity
This role is eligible to participate in Cloudflare's equity plan.
Benefits
Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S.
Health & Welfare Benefits
Medical/Rx Insurance, Dental Insurance, Vision Insurance ,Flexible Spending Accounts, Commuter Spending Accounts, Fertility & Family Forming Benefits, On-demand mental health support and Employee Assistance Program, Global Travel Medical Insurance
Financial Benefits
Short and Long Term Disability Insurance, Life & Accident Insurance401(k) Retirement Savings Plan, Employee Stock Participation Plan
Time Off
Flexible paid time off covering vacation and sick leave. Leave programs, including parental, pregnancy health, medical, and bereavement leave
