Product Manager (AI Speech)

About Artificial Analysis

Artificial Analysis is the leading independent AI benchmarking company. We support labs, engineers and enterprises to understand AI capabilities and make critical decisions about their AI strategies. We are the go-to authority for understanding AI, from AI labs and enterprises to media, investors, and policymakers. Our benchmarks don't just measure the cutting edge of AI, they are actively shaping the frontier.

Our benchmarks and analysis are trusted by hundreds of thousands of users and are the go-to reference for leading AI labs including OpenAI, Google, Meta, NVIDIA and Anthropic, and major publications including the Wall Street Journal, Bloomberg, the Financial Times and The Economist.

We are a team of 35+, on track to triple by year end, backed by Nat Friedman (Github, Meta), Daniel Gross (SSI), Andrew Ng (Google Brain, DeepLearning.ai, Amazon), Adam D'Angelo (Quora, Poe, OpenAI), Clem Delangue (Hugging Face) and other industry leaders.

The Opportunity

We're hiring for a Product Manager focused on AI speech (text-to-speech, speech-to-text, voice cloning, real-time voice, and more). You'll work closely with us to develop and enhance our speech arenas and leaderboards, contributing to product strategy and execution at the intersection of voice technology and AI.

This is a hands-on, technical product role: you'll drive day-to-day operations for our speech offering and be a key contributor to product development, collaborating closely with engineering and analysis colleagues, as well as our founders. You'll write and run experiments, curate datasets and prompts, and work with top companies in the field to benchmark their latest models.

If you're excited about cutting-edge speech models and care deeply about how developers and creators are using them (from app builders to content creators to accessibility applications), this role offers a front-row seat to the next wave of AI.

What You’ll Do

• Product Development for Speech AI Benchmarking: Contribute to Speech AI product strategy and help execute the roadmap for our speech evaluation platforms, including text-to-speech, speech-to-text, voice cloning, and emerging capabilities — including working with engineers on our team to develop features and potentially coding features yourself
• Curate and Develop Speech Evaluation Frameworks: Build and maintain comprehensive frameworks, prompt libraries, and evaluation techniques that reflect real-world usage patterns to test the capabilities, strengths, and weaknesses of speech models. Our aim is to reflect not just how developers and creators are using speech models today, but how they might use future models in the coming months and years
• Speech Operations: Ensure that coverage of speech models across Artificial Analysis stays up to date by benchmarking new models and providers — both working with our development team and using our tooling yourself (e.g. running Python scripts)
• Voice Quality & Use Case Analysis: Deeply understand how developers and creators are pushing the boundaries with AI speech tools, and translate these insights into evaluation frameworks that help users understand AI capabilities
• Strategic Marketing Support and Community Engagement: Help amplify the impact of our speech benchmarks, collaborating with our team to maximize impact of our content across platforms and audiences
• Industry Engagement: Work with leading companies to benchmark their speech models, understanding their capabilities and helping shape industry standards for how AI speech capabilities are evaluated
• Become AI-Native: Embrace an AI-native workflow, using the latest AI tools to generate leverage in a fast-changing industry and maintain our competitive edge in AI benchmarking

What We’re Looking For

Required:

• Strong analytical and critical thinking skills
• Excitement about AI and eagerness to work at the forefront of technological innovation
• Demonstrated excellence, both academically and professionally
• Real interest in speech AI models

Beyond that, this opportunity could potentially suit a wide range of backgrounds. We believe that the following skills and experience would likely be helpful for success in this role. We're not expecting any single candidate to tick off the entire list, but these are some things that we think would be valuable:

• Experience working with speech AI models — especially building products leveraging recent TTS, STT, or voice cloning models
• Experience working in a product role at a voice/audio software company (e.g. ElevenLabs, Descript, Resemble AI) or in a startup environment
• Experience in strategy consulting
• Academic success in a technical degree programme, especially related to AI (e.g. Computer Science, Engineering), or in a related technical field (e.g. Physics, Maths, Linguistics)
• Strong writing skills, especially in relation to explaining technical topics to both technical and non-technical audiences
• Visual communication skills (e.g. making slides, visualizing data)
• A strong perspective on AI scaling laws — and specifically their implications for speech models
• Publication record in AI/ML or speech processing conferences or journals
• Familiarity with modern AI language models (e.g. developing systems leveraging LLMs as a component)
• Experience working in software engineering or data science
• Proficiency in Python and data analysis libraries (e.g. pandas, numpy, matplotlib); experience with AI/ML frameworks (e.g. PyTorch, TensorFlow)

Why Artificial Analysis?

• Shape how AI gets built: The leading AI labs track our benchmarks and use them to guide their development priorities. Your work will directly influence the direction of AI.
• Become a world expert in AI: You will evaluate every major model, across every major capability, as they are released. Very few roles offer this breadth of exposure to frontier AI.
• Work with the most important players in AI: You'll manage relationships with teams at the leading AI labs and major enterprises as a trusted, independent voice.
• Join at a defining moment: We're 35+ people and fast growing, backed by some of the most connected investors in AI. The people who join now will shape the product, the team, and the strategy as we scale.
• Competitive compensation including equity
• Our team is split across San Francisco, Sydney, and Melbourne