Login
Latitude AI Academy/Become an AI PM
Get access for free

  • Free

Become an AI PM

  • Course
  • 37 Lessons

Learn how to build AI features that actually ship. In this hands-on course, you’ll master prompts, agents, experimentation, evals, and the full reliability loop to build AI products. Perfect for PMs who want to move from “AI demos” to production-ready systems. Built by Latitude - the open-source AI engineering platform.
Get now

Contents

1. AI PM Mindset

Build the mindset and fundamentals every AI PM needs.

1. Introduction
2. Resources
3. What’s Different About AI Products
4. The AI Reliability Loop
5. Some AI Concepts
6. Setting Up Your Playground
Wrap Up Quiz

2. Designing AI Systems

Design AI systems that behave predictably.

7. Prompts vs agents
8. What Makes a Good Prompt
9. Prompting Roles
10. Designing Structured Outputs
11. Tool Use & Function Calling
12. Common Pitfalls in AI Design
Wrap Up Quiz

3. Experimentation & Feedback

Observe AI behavior, generate logs, and turn experiments into actionable feedback.

13. Test Your AI Manually
14. Seeing Inside the Machine: Runs, Traces & Spans
15. Setting Up Your First Experiment
Wrap Up Quiz

4. Diagnosing & Automating Quality

In this track, you’ll learn how to diagnose quality issues, turn feedback into evaluations, and start automating reliability.

17. Finding Failure Patterns
16. Annotating Your AI Outputs
18. Choosing the Right Evaluations
Wrap Up Quiz (Pt. 1)
19. Building Evaluations
20. Running Experiments with Evaluations
Wrap Up Quiz (Pt. 2)

5. Iteration & Optimization

Learn how to improve AI systems using experiments, regression tests, manual iteration and automatic optimization.

21. Iterating your Prompt
22. Testing Improvements with Experiments
23. Golden Datasets and Regression Testing
Wrap Up Quiz (pt. 1)
24. Prompt Optimization
25. Managing Prompt Versions
26. Monitoring in Production
27. Cost & Latency Optimization
Wrap Up Quiz (Pt. 2)

6. Becoming an AI PM

Tie together the skills, frameworks, and mindset that define an AI PM and get your certificate

28. Scaling the Reliability Loop
29. AI Reliability Review
30. Get your AI PM Certificate!