Product analytics isn’t a specialist’s sport—it’s a team capability. In my role leading product teams, I’ve seen designers, engineers, marketers, and customer success partners uncover insights that shape strategy, accelerate product-led growth, and improve outcomes for customers. When we demystify the basics and bring analytics into everyday decisions, we build truly empowered product teams.
Here’s the core promise of this approach: "Learn the product analytics fundamentals of funnels, retention, and conversion drivers so that anyone can confidently answer key product questions." That line has guided how I teach product managers to think—start with the essentials, tie them to real customer behaviors, and make the work repeatable across the organization.
I start with funnels because they tell a story—the journey from discovery to value. A simple example: track the path from sign-up to user activation to the first value event. This reveals where onboarding succeeds or stalls, what friction blocks adoption, and which moments are ripe for optimization. With tools like Amplitude analytics or Pendo, we can break down conversions by segment, channel, or feature usage to isolate where improvements matter most.
Next comes retention analysis, the clearest signal that we’re building something customers choose to return to. Cohort analysis shows who comes back and when; retention curves show where value compels a second, third, and tenth use. Tie retention to activation milestones and the outcomes customers achieve—not just logins—and you’ll quickly spot whether your product discovery assumptions hold up in the wild. A unified analytics platform makes these insights discoverable and repeatable across teams.
Conversion drivers round out the picture. Once the funnel is clear and retention is stable, I look for the behaviors and experiences that predict success: feature combinations, time-to-value, message timing, or supportive content. Whether in Amplitude analytics or Pendo, correlating these drivers with outcomes lets us prioritize roadmaps with confidence. Pair this with continuous discovery—qualitative interviews, in-product feedback, and rapid experiments—and you’ll move from interesting data to decisive actions.
This is how we build empowered product teams: by making analytics a daily habit rather than a quarterly report. We bring insights into roadmap reviews, design critiques, and sprint planning; we celebrate learning from experiments as much as shipping features; and we hold ourselves accountable to customer outcomes, not just output. When everyone can interpret funnels, discuss retention, and isolate conversion drivers, we make smarter bets faster.
If you’re getting started, keep it simple. Define a clear activation metric, instrument the top of your funnel, and track a small number of cohorts. Share a weekly readout with highlights, surprises, and questions to investigate. Over time, stitch insights into narratives that drive product-led growth—and, most importantly, help customers achieve what they came for.
Product analytics isn’t just for analysts. It’s a shared language for product discovery, onboarding excellence, user activation, and long-term retention. When we practice it together, we build better products and stronger teams.
Inspired by this post on Amplitude – Best Practices.
If product managers still open analyst tickets for routine funnel, activation, and retention questions, your analytics transformation has not reached self-service. Buying licenses and publishing dashboards may increase access, but access is not the same as decision autonomy.
You are not trying to turn every product manager into an analyst. You are creating a governed path from question to evidence to decision, while preserving analyst time for problems that require deeper investigation. That takes a shared measurement layer, curated entry points, clear ownership, and operating rituals that make data part of product work.
Start with the bottleneck, not the analytics platform
A self-service analytics transformation should begin with the service your teams experience today. Pick a common product question, such as which users complete activation, where a critical journey loses customers, or which cohorts retain. Ask a product manager to answer it from a standing start, then observe every dependency between the question and a decision.
Look for five distinct sources of friction:
Discovery friction: the product manager cannot find the relevant event, metric, or approved dashboard.
Definition friction: two reports use the same metric name but calculate it differently.
Construction friction: the data exists, but answering the question requires an analyst to build or join the view.
Trust friction: the product manager can create a chart but still needs someone to confirm that it is correct.
Decision friction: the chart answers what happened but does not connect the behavior to a product choice.
This diagnostic separates a tooling problem from a measurement or operating-model problem. Consolidating scattered tools into a unified analytics platform can reduce search and construction friction. It will not resolve inconsistent definitions, unclear ownership, or a culture in which every decision still needs analyst approval.
Establish a baseline before changing the stack. Track the elapsed time from a clearly stated question to decision-ready evidence, the mix of routine and investigative analyst requests, the frequency of conflicting metric definitions, and the product decisions that cite behavioral evidence. Avoid choosing a universal benchmark that your context cannot support. Measure your current state, separate question types, and set improvement targets from that baseline.
The intended end state is narrow enough to test. A product manager should be able to examine activation, funnel drop-off, and cohort retention without joining a reporting queue. An engineer should be able to see the behavioral signal after a release. An analyst should spend less time reproducing standard views and more time on questions whose ambiguity or complexity merits specialist work. When evidence is visible to the people making the decision, discovery and delivery can share the same facts.
Build a governed measurement layer before expanding access
Giving more people permission to query inconsistent data produces faster inconsistency. Self-service becomes trustworthy only when teams share a stable vocabulary for customer behavior and business outcomes.
Treat that vocabulary as a product. Events describe observable behavior; metrics encode an interpretation of that behavior. The distinction matters. A signup event may have a precise trigger, but an activation metric still needs a qualifying action, an eligible population, a time window, and explicit exclusions. If those choices live only inside one dashboard, the dashboard is carrying business logic that other teams cannot reliably reuse.
Use a standard instrumentation workflow for every new event or property:
Start with the decision. Record the question the team needs to answer and the action that could change because of the result.
Define the behavior. Specify the event trigger, required properties, allowed values, exclusions, and the naming convention it follows.
Assign accountability. Name the owner, identify the affected product flow, and record privacy and access requirements.
Implement consistently. Use the same instrumentation pattern and carry the change through the normal CI/CD path instead of relying on an undocumented one-off.
Validate before release. Compare the emitted payload with the tracking contract and check that required properties arrive with expected values.
Publish for reuse. Add the definition to the catalog and expose it through the appropriate curated report, rather than leaving users to discover raw events by trial and error.
This is the practical value of treating data requests like product requests: a team can ask for an event or property with a defined purpose, owner, and privacy classification, while a repeatable path takes it from instrumentation through CI/CD, documentation, and curated analytics.
Your catalog entry should answer the questions a future user will otherwise send to an analyst:
What behavior does this event represent, and what does it not represent?
Exactly when does it fire?
Which properties are required, and what do their values mean?
Which users, accounts, environments, or internal activities are excluded?
Who owns the definition and approves a semantic change?
What privacy classification and role-based access rules apply?
Which approved metrics and dashboards depend on it?
Is it active, deprecated, or scheduled for replacement?
Choose a naming convention that reveals intent, such as an object plus a past-tense action, and apply it consistently. The exact grammar matters less than eliminating synonymous events and ambiguous labels. Do not silently rename or repurpose an event after teams have built reports on it. Deprecate it explicitly, identify the replacement, and update dependent views so a semantic change does not masquerade as a change in customer behavior.
Governance should make the safe path easier, not turn every question into an approval request. Standard definitions, privacy-by-design, role-based access, named owners, and clearly labeled dashboards are the guardrails. Product teams should remain free to explore within them. That balance preserves both speed and trust.
Give non-technical teams a curated front door
A blank analytics canvas is not a self-service experience. It transfers the construction work to users without giving them the context needed to interpret the result. Start with a small set of approved views that answer recurring product questions, then let experienced users branch into deeper exploration.
For one critical product flow, publish three discoverable dashboards:
An activation dashboard that shows the eligible population, qualifying behavior, and relevant segments.
A journey dashboard that exposes conversion between meaningful steps and makes drop-off visible.
A retention dashboard that uses a documented cohort definition and return behavior.
Three well-governed dashboards are more useful than a large library nobody can navigate. Each one should state the question it answers, intended audience, metric definitions, default filters, exclusions, owner, and review status. If a chart is exploratory rather than authoritative, label it accordingly. Users should not have to infer whether they are looking at a decision-grade view or a working draft.
Build enablement around real decisions. Generic feature training teaches people where buttons live; it does not teach them which metric to trust. Use a current product question to show how to select a cohort, inspect a funnel, compare segments, and move from an observed pattern to the next investigation. Targeted onboarding, in-app guidance, and product tours can reinforce that path when users return to the platform.
Then hold a weekly readout for the teams using the flow. Ask what they learned, which decision changed, where a definition was unclear, and which missing property blocked the analysis. Starting with one end-to-end flow, three core dashboards, and weekly decision readouts gives you a controlled environment in which to repair the system before scaling it.
Watch the first few self-service attempts closely. If users repeatedly choose the wrong event, improve the label and catalog entry. If they can build a chart but cannot explain the denominator, curate the metric rather than adding more training. If sensitive properties are broadly visible, fix access design before inviting more users. Friction observed during onboarding is product feedback about the analytics experience.
Change ownership, decision rituals, and success measures
Self-service changes the division of work; it does not eliminate analysts or central governance. Product trios should define measurement needs while they shape a solution, not after engineering has finished it. The data function should own reusable semantics and quality mechanisms. Leaders should make evidence part of routine decisions instead of treating analytics as a separate reporting activity.
A workable ownership split looks like this:
Role
Primary ownership
Boundary
Product trio
Decision question, hypothesis, measurement plan, interpretation, and product action
Does not redefine shared metrics inside a local dashboard
Data and analytics
Event taxonomy, reusable metric definitions, validation patterns, and deeper investigation
Does not become the required builder for every routine chart
Engineering
Accurate instrumentation, implementation consistency, and release validation
Does not decide business meaning without product and data input
Platform and governance owners
Access, privacy controls, catalog standards, dashboard hygiene, and lifecycle management
Does not approve every permitted exploration
Product leaders
Decision rituals, outcome accountability, and protection of specialist capacity
Does not reward unsupported numbers simply because they arrive quickly
Carry measurement through the entire product lifecycle. During discovery, write the expected behavior and the evidence that would change the team’s view. During delivery, make instrumentation part of acceptance criteria. After release, inspect the same agreed signals instead of inventing success measures retrospectively. Before an A/B test, state the hypothesis and justify the minimum detectable effect so the team understands what result the experiment is designed to detect.
The weekly decision ritual can remain simple:
What product question did you answer?
Which governed event, metric, cohort, or dashboard supported the answer?
What decision changed, or what new uncertainty must be resolved?
What defect in instrumentation, definition, access, or documentation slowed you down?
This keeps dashboards connected to action and creates a visible backlog for the analytics product itself. It also prevents login counts from becoming the transformation’s main success measure. A person can log in frequently without reaching a trustworthy conclusion.
Measure the operating change instead:
Time from question to decision-ready evidence, segmented by question type.
Routine questions resolved by the product team without an analyst handoff.
Analyst capacity spent on recurring report construction versus deeper investigation.
Critical events and metrics with complete definitions, owners, and privacy classifications.
Duplicate dashboards, conflicting definitions, validation failures, and data-quality incidents.
Discovery, experiment, and post-release decisions that reference governed behavioral evidence.
Read these signals together. If platform usage rises but routine tickets remain unchanged, access improved while autonomy did not. If self-service rises while definition disputes and quality incidents increase, governance is lagging adoption. If tickets fall but teams cannot name decisions informed by data, people may have stopped asking rather than become self-sufficient.
Do not remove analyst support merely to make the ticket count look better. The intended shift is from repetitive construction to higher-leverage work: investigating ambiguous patterns, improving measurement quality, supporting sound experiment design, and helping teams interpret questions that exceed the safe limits of a standard dashboard.
Key takeaways
Define self-service as the ability to reach trustworthy, decision-ready evidence without a routine analyst handoff, not as access to an analytics tool.
Standardize event definitions, properties, ownership, privacy requirements, validation, and documentation before expanding access.
Begin with one critical flow and three curated views: activation, journey conversion, and retention.
Teach analytics through live product questions and reinforce it with weekly decision readouts.
Measure time-to-insight, ticket mix, governed coverage, quality failures, and decisions changed; logins alone cannot show autonomy.
Scale only after teams can move faster without creating conflicting metrics, unsafe access, or hidden analyst dependencies.
Choose one critical flow in your next planning cycle. Baseline its current question-to-decision path, define the tracking contract, publish the three governed views, and schedule the first weekly readout. Let that flow prove the operating model before you broaden the rollout. Self-service scales when each new team inherits a trusted path, not another blank workspace.
I recently revisited a topic I once pushed back on: using AI to analyze (and maybe even synthesize) customer interviews. After six months of real-world experiments and countless conversations with seasoned product leaders, I’ve evolved my perspective. There is meaningful value here—but only when we’re clear about where AI helps and where it quietly erodes the hard-won customer understanding that powers great product decisions.
If you want to experience the conversation that sparked this reflection, you can listen to the episode on Spotify or Apple Podcast, and watch the discussion here: YouTube. It’s a candid, practical exploration of AI’s role in continuous discovery, and it mirrors what I’m seeing on the ground with product trios and empowered product teams.
Here’s the crux: AI raises the floor for beginners but accelerates experts even more. That matches my experience—early-career PMs get structure, momentum, and a confidence boost, while experienced interviewers can move faster without sacrificing nuance. But there’s a catch. If your interviewing skills aren’t solid yet, AI can create a veneer of insight that masks shallow understanding. In other words, it can help you go wrong more efficiently.
The conversation makes an important distinction between analysis and synthesis. Analysis is about extracting signals from the interview. Synthesis is about building meaning—connecting patterns, weighing contradictions, and deciding what to do next. AI can speed up the former with summaries and highlights. The latter—true synthesis—still demands expert judgment, context, and empathy.
One line from the episode stuck with me: your unpolished interview skills matter more than any shiny new AI workflow. I’ve felt that firsthand. When interview quality is uneven, dropping transcripts into an LLM won’t save you. You still need to synthesize every interview individually so the signals remain traceable and credible. That discipline keeps teams aligned, prevents overfitting to noise, and builds the organizational memory that fuels better bets.
We also explored the operational reality most teams face: interviews pile up. Backlogs grow. Leaders want speed. This is where “expert + AI” shines. With the right prompts, templates, and context, tools like ChatGPT and Claude can help transform raw transcripts into structured artifacts you can trust—provided a strong interviewer sets the frame and makes the calls. That balance preserves both velocity and quality.
What changed my mind most was the evidence from experiments—running sets of interviews through different LLMs and comparing outcomes. The patterns were consistent: beginner + AI is usually better than nothing, but the real performance gains come from expert + AI. When experts guide the process, AI becomes an accelerant rather than a crutch.
A favorite story in the episode takes a detour into building a gaming PC—an unexpected but perfect metaphor for AI’s limits. You can get great step-by-step guidance from a model, but when context shifts or edge cases appear, expertise is what keeps you from making expensive mistakes. Customer interviews are like that. Empathy comes from human interaction; AI can’t replace the experience of talking directly to your customers.
My practical guidance for teams integrating AI into continuous discovery: start with interviewing fundamentals, separate analysis from synthesis, and standardize how you capture single-interview learnings. If you need a tight template for this, refer to “The Interview Snapshot: How to Synthesize and Share What You Learned from a Single Customer Interview.” Use AI for summaries, clustering, and draft artifacts—but have an expert finalize the narratives, evaluate trade-offs, and document assumptions.
If you’re scaling this across an organization, invest in training first, then in workflows. Build a lightweight operating system for discovery: consistent interview guides, “story-based” techniques, and a shared library of prompts. Consider resources like “The Interview Coach,” as well as practical write-ups such as “Customer Interview Analysis: Where AI Helps and Hurts.” These help teams avoid common pitfalls and make better use of AI in high-judgment moments.
My bottom line: AI isn’t magic. It can help, but only if your interviews are strong and you provide the right context. Customer understanding is a competitive moat; outsourcing it entirely will cost you in the long run. Use AI to accelerate—not replace—the human judgment that makes product discovery work.
Resources and links worth exploring: ChatGPT, Claude, The Interview Snapshot: How to Synthesize and Share What You Learned from a Single Customer Interview, The Interview Coach, and Customer Interview Analysis: Where AI Helps and Hurts.
I’d love to hear how your team is using AI in discovery. What’s working, what’s risky, and where do you draw the line between automation and judgment? Share your experiences in the comments—our community learns faster when we compare notes.
When I push our organization to adopt the product operating model, I’m emphasizing a foundational shift—from “shipping roadmaps of features (output)” to solving real customer and business problems, measured by “business results (outcomes)”. That’s the difference between activity and impact, and it’s the only way to build durable value at scale.
This change inevitably reaches beyond the product organization. It reshapes how company stakeholders in Sales, Marketing, Customer Success, Finance, Legal, Security, and Operations engage with product teams, and it reframes what they expect from us. Instead of asking, “When will feature X ship?” they learn to ask, “How will we move the outcome that matters?”
In practice, the product operating model is a contract: product teams commit to outcomes, and stakeholders commit to partnership. That partnership means we co-own the problem, align on evidence, and share accountability for results. The reward is clarity—everyone sees how their work ladders to strategy and why the sequence of work makes sense.
Here’s how I align stakeholders around this model. First, I ground everything in outcomes vs output OKRs. We replace feature roadmaps with a clear strategy, prioritized problems, and measurable objectives. Our product roadmapping and sprint planning then serve the objectives—not the other way around—so capacity is allocated to the highest-leverage bets.
Second, I build empowered product teams around product trios (product, design, engineering). We practice continuous discovery with stakeholders: we share opportunity trees, test riskiest assumptions early, and bring partners into research when it informs go-to-market strategy, pricing, or enablement. This keeps us honest and avoids late-stage surprises.
Third, I establish operating rhythms that make outcomes visible. Monthly stakeholder reviews focus on progress toward objectives and what we’re learning—not status theater. Quarterly, we connect OKRs to business performance so leaders can see the throughline from discovery and delivery to pipeline, retention, or margin. If priorities shift, we renegotiate objectives explicitly.
Fourth, I define metrics that stakeholders trust. We use a balanced set of leading indicators (activation, engagement, cycle time) and lagging indicators (revenue, retention, unit economics). We socialize definitions early so no one debates the scoreboard mid-game. The result: faster decisions and less “data whiplash.”
Fifth, I invest in change management. Moving from outputs to outcomes can feel threatening if your success has historically been measured by launch volume or roadmap commitments. I address this head-on with training, transparent comms, and clear decision rights. The message is simple: outcomes create more autonomy for empowered product teams and more predictability for stakeholders.
At HighLevel, this approach has been especially powerful when cross-functional dependencies are high. For example, when we set an objective to improve user activation for a new CRM integration, we didn’t promise a bundle of features. We committed to a measurable lift in activation and a shorter time-to-value, co-owned with Customer Success and Marketing. That alignment unlocked smarter experiments, tighter enablement, and a more credible launch narrative.
The anti-patterns are predictable: treating OKRs as a renaming of the roadmap, equating discovery with indecision, or isolating product decisions from go-to-market strategy. The cure is equally consistent: bring stakeholders into discovery, attach every bet to an objective, and show progress with evidence—not just demos.
Ultimately, the product operating model is a leadership choice. It asks us to trade certainty theater for learning velocity, and feature checklists for business impact. When stakeholders see that shift pay off—in faster cycles, clearer priorities, and results that matter—support for the model moves from compliance to conviction.
By 2026, the AI Product Owner will be the keystone role that turns AI strategy into measurable business outcomes. In my teams, this seat bridges market insight, model capability, data governance, and shipping velocity—so product decisions are not just clever, but compliant, reliable, and fast.
I often describe the remit simply: "Here is your clear guide to the AI product owner role (skills, responsibilities, how it differs from PM) and ways AI tools supercharge delivery." In practice, the AI Product Owner translates business goals into model-backed experiences, aligns cross-functional execution, and ensures the product’s AI behavior remains safe, lawful, and on-brand under real-world constraints.
How does this differ from a traditional PM? While Product Management sets portfolio strategy, positioning, and market narratives, the AI Product Owner owns the AI experience end-to-end—data readiness, evaluation harnesses, safety guardrails, and the iterative model improvements that drive outcomes vs output OKRs. I anchor the role inside empowered product teams and product trios (PM/Design/ML Eng) to keep discovery continuous and delivery disciplined.
On responsibilities, I expect four pillars. First, discovery: continuous discovery with customers and internal experts to uncover use cases where generative AI or LLMs beat the status quo. Second, experience: define the right interaction patterns for AI UX, including retrieval-first pipeline choices, context window management, and feedback loops for human-in-the-loop correction. Third, governance: privacy-by-design, AI risk management, data governance, and regulatory compliance baked into the roadmap. Fourth, delivery: CI/CD for models and prompts, observable evaluation with A/B testing and minimum detectable effect (MDE), and SRE-grade incident management when AI behavior drifts.
Skills-wise, I look for product sense plus technical fluency. That includes LLMs for product managers (prompting, grounding, RAG), analytics mastery (Amplitude analytics, retention analysis, activation metrics), and comfort with DORA metrics and deployment frequency to keep iteration high but safe. Strong stakeholder management and clear writing are non-negotiable—AI capabilities evolve fast, and leaders must see risk, cost, and ROI with no ambiguity.
AI tools truly supercharge delivery when they eliminate bottlenecks. My practical stack: an AI product toolbox with Claude Code and a ChatGPT connector for rapid prototyping; CustomGPT workflows for support triage and internal knowledge; Pendo product tours and in-app guides to validate behavior changes; Intercom for customer support ai strategy; and tight CRM integration via HubSpot to measure revenue impact. The outcome is faster idea-to-learning cycles, sharper telemetry, and far cleaner handoffs.
For roadmapping, I prioritize thin slices that prove value early—shipping narrowly scoped assistants or copilots, then expanding with product roadmapping and sprint planning that ties capability unlocks to outcomes. A unified analytics platform helps compare human-only baselines to augmented workflows, while agentic AI patterns automate routine steps under strict guardrails.
Risk is a product surface, not a side task. I require explicit policy gates (PII handling, red-teaming, bias audits), clear escalation paths, and incident playbooks. When we treat policy and reliability as features, customers reward us with deeper adoption and higher trust.
If you’re pursuing the AI Product Owner path, build a portfolio around shipped learnings: the experiment you killed with data, the safety constraint you designed, the postmortem you led, and the business metric you moved. That story—evidence of disciplined discovery, responsible delivery, and real-world results—is exactly what teams (and boards) want to see in 2026.
If your community of practice needs constant reminders, fills its agenda with updates, and produces little that teams use afterward, the problem probably is not motivation. The community was given a meeting cadence before it was given a job.
Your job as a product leader is to create a repeatable path from a live problem to a better decision, a stronger practice, and knowledge another team can reuse. That is how you design continuous learning as a system instead of hoping it emerges from another recurring call.
Give the community a practice to improve, not a topic to discuss
A broad subject can attract interest without changing anyone’s work. Product strategy, discovery, AI, leadership, and experimentation are all reasonable areas of interest, but each is too large to serve as an operating purpose.
Start with a practice that members perform and can inspect. Opportunity framing is a practice. Writing an AI evaluation plan is a practice. Preparing an experiment decision is a practice. Stakeholder management is still too broad until you identify the behavior you want to improve, such as exposing trade-offs before a roadmap commitment is made.
A useful purpose statement has four parts:
Members: Who needs to learn together?
Practice: What recurring part of their work should get better?
Learning activity: What will they examine, attempt, or critique together?
Work consequence: What should change in a decision, artifact, or team behavior?
For example: This community helps product trios improve opportunity framing by critiquing active discovery artifacts, so teams can separate evidence from assumptions before choosing a solution.
That statement is narrow enough to guide an agenda. It tells members what to bring, tells a facilitator what kind of discussion belongs, and gives a sponsor something more meaningful to inspect than attendance.
Choose a quarterly learning theme with these filters:
Members are encountering the problem in current work, not merely expressing general interest in it.
The practice is shared enough that one person’s case can teach something useful to others.
A real artifact can make the practice visible. That might be an opportunity map, discovery plan, evaluation set, experiment brief, decision record, or stakeholder narrative.
Improvement can be noticed in later work. You should be able to point to a changed question, assumption, method, trade-off, or decision.
The theme is narrow enough to defer adjacent subjects. A community without boundaries becomes an internal conference with no coherent learning loop.
Write those choices into a short charter. Include the theme, target practice, current definition of good, artifact members will examine, evidence of progress, and what is out of scope. Treat the definition of good as a starting hypothesis. Learning can reveal a stronger standard after the work begins; the charter should be stable enough to focus the community but not so rigid that it prevents that discovery.
Combine learning from people with learning with people
A community needs external input and collaborative practice. Input without practice becomes content consumption. Collaboration without input can recycle the same local assumptions. Design both modes deliberately.
Learning mode
Use it when you need
Useful inputs
Expected output
Learning from people
Depth, a reference point, or a clearer definition of good
A tightly curated personal learning network, talks, books, courses, examples, and practitioners whose decisions you can examine
A heuristic, annotated example, sharper question, or alternative approach to test
Learning with people
Feedback, accountability, new patterns, or pressure-testing
Peer circles, artifact critiques, hackathons, meetups, and cross-functional working sessions
A revised artifact, changed decision, new experiment, or reusable lesson
The bridge between the two modes matters more than the volume of material consumed. Begin with a live question from the work. Curate external input that can sharpen that question. Bring the work artifact to peers. Critique its assumptions and trade-offs. Record what changed. Store the lesson where the next person facing the problem can retrieve it.
For an AI product community, the live question might concern an evaluation plan for a support agent. External examples can help the group notice missing failure cases, but reading alone does not improve the plan. Members need to inspect the proposed evaluation set, challenge what it represents, identify gaps, and document the resulting change. The work becomes the learning surface.
Track the network as working infrastructure. For each person or resource, note the practice you are learning, the artifact or decision that demonstrates it, the question it helps answer, and the action you intend to try. Prune the list when the theme changes or an input repeatedly fails to affect your thinking. The goal is not to follow everyone worth knowing. It is to make the right expertise retrievable when a decision needs it.
Build a cadence that ends in changed work and reusable artifacts
A community meeting is only one step in the learning loop. If the loop begins with an agenda and ends when the call finishes, members may enjoy the conversation while the organization loses most of its value.
A lightweight operating model can fit alongside product delivery:
Set a quarterly theme. Tie it to a practice teams currently need to improve.
Curate a small learning network. Gather examples and perspectives that challenge the community’s current standard.
Run monthly critiques. Use current work from product, design, and engineering rather than hypothetical exercises.
Publish one teaching artifact. Turn the strongest learning into a talk, guide, workshop, template, annotated example, or decision pattern.
Close the loop. Write down what changed in a decision, discovery cadence, product bet, or working method.
Do not ask a member to present everything they know about the theme. Ask them to bring something unfinished that matters to a real decision. The critique should answer a small set of questions:
Decision: What decision is the owner preparing to make?
Artifact: What document, model, prototype, dataset, or plan exposes the current thinking?
Evidence: What is known, what is assumed, and where is confidence weak?
Trade-off: Which constraint or competing objective makes the decision difficult?
Critique request: What does the owner want peers to challenge?
Change: What will the owner revise, test, reject, or investigate after the session?
The final question prevents critique from dissolving into commentary. Advice is not yet learning. Learning becomes visible when the owner changes an artifact, runs a test, revises a decision, or explains why the critique did not alter the course.
Keep the feedback about the work, not the person’s competence. Sensitive examples can be anonymized, but stripping out every constraint makes the exercise artificial. Preserve the decision context, evidence, and trade-offs that peers need in order to give useful criticism.
Separate community roles so the founder is not the system
A community becomes fragile when one enthusiastic leader selects every topic, provides every answer, facilitates every discussion, and writes every note. Distribute the work:
Steward: Maintains the charter, boundaries, and relationship to organizational priorities.
Curator: Finds relevant people, examples, and learning inputs for the current theme.
Facilitator: Keeps sessions focused on the stated decision and critique request.
Artifact owner: Brings live work and decides what to do with the feedback.
Synthesizer: Captures the reusable lesson, change made, and retrieval metadata.
A small community can combine roles, but the responsibilities should still be explicit. Rotating artifact ownership also prevents the group from becoming an expert’s help desk. Members learn to expose their reasoning, offer precise critique, and teach what they have understood.
Use the same structure for every durable artifact: context, decision, evidence, critique, change, result still to be observed, and reusable principle. Tag it by practice and decision type rather than only by meeting date. A folder full of chronological notes is an archive. A collection organized around future retrieval is a knowledge system.
Diagnose failure modes and show evidence of impact
Community leaders often respond to weak participation by adding speakers, reminders, or more topics. Those actions can increase activity while preserving the design flaw. Read the symptom as evidence about the operating model.
What you notice
Likely design problem
What to change
Sessions become status updates
Live work is being reported rather than examined
Remove the progress round. Require a decision, artifact, and explicit critique request.
Conversations are energetic but nothing changes afterward
The learning loop ends at discussion
Close every critique with a named change, test, investigation, or reason for retaining the current approach.
The same experts do most of the talking
The community has become a help desk or lecture series
Rotate artifact ownership and ask members to expose their judgment, not just request answers.
Every session covers a different subject
The theme is too broad or absent
Return to one quarterly practice and place adjacent requests in a backlog.
Notes accumulate but are rarely reused
Capture is organized around meetings rather than retrieval
Use a common artifact template and tag lessons by practice, decision, and problem.
People attend but stop bringing unfinished work
Critique may feel unsafe, performative, or disconnected from current decisions
Review the invitation, keep feedback about the artifact, and let owners state the feedback they need.
The community depends on its founder
Operational knowledge and authority have not been distributed
Make roles explicit, rotate them, and document the cadence.
Do not make attendance your primary success measure. Attendance can show reach, but it cannot tell you whether anyone learned, changed a practice, or made a better-informed decision. It is possible to fill every session and still run a content club with no operational effect.
Use an evidence chain that a product or executive sponsor can inspect:
Participation: Members bring relevant work and a real decision question.
Artifact change: A plan, model, evaluation, narrative, or discovery artifact is revised after critique.
Practice change: A team adopts, tests, or deliberately rejects a method with its reasoning recorded.
Knowledge reuse: Another person can find the artifact and apply it to a later decision.
Decision trace: The close-loop note identifies what changed in the team’s cadence, choices, or bets.
This chain is more defensible than claiming the community directly produced a business outcome. Product teams still own delivery and results. The community improves the quality and availability of the practices those teams use. Connect it to business impact when the trace is real, but do not skip the intermediate evidence.
At the end of the quarterly theme, review the artifacts and ask: Which critiques changed work? Which lessons were reused? Which assumptions survived testing? Which part of the definition of good became clearer? Which unresolved practice deserves the next theme? If you cannot answer those questions, adjust the design before adding another meeting.
Key takeaways
Define the community around a recurring practice and a visible change in work, not a broad topic or an attendance goal.
Combine curated learning from people with artifact-based learning alongside peers.
Use a quarterly theme, monthly critique, teaching artifact, and change record to complete the learning loop.
Make unfinished work the center of each session and end with a revision, test, investigation, or explicit decision.
Organize knowledge for retrieval by practice and decision type, not merely by meeting date.
Show impact through artifact changes, practice changes, reuse, and decision traces before connecting the community to business results.
Before scheduling the next session, write the purpose sentence and name the artifact members will examine. Invite them to bring a live decision, then publish a short record of what changed after the critique. If you cannot name the practice or the expected output yet, keep designing the community before you create its calendar.
I treat ChatGPT as a force multiplier across the entire product lifecycle—from discovery and strategy to delivery and growth. Unlock workflows, prompts, and real PM tips showing how ChatGPT quietly reshapes product management behind the scenes.
My goal is pragmatic: turn generative AI into repeatable, measurable leverage for product discovery, product roadmapping and sprint planning, stakeholder management, and product-led growth without sacrificing quality, privacy-by-design, or judgment. This is how I apply LLMs for product managers in a way that strengthens customer empathy and speeds up decision cycles.
In discovery, I use ChatGPT to synthesize interviews, categorize sentiment, and surface emergent themes faster than a manual pass. I’ll feed it anonymized notes and ask for Jobs-to-be-Done statements, contradictory signals to validate, and the top three risks to our hypotheses. When the corpus gets large, I pair it with a retrieval-first pipeline and apply context window management so outputs stay grounded in real customer data.
On strategy and positioning, I draft and refine a crisp value proposition, clarify points of parity, and identify competitive differentiation. I ask ChatGPT to convert inputs into outcomes vs output OKRs, pressure-test assumptions, and produce a one-page narrative that even non-technical stakeholders can engage with. The result is faster alignment and fewer meetings to get to the same level of clarity.
For planning and delivery, I use ChatGPT to accelerate PRD outlines, user stories, and acceptance criteria, while explicitly requesting edge cases, failure states, and non-functional requirements. I’ll have it map risks to mitigations and suggest simple instrumentation aligned to DORA metrics and incident management readiness—useful when we’re iterating within a CI/CD cadence.
In experimentation, ChatGPT helps me frame strong A/B testing plans, calculate a minimum detectable effect (MDE), and sanity-check sample sizes. I also use it to translate metrics into plain language updates for the team, connect learnings to the next experiment, and propose follow-up analyses for retention analysis or activation bottlenecks.
For growth and onboarding, I prompt ChatGPT to generate hypotheses for user activation, in-app guides, and tooltip design that match personas and JTBDs. It drafts variations I can quickly test through Pendo or similar tools, supports product-led growth motions, and helps craft contextual copy that aligns with our value proposition without adding cognitive load.
Stakeholder communications get sharper and faster. I’ll ask for concise executive summaries, a version tailored for engineering leaders, and another for customer-facing teams. It’s especially effective for QBRs vs OKRs updates, where I need crisp narratives tied to outcomes, plus a plain-English articulation of risks and trade-offs for empowered product teams.
The guardrails matter. I set clear AI risk management boundaries, prevent any sensitive data from entering prompts, and align usage with data governance and regulatory compliance requirements. I also version and review prompts just like product artifacts, so the best ones evolve into a durable AI product toolbox the whole team can use.
If you’re getting started, pick one high-friction workflow—say, interview synthesis or PRD drafting—and timebox a week to build a repeatable prompt set and review rubric. Measure cycle-time savings and quality deltas, then expand to a second workflow. Within a month, you’ll have a lightweight operating model for AI Strategy that compounds across your roadmap.
Setbacks are the tax we pay for doing meaningful product work. As a VP of Product Management, I’ve learned that what separates resilient teams from the rest isn’t a lack of failures—it’s how we metabolize them. This episode of All Things Product with Teresa Torres and Petra Wille is a powerful reminder that recovery, reflection, and rigorous product discovery are as essential as speed and execution.
Listen to this episode on: Spotify https://open.spotify.com/episode/10LYRya7boYJBHTYBnE79E?ref=producttalk.org | Apple Podcasts https://podcasts.apple.com/kh/podcast/dealing-with-setbacks/id1794203808?i=1000737190520&ref=producttalk.org
What struck me most is how Teresa shares a deeply personal story about her long recovery from an injury—and how that journey mirrors the nonlinear reality of product development. In product, just like in healing, progress is rarely a straight line. We have surges, stalls, and moments that feel like reversals. Yet with the right mindset and rituals, we still move forward.
Professionally, we all face moments when your product fails to move a single KPI, when a launch falls flat, or when you just feel stuck. I’ve been there—in quarterly reviews, post-launch standups, and board prep. The instinct is to sprint straight into solutions. The wiser move is to respond with curiosity, emotional honesty, and resilience, then re-engage our discovery habits with intention.
If you’re a PM, designer, or researcher, consider this an invitation to rebalance. Recovery and reflection are just as important as velocity and success. That’s not soft talk—it’s how empowered product teams build durable performance without burning out.
On the emotional reality of setbacks, I’ve learned to normalize naming the loss. We put immense pressure on ourselves, and it’s okay (and necessary) to grieve product failures. When we acknowledge the disappointment, we regain the ability to observe clearly—and to learn.
Leaders play a crucial role here. I create space for teams to recover before jumping into post-mortems. We don’t whiteboard over feelings; we schedule time for decompression, then conduct a crisp, blameless review. That sequencing transforms the quality of insights and strengthens psychological safety.
Another lesson that resonates is the danger of tying performance too tightly to outcomes. Outcomes matter, but they are lagging indicators influenced by many externalities. I evaluate performance on behaviors: clarity of problem framing, rigor in discovery, quality of decision-making, and stakeholder alignment. This aligns with outcomes vs output OKRs and keeps us focused on controllable excellence.
How do we build resilience? Continuous discovery builds resilience by normalizing failure. When we test assumptions routinely with customers and data, we turn large, risky bets into a series of small, learnable steps. Teams recover faster because failure becomes feedback—frequent, cheap, and informative.
For perspective, I often use the 10–10–10 framework (from Decisive by Chip & Dan Heath). I ask: How will this setback feel in 10 minutes, 10 months, and 10 years? The answers de-escalate urgency, expand our time horizon, and produce better, calmer decisions.
Here are the key takeaways I’m carrying forward. Setbacks are not just inevitable—they’re part of doing meaningful product work. Giving teams time and space to process failure builds long-term resilience. Mourning losses is just as important as celebrating wins.
Healthy discovery cultures embrace reflection, psychological safety, and emotional honesty. And most importantly, staying consistent with discovery habits helps teams recover faster and learn more deeply.
Notable moments that stood out for me include: [00:02:00] Teresa shares the story of her injury and what it’s taught her about patience and setbacks. The parallel to product cadence is both humbling and motivating.
[00:10:00] Petra talks about a team whose carefully planned launch didn’t move a single KPI. I’ve led similar debriefs; when we anchor on customer insight gaps rather than blame, the next iteration improves dramatically.
[00:20:00] Discussion on allowing space for grief and frustration after failure. In my teams, we time-box “emotional processing” before we enter analysis mode—it humanizes the work and sharpens the learning.
[00:30:00] Why organizations must decouple performance reviews from short-term outcomes. I align evaluations to strategy execution quality, hypothesis discipline, and cross-functional collaboration.
[00:40:00] How continuous discovery can help teams normalize—and even learn to appreciate—setbacks. When discovery is weekly, momentum becomes self-healing.
If you want to dig deeper, here are useful links from the episode. Follow Teresa Torres: https://ProductTalk.org
Follow Petra Wille: https://Petra-Wille.com
Mentioned in the episode: Decisive by Chip & Dan Heath — The 10–10–10 framework for perspective in decision-making https://heathbrothers.com/books/decisive/?ref=producttalk.org
Teresa Torres’ Continuous Discovery Habits — Building resilience through ongoing discovery practices. https://www.amazon.com/Continuous-Discovery-Habits-Discover-Products/dp/1736633309?dchild=1&keywords=continuous+discovery+habits&qid=1621385051&sr=8-2&linkCode=sl1&tag=teresatorres-20&linkId=34bc439ac78da06e1398f7bf069b219e&language=en_US&ref_=as_li_ss_tl&ref=producttalk.org
Join the Conversation: Have thoughts on this episode? Leave a comment below. I’d love to hear how you create space for recovery while sustaining product velocity.
Full Transcript: Full transcripts are only available for paid subscribers.
If your AI portfolio has plenty of prototypes but little habitual use, the gap is probably not access to better models. It is operating design. A team can ship an impressive assistant and still fail because it chose a weak workflow, buried the feature, measured clicks instead of changed behavior, or treated trust as a post-launch review.
At PendomoniumX London, more than 350 software leaders gathered around AI transformation and product innovation. The useful signal for product leaders was the move from broad enthusiasm to execution: clearer customer problems, measurable adoption, faster learning, and explicit governance. You can turn that signal into an operating model for your own AI roadmap.
Transform a customer workflow, not a feature list
An AI feature generates, summarizes, classifies, recommends, or takes an action. An AI product transformation changes how a person completes a meaningful job. The distinction matters because customers do not adopt model capabilities in isolation. They adopt a faster, easier, or more reliable way to get something done.
Starting with the model usually produces a familiar failure mode: the team finds technically plausible places to insert AI, ships several disconnected experiences, and then struggles to explain why customers should change their behavior. Starting with the workflow forces the team to identify the user, the moment of friction, the desired behavior, and the evidence that would justify further investment.
I would not approve an AI roadmap item until the team can complete this sentence:
For a specific user completing a specific workflow, the product will use AI to remove a named source of effort or uncertainty, leading to an observable behavior change and a defined customer or business outcome, within explicit trust boundaries.
Build the statement in this order:
Describe the current workflow. Write the steps a customer takes now, including any handoffs, repeated decisions, manual checks, or places where work is abandoned.
Isolate one consequential friction point. Avoid vague problems such as “the workflow is inefficient.” Name the decision, delay, rework, or uncertainty that prevents progress.
Define the assistance. State whether AI will draft, recommend, retrieve, classify, predict, or act. These modes create different expectations and require different controls.
Name the behavior that should change. Examples include completing a setup step, accepting or editing a recommendation, resolving a case, or returning to use the capability again.
Connect the behavior to an outcome. A click is not an outcome. Faster time-to-value, lower abandonment, greater task completion, and sustained use are closer to the value you need to establish.
Write the boundary before the prototype. Specify what data the system may use, what the user must verify, when a human remains responsible, and what happens when the system cannot produce an acceptable result.
This framing also gives you a useful way to reduce an overcrowded AI roadmap. Reject ideas that cannot name a recurring workflow, an observable behavior, and a credible path to customer value. A clever demonstration without those elements is an experiment, not yet a product commitment.
Run one evidence loop from discovery through go-to-market
AI work becomes slow when discovery, delivery, analytics, and go-to-market operate as separate projects. Research identifies one problem, engineering explores another, marketing promises a broad capability, and analytics arrives after launch. Each function can appear busy while the product accumulates uncertainty.
The better unit of management is one evidence loop:
Discovery identifies the costly moment. Combine customer interviews with behavioral data. Interviews explain the user’s reasoning and workarounds; analytics shows where the behavior occurs, which segments encounter it, and whether the problem is frequent enough to matter.
Prioritization exposes the assumptions. Compare bets using problem severity, workflow frequency, data readiness, trust burden, reach, and speed of learning. Do not hide weak evidence behind a single calculated score. Record why each factor received its assessment.
Sprint planning targets uncertainty. A prototype should answer a specific question: whether customers want assistance at this moment, whether the available context supports an acceptable output, or whether users understand how to review the result. Building the full workflow before answering the riskiest question creates expensive evidence.
Go-to-market explains the changed job. Lead with what the customer can now accomplish. “AI-powered” describes an implementation choice; it does not tell a customer when to use the capability, what input it needs, or what outcome to expect.
Post-launch behavior changes the roadmap. Compare actual use with the original baseline and bet statement. Look at starts, completions, acceptance or editing of outputs, abandonment, repeated use, and downstream outcomes. Feed those observations into the next discovery decision.
A lightweight decision log keeps this loop honest. For every AI bet, record the customer problem, riskiest assumption, evidence collected, decision made, owner, and next review condition. The log prevents a prototype from quietly becoming a permanent commitment simply because significant effort has already been spent.
A prototype that misses the mark can still be valuable if it retires uncertainty. If customers do not recognize the problem, stop. If they value the workflow but distrust the output, change the interaction or control model. If the output is useful but discovery is weak, address distribution and onboarding. Those are different diagnoses, so they should not all produce the same response of adding more features.
Make adoption part of the product itself
Launching an AI capability does not teach customers when to trust it, what information to provide, or how it fits into an existing routine. That education is part of the experience, especially when the product asks someone to replace a familiar manual process with a probabilistic system.
Instrument the adoption path before you publish the guidance:
Eligible: the right user reaches the relevant workflow and has permission to use the AI capability.
Exposed: the user can see the entry point or receives contextual guidance.
Started: the user initiates the AI-assisted action.
Delivered: the system returns an output or completes the requested action.
Evaluated: the user accepts, edits, rejects, retries, or reverses the result.
Completed: the user finishes the larger workflow in which the AI action sits.
Repeated: the user chooses the capability again when the relevant need returns.
This sequence prevents a common measurement mistake. A guide view shows exposure, not activation. A button click shows curiosity, not value. Even a generated output may not matter if the user discards it or fails to complete the surrounding task. Define activation at the first point where the customer receives meaningful value, then monitor whether that behavior repeats.
Keep the guidance proportional to the decision:
Use a short contextual prompt when the customer only needs to notice a new action.
Use a tooltip when the customer needs one local explanation, such as what information the model will use.
Use a multi-step tour only when the workflow itself spans multiple unfamiliar steps.
Show an example input when output quality depends heavily on how the request is framed.
Explain review and fallback behavior next to the action, not in a distant help page.
Let experienced users dismiss education that no longer helps them.
If traffic and risk permit a controlled experiment, compare eligible guided and unguided cohorts on workflow completion and repeated use. If you cannot create a credible control group, use a documented baseline and staged rollout. In either case, do not claim that guidance caused adoption merely because guide views and feature use rose at the same time.
Make trust boundaries and decision rights explicit
Trust is not a legal checklist appended to an otherwise finished AI experience. It affects what the system may do, what the interface must explain, which events need monitoring, and whether the customer remains in control. Deferring these decisions creates rework because the team may later need to change data flows, permissions, interaction design, or the scope of automation.
For each workflow, answer these questions in language the product team can implement:
What customer, account, or third-party data may enter the system?
What context is necessary, and what data should be excluded even if it could improve the output?
What is retained, for what purpose, and who can access it?
Which outputs are suggestions, and which can cause an action in the customer’s environment?
What must the user review or confirm before an action becomes consequential?
How does the experience communicate uncertainty, missing context, or inability to complete the task?
What fallback lets the customer continue when the AI path fails?
Which signals trigger investigation, rollback, or a narrower release?
Who owns customer feedback, incidents, and changes to the evaluation criteria?
When personal data, sensitive customer information, or regulated decisions are involved, bring privacy, security, and legal reviewers into discovery. The safe alternative to making assumptions is to narrow the data and action scope until the appropriate review is complete.
Governance must be matched by clear decision rights. An empowered product team is not an ungoverned team. It is a team that knows which decisions it can make, the evidence expected, and the boundary at which another owner must participate.
A practical division is to distinguish three layers:
Team-owned decisions: workflow design, contextual education, experiments within approved boundaries, evaluation cases, and roadmap changes supported by product evidence.
Cross-functional review: new data access, material changes to retention, model-provider changes, higher-impact automation, and controls that affect security, privacy, support, or compliance.
Leadership decisions: risk tolerance, strategic investment across portfolios, shared platform choices, and conflicts that cannot be resolved within the product outcome.
Write these rights into the AI bet rather than relying on organizational memory. Also define the conditions for continuing, reworking, pausing, or stopping the work. The exact thresholds should come from your baseline and risk context, but the decisions should exist before launch. Otherwise, encouraging signals will be celebrated while contradictory evidence is explained away.
Key takeaways
Frame every AI investment around a recurring customer workflow, not a model capability.
Require a bet statement that connects assistance, behavior change, customer value, and trust boundaries.
Use one evidence loop across discovery, prioritization, sprint planning, go-to-market, and post-launch learning.
Measure the full adoption path from eligibility to repeated use; guide views and feature clicks are intermediate signals.
Treat in-app education as contextual product design, not a substitute for a clear value proposition.
Set data boundaries, human-review points, fallback behavior, decision rights, and stop conditions before broad release.
In your next planning cycle, choose one live AI initiative and rewrite it as a workflow bet. Add its behavioral baseline, activation event, trust boundary, decision owner, and stop condition. Then instrument the path before expanding the feature set. If the team cannot agree on those elements, the roadmap item is not ready. If it can, AI has started to become a managed product capability rather than a collection of prototypes.
Will AI replace software engineers or reshape their roles? Explore risks, opportunities, and alternative career paths in tech.
I’m often asked whether AI will make software engineers obsolete. My short answer: AI is already automating tasks, not eliminating the role. The engineers who learn to orchestrate models, systems, and stakeholders will create more value—not less. The real shift is from keystrokes to judgment, from writing code to designing socio-technical systems that deliver outcomes.
Today’s gen ai assistants—think Claude Code and ChatGPT connector—excel at unit test scaffolding, boilerplate generation, refactoring, docstrings, and code search. When integrated into CI/CD, they can open draft pull requests, annotate diffs, and propose fixes. This lifts developer productivity and frees time for higher-leverage work: problem framing, architecture decisions, and customer discovery.
What changes in the role? We spend more cycles on product discovery, privacy-by-design, and AI Strategy, and fewer on repetitive implementation. We design agentic AI workflows that combine retrieval, tools, and guardrails; we evaluate trade-offs that blend performance, cost, and safety; and we partner with empowered product teams to ship the smallest valuable slice, learn, and iterate.
Measure what matters. If AI is working, DORA metrics should improve: higher deployment frequency, shorter lead time for changes, stable change failure rate, and faster MTTR. Pair that with outcomes vs output OKRs to avoid gaming the system—shaving seconds off a build is meaningless if it doesn’t move activation, retention, or revenue. A unified analytics platform can help connect engineering signals to business impact.
Risk is real—and manageable. AI risk management and data governance are now core competencies, not afterthoughts. Protect IP with robust access controls, context window management, and red-teaming. In production, instrument threat detection and response to catch prompt injection, data leakage, and model drift. Treat this like any other reliability discipline alongside SRE.
If parts of coding get automated, where can great engineers thrive? Several high-impact paths are emerging: platform engineering for LLMs (tooling, evals, observability), SRE for AI-infused systems, developer evangelism and education, product management for AI-native experiences, security engineering focused on model and data threats, and forward deployed engineers who pair with customers to solve messy, real-world problems.
How to upskill fast: build an AI product toolbox and ship small. Prototype gen ai features end-to-end—retrieval, function calling, human-in-the-loop QA—and connect them to your CRM integration or support stack. Use A/B testing with a clear minimum detectable effect (MDE) to validate impact. Leverage CustomGPT workflows for internal enablement and in-app guides or product tours to onboard users safely.
Here’s a pragmatic 90-day plan. Week 0–2: audit your top 10 engineering tasks by time spent; identify 3 that are ripe for AI augmentation. Week 3–6: pilot inside CI/CD with explicit guardrails; track DORA metrics and developer sentiment. Week 7–10: productionize the wins; document runbooks; add incident management paths. Week 11–12: share learnings with product trios, refine your value proposition, and set next-quarter OKRs.
AI won’t replace software engineers; engineers who master AI will outpace those who don’t. If we embrace the shift—toward systems thinking, responsible governance, and customer outcomes—we’ll build better products faster and open new, rewarding career paths. The opportunity is here and compounding.
I hit play on Global Invoicing – All Things Product Podcast with Teresa Torres & Petra Wille and felt an immediate jolt of recognition. We’ve all launched a feature that looked solid—until a small, overlooked detail broke everything. Their stories about global invoicing and taxes echoed challenges I’ve faced leading product for international customers: if you don’t design for the last mile of compliance, you can accidentally block the very "moment of value creation" your product promises.
Listen to this episode on: Spotify | Apple Podcasts
The conversation starts as a candid rant about EU tax compliance and quickly becomes a precise product management lesson: when we fail to map the entire path to customer value—down to the tiniest regulatory requirement—we can ship something “done” that still doesn’t work in the real world. That gap between intention and outcome is where good product teams live or die.
In my experience, the nightmare of global invoicing for small online businesses is very real. Even big platforms (like Squarespace and Teachable) miss the mark on EU tax compliance, and when they do, customers feel it immediately. It’s the kind of edge case that doesn’t show up in a demo but absolutely shows up in revenue. Or as Teresa put it, “It’s not a little detail when your client won’t pay the invoice.” — Teresa Torres
I appreciated how the episode digs into the difference between passing a regulatory checklist and actually meeting customer needs. Put plainly: the product isn’t “done” when the ticket moves to Done; it’s done when the customer completes the job—receives an acceptable invoice, pays successfully, and can reconcile it without friction. That’s why I lean hard on story mapping for regulatory work; it exposes the invisible steps where value creation can silently fail.
Here’s how the episode resonates with my own playbook: the nightmare of global invoicing for small online businesses is a systems problem; why even big platforms (like Squarespace and Teachable) miss the mark on EU tax compliance is a prioritization and discovery problem; how Petra and Teresa navigated invoicing across borders with Ableify and LearnWorlds highlights pragmatic tool choices and trade-offs; the key difference between meeting regulations and meeting customer needs is an outcomes-over-output mindset; what product teams can learn from regulatory edge cases is how to find the seams where markets, laws, and workflows collide; how missing a single detail can block the "moment of value creation" is a reminder that value is defined by customers; and why story mapping is critical for finding gaps between "we shipped it" and "customers got value" is the method that connects all of the above.
Practically, that means I treat regulatory features like any other high-stakes product surface: do real product discovery with affected users; co-design the happy path and the ugly edge cases; write acceptance criteria that include jurisdictional and document-level specifics (e.g., VAT numbers, invoice formats, timing rules); align with finance and legal early; and instrument the journey from invoice issued to invoice paid so we can see where real customers get stuck. This is outcomes vs output OKRs in action, and it’s one of the fastest ways to earn trust with stakeholders.
Key takeaways worth bookmarking: Customers define value, not your compliance checklist. Regulatory work still requires discovery—you can’t skip understanding user needs. The path to value doesn’t end when your feature works; it ends when your customer succeeds. “Sweating the details” isn’t micromanagement—it’s good product management.
Memorable quotes to bring back to your team: “If you don’t sweat the details, people choose other platforms.” — Petra Wille. “It’s not a little detail when your client won’t pay the invoice.” — Teresa Torres.
Follow Teresa Torres: https://ProductTalk.org | Follow Petra Wille: https://Petra-Wille.com
Mentioned in the episode: Squarespace | Stripe | Product at Heart | Teachable | LearnWorlds | Ablefy | Become a Better Product Leader: A 52-Week Transformation Journey | Product Talk Academy
Have thoughts on this episode? Leave a comment below.
Full transcripts are only available for paid subscribers.
Note: This is part of the product creator series of articles, based on the overview article, The Era of the Product Creator. This series is for anyone who wants to create a successful product—whether or not you’ve had formal training or experience in product management, product design, or engineering.
Over the years, I’ve watched smart teams stumble because they treated a prototype like a product. The distinction is simple but vital: prototypes exist to learn; products exist to earn trust by delivering value reliably at scale. When we blur that line, we ship avoidable risk to customers and slow ourselves down later with rework.
When I build a prototype, I’m testing assumptions as quickly and cheaply as possible. It might be a clickable Figma mock, a Wizard‑of‑Oz demo, or a quick script stitching together a ChatGPT connector with a CustomGPT workflow. It’s intentionally disposable. I expect missing edge cases, fake data, hand‑waving on latency, and limited attention to security or privacy. The only goal is to answer the riskiest questions fast.
A product is a promise. It’s hardened for reliability, performance, security, and privacy‑by‑design. It’s observable with real analytics, supports CI/CD and rollback, meets accessibility guidelines, and can be maintained by empowered product teams. It has clear SLAs, incident management runbooks, and instrumentation that lets me track outcomes vs output OKRs and DORA metrics.
Keeping prototypes and products separate makes us faster and safer. Prototypes accelerate discovery; products operationalize value. If I catch myself “polishing” a prototype, I pause and either discard it or define the path to production with the right engineering rigor, data governance, and stakeholder management.
Here’s how I decide. In prototype mode, I timebox learning to days, not weeks, and focus on a single risky assumption—value, usability, or feasibility. I validate through qualitative research and usability tests, not vanity metrics. To graduate to product work, I require a crisp problem statement, evidence of problem‑solution fit, a technical plan for scale and observability, a privacy and threat modeling review, and a measurement plan (including minimum detectable effect) for upcoming A/B testing.
AI adds new wrinkles. For gen AI and agentic AI, I evaluate model behavior offline before exposing anything to customers. That includes prompt design, context window management, guardrails to minimize hallucinations, and clear fallback strategies. I define red‑team scenarios, logging for auditability, and policies for data retention and encryption as part of AI risk management.
A recent example: we prototyped an agent workflow in a day that felt magical in demos. We resisted the urge to ship. Instead, we added authentication, rate limiting, PII redaction, human‑in‑the‑loop review, observability, and in‑app guides and product tours for onboarding. Only then did we move to a limited release with a well‑defined go‑to‑market strategy and support readiness.
One more trap to avoid: calling a prototype an MVP. An MVP is still a product—minimal in scope but complete enough to deliver value, gather trustworthy data, and support customers. If you wouldn’t put your name on it or support it in production, it’s a prototype, not an MVP.
If you’re a product creator, align your product trios around this discipline. Use prototypes to learn quickly in discovery, and use products to deliver outcomes in delivery. That mindset protects customer trust, speeds iteration, and moves you toward product‑market fit with far less waste.
