TIP practice paper · 10 October 2026 · 13 minute read
Two biases.
One conversation.
AI brings patterns learned from the world. We bring assumptions about how that world works. Better judgement starts by making both visible.
You frame
Assumptions, language and selected evidence.
The model responds
Learned patterns, instructions and available sources.
You interpret
A polished answer can feel like confirmation.
You ask again
The answer becomes context for the next question.
01 / The bias the model brings
A fluent answer is not a neutral view.
Language models learn patterns from selected data. Depending on the system, that can include public, licensed, human-created and synthetic material. What is included, whose experience is missing, and how the model is trained and evaluated all matter. Instructions, retrieved documents and conversation history then shape the answer you see.
Bias can appear as stereotypes, uneven performance across languages or groups, or a narrow view of what is “normal”. An inaccurate answer is not automatically biased; bias concerns systematic patterns in representation or judgement. NIST treats this as a wider system issue, not something a better prompt alone can solve.[1]
Research published in January 2026 found omissions and stereotypes in stories generated from open-ended prompts, even without explicit identity cues. It tested earlier model generations, so it is evidence of a failure mode—not a scorecard for current products.[2] A separate Nature study found prejudice associated with dialect, despite apparently positive statements about the relevant group.[3]
For leaders: a courteous answer, an inclusive statement or a familiar provider name does not establish that a particular use is fair. Test the actual task, the actual model version and the people it affects.
02 / The bias we bring
Our shortcuts are useful. Until the situation changes.
We have limited attention. Experience helps us recognise patterns and act without analysing everything from scratch. Experiments also show that cognitive effort can influence which tasks people choose.[4] Calling this “laziness”, or explaining every bias as a need to conserve bodily energy, goes further than the evidence supports.
The practical question is whether a shortcut still fits the problem. Under pressure, we can mistake a familiar explanation for a tested one. AI then makes it easy to turn that explanation into a convincing plan.
- Confirmation
- “Find evidence that our strategy is right.” We have asked for support before testing the strategy.
- Anchoring and solution jumping
- “Help us automate this report.” The first solution crowds out whether anyone still needs the report.
- Halo and authority
- “Our most experienced leader recommends it.” Status can spill into judgements about the evidence.
- Negativity and availability
- One vivid failure dominates the discussion while the wider pattern receives little attention.
- Overconfidence and sunk cost
- We defend the answer—or the project—because we have already invested in it.
Research on news finds stronger average responses to negative information, with substantial variation between people.[5] That does not mean everyone is inherently negative. At work, a useful check is to examine both the risks of changing and the risks of staying as we are.
03 / Where the two meet
Agreement can become a trap.
Ask a leading question and an agreeable model may strengthen the story you already believe. In interpersonal-advice experiments reported in Science in 2026, participants preferred more affirming AI responses even when those responses made them more convinced they were right and less willing to repair a conflict.[6]
Other 2026 research found that models could cling to an initial answer or give too much weight to subsequent advice, depending on the task.[7] So an answer that changes when challenged is not necessarily corrected. Ask what evidence justifies the change.
“Act as a CFO” can be a useful lens. It also steers the response. Persona research finds changes in performance and social bias across roles and models.[8] Specify the relevant criteria—cash, customer value, risk, time horizon—rather than relying on a role label to confer expertise.
Likewise, a simulated customer is a hypothesis to investigate. It is not customer research. Asking one model for a hundred reviewers does not create a hundred independent judgements.
See it in real work
Same situation.
A different starting question.
An AI rollout has low usage. Is “resistance to change” the problem—or an untested explanation?
The question we ask
The conclusion is already in the question.
Act as a change expert. Our managers are resisting AI. Write a plan to overcome their resistance.
What this assumes
Low usage is treated as resistance. Managers are positioned as the obstacle before we have heard what is happening.
Risk: a polished persuasion plan for a problem we have not established.
Illustrative coaching example. These are prepared prompts and possible next steps, not live model responses or a reported client result.
04 / Put it into practice
Ask for challenge. Build in verification.
Give the model the observed problem, intended outcome, relevant evidence and constraints. Then try this:
Before proposing solutions, separate the observations from my assumptions. Where might my wording, selected evidence or requested role steer the answer? Offer credible alternative explanations and identify whose perspective is missing. What evidence would distinguish between those explanations? What would change the recommendation? Identify uncertainties, link material claims to checkable sources, and suggest one small test with the people affected.
This can expose blind spots. It cannot certify an answer as unbiased. Check the sources yourself. Different perspectives deserve examination in proportion to their evidence; inventing an equally strong “other side” is not balance.
- Set the criteria first. Agree what a good outcome means before evaluating options. Assess each criterion separately.
- Change the frame. Start a fresh conversation without the preferred conclusion. Try another model or evidence set and investigate differences. Agreement is not independent proof.
- Go back to people and evidence. Speak to affected customers and colleagues. Test assumptions against observations, not invented quotes or personas.
- Check the pattern over time. For repeated use, test relevant groups and realistic cases, record failures and revisit checks when models or workflows change. Keep an accountable person at consequential decisions.
05 / Faster answers. Stronger understanding.
Read it. Understand it. Own the decision.
AI can help us reach a useful answer faster. Producing that answer and understanding why it is right are different achievements. If we cannot explain the reasoning, spot missing context or recognise when the situation changes, a polished output can conceal a gap in our capability.
The emerging evidence concerns cognitive offloading, learning and independent judgement. It does not establish that ordinary AI use causes general clinical cognitive decline. Some studies find weaker learning when people delegate the thinking; others show that AI and explicit reasoning practice can complement each other. The task, the design of the assistance and how people use it matter.
Workplace judgement / CHI 2025
Confidence can change the effort we invest.
A survey of 319 knowledge workers associated greater confidence in AI with less reported critical-thinking effort. It also found that thinking shifted towards verification and integration. This is a survey relationship, not proof that AI caused a decline in ability.[9]
Learning a new skill / 2026 preprint
Completing the work can conceal a learning gap.
In a randomised study of 52 people learning a coding library, the AI group scored 50% on the subsequent quiz, compared with 67% without AI assistance. The average time saving was not statistically significant. The study concerns immediate learning on a specific task, not long-term cognitive health.[10]
Independent judgement / CHI 2026
Assisted accuracy may not transfer.
A four-week study of 67 participants found that AI dialogue improved judgements about news while assistance was available, without building lasting discernment on new, unassisted items. A better answer today is not sufficient evidence of a stronger skill tomorrow.[11]
Reasoning practice / August 2026 working paper
The tool and the thinking can work together.
In a classroom-randomised business-case experiment with 1,053 students, AI improved assessed output quality. Causal-reasoning training encouraged a wider range of ideas and explanations; these benefits persisted when AI was available. This Bocconi/OpenAI study supports cultivating reasoning alongside AI, but does not establish lasting independent learning.[12]
The widely discussed MIT essay-writing study also reported differences in recall and EEG measures. It is a small preprint. Its findings should not be translated into claims that AI “damages the brain”.[13]
Make understanding part of the work.
TIP’s practical response starts in PERSONAL and carries through the pathway. We ask for evidence of both a useful outcome and the person’s ability to understand and challenge it:
- Read the important material. Open original sources and check the context behind consequential claims. A summary can help you navigate; it does not establish that the source supports the answer.
- Explain the reasoning yourself. Close the answer and describe the recommendation, assumptions and trade-offs in your own words. Revisit anything you cannot explain.
- Ask for challenge and teaching. Explore a competing explanation, ask why a step follows, and identify what evidence would change the answer. Treat those suggestions as questions to test.
- Apply and verify. Try the method on a different case, check the result with the person who uses it, and review what actually happened. Measure effort and outcome separately.
These are practice principles informed by the evidence, not a clinically validated prevention programme. Effectiveness means better decisions and outcomes, supported by people who can still exercise their own judgement.
Start with your own work in PERSONAL06 / Make the difficult conversation easier
Challenge the assumptions.
Keep ownership with leaders.
A project can carry someone’s reputation, years of effort or a promise they have made. That investment deserves acknowledgement. The decision still needs to consider the value, costs, risks and commitments ahead. A useful question is: “Knowing what we know now, what would we choose to do next?” Stopping also has consequences; include those alongside the options to continue or change course.
Different views are not always evidence of bias. A leader may be responding sensibly to a target that conflicts with another function’s target. A change that improves one P&L may move cost or risk elsewhere. Making that tension visible allows the executive team to discuss what is best for the whole business and whether incentives need to change.
AI can help structure approved evidence, compare options, identify missing perspectives and suggest questions about possible bias. It cannot establish a colleague’s motives or certify that a judgement is unbiased. Check interpretations with the people concerned. Use the output to prepare a respectful conversation, with genuine room for disagreement.
Using only the evidence provided, separate facts, assumptions and unresolved questions. Compare the options against our agreed customer and enterprise outcomes. Where could prior commitments or conflicting incentives affect the choice? Who benefits and who bears the cost or risk? Do not infer anyone’s motives. Suggest neutral questions to test these possibilities with the leaders involved, and identify the decision that needs an accountable owner.
Transformation enables the decision. It can bring evidence, options and dependencies together, facilitate challenge and follow through on commitments. Accountable leaders make the choices within their authority. The executive team and CEO resolve enterprise trade-offs under agreed decision rights. Clear sponsorship gives the Transformation team the authority and support to deliver what has been decided.
That is the constructive leadership opportunity: make it safe to revise a view, make incentives discussable, and make responsibility explicit. Better decision support helps leaders exercise judgement and own the consequences.
Build the habit through the work.
This is why TIP combines mindset and method. The adaptive work is holding up the mirror and being willing to change our view. The practical work is reframing, asking better questions, testing assumptions and validating with real users.
Practise that in PERSONAL and TEAM. Deepen customer discovery and workflow experiments in ACCELERATE. Carry the checks into the applications and operating decisions that follow. The aim is better judgement you can repeat.
Go deeper: validation and verificationResearch, sources and the limits of the evidence
This paper builds on TIP’s earlier work on GenAI and unconscious bias. Research checked 10 October 2026. The workplace example and prompts are TIP teaching illustrations; the linked studies cover specific models, tasks and populations. They do not establish that every model behaves the same way, or that a prompt removes bias.
- NIST · Generative Artificial Intelligence Profile (2024)
Section 2.6 covers harmful bias, representation and differences in performance. A risk framework, not a ranking of models.
- Nature Communications · Intersectional biases in narratives produced by open-ended prompting (2026)
Published January 2026; examines 500,000 outputs from five earlier-generation models, including GPT-4, Claude 2 and Llama 2. It does not assess today’s model versions.
- Hofmann and colleagues · Dialect prejudice in language models (Nature, 2024)
Matched-language experiments found covert prejudice associated with African American English. Experimental decisions are not evidence of real hiring outcomes.
- Kool and colleagues · Decision making and the avoidance of cognitive demand (2010)
Six experiments on effort and choice. Supports a role for cognitive effort; does not explain every bias or imply people are simply lazy.
- Soroka, Fournier and Nir · Cross-national evidence of a negativity bias (PNAS, 2019)
Physiological responses to news, with substantial individual variation. The workplace examples here are TIP illustrations, not findings from this study.
- Stanford · Report on Cheng and colleagues’ Science study (March 2026)
Interpersonal-advice experiments on sycophancy, user preference and judgement. These results do not establish a rate for business decisions.
- Kumaran and colleagues · Competing biases in LLM confidence (2026)
Controlled tasks found both excessive attachment to an initial answer and susceptibility to advice. Context and task mattered.
- de Araujo and Roth · How personas affect language model behaviour (2025)
Seven models and 162 personas, evaluated across five datasets. Persona instructions changed behaviour, with trade-offs between accuracy and measured social bias.
- Lee and colleagues · AI and critical thinking at work (CHI, 2025)
Survey of 319 knowledge workers and 936 examples. Associations and self-reported effort, not evidence of causal or lasting cognitive decline.
- Shen and Tamkin · How AI Impacts Skill Formation (2026 preprint)
Randomised coding study with 52 participants learning an unfamiliar library. Immediate learning outcomes in a specific task; it does not establish long-term cognitive decline.
- Rani and colleagues · Dialogues with AI and lasting discernment (CHI, 2026)
Four-week study of 67 participants judging news headlines. Distinguishes assisted performance from transfer to new, unassisted judgements.
- Asirvatham and colleagues · Training novices to think, or giving them LLMs? (August 2026 working paper)
Bocconi/OpenAI collaboration: classroom-randomised business-case experiment with 1,053 undergraduates. Assesses immediate work and reasoning, not lasting independent skill.
- Kosmyna and colleagues · Your Brain on ChatGPT (2025 preprint)
Small essay-writing study using EEG and recall measures. Preliminary, task-specific findings do not demonstrate brain damage or general clinical cognitive decline.
Further reading: Daniel Kahneman’s Thinking, Fast and Slow; Julia Galef’s The Scout Mindset; and Thomas Wedell-Wedellsborg’s What’s Your Problem? for the discipline of reframing.
Your next step
Bring a decision you are working on.
Use the method on your own problem. Challenge the framing, test the evidence and decide what to try next.
