How to Spot Manipulation Before It Changes Your Mind

How to Spot Manipulation Before It Changes Your Mind

Your uncle takes his health advice from adverts for pills and laughs at a cup of herbal tea. Your neighbour believes whatever the evening news says and calls every natural remedy quackery. Your coworker thinks a ready meal in a plastic tray is normal food and calls a steak from the butcher "expensive nonsense". And the friend who sees through all three of them buys whatever supplement a smiling stranger holds up on Instagram.

Each of them is sure they're the one who sees clearly. So are you. So am I.

That's the joke at the heart of this article, and it isn't only a joke. In two studies of the classic thinking errors, psychologists found that we spot bias in others far more easily than in ourselves, and that being clever didn't shrink the blind spot. If anything, the people with higher cognitive ability had a larger one.

The tricks used to steer what you believe are surprisingly predictable, though, and learning to spot manipulation is mostly a matter of a few habits. Once you've seen how a magic trick is done, you can't watch it the same way again. The mystery goes, and what's left is a little funny.

The fastest fix is to switch off the TV, leave the phone at home and walk somewhere green. When researchers sent volunteers on a 90-minute walk, the ones who walked through nature came back with less brooding and calmer activity in a brain area tied to it; the ones who walked through the city didn't. But you'll come back to the phone, so here's the manual for the rest of the time.

Why clever doesn't protect you

Your brain believes first and checks later. In a set of experiments from 1993, people read short crime reports in which some statements were marked as false. When they were interrupted while reading, they later remembered the false statements as true, and the false details pushed up the prison terms they recommended. Understanding a sentence and accepting it turned out to be nearly the same step; rejecting it takes a second step, and that second step is the one a busy mind skips. Daniel Kahneman's Thinking, Fast and Slow is the long tour of the quick mind that believes and the slow one that checks.

Manipulators front-load their authority for exactly this reason. "Studies show…", "Experts say…", "Research proves…" arrive first, before you've had time to ask which studies, and the claim slides in behind them.

Repetition does the rest. Statements you've heard before are easier to process, and easy feels true. In one study, repeated false statements felt more believable even to people who demonstrably knew the right answer. Hearing "the Atlantic is the largest ocean on Earth" often enough starts to sound right, even when you know it's the Pacific.

So the question isn't whether you're smart enough to see through manipulation. It's whether you have a few habits that kick in before the claim settles.

Ask "Says who?"

"Studies show that 87% of people will believe any statistic if it sounds official enough."

That one's a joke, and it works for the same reason the real ones do. Propaganda leans on authority without accountability: "scientists say", "experts agree", "research proves", with no names attached.

Ask the five questions. Which study? Done by whom? Tested on how many volunteers? Using what methods? Paid for by whom? A claim built to slip past you usually collapses at the first or second, because it was written for readers who don't ask.

Leave the page. Stanford researchers watched historians, students and professional fact-checkers judge websites. The historians and students stayed on the page and were fooled by official-looking logos and domain names. The fact-checkers glanced at the page, then opened new tabs to see what others said about the source, and they reached better conclusions in a fraction of the time. The researchers called it reading laterally. You don't learn much about a website from the website.

Grade the source like an Olympic judge. A named researcher, a named journal and a year you can find in under a minute wins gold. "Researchers at a major university recently discovered…" scrapes a bronze. "Scientists say…" didn't qualify. "People are saying…" isn't even a sport. A good share of what lands in your feed would score worse than a drunk figure skater, and once you start grading, it gets hard to stop.

Reviews get the same treatment. Fake ones were common enough that in August 2024 the US Federal Trade Commission voted unanimously to ban fake reviews, including those written by AI chatbots, along with bought follower counts. Read reviews from the middle. Start with the 3-star ones, where buyers tend to weigh the good against the bad. Watch for bursts of 5-star reviews posted within a few days of each other, and for reviewers who describe the box, the delivery and their excitement but never the product.

Seeing and hearing aren't proof any more, either. In 2024 the engineering firm Arup lost $25 million to a deepfake scam. A shocking clip or a familiar voice can now be made to order, so leaving the page applies to video too. Check money requests through a second channel. If a voice or a face on a screen asks for money, hang up and call back on a number you already have. A family code word settles it in seconds.

Try it on the next three claims you meet. The influencer whose supplement cures everything: what's their training, and are they paid to say it? The news story about a breakthrough: which journal, and can you read the study, or only the press release? The expert dismissing a traditional remedy: did they look at the evidence, or only at its reputation? Ask "Says who?" for a week and you'll notice how many facts turn out to be opinions in borrowed lab coats.

Ask "Out of how many?"

Health headlines have a favourite number trick, and it's perfectly legal. "Cuts your risk by half" sounds enormous. It may mean your risk went from 2 in 1,000 to 1 in 1,000. That's a real change, and it's also one person in a thousand. "Doubles your risk" can mean the same small step in the other direction.

Ask for the "out of how many". A percentage change without the starting number tells you how dramatic the story is, not how much your life changes. When the article won't give you the starting number, that tells you something too.

Fear works the same way as hope here. In October 1995 a UK safety warning said that some contraceptive pills carried a higher risk of blood clots. Women switched brands or stopped altogether. Pill use among under-16s fell from 40% to 27% within a year, unplanned pregnancies rose, and the extra births and abortions cost the health service tens of millions of pounds. The researcher who added it up concluded that risk should be weighed more carefully and presented more carefully in future. Knowing how big a risk is matters as much as knowing it exists.

Take your emotional temperature

Propaganda is Latin for "things to be spread". The word comes from a body the Catholic Church set up in 1622, the Congregatio de Propaganda Fide, to spread the faith abroad, and it took on its secular meaning only from the 1790s. Spreading is still the point, and nothing spreads like a strong feeling.

Content built to steer you is built to make you furious, frightened or disgusted, because a body in that state reacts before it thinks.

Researchers at MIT followed about 126,000 verified true and false news stories on Twitter between 2006 and 2017. The false ones travelled farther, faster and deeper in every category, and the replies to them were full of fear, disgust and surprise, while true stories drew anticipation, sadness, joy and trust. Bots spread true and false news at the same rate. The difference came from humans. A separate study of more than half a million messages about heated political issues found that each extra moral-emotional word, the outrage words, raised a message's spread by about 20%.

Rate yourself from 1 to 10. A post about how some politician is destroying the country: 8, red flag. A video about how some food is secretly poisoning you, with not one study named: 7, red flag. A post blaming one group for every problem: 9, a big red flag.

At 6 or above, step back. Ask why this is making you so angry, and what the person who made it wants you to do with that anger.

Ask one question before you share. Real information makes you want to look further. Manipulation makes you want to share it now. When researchers nudged social-media users to think about whether one headline was accurate, the quality of the news they shared afterwards went up, measured both in survey experiments and in a field test on Twitter. The same team found that falling for fake headlines was better explained by not stopping to think than by politics: the volunteers who reasoned more carefully told real from fake better, even when the fake one flattered their own side. Their paper's title says it in three words: lazy, not biased.

The feed is a slot machine

Slot machines pay out on what psychologists call a variable ratio schedule. You never know which pull wins, so you keep pulling, and of the basic reward patterns, it's the one that produces the fastest and most stubborn responding. A feed works the same way. Any scroll might bring the post that makes you feel smart, validated or properly outraged, so you keep scrolling.

Notice when your feed gets too agreeable. If everything you see confirms what you already believe, and you can't remember the last time something made you think "hmm, I hadn't considered that", you're not getting informed. You're getting comfortable.

The algorithm isn't the whole story, though. In a large experiment during the 2020 US election, Facebook and Instagram users were switched to a plain, time-ordered feed for three months. They spent less time on the apps and saw different posts, yet their political views and their feelings about the other side barely moved. The feed amplifies; it doesn't do all the work. We carry our own echo chamber with us.

Set the limit before you open the app. Decide how long you'll scroll while you're still calm. Once the slot machine is running, the part of you that wants one more pull is the part making the decisions.

Follow the money

Every piece of information you take in earns somebody something. News outlets earn when you stay engaged, so drama beats nuance. Platforms earn from your attention, so they show you whatever holds it. Politicians gain when you're angry at the other side instead of reading their own policies. Influencers earn from affiliate links, sponsorships and their own product lines. So does this website, for the record; the disclosure sits at the foot of the page, where it belongs.

Ask "Who makes money if I believe this?" It doesn't prove a claim false. It shows you where to dig.

Food science has a famous case. In 1965 a sugar-industry group paid for a review in a leading medical journal that blamed fat and cholesterol for heart disease and brushed aside the case against sugar. The group set the review's goal, suggested articles to include and saw drafts, and its funding wasn't disclosed. Internal documents only brought it to light in 2016, half a century of dietary advice later.

It isn't a one-off. When researchers looked at 206 studies on soft drinks, juice and milk, funding tracked conclusions. Among the experiments, none of those fully paid for by industry reached an unfavourable conclusion, against 37% of those with no industry money. So check the disclosures at the end of a paper for "funded by", "sponsored by" or "industry partnership" before you trust the headline about it.

Money pitches have their own script, and it barely changes. Urgency ("limited time"), secret knowledge ("what the banks don't want you to know"), greed ("$10,000 a month from home") and fear ("protect yourself before it's too late").

Three questions take care of it. How does this person actually make their money? If it's from selling the advice rather than following it, walk away. Why share the secret instead of quietly getting rich? And what exactly are they selling you? Often it's a course on getting rich by selling courses on getting rich. Robert Cialdini's Cialdini's Influence is the classic guide to the levers sellers pull, urgency and scarcity included.

Play Opposite Day

The easiest way to mislead you is to show you one side of a complicated story and leave the rest out. Your brain helps, because it enjoys agreeing with itself.

Find the strongest case against what you believe. Not the silliest version, the best one.

Read that processed food is perfectly safe? Read the whole-food side. Read that a natural remedy is wonderful? Look for its limits and side effects.

Watched a documentary praising a drug company? Find the independent studies. Told a treatment is your only option? Find out what else exists.

It takes some humility, because it means admitting your first impression might be incomplete. It's also where you'll notice how many shocking revelations are cherry-picked facts with dramatic music, like a trailer that makes a terrible film look brilliant. Adam Grant's Think Again is about the harder half of that, changing your own mind.

Get in the time machine

Manipulative content presents everything as unprecedented. "This has never happened before." "We must act now." "This is the most important election in history." Human nature hasn't changed much, though, and the same plots return in new costumes.

Ask "Has this happened before, and how did it turn out?" The most important election in history comes round every few years. Miracle foods were already on sale in ancient markets. Predictions of imminent collapse are a permanent background hum, and most social-media trends vanish within months, replaced by the same trend with a new name. Today's emergency often looks like ordinary weather once you know the seasons.

The cult checklist

The word itself has a story. "Brainwashing" first appeared in English in the Miami News on 7 October 1950, in an article by Edward Hunter, an outspoken anticommunist newspaperman said to have been working undercover for the CIA, and it quickly became a stock phrase of Cold War headlines. So the word we use for being manipulated may have been spread by a man doing a little manipulating of his own.

In 1961 Robert Jay Lifton published a study of brainwashing in China and listed eight criteria for what he called thought reform. The first was milieu control: the group controls the information that reaches you, and eventually what you let yourself think. The same playbook turns up in religious cults, political movements, pyramid schemes, business coaching, online communities and, yes, wellness circles, including the natural-health end of it. Only the content changes.

Run any source you trust through five questions. Does it tell you to ignore all other information? Does it claim that only it has the real truth? Are you pressured to cut off those who disagree? Does questioning it make you a bad person? Are you told that thinking for yourself is dangerous?

One yes is worth noticing. Three is a pattern.

Assume you've already been had

Your conspiracy-minded relative sees through the news while trusting sources that use identical tricks. Your health-conscious friend avoids Big Pharma and pays a premium for supplements sold with the same psychology. Your politically sharp coworker spots bias in the other side's media and misses it in their own. They aren't stupid. They're human, and so are we.

Assume you've been brainwashed about something, and work backwards. Which beliefs have you never seriously questioned? Which sources do you trust without checking? Which ideas make you angry when someone challenges them? Which groups you belong to discourage outside views?

Correcting a false claim afterwards is harder than it sounds. In one set of experiments, information that was later retracted kept shaping how volunteers reasoned about a story, even when they clearly remembered the retraction. A detailed warning at the start reduced the effect without removing it, and adding a believable alternative explanation reduced it further. A debunked story leaves a gap, and the old story fills it unless something better does. Give the better explanation, not only "that's false". When you correct your uncle, tell him what did happen as well as what didn't.

Knowing the tricks in advance helps more than you'd think. In seven studies, researchers made five short videos explaining one manipulation technique each: emotionally loaded language, incoherence, false choices, scapegoating and personal attacks. They ran them as adverts on YouTube, and the 22,632 viewers in the field test got better at recognising the techniques afterwards. Earlier experiments with 6,464 volunteers found they also got better at telling trustworthy content from rubbish and made better choices about what to share, whatever their politics. The researchers call it inoculation. A weakened version of the trick, shown in advance, makes the real one easier to resist.

Five tricks worth naming

Straw man. You're accused of a position you never took. Want bike lanes? You must hate cars.

Appeal to emotion. You're made to feel instead of think. Sad puppies selling pet insurance.

False choice. Two options are offered when there are more. Either you trust this product completely or you don't care about your health.

Personal attack. It goes after the person instead of the argument, so you never have to deal with the argument at all.

Bandwagon. It must be right, because it's popular. The usual comeback is that medieval Europe believed the Earth was flat, so popular proves nothing. Good point, wrong example, because that story is itself a myth. A round Earth is documented among Greek thinkers from the 5th century BC, Eratosthenes calculated its circumference around 240 BC, and medieval scholars knew it was round. The flat-earth story was spread in the 19th century, helped along by Washington Irving's romanticised 1828 biography of Columbus. Repeat a story often enough and it becomes a fact, which is the illusory truth effect doing its job.

Ten minutes a day

Three headlines. Each morning, put three headlines through "Says who?"

Ten minutes of temperature. While you scroll, notice when your number spikes and what made it spike.

A money trail. Pick one impressive claim and trace who benefits if you believe it.

One opposite view. Look up the best case against one strong opinion you held today.

Keep a short list of red flags in your head while you do it: emotional language designed to make you angry or scared, vague authority, urgency without a real deadline, claims too good or too bad to be true, attacks on people instead of their arguments, demands that you ignore other sources, and messages that make you feel special for believing them.

Then practise on the family. When your uncle shares a conspiracy theory, ask for the source. When your aunt promotes her latest pyramid-scheme product, follow the money. When your cousin rants about politics, check the temperature. When grandpa gets nostalgic about the good old days, ask which parts were better, and for whom.

Your brain is yours

These tricks work because they aim at the hurried part of your brain, the part that wants quick answers and a pleasant feeling of being right. The people using them are counting on that hurry, on your emotions and on your ego. Don't make it easy for them.

If the phone itself is the problem, Digital Overwhelm (linked below) is about breaking the habit of reaching for it. And if all this outrage leaves you wired, Why Your Nervous System Fights Some Stress Techniques (linked below) is about calming a stress response that won't switch off.

Start today with one article. Put it through "Says who?", take its temperature and follow its money, and notice how much falls apart. The more you practise, the funnier it gets.

Your brain is the only thing that's truly yours. Protect it. Your uncle's next Facebook post is waiting.


Is your phone the first thing you reach for? Digital Overwhelm: Breaking Free from Phone Addiction and Information Overload — why the scroll keeps pulling you back, and the habits that loosen its grip.

Still wired after reading the news? Why Your Nervous System Fights Some Stress Techniques — why some calming methods backfire, and which ones suit a wired body.


Know someone who believes every post they see? Send them this. Start with the uncle.

Tried something here, or got a question it didn't answer? Write to us at contact@allforlife.club. Your questions shape the next articles.


Disclaimer: This article is general information about critical thinking and media literacy. It isn't psychological advice. Before a big decision, check more than one source.

Affiliate Disclosure: This article contains affiliate links. As an Amazon Associate, All For Life earns from qualifying purchases, at no extra cost to you. We only link to products we would recommend without the commission.


Sources

West RF, Meserve RJ, Stanovich KE (2012). Cognitive sophistication does not attenuate the bias blind spot. Journal of Personality and Social Psychology 103(3):506–519. doi.org/10.1037/a0028857

Bratman GN, Hamilton JP, Hahn KS, et al. (2015). Nature experience reduces rumination and subgenual prefrontal cortex activation. Proceedings of the National Academy of Sciences 112(28):8567–8572. doi.org/10.1073/pnas.1510459112

Gilbert DT, Tafarodi RW, Malone PS (1993). You can't not believe everything you read. Journal of Personality and Social Psychology 65(2):221–233. doi.org/10.1037/0022-3514.65.2.221

Fazio LK, Brashier NM, Payne BK, Marsh EJ (2015). Knowledge does not protect against illusory truth. Journal of Experimental Psychology: General 144(5):993–1002. doi.org/10.1037/xge0000098

Wineburg S, McGrew S (2019). Lateral Reading and the Nature of Expertise: Reading Less and Learning More When Evaluating Digital Information. Teachers College Record 121(11):1–40. doi.org/10.1177/016146811912101102

Wikipedia. Fake review. en.wikipedia.org

Wikipedia. Deepfake. en.wikipedia.org

Furedi A (1999). The public health implications of the 1995 'pill scare'. Human Reproduction Update 5(6):621–626. doi.org/10.1093/humupd/5.6.621

Wikipedia. Propaganda. en.wikipedia.org

Vosoughi S, Roy D, Aral S (2018). The spread of true and false news online. Science 359(6380):1146–1151. doi.org/10.1126/science.aap9559

Brady WJ, Wills JA, Jost JT, et al. (2017). Emotion shapes the diffusion of moralized content in social networks. Proceedings of the National Academy of Sciences 114(28):7313–7318. doi.org/10.1073/pnas.1618923114

Pennycook G, Epstein Z, Mosleh M, et al. (2021). Shifting attention to accuracy can reduce misinformation online. Nature 592(7855):590–595. doi.org/10.1038/s41586-021-03344-2

Pennycook G, Rand DG (2019). Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition 188:39–50. doi.org/10.1016/j.cognition.2018.06.011

Wikipedia. Reinforcement. en.wikipedia.org

Guess AM, Malhotra N, Pan J, et al. (2023). How do social media feed algorithms affect attitudes and behavior in an election campaign? Science 381(6656):398–404. doi.org/10.1126/science.abp9364

Kearns CE, Schmidt LA, Glantz SA (2016). Sugar Industry and Coronary Heart Disease Research: A Historical Analysis of Internal Industry Documents. JAMA Internal Medicine 176(11):1680–1685. doi.org/10.1001/jamainternmed.2016.5394

Lesser LI, Ebbeling CB, Goozner M, et al. (2007). Relationship between funding source and conclusion among nutrition-related scientific articles. PLoS Medicine 4(1):e5. doi.org/10.1371/journal.pmed.0040005

Wikipedia. Brainwashing. en.wikipedia.org

Wikipedia. Thought Reform and the Psychology of Totalism. en.wikipedia.org

Ecker UKH, Lewandowsky S, Tang DTW (2010). Explicit warnings reduce but do not eliminate the continued influence of misinformation. Memory & Cognition 38(8):1087–1100. doi.org/10.3758/MC.38.8.1087

Roozenbeek J, van der Linden S, Goldberg B, et al. (2022). Psychological inoculation improves resilience against misinformation on social media. Science Advances 8(34):eabo6254. doi.org/10.1126/sciadv.abo6254

Wikipedia. Myth of the flat Earth. en.wikipedia.org