# A preregistered field experiment finds Google’s AI search reduces publisher clicks A new randomized field experiment with 1,100 Google Search users found that removing AI Overviews and AI Mode increased clicks to third-party publishers, while forcing searches into AI Mode reduced external referrals and worsened reported trust and user experience. The study moves the AI-search traffic debate beyond observational correlations: participants were randomly assigned to current Google Search, a version with AI features hidden, or AI Mode-only search during ordinary browsing. It is still a preprint and does not establish effects for every query or publisher. - Status: Active - Published: 2026-08-22T19:19:28+12:00 - Updated: 2026-08-22T19:19:28+12:00 - Categories: Marketing & Distribution, SEO & Search, GEO & AI Search, Content & Publishing - Tags: AI Mode, AI Overviews, AI search, Google Search, publisher distribution - Canonical HTML: https://beyondthe.news/dossiers/google-ai-search-field-experiment-publisher-referrals-user-trust ## What changed On August 18, researchers released a preregistered randomized field experiment involving 1,100 participants using Google Search in ordinary browsing. Participants were assigned to one of three conditions: current Search, Search with AI Overviews and AI Mode removed, or an AI Mode-only experience. The researchers report that removing Google’s AI search features increased click-through to third-party publishers, while the AI Mode-only condition reduced publisher referrals and also lowered reported trust and user experience relative to current Search. ## Why it matters Publishers and search marketers have had abundant observational evidence that AI answers coincide with fewer outbound clicks, while Google has argued that AI Search can generate more queries and higher-quality referrals. This experiment is materially stronger evidence because the search experience was randomly manipulated in the field rather than inferred from traffic trends. It does not tell an individual publisher how much traffic will change, but it strengthens the case for treating AI-search exposure and referral traffic as separate distribution metrics and for reducing dependence on traditional Google click-through as AI Mode expands. ## The experiment changed the search experience, not the publisher The researchers used a browser extension to randomly assign participants to three Google Search conditions during normal browsing: current Search, Search with AI Overviews and AI Mode hidden, or a version redirecting searches to AI Mode. That design helps isolate the causal effect of the search interface from seasonality, publisher changes and many of the confounders that affect observational traffic studies. ## Removing AI features increased outbound publisher clicking The study reports that participants in the no-AI condition clicked third-party publishers more often than users seeing current Google Search. Conversely, the AI Mode-only condition reduced external click-through. The direction is consistent with the substitution concern: more information is consumed inside Google rather than through visits to the sites supplying source material. ## AI Mode did not offset the traffic loss with better reported experience The researchers also report that the AI Mode-only experience reduced trust in information found on Google and worsened user-experience measures relative to current Search. That result challenges a simple trade-off in which lower publisher traffic is assumed to buy a clearly superior search experience, although the effects may vary by task and population. ## This is stronger evidence, but not a universal traffic forecast The paper is a newly released preprint rather than a peer-reviewed final publication. Its 1,100 participants and field design improve causal inference, but the results should not be translated into a fixed percentage loss for every site, query class or country. Google’s products, ranking systems and AI interfaces also continue to change, so the experiment is best treated as evidence about the direction and mechanism of attention shift rather than a permanent coefficient. ## Key details - The paper was submitted on August 18, 2026. - The experiment was preregistered and included 1,100 participants. - Participants used Google Search in everyday browsing rather than a purely laboratory task. - The three conditions were current Search, Search with AI features hidden, and AI Mode-only Search. - Removing AI Overviews and AI Mode increased click-through to external publishers. - AI Mode-only search reduced external referrals and lowered reported trust/user experience. - The paper is currently a preprint, not a peer-reviewed final publication. ## Builder takeaways - Track AI-search visibility separately from referral traffic; higher AI impressions or citations do not imply more site visits. - For businesses dependent on informational SEO, model a scenario in which Google query volume remains healthy while publisher click-through declines as AI interfaces take more of the answer journey. - Invest in channels that convert search exposure into direct audience relationships—email, accounts, apps, communities or preferred-source mechanisms—rather than assuming historical organic CTR will persist. - When evaluating GEO tactics, measure downstream visits, leads and revenue rather than citation presence alone. - Do not apply one generic 'AI search traffic loss' percentage to forecasts; effects remain query-, audience- and interface-dependent. ## What to watch - Peer review, replication and any revisions to the preprint’s estimates. - Whether effects differ materially by informational, commercial, navigational and news queries. - Google’s response or new first-party evidence on AI Search click quality and referral volume. - Real-world referral trends as AI Mode adoption grows and dedicated Search Console AI reporting becomes more widely available. ## Uncertainties - The study is a preprint and may change through peer review or subsequent versions. - The experiment estimates effects for its recruited participant population and Google interface at the time of study, not every search market or publisher. - Product changes to AI Overviews and AI Mode could alter future effects. - The study supports a causal direction of reduced external clicking under its treatments but should not be treated as a universal per-site traffic forecast. ## Sources - [AI in Search Reduces Publisher Referrals Without Improving User Experience: Experimental Evidence](https://arxiv.org/abs/2608.18352) — arXiv · research_preprint · 2026-08-18T00:00:00+12:00. Primary research source: preregistered randomized field experiment with N=1,100, including no-AI, current-Search and AI-Mode-only conditions.