Ranking Manipulation for Conversational Search Engines (Pfrommer, S., Bai, Y., Gautam, T., & Sojoudi) offers one of the most detailed looks into how large language models (LLMs) determine what content gets surfaced first and how those rankings can be gamed.

The research explores how today’s LLMs, like ChatGPT, respond when asked for recommendations or rankings across categories like consumer products, restaurants, and hotels. The core finding? LLMs exhibit consistent preferences, and with enou

At Gumshoe AI, we spend a lot of time with the models behind the curtain, studying how generative engines respond, evolve, and influence the way people make decisions. One of the most important (yet often overlooked) dimensions of that behavior is consistency: when you ask the same question multiple times, do you get the same answer?

And more importantly, can you trust what you’re seeing?

In this post, we share new research from our team that examines how consistently leading models, ChatGPT c