Phoenix
#245 LLMs revive decade-old visions for Search
In November 2023, we conducted a study to identify the friendliest neighborhoods throughout the U.S., and our effort earned us 146 links, including those from prominent sources such as Axios, CultureMap, TimeOut, Deseret, The San Antonio Express-News, and Seattle Magazine.
Here's EXACTLY how we did this and how you can too:
1. We began by generating a list of popular neighborhoods by reviewing Zillow's 200 most-viewed city neighborhoods in 2022.
2. Next, we analyzed approximately 150,000 Google reviews of businesses in these neighborhoods.
3. We categorized these businesses into ten sectors: banks, bars and pubs, beauty salons, car-repair shops, coffee shops, convenience stores, dry cleaners, grocery stores, pharmacies, and post offices.
4. We determined the friendliest neighborhoods by calculating the average number of reviews that included the word “friendly.”
5. We considered only the reviews posted within the last year to guarantee fairness.z
6. We created a landing page that contained all our findings, including a nice article and a few tables and visualizations.
7. We ran targeted outreach to each neighborhood, city, and state for what I call scaled localization.
8. Watch the placements roll in.
To see more examples like these, check out our work here. Learn more about our strategies in my newsletter here.
No one can perfectly predict the future, but it turns out some are better at it than others. A study of over one million judgments from thousands of people found “super forecasters”: people who have significantly higher success rates at predictions.1
What separates super forecasters from lousy forecasters? They change their minds gradually based on new evidence.
“People who are right a lot, they listen a lot, and people who are right a lot, change their mind a lot” is a quote by the man who owns the world's largest e-commerce economy, the Washington Post and most wealth on earth.2
When people ask me what I'm changing my mind about, I give them two answers: voice and personalization. The biggest change agent of our times - way bigger than the BlockchAIn - is AI. LLMs have the power to hold voice assistants and personalization to the promises they once made.
Don't call it a comeback
The controversial "50% of searches will come from voice by 2020" prediction was blown out of epic proportions and repeated too many times because it made for a good, fear-inducing story.
Reality is that voice assistant devices are not doing so hot. They're more speaker than assistants. Investors got scared when Mark Zuckerberg announced to write off $10 billion a year to develop the Multiverse, but no one bats an eye that Amazon is losing the same amount of money on Alexa devices despite having sold 500 million of them. 34
Apple and Alphabet are in similar boats, boasting almost 100 million Siri and Google Assistant users despite the fact that they're pre-installed on their vast hardware ecosystem.5
In 2020, 54% of U.S. adults 18+ had used voice commands, 24% daily.6 But the majority of use cases of voice are "play music" and "what's the weather today?" My primary voice assistant usage is asking Siri to continue the podcast I'm listening to when I step out of the shower. Commands and searches are two different pairs of shoes.
And yet, there is reason for optimism. Just like LLMs can instantly improve the quality of search boxes, they can make voice assistants actually useful by better understanding user intent and giving more natural answers.
For ad platform giants like Alphabet, Amazon and Meta, any moment users can't see ads is a market opportunity. Shower thoughts and requests are just one small instance. Americans spend an hour per day in their cars, an hour to make food and half an hour to clean. Just a fraction of that time spent on conversations with AI could unlock significant ad or subscription revenue. 7 8 9
A well-working voice assistant would be an opportunity to not just make more revenue directly but also foster a new app ecosystem and sell more hardware, which Amazon is best positioned to do with their home security and other smart home products. Just recently, Amazon had to walk away from a $1.7b deal to acquire iRobot due to regulatory pressure.
Amazon is already on the train and works on upleveling Alexa to have better conversations.10
Voice assistants need to overcome challenges of speed and access. Even if an answer only takes a few seconds to generate, the experience doesn’t feel conversational. Most importantly, the more access to information a voice assistant has, the more it can personalize answers.
The multimodal nature of LLMs could allow voice assistants to see and hear. Multiplied across your phone, computer, doorbell, security cameras, appliances and cleaning robots, Google’s vision of ambient computing could come to life:
In the mobile era, smartphones changed the world. It’s super useful to have a powerful computer everywhere you are. But it’s even more useful when computing is anywhere you need it, always available to help. Now you heard me talk about this idea with Baratunde, that helpful computing can be all around you — ambient computing. Your devices work together with services and AI, so help is anywhere you want it, and it’s fluid. The technology just fades into the background when you don’t need it. So the devices aren’t the center of the system, you are. That’s our vision for ambient computing.
My web or your web?
Web personalization is the Blockchain of the early 2010s: a disappointment. 10 years ago, we believed the future of the web was hyper-tailored websites and search results. But we got filter bubbles and Cambridge Analytica. Patronizable data is hard to collect and scale. Users like free products, but they don't like the feeling of being tracked.
Google started personalizing Search first in beta in 2004 and then globally in 2009. Today, Google personalizes results for a limited amount for queries like “what to watch”, events, previous searches and Discover.
The overall degree is negligible. In 2013, researchers found that the average degree of personalization in Google Search was 11.7%, of course varying widely by query and rank. Higher positions, for example, have a higher chance of being personalized than lower positions.11 A study from 2019 found that Google personalizes 2/10 results when searching for people and 4/10 for political parties. In other words, not much.12
The highest degree of personalization in Search goes into Google Suggest: based on millions of other searches from people just like me, Google suggests query completions that are sometimes plain scary.
However, Google started to offer more personalization for its Search canary: fashion. Users get custom style recommendations based on their choices and can add brands to favorites to customize their search. In 2022, Google started customizing shopping Search more based on previous purchases.13
When you’re shopping on Google, just make your selections once — your preferred department and brands — to see more of each in the future. So if you select the “womens” department and the brand Cuyana, next time you’re shopping for something like a messenger bag, we’ll show you women’s messenger bags from Cuyana and similar brands.
Personalized shopping recommendations are much less scary than political news and easier to monetize because Google can shorten the path to conversion while keeping users in Search.
Personalization is most useful in shopping, news and local but less for informational searches with a learning intent. LLMs and machine learning paired with the Shopping graph of over 35 billion data points allow Google to tailor shopping Search more than ever before - exactly what Google has been doing over the last months:
When searching for a product, you’ll get a snapshot of noteworthy factors to consider and products that fit the bill. You’ll also get product descriptions that include relevant, up-to-date reviews, ratings, prices and product images. That’s because this new generative AI shopping experience is built on Google’s Shopping Graph, which has more than 35 billion product listings — making it the world’s most comprehensive dataset of constantly-changing products, sellers, brands, reviews and inventory out there. In fact, every hour, more than 1.8 billion listings are refreshed in our Shopping Graph to give people fresh, reliable results.14
“Hey Google, where is my data?”
If voice and personalization ever have a chance to make it big, it’s now. Things rarely play out the way you think they do, which would perfectly fit the bill for voice and personalization.
If I’m right and personalization and voice search do get bigger, the importance of being top of mind before an intent comes up grows even more than today. On the backend, brands need to convince with superior service, shipping and returns to keep customers. The beauty of personalized shopping Search is that once customers are settled on an opinion, it’s hard to get them off.
How would Google personalize results? A combination of first-party data from Google services like Gmail, YouTube, Android & co and Topics.
One factor I’m not bullish about is data. Ever since flooding the SERPs with features like map packs, image carousels, shopping carousels and other carousels, Google hasn’t given marketers much data to understand their impact. I also fear that Google wouldn’t give us data about SGE if it ever rolled out, but that’s another story.
What would change my mind is if I saw how we get the queries and number of searches from current voice devices, but neither Alphabet, Apple or Amazon share that data.
Hi Kevin,
I always had this question - What is the difference between an SEO strategy / roadmap / campaign. Is there any resource to study this?
And particularly about campaign as Eli also mentioned sometime back about a "SEO brand campaign".