B2B NewsPet industry newsThe Future of Search in 2023: Google Goes Multi-Modal

The Future of Search in 2023: Google Goes Multi-Modal


- Advertisment -spot_img

The Future of Search in 2023 Google Goes Multi-Modal

In recent months, Google has been slowly acclimating the public to a new way of thinking about search that is likely to be a hallmark of our future interactions with the platform. 

Searching the internet has been, since its inception, a text-based activity, based on the concept of locating the best match between the intent of the searcher and a set of results displayed in the form of text links and content snippets. 

But in this emerging phase, search is becoming increasingly multi-modal — able, in other words, to handle input and output in various formats, including text, images, and sound. At its best, multimodal search is more intuitive and convenient than traditional methods.

At least some of the impetus for Google’s move toward thinking of search as a multi-modal activity comes from the rise of social media platforms like Instagram, Snapchat, and TikTok, all of which have evolved user expectations in the direction of highly visual and immediate interaction with content. As a veteran internet company, Google has moved to keep pace with these changing expectations.

The Emergence of Multisearch

Representing the next evolution of tools like Google Images, the company has focused immense development resources into Google Lens, Vision AI, and other components of its sophisticated image recognition technology. 

Google Lens is fairly well established as a search tool that lets you quickly translate road signs and menus, research products, identify plants, or look up recipes simply by pointing your phone’s camera at the object you want to search for. 

This year, Google introduced the concept of “multisearch,” which allows users to add text qualifiers to image searches in Lens. You can now take a photo of a blue dress and ask Google to look for it in green, or add “near me” to see local restaurants that offer dishes matching an image. 

The Image Icon Joins the Voice Icon

In a further step toward nudging the public toward image-based search, Google also recently added an image icon to the main search box at google.com. 

The Google Voice Icon
New Google homepage with microphone and image icons for voice and photo search

The image icon takes its place alongside the microphone, Google’s prompt to search by voice. In the early days of Amazon Alexa and its ilk, voice search was supposed to take over the internet. That didn’t quite happen, but voice search has since grown to occupy a useful niche in our arsenal of methods for interacting with devices, convenient when talking is faster or safer than typing. So too, hearing Google Assistant or Alexa read search results out loud will sometimes be preferable to reading text on a screen. 

This brings us to the vision of a multi-modal search interface: users should be able to search by, with, and for any medium that is the most useful and convenient for the given circumstance. 

A voice prompt to “show me pictures of unicorns” might work best for a child still learning to read; an image-based input potentially conveys more information than any short text phrase regarding the color, texture, and detailed features of a retail product. It’s safe to assume that any combination of text, voice, and image will soon be supported for both inputs and outputs. 

Marketing in the World of Multi-modal Search

What does all of this mean for marketers? Those with goals to increase exposure of businesses and their offerings online will do well to focus their attention on two priorities. 

The first is to provide content for consumption in search that is not just promotional but also useful. With consumers being trained to ask questions of all kinds and receive responses that help them stay informed and make better decisions, marketers need to compete to provide answers and advice, in addition to promoting the availability of their products or services. Google uses Featured Snippets, for example — the answers showcased at the top of search results — as content to be read aloud by Google Assistant when users ask questions, offering a great opportunity to increase brand exposure and to be recognized as an authoritative industry voice. 


Google Assistant Read Featured Snippet
Here, Nike wins prominent placement as a Featured Snippet for an informational query; Google Assistant will read this answer when a user asks the same question via voice interface


Image Optimization is Key

The other major priority for marketers in the age of multi-modal search is image optimization. Google’s Vision AI technology provides the company with an automated means of understanding the content of pictures. With its image recognition technology — an important facet of Google’s Knowledge Graph, which creates linkages between entities as a way of understanding internet content — the company is transforming search results for local and product searches into immersive, image-first experiences, matching featured images to search intent. 

Marketers who publish engaging photo content in strategic places will stand to win out in Google’s image-rich search results. In particular, e-commerce websites and store landing pages, Google Business Profiles, and product listings uploaded to Google’s Merchant Center should showcase photos that correspond to search terms a company hopes to rank for. Photos should be augmented with descriptive text, but Google can interpret and display photos that match a searcher’s query even without text descriptions. 

A search for “handmade jewelry in Sedona, Arizona,” for example, returns Google Business Profiles in the result, each of which displays a photo pulled from the profile’s image gallery that corresponds to what the user was searching for. 

Google search image gallery
A search for “handmade jewelry sedona az” showcases matching photos pulled dynamically by Google from the image gallery of each business profile


Rising Up in Search

The new shopping experience in search, announced by Google this fall, can be invoked by typing “shop” at the beginning of any query for a product. The results are dominated by images from retail websites, matched precisely to the search query entered by the user.

Food and retail are on the cutting edge of multi-modal search. In these categories, marketers already need to be actively working on image optimization and content marketing with various media use cases in mind. For other business categories, multi-modal search is coming. 

Wherever it’s more convenient to use pictures in place of text or voice in place of visual display, Google will want to make these options available across all business categories. It’s best to get ready now for the multi-modal future.

About the Author

With over a decade of local search experience, Damian Rollison, SOCi’s Director of Market Insights, has focused his career on discovering innovative ways to help businesses large and small get noticed online. Damian’s columns appear frequently at Street Fight, Search Engine Land, and other publications, and he is a frequent speaker at industry conferences such as Localogy, Brand Innovators, State of Search, SMX, and more.

Source link


Please enter your comment!
Please enter your name here

Latest news


上海海洋大学的历史可上溯至1912年成立的江苏省立水产学校。2006年,位于杨浦区军工路的上海海洋大学前身——上海水产大学,积极响应上海市教委号召,成功组织了“阳光体育大联赛”。宣传、动员过程中,学校 Source link

「贵州日报·教育」聚势赋能 提质扩容——贵州财经大..

2023年11月21日贵州日报16版(点击图片,阅读全文)全省高等教育高质量发展大会对当前和今后一个时期全省高等教育工作作出部署,描绘了新时代贵州高等教育发展的新蓝图,干货满满、令人鼓舞、催人奋进。风 Source link


来源:新华社新华社台北11月6日电(记者刘斐石龙洪)台湾“历史教育新三自运动协会”6日在台北举行记者会,批评民进党当局为达成不可能实现的“去中国化”政治目的,进行不负责任的“去古文化”教育,牺牲学子们 Source link


8月13至16日,受中交疏浚邀约,来自云南怒江崇仁完小的19名师生代表来到上海,参加为期四天的“中交助梦?看世界”暑期访沪交流活动。崇仁完小坐落于海拔2000多米的横断山区。该校师生总共327人,学校 Source link
- Advertisement -spot_imgspot_img

Bronchitis in Dogs: Signs, Causes, & Treatment (Vet Answer)

The information is current and up-to-date in accordance with the latest veterinarian research. Learn more » In dogs,...

Symptoms, Diagnosis and Treatment – Dogster

Astra, the 6-year-old Cocker Spaniel exhibited several vague clinical signs like not eating every few days and occasional...

Must read

Lady Gaga and Cardi B Meet at the Grammys

What was expected of her was the same thing...

Jennifer Aniston’s Ex Justin Theroux Wishes Her Happy Birthday on Instagram

What was expected of her was the same thing...
- Advertisement -spot_imgspot_img

You might also likeRELATED
Recommended to you