Tech

Pinterest's new visual search tool uses camera lens instead of text

Casey Newton
WATCH LIVE
Source: Pintarest

Pinterest today introduced Lens, a new visual search tool that uses machine vision to detect objects in the real world and suggest related items on the service. Lens, which is now in beta, is a tool inside the Pinterest mobile app that functions as a kind of Shazam for objects. Point it at food, furniture, or even the night sky, and Pinterest will return objects that it believes are related.

More from The Verge:
Mossberg: Flipboard redesigns itself around 'smart' digital magazines
Fire starts at Samsung's Note 7 battery supplier
Facebook introduces a way to help your neighbors after a disaster

In a demonstration, Pinterest co-founder Evan Sharp used Lens to detect a pomegranate. Pinterest returned results for pomegranate bread, pomegranate sandwiches, and tips for peeling pomegranates. He described a second use of Lens in which a boy held his phone to the night sky, and Pinterest returned a variety of nighttime landscape photos.

The introduction of Lens has led Pinterest to create a new kind of search result that shows you objects in context, the company said. If you use it to capture a clock, for example, search results would show you pictures of rooms where the clock was part of the decor. Similarly, Lens used on a sweater would show you that sweater styled in different ways, Pinterest said.

Lens builds on underlying visual search technology that Pinterest introduced in November 2015. It's part of a suite of updates to search today that the company announced at an event in San Francisco. Related pins can now be found by tapping on a circle in the bottom-right corner of each pin. And the company also introduced "Shop the Look," a tool that identifies items in pins that can be bought and offers you links to make the purchase.

Lens is rolling out today on iOS and Android in the United States.

Developing ...