Firefly brings visual search to Amazon's Fire Phone

Firefly brings visual search to Amazon's Fire Phone

Amazon introduced it's own Fire Phone today and while it integrates practically every Amazon service already in the world one new feature the handset brings is Firefly.


The new app uses the Fire Phone's built in camera to recognize over 100 million different objects. These include a wide variety of items including, DVDs, phone numbers, QR codes, CDs, URLs, games, and bar codes.


The camera can automatically recognize objects and this is visualized on the user's screen as a swarm of fireflies that arrange themselves around the item. Amazon CEO Jeff Bezos demoed Firefly on stage to identify multiple objects including a book, jar of Nutella, and can containing the card game Spot It.


Of course, once that the app recognizes an object users will be able to purchase it on Amazon right from their device.


Mockingbird


In addition to physical objects, Firefly can also recognize music and television shows similar to Shazam's audio searching features.


Beyond finding the corresponding music track on Amazon's MP3 library, Firefly can connect with other apps including iHeartRadio to start a radio station based on the tune. Firefly can also plug directly with Shazam and Amazon Music.


When listening to TV shows Firefly will send over the corresponding X-Ray data, which relays supplementary information on the TV series and characters in the show.


Anything Firefly searchers for can also be, you guessed it, bought.


More to follow...








James Potter