Meta has just surprised everyone by embedding its AI into a pair of Ray-Ban smart glasses. Now, wearers can engage with their smart glasses using the Meta AI virtual assistant software, allowing them to ask questions about their surroundings simply by speaking to their glasses.
This integration of AI technology could potentially revolutionize smart glasses, which have struggled to gain widespread adoption. In the United States and Canada, the Ray-Ban Meta smart glasses are now equipped with multimodal AI technology, powered by the “Meta AI virtual assistant.” This type of AI can process queries involving different mediums, such as audio and imagery, allowing the device to provide more accurate and contextualized responses based on what the wearer is looking at.
For instance, if you’re traveling and need to decipher a menu in French, your smart glasses can utilize their built-in camera and Meta AI to translate the text for you, eliminating the need to pull out your phone or stare at a screen.
The process involves the glasses taking a photo of what the wearer is viewing, and then the AI utilizes cloud-based processing to deliver an answer to the query in speech form, such as identifying a type of plant or car model.
While the integration of AI into smart glasses isn’t entirely new, the strength of the Meta AI lies in its multimodal functionality, which allows it to process data from multiple sensor modules like cameras and microphones. This enables the AI to generate more accurate and sophisticated outcomes compared to traditional unimodal AI systems.
Despite its promising capabilities, the AI in the Ray-Ban Meta smart glasses is still undergoing refinement. While it can accurately identify some objects and describe them, it struggles with more complex tasks like identifying specific plant species. However, as technology advances, these limitations are likely to be addressed, paving the way for even smarter and more intuitive wearable devices.
