Meta’s Ray-Ban branded sensible glasses are getting AI-powered reminders and translation options

Meta’s AI assistant has at all times been probably the most intriguing characteristic of its second-generation Ray-Ban smart glasses. Whereas the generative AI assistant had pretty restricted capabilities when the glasses launched last fall, the addition of real-time data and multimodal capabilities supplied a variety of recent prospects for the accent.

Now, Meta is considerably upgrading the Ray-Ban Meta sensible glasses’ AI powers. The corporate confirmed off numerous new talents for the year-old frames onstage at its Join occasion, together with reminders and dwell translations.

With reminders, you’ll be capable to have a look at objects in your environment and ask Meta to ship a reminder about it. For instance, “hey Meta, remind me to purchase that guide subsequent Monday.” The glasses may even be capable to scan QR codes and name a telephone quantity written in entrance of you.

As well as, Meta is including video help to Meta AI in order that the glasses will likely be higher in a position to scan your environment and reply to queries about what’s round you. There are different extra delicate enhancements. Beforehand, you needed to begin a command with “Hey Meta, look and inform me” as a way to get the glasses to answer a command based mostly on what you have been taking a look at. With the replace although, Meta AI will be capable to reply to queries about what’s in entrance of you with extra pure requests. In a demo with Meta, I used to be in a position to ask a number of questions and follow-ups with questions like “hey Meta, what am I taking a look at” or “hey Meta, inform me about what I’m taking a look at.”

Once I tried out Meta AI’s multimodal capabilities on the glasses last year, I discovered that Meta AI was in a position to translate some snippets of textual content however struggled with something quite a lot of phrases. Now, Meta AI ought to be capable to translate longer chunks of textual content. And later this 12 months the corporate is including dwell translation talents for English, French, Italian and Spanish, which may make the glasses much more helpful as a journey accent.

And whereas I nonetheless haven’t totally examined Meta AI’s new capabilities on its sensible glasses simply but, it already appears to have a greater grasp of real-time data than what I discovered final 12 months. Throughout a demo with Meta, I requested Meta AI to inform me who’s the Speaker of the Home of Representatives — a query it repeatedly got wrong final 12 months — and it answered appropriately the primary time.