Meta's AI-equipped Ray-Ban smart glasses feature object recognition and language translation capabilities
December 12 2023
Wes Davis reports that Meta is introducing a new multimodal AI feature for its Ray-Ban smart glasses, initially via an early access test. This AI can analyze visual and auditory data to provide information and assistance to the wearer, as Meta CEO Mark Zuckerberg demonstrated by having the AI suggest matching clothes and translate text. The features, which include descriptive analysis of surroundings, captioning photos, and translation, are in line with those available in products by Microsoft and Google. The testing phase is exclusive to a select group of U.S. participants who choose to opt in. Tech CTO Andrew Bosworth has shared additional details and opt-in instructions.
Back to Breaking AI News
What does it mean?
- Multimodal AI: A type of artificial intelligence technology that can process and understand multiple types of input, such as visual (images) and auditory (sound) data.
- Visual and auditory data: Visual data refers to images or video content, while auditory data refers to sounds or audio content.
- Descriptive analysis: The process of using data analysis and interpretation to understand and describe the characteristics of the data. In this context, it likely refers to the AI's ability to describe the wearer's surroundings.
- Captioning photos: The process of providing a textual description or subtitle for an image, which could be generated by AI to explain what is depicted in a photo.
- Translation: The process of converting text or speech from one language into another. The AI feature would be capable of translating text seen or heard into the user's preferred language.
- Testing phase: A period during which a new product feature or service is tested by users, often to gather feedback and identify any issues before a wider release.
- Opt in: The action of choosing to participate in something, especially a service or feature that requires explicit consent to join or use.
- CTO: Acronym for Chief Technology Officer, which is an executive-level position in a company responsible for the management of the technology and research and development sectors.