Orion Glasses: When AI Meets AR

2024 was an exciting year in the world of technology. We saw many technological advancements that make us question, “Are we living in the future?” Few expected AI tools to become so widespread and powerful within just a few months of popular adoption.

At the 2024 Meta Connect event, Meta announced something truly revolutionary. It’s been some time since mobile phones became the epitome of mobile computing capabilities. In the timeline of mobile computing, the smartphone is the last major leap. Meta just showed us a working prototype that may become the next milestone in this timeline.

Meta introduced Meta Orion AR glasses. These are a perfect blend of AR and AI features, making us feel like they’re indeed something from the future. In this blog, we will explore the key features of this technology, how AI makes this product more interesting, and the future challenges it may face.

What is Orion AR Glass?

At first glance, Orion AR glasses may seem like just another pair of eyewear, but according to Meta, they are “the most advanced pair of AR glasses ever made.” AR glasses are eyewear that helps the user see the real world with digital projections of content in various formats.

These glasses are see-through, meaning you can see the real world without distractions. However, they are also equipped with micro LED projectors that can project images, making these glasses holographic in nature.

In simple terms, a user wearing these glasses will be able to see the real world as well as displays of information overlaid in their view.

Until now, AR glass products were mostly heads-up displays integrated into normal eyewear. Attempts like Google Glass tried to bring this concept to life but failed, mostly due to application flaws and privacy concerns. Microsoft had one of the best implementations of AR and mixed-reality glasses, but those were too bulky and primarily intended for industrial use cases. Orion aims to match both versatility and functionality.

What Makes Orion AR Glasses Special?

1. They are lightweight.

One of the key reasons to take Meta’s Orion AR glasses seriously is the weight of the product. They’re not bulky like the super-premium VR glasses introduced in recent years by prominent companies. According to early third-party testers, they weigh under “100 grams”—which is a big deal. Previous VR and AR glasses were bulky and weighed significantly more than regular eyewear, but Orion is lightweight and resembles a normal pair of glasses.

2. A one-of-a-kind control system.

Orion uses a neural wristband control that interprets electrical signals from finger movements to operate the AR glasses. This allows users to control the glasses through gestures, such as pinching fingers to navigate apps or select options, without the need for a touchscreen.

3. Integration with Meta AI.

Meta AI is becoming more powerful day by day, and Meta made sure to integrate it into their flagship hardware innovation. Meta AI is integrated into Orion glasses, making it feel like something out of a movie like Iron Man. This AI integration enhances user interaction by understanding the physical context. For example, users can ask for recipes based on ingredients visible in their refrigerator or manage tasks like video calls and calendar adjustments hands-free while multitasking.

4. Next-generation display technology.

Orion utilizes silicon carbide lenses that support holographic projections, allowing users to view both 2D and 3D digital content integrated into their environment. This technology provides a 70-degree field of view, which is among the largest available in AR glasses today. This 70-degree field of view allows users to view up to three displays without sacrificing functionality or interaction quality.

 

5. It’s wireless!

The fact that these glasses work without any wires is truly a technological marvel. Yes, no external battery pack is required, yet they deliver a 70-degree FOV and control via hand gestures and a remote control—all in a form factor that looks like a normal pair of glasses and weighs under 100 grams. It’s nothing short of incredible!

How AI Makes Meta Orion Glasses More Interesting

1. Contextual awareness.

Since AI is at the core of this product, it helps users have more contextual awareness of what’s in their sight. Orion glasses utilize contextual AI that can sense and understand the surrounding environment. This capability allows the glasses to anticipate user needs and provide relevant information or assistance based on what the user is viewing. A practical use case is the live translation of documents or identifying the ingredients of a dish on a menu.

2. AI delivers an interactive user experience.

AI helps Orion glasses go beyond merely projecting information to become interactive. Users can make hands-free video calls, adjust their digital calendars, or interact with messaging apps while staying engaged with their physical surroundings.

3. AI enables gesture control.

Orion glasses can be controlled with a neural wristband that translates electrical signals from finger movements into digital commands. This allows users to control the glasses using simple gestures, such as pinching fingers to interact with the UI. AI helps the wristband accurately interpret gestures, making the overall experience smooth.

Future Challenges

One of the biggest challenges Orion will face is the same one that has plagued previous AR glasses for the general public—privacy! These glasses have two cameras, and anyone in the field of view could raise concerns about their privacy. Meta will need to implement policies and features to ensure that privacy concerns don’t escalate into future lawsuits.

Another challenge is pricing. Current production costs are estimated at around USD 10,000, and bringing this to market will add several more thousand dollars. Meta will need to work on reducing production costs to make this product accessible to the general public.