Jobs by JobLookup

Meta Debuts Orion AR Glasses as Eventual Smartphone Rival


 (Reuters) - Facebook owner Meta Platforms (META.O)

, opens a new tab showed off its first working prototype of augmented-reality glasses, called Orion, during its annual Connect conference on Wednesday, as the California company sketched out its aspirations for products that would bring the virtual world into the real one.
"This is the physical world with holograms overlaid on," Chief Executive Mark Zuckerberg said after pulling out the chunky black glasses from a metal case dramatically brought to him on stage. Shares rose 2.2% to a new high.
The Orion glasses are made of magnesium alloy and powered by custom silicon designed by Meta. Users can interact with the glasses through hand-tracking, voice, and wrist-based neural interfaces. Zuckerberg called Orion a “dev kit” and said Meta planned to work on making it smaller, sleeker, and more low-cost for consumers later on.

Big Tech has for years been developing AR devices, although the most notable ones have been failures, such as Google's notorious Glass glasses.
The augmented-reality reveal is a long time in the making for Zuckerberg, who positioned AR technology as a sort of magnum opus when he first pivoted the world’s biggest social media company toward building immersive “metaverse” systems in 2021. Delivering products has been hampered by high development costs and technological hurdles.

Paolo Pescatore, an analyst at PP Foresight, said there was no doubt of Meta's aspiration to make virtual- and augmented-reality products as mass-market and affordable as possible. But he added that users were "still wary of AI" and needed some convincing.
Meta aims to ship its first commercial AR glasses to consumers in 2027, by which point technical breakthroughs should bring down the cost of production, a source said before the event.

The AR glasses can show multiple little windows with WhatsApp and Messenger texts, video calls, and Instagram reels, Zuckerberg showed, although the presentation offered few details of the device's abilities. Videos showed testers reacting positively, including the CEO of Nvidia (NVDA.O), who opens a new tab, Jensen Huang.
Meta also announced a slew of software enhancements to the AI assistant that has driven interest in the Ray-Ban Meta smart glasses, making it possible for users, for example, to scan QR codes and stream music from Spotify in response to voice prompts.
Later this year, the company plans to add video capabilities and the ability to perform real-time language translation between English and French, Italian, or Spanish.

The Facebook owner kicked off the Connect event with expanded bets on artificial intelligence, announcing a raft of new product offerings for its ChatGPT-like chatbot and plans to start automatically injecting personalized images created by the bot into people's Facebook and Instagram feeds.
Meta also announced an entry-level version of its Quest line of mixed-reality headsets, the Quest 3S.
Among the AI updates announced was an audio upgrade to the digital assistant, Meta AI, which will now respond to voice commands and offer users the option to make the assistant sound like celebrities including Judi Dench and John Cena.
“I think that voice is going to be a way more natural way of interacting with AI than text," Zuckerberg said.
The company said more than 400 million people use Meta AI monthly, including 185 million who return to it weekly.
In keeping with its strategy of sharing the AI models powering its digital agent for free use by others, Meta released three new versions of its Llama 3 models. Two of the models are multimodal, meaning they can understand both images and text, while the third is a basic text-only model capable of running entirely on a user's device, a key privacy advantage.
Meta has struggled to overcome technical challenges with its AR project in recent years, prompting the head of the company’s metaverse-oriented Reality Labs division to acknowledge last year that a product it could viably bring to market was “still a few years away - a few, to put it lightly."
The company has been plowing tens of billions of dollars into its investments in artificial intelligence, augmented reality, and other metaverse technologies, driving up its capital expense forecast for 2024 to a record high of between $37 billion and $40 billion.
Its metaverse unit Reality Labs lost $8.3 billion in the first half of this year, according to the most recent disclosures. It lost $16 billion last year.
Riding a wave of excitement around emerging generative AI technology, the company announced at last year’s Connect conference that it was adding an AI-powered digital assistant to the Ray-Ban glasses, turning a once-forgotten device into the most popular AI wearable on the market.
Although Meta has not disclosed sales numbers for the smart glasses, the CEO of Ray-Ban maker EssilorLuxottica (ESLX.PA), opened a new tab said this summer that more of the new generation sold in a few months than the old ones did in two years. Market research firm IDC estimates that more than 700,000 pairs of the glasses have shipped since the update last year.
Set to hit shelves on Oct. 15, the Quest 3S headset will be offered in two storage capacity sizes, the smaller one priced at $299.99 and the other at $399.99.
With the launch, the company is discontinuing its older Quest 2 and high-end Quest Pro devices, while also dropping the price of the more powerful Quest 3 it introduced last year from $649.99 to $499.99.

 Meta Quest 3S review – an affordable mixed-reality headset that everyone might want

There may be no better argument for affordable yet reasonably performant mixed and virtual reality than the new Meta Quest 3S. it strips away a handful of features from the Quest 3 that most users might not notice to achieve a pocket-friendly price point, and it may soon occupy a spot near the top of our best VR headset list.

After chasing the high-end with the now-discontinued Meta Quest Pro, and then leapfrogging that headset with a more affordable Meta Quest 3 (which included a better chip and higher display resolution) Meta pulled has back just a bit on resolution, image quality, and depth-sensing, to deliver its most compelling combination of value and performance yet in the Meta Quest 3S. 

There may be a lesson here for Apple, which has been chasing the high-end with the $3,499 / £3,499 Apple Vision Pro, a headset that has the highest imaginable specs and includes powerful hand and face tracking. However, while Apple hasn't shared much about sales, it's clear that it has not enjoyed iPhone-level adoption.

With the $299.99 / £289.99 Quest 3S, Meta is now focused on the middle, a sizeable segment of potential users that has yet to adopt VR and mixed reality at scale. Coming in at hundreds less than the $499.99 / £469.99 Quest 3 is not without sacrifice. The Quest 3S has a lower per-eye solution, at 1832 x 1920 per eye, matching that of the now-discontinued Quest 2. The Quest 3 by contrast offers a 4K display with 2064 x 2208 per eye. Plus it has a pancake display design, which is slimmer and less bulky than the Quest 3S's fresnel lens.

Like the Quest 3 and Quest 2 before it, the Quest 3S isn't trying to be Vision Pro or even a Quest Pro. It's a glasses-friendly headset that can track your hands, and ships with controllers for maximum compatibility with games and apps that have not been remade for gesture control.

Meta Quest 3S hands on

(Image credit: Future / Lance Ulanoff)

That fact that the Quest 3S works with glasses is a big deal for many users, including me. There's no need for special lens inserts (which also add cost); the headset can adjust to fit your head and the glasses you wear every day.

Despite the price and some sub-pro specs, the Quest 3S is also a mixed-reality headset with image passthrough capabilities that match those of the Quest 3: 4MP RGB, 18ppd. There's no hardware depth sensor, though, which means some of the headset's recognition of your environment may be lacking.

Meta is pitching the Quest 3S as no less than a do-it-all mixed reality headset, supporting console-level gaming, productivity (look at all those floating browser windows!), exercise, entertainment, and virtual gathering places in the form of Horizon Worlds.

How good is the Meta Quest 3S? I took it for a quick spin, and below you can read my hands-on first impressions – the TLDR version is that this is the well-fitting, easy-to-use, glitch-free performing VR and mixed reality headset that you probably want.

Meta Quest 3S hands on

(Image credit: Future / Lance Ulanoff)

Meta Quest 3S: Specs

Header Cell - Column 0Meta Quest 3SMeta Quest 3
DimensionsRow 0 - Cell 1184 mm x 160 mm x 98 mm
Weight514g515g
DisplayFresnel LensTwo LCD displays
Display resolution1832 x 1920 per eye2064 x 2208 pixels per eye
FOV96 degrees horizontal, 90 degrees vertical110 degrees horizontal, 96 degrees vertical
Refresh rate120Hz72Hz, 80Hz, 90Hz, 120Hz
ChipsetQualcomm Snapdragon XR2 Gen 2Qualcomm Snapdragon XR2 Gen 2
RAM89GB8GB
Storage128GB or 256GB128GB or 512GB
Battery life2 hours 30 minutes2 hours 12 minutes

Meta Quest 3S: Price and availability

Meta unveiled the Quest 3S at its September 25 Meta Connect event. There are two Meta Quest 3S models, and the only difference between them is the amount of on-board storage. The 128GB headset costs $299.99 / £289.99, and the 256GB model costs $399.99 / £379.99. Pre-orders are open now, with shipping from October 15.

Meta Quest 3S hands on

(Image credit: Future / Lance Ulanoff)

Meta Quest 3S: Design

  • Good looks
  • Decent, lightweight feel
  • Nicely adjustable straps
  • Excellent remotes

The hallmark of good VR headset design is when you need a minimum of guidance to get it on your head and find a good fit. In this regard, the Meta Quest 3S largely succeeds.

In my hands, it felt relatively lightweight. At 514 grams (just a bit over a pound) it's just a gram lighter than the Meta Quest 3. It comes with a Y strap that supports the Quest 3S over the top and across the back of your head. I found the strap-adjustment system fairly obvious. There's a pair of plastic strap guides that you push together or pull apart to adjust the tightness of the strap that goes around your head. The top strap uses velcro. As is the case with Apple's Vision Pro, this top strap is critical to comfort; otherwise, the weight of the headgear rests on your face.

Meta has redesigned the face cushions for added comfort. It felt pretty good, but I still found myself sweating underneath the soft foam, although to be fair the demo room was pretty warm.

Button placement is also good. There's a home button on the headset (in case you opt not to use the included remotes) and a volume rocker that I found with a little guidance.

Meta appears to be taking a relatively cavalier attitude when it comes to the fit. The Meta reps just let me slip the headset on over my glasses and make fit adjustments. We never talked about adjusting pupillary distance or focus and, to be honest, none of that seemed to matter.

They handed me the two controllers, which look a bit like white versions of my Meta Quest Pro (RIP) remotes, but without the magnets to hold them together. The remotes, which include safety straps, were comfortable to hold, and my thumbs found the buttons, though I could also see them in passthrough mode.

The Quest 3S is also an able hand-tracker, and you can choose to use the headset without the remote, although not all games and experiences will support it. In any case, I didn't get to try it out during my demo.

Meta Quest 3S: Software and apps

  • Multi-purpose
  • Mixed reality puts windows all around you
  • Gaming FTW

As soon as I put on the headset and it woke from sleep mode I could see a slightly grainy, full-color version of my environment. Also floating in front of me were three screens, for music, applications, and the web browser. I could hold down the Oculus button on the right-hand controller to reset the viewport so all the windows were directly in front of me – this is exactly how it worked with previous Quest headsets.

I've used a number of different VR and mixed-reality headsets, and found the gestures for moving, resizing, and opening applications pretty obvious.

Unlike the Vision Pro, the Quest 3S does not track my vision, so I needed to point at whatever I wanted to move or grab; I couldn't just look and something would light up. Still, for $299.99, no one should be expecting eye tracking.

I was told that I could open multiple web browsers and place them all around the room, but I got stuck at one point and could not seem to move my browser window out of my field of view; it just kept snapping back into place. This is apparently related to the positioning and visibility of the menu bar. There may be a bit of a learning curve for more advanced mixed-reality window placement.

Meta Quest 3S hands on

(Image credit: Future / Lance Ulanoff)

I summoned a virtual keyboard, but instead of typing I selected the microphone icon and said "TechRadar", selected enter, and our homepage loaded. It, like everything I saw in a window, looked very sharp. The Meta Quest 3S lacks the Quest 3's 4K dual displays, but it still delivers HD-quality content to each eye via a fresnel lens (the Quest 3 has slimmer pancake displays).

I also opened the music app and played some smooth jazz. The dual, open-ear speakers deliver crisp, loud, spatial audio that I enjoyed listening to.

Meta Quest 3S hands on

(Image credit: Meta)

After closing TechRadar.com (you, of course, should always keep it open), I opened a canned Dolby Atmos demo and then, using some of the browser settings, switched to Theater mode, which popped the video out of the browser window. When I selected the dimming option, I could turn down the passthrough video until it fell into darkness. I also grabbed a little curve on the lower-left side of the window and made the screen massive. Now it was as if I was in a cavernous movie theater. It's an effect I've seen done somewhat more dramatically on the Vision Pro, but it's still quite effective here.

Meta Quest 3S hands on

(Image credit: Meta)

Game on

I spent the most time, though, inside Batman: Arkham Shadow, an excellent Batman first-person action and puzzle game that looks fantastic on the headset. Unlike my mixed-reality experiences, this is immersive and interactive. so, yes, I stood up to play.

I'll admit, it's been a while since I've played this kind of game on a VR headset, so some of the movement made me a bit dizzy. I needed a minute to get my sea legs under me, and to remind myself that I could turn my head around to look and didn't always need to use the almost too-smooth remote to look around.

Soon I was walking through an abandoned factory space in search of opponents. I learned how to grab climb, fly with my cape, throw a batarang, and use a grappling gun. One of the coolest moments was when I was looking around and noticed my full Batman shadow on the ground. Ii could barely hold back from whispering earnestly, "I'm Batman".

I spent way too much time playing but eventually got stuck. For this, I blame myself, not the game or Quest 3S. I would've kept going, but the headset warned me I was low on power. It's rated for a maximum of 2.5 hours of play, but your mileage will vary based on activity.

In this case, though, many others had been through similar demos before me, and the Quest 3S was just exhausted.

Meta Quest 3S hands on

(Image credit: Future / Lance Ulanoff)

My brief hands-on was just a glimpse of what's possible with the Meta Quest 3. It's a home for gaming (it'll ship bundled with not just the Batman game but a 3-month Quest Plus gaming membership). It's a health and fitness wearable with support for workout games like Supernatural (that'll get a sweat on) and Le Mills XR Bodycombat. There are also more chill-friendly health apps, like Headspace XR.

It's an entertainment platform, with apps like Peacock and Youtube VR (you can watch Netflix, but only in a browser) and there's now a Travel Mode, so you can use it and watch content while on an airplane.

This being Meta, it's also a social tool. I didn't get to try it out, but the Quest 3S supports Horizon Worlds, a social media platform where you can meet up with fellow Quest headset wearers and chat, play, and generally engage. 

Put another way, there's a lot to explore both inside and out on this mixed-reality headset.

Meta Quest 3S: Performace

  • Powerful new Snapdragon XR2 Gen 2 chipset
  • Average battery life of two hours and 30 minutes

Meta Quest 3S hands on

(Image credit: Future / Lance Ulanoff)

Even in my all-too-short demo, I could see that the headset was ready to handle all these activities. That's largely due to the powerful Qualcomm Snapdragon XR2 Gen2 chipset backed by 8GB of RAM – that's the exact same chip you'll find in the pricier Meta Quest 3. One area where Meta did skimp a bit is on-base storage. You get just 128GB, whereas the Quest 3 starts with 512 GB. If you want 256GB on the Quest 3S you'll pay $399 / £379.99.

That's what is key here: Meta has made few noticeable concessions to bring the price of its Quest line down to affordability for the masses. I know, $299.99 isn't cheap, but it does look like an incredible bargain next to the Vision Pro and now-defunct Quest Pro. And if you're comparing it to the $499.99 Quest 3 with its higher-resolution displays and slightly better hardware-based 3D object tracking, it still looks quite good.

I'm pretty sure that Meta has a very popular gift on its hands for Christmas and the holiday season.

Meta’s Orion holographic avatars will (eventually) be in VR too

The company has been working on Codec Avatars for years.

The biggest reveal at Meta’s Connect event was its long-promised AR glasses, Orion. As expected, the prototype, each of which reportedly costs around $10,000, won’t be ready for the public any time soon.

In the meantime, Meta offered a glimpse of its new holographic avatars, which will allow people to talk with lifelike holograms in augmented reality. The holograms are Meta’s Codec Avatars, a technology it’s been working on for several years. Mark Zuckerberg teased a version of this last year when he participated in a podcast interview “in the metaverse.”

That technology may now be closer than we think. Following the keynote at Connect, I sat down with Mark Rabkin, a VP at Meta leading Horizon OS and Quest, who shared more about Meta’s codec avatars and how they will one day come to the company’s VR headsets as well.

“Generally, pretty much everything you can do on Orion you can do on Quest,” Rabkin said. The Codec Avatars in particular have also gotten much easier to create. While they once required advanced camera scans, most of the internal avatars are now created with phone scans, Rabkin explains.

“It’s an almost identical process in many ways in generating the stylized avatars [for VR], but with a different training set and a different amount of computation required,” Rabkin explained. “For the stylized avatars, the model has to be trained on a lot of stylized avatars and how they look and how they move. [It has to] get a lot of training data on what people perceive to look like their picture, and what they perceive to move nicely.”

“For the Codec avatars ... it's the same process. You gather a tremendous amount of data. You gather data from very high-quality, fancy camera scans. You gather data from phone scans because that's how people will be really creating, and you just build a model until it improves. And one of the challenges with both problems is to make it fast enough and computationally cheap enough so that millions and millions can use it.”

Rabkin said that he eventually expects these avatars to be able to play in virtual reality on the company’s headsets. Right now, the Quest 3 and 3S don’t have the necessary sensors, including eye tracking, necessary for the photorealistic avatars. But that could change for the next-generation VR headset, he said: “I think probably, if we do really well, it should be possible in the next generation [of headset].”

Post a Comment

Previous Post Next Post