Meta today announced the launch of Llama 3.2 to enhance edge AI and vision tasks, offering both small and medium vision LLMs (11B and 90B) and lightweight models (1B and 3B) optimised for on-device use, with robust support for Qualcomm and MediaTek hardware.
“Llama 3.2 models bring state-of-the-art capabilities to developers without the need for extensive resources, enabling innovation and breakthroughs directly on edge and mobile devices,” said Meta chief Mark Zuckerberg.
Interestingly, it claimed to beat all closed source models on vision, including Claude3-Haiku and GPT-40-mini.
Meta Connect 2024 Key Announcements
Unveils Orion AR Glasses, Calls it the “Most Advanced AR Glasses Ever”
In one of the most anticipated announcements, Meta revealed its first functional prototype of the Orion AR glasses, which Zuckerberg described as “the most advanced AR glasses the world has ever seen.”
These glasses represent Meta’s multibillion dollar bet on the future of wearables, positioned as the successor to smartphones. Zuckerberg’s unveiling of Orion signals the company’s serious ambitions to lead the market in augmented reality hardware.
The glasses, most likely powered by Llama, are expected to integrate with other wearables, such as wrist bands, offering users a comprehensive AR experience.
Mark Zuckerberg and $META got Jensen Huang to try out their upcoming AR Glasses 👀
pic.twitter.com/Brsuv7FlgR— Valentin (@KapelleVal99049) September 25, 2024
Limited Edition Clear Ray-Ban Meta Glasses Priced at $429
Meta introduced a limited edition version of its Ray-Ban Meta smart glasses featuring clear, translucent frames, priced at $429—$100 more than the existing translucent models.
These glasses, available only in a “standard” size, come with Transitions lenses and an exclusive custom designed black case.
Showcases Live Language Translation on Ray-Ban Meta Glasses
At Connect 2024, Meta demonstrated a new feature for its Ray-Ban Meta smart glasses: real-time language translation.
In a live demo with mixed martial artist Brandon Moreno, Zuckerberg spoke in English while Moreno responded in Spanish, with the glasses seamlessly translating between the two languages. “This feature could revolutionize how we communicate globally,” he added.
The live translation tool is expected to roll out soon.
Metaverse Avatars with Enhanced Customization, Launching October 1st
Meta rolled out a significant update to its avatars across its platforms, including Meta Horizon OS, Facebook, Instagram, and Messenger, starting October 1st.
The new avatars will provide users with more customisation options, allowing them to fine-tune facial features such as eye size, nose shape, and body proportions.
“We’re giving users unprecedented control over their avatars with a focus on personalisation,” said Aigerim Shorman, VP on the Horizon team, highlighted that the advancements are due to an updated avatar skeleton and underlying tech stack.
This upgrade reflects Meta’s ongoing efforts to enhance user engagement within the metaverse and provide a more immersive and inclusive experience.
Meta App Store Expands to Include 2D and Spatial Apps for Quest Headsets
In an interesting turn of events, Meta made a major shift in its Quest app store by welcoming 2D and spatial apps, marking a significant departure from its focus on 3D and AR apps.
“From today, the Meta app store fully welcomes 2D and spatial apps,” said Horizon OS and Quest VP Mark Rabkin, saying that this expansion would allow developers to create more diverse experiences, integrating traditional 2D applications alongside virtual and augmented reality.
Introduces Quest 3S VR Headset with Enhanced Battery Life at $299.99
Meta launched the much anticipated Quest 3S VR headset, priced at $299.99—almost half the price of its predecessor, the Quest 3.
Despite its lower cost, the Quest 3S offers many of the same features, including mixed reality capabilities, Qualcomm’s Snapdragon XR2 Gen 2 chip, and compatibility with the same games and experiences as the Quest 3.
The 3S boasts longer battery life, rated at 2.5 hours versus the Quest 3’s 2.2 hours.
“Our third era is a stable era. Quest 3S is the perfect platform for users and developers to build immersive VR experiences,” said Rabkin.
Discontinues Quest Pro VR Headset After Lackluster Reception
Meta announced the discontinuation of its high-end Quest Pro VR headset, which launched in 2022 but failed to gain significant traction in the market.
The company will continue selling the remaining stock through the end of 2024.
Despite the initial excitement surrounding the device, user feedback criticised its comfort and performance, particularly in professional settings. It is interesting to note that Meta acknowledged the limitations of Quest Pro but remains committed to refining future VR products.
Introduces Celebrity Voices for Chatbots in Instagram, WhatsApp, and Facebook
Meta said it is enhancing its AI chatbot experience by introducing celebrity voices in Instagram, WhatsApp, and Facebook. Among the notable personalities lending their voices are Awkwafina, John Cena, and Judi Dench.
“Voice will be one of, if not the most frequent, ways we interact with AI in the future,” said Zuckerberg.
Releases Logitech MX Ink Stylus for Precision Drawing on Quest VR Headsets
Meta, in collaboration with Logitech, officially released the MX Ink Stylus, designed for precision drawing and object manipulation in virtual reality. Priced at $129.99, the stylus works across 2D and 3D creative software on the Quest 3S, Quest 3, and Quest 2 headsets.
Artists and designers will benefit from the pen-like experience that offers more accuracy compared to standard controllers. Meta’s partnership with Logitech underscores its commitment to enhancing the creative potential of its VR platforms. The stylus is already compatible with popular apps like Open Brush and Adobe Substance 3D Modeler.
MX Ink is here! Unlock new dimensions of creativity with our mixed reality stylus, now available for #MetaQuest including the new Meta Quest 3S. Ready to create without limits? 🚀 #MetaConnect2024 https://t.co/9qDvFmtqD3 pic.twitter.com/ZLt1gDwajV
— Logitech (@Logitech) September 25, 2024
Create AI Avatars with Prompts
Meta also announced its ambitious plans for the future of avatars. The company said that by 2025, users will be able to generate avatars simply by using AI prompts.
“This technology will give people the ability to create lifelike avatars that reflect their personality with just a simple prompt,” said Zuckerberg, highlighting the importance of integrating AI in the metaverse.
This new development will allow users to create avatars simply based on text descriptions/prompts.
