At Build 2023, Qualcomm and Microsoft join forces to enhance on-device AI capabilities.
The Rise of Generative AI
In the year 2023, there’s an unstoppable duo capturing attention—and it’s not Gen Z with their retro flip phones. We’re talking about generative AI, the learning models that have sparked a boom in creative content generation, ranging from text and images to videos and audio.
Until now, accessing generative AI required a connection to internet-connected data servers. However, during Microsoft’s annual Build event, an exciting announcement was made: a partnership between Microsoft and Qualcomm to accelerate on-device computing.
Empowering Devices: Qualcomm’s AI Stack
In a press release, Ziad Asghar, Senior Vice President of Product Management at Qualcomm Technologies, highlighted the need for executing generative AI tasks on edge devices for true mainstream adoption. These edge devices include smartphones, tablets, laptops, cars, and other Internet of Things (IoT) products.
To enable future Qualcomm-powered devices to perform generative AI tasks, the company is promoting its own AI Stack—an integrated development platform that empowers OEMs and developers to create, test, and distribute applications. With the Qualcomm AI Stack, applications can be seamlessly deployed across all edge devices.
Windows on Snapdragon: A Collaboration for Scaling On-Device AI
Another remarkable solution for scaling on-device AI is the collaboration between Qualcomm and Microsoft through Windows on Snapdragon. Initially introduced with the Surface Pro X, this partnership will see future Windows 11 PCs equipped with Qualcomm’s latest Snapdragon 8cx Gen 3 processor.
This processor incorporates a built-in neural processing unit (NPU) designed to provide dedicated and efficient AI experiences, surpassing the capabilities of traditional CPUs and GPUs. Notably, owners of Microsoft Surface Pro 9 5G or Lenovo ThinkPad X13S devices can already benefit from Qualcomm’s on-device AI features.
Unleashing Creativity and Enhancing Security
Aside from the convenience of generating content without an internet connection, Qualcomm’s advancements in Stable Diffusion and on-device generative AI hold promise for a future where machine-learning workloads demand fewer resources and less time.
Moreover, thanks to localized data processing, the enhanced security of these solutions becomes a significant advantage.
Embracing the Future of Generative AI
The advancements made by Qualcomm and Microsoft in on-device generative AI are set to excite consumers, developers, and business users alike. The possibilities for creative content generation are endless, and the convenience and security provided by localized processing are unparalleled.
Wrapping Up
The collaboration between Qualcomm and Microsoft at Build 2023 has paved the way for a new era of on-device AI capabilities. The rise of generative AI has enabled creative content generation in various forms.
Now, with Qualcomm’s AI Stack and the Windows on Snapdragon partnership, these capabilities will be accessible on a wide range of edge devices, from smartphones to laptops and cars.
Users can enjoy the convenience of generating content even in Airplane Mode while benefiting from the enhanced security and efficiency of localized data processing. The future of generative AI looks promising, and these advancements open up a world of possibilities for consumers, developers, and business users alike.
FAQs
1. What is generative AI?
Generative AI refers to learning models that have the ability to create and generate content, such as text, images, videos, and audio, based on patterns and examples from existing data.
2. How was generative AI accessed before on-device capabilities?
Previously, accessing generative AI required a connection to data servers on the internet, as the processing power and resources needed for generating content were primarily located in remote servers.
3. What is Qualcomm’s, AI Stack?
Qualcomm’s AI Stack is an integrated developer platform that empowers OEMs and developers to create, test, and distribute applications with generative AI capabilities. It enables seamless deployment of applications across a wide range of edge devices, including smartphones, tablets, laptops, cars, and IoT products.
4. What is Windows on Snapdragon?
Windows on Snapdragon is a collaboration between Qualcomm and Microsoft that brings the benefits of Qualcomm’s Snapdragon processors, equipped with built-in neural processing units (NPUs), to Windows devices. This collaboration enables enhanced on-device AI experiences, surpassing the capabilities of traditional CPUs and GPUs.
5. How does on-device AI enhance security and efficiency?
On-device AI eliminates the need for data to be processed in remote servers, keeping sensitive information localized and reducing the risk of data breaches.
Also, by performing AI tasks directly on the device, there is a reduction in latency and resource requirements, resulting in improved efficiency and faster response times.
