Qualcomm Taps Meta for On-Device Generative AI
Qualcomm and Meta are working to optimize the execution of Meta's Llama 2 large language models directly on-device. Qualcomm aims to make available Llama 2-based AI implementations on flagship smartphones starting from 2024. This will enable new generative AI features on phones such as "intelligent virtual assistants, productivity applications, content creation tools, entertainment, and more." Most generative AI products such as ChatGPT and DALL·E 2 currently run in the cloud. By putting this technology on-device, these features can be cheaper, private & secure, more personalized, and work offline. Qualcomm successfully demonstrated on-device generative AI earlier this year.