For AI hardware to support local large language models, generative AI, and more, it’s not enough. Hardware vendors must become middlemen or developers for local AI apps as well.
Qualcomm made strides in this direction at MWC 2024 by introducing the Qualcomm AI Hub. This hub houses over 75 optimized AI models for Qualcomm and Snapdragon platforms. They showcased a seven-billion-parameter local LLM on a PC and Snapdragon phones, enhancing the local AI experience.
However, more PC and chip vendors need to provide real-world AI examples to promote local AI adoption. Making local AI accessible and affordable is crucial for convincing users to embrace it, but few have taken the necessary steps.
The PC industry faces challenges due to competition from smartphones and cloud-based devices. While the first AI examples ran in the cloud, the PC industry needs to catch up. Microsoft’s focus on cloud-based AI with limited local options shows the need for more local AI initiatives.
Chip and hardware vendors must address the user’s skepticism towards AI and showcase the benefits of local AI. Software, rather than hardware, holds the key to promoting local AI adoption.
The answer is apps: lots and lots of apps
Microsoft’s AI Hub on the Microsoft Store lacks robust local AI options, with many chatbot apps running in the cloud. Hardware vendors like MSI are starting to offer AI apps, but there’s a shortage of local AI solutions. AMD and Intel highlight their chip performance on AI models, but more consumer-focused efforts are needed.
To make local AI more accessible, chip vendors should offer trial subscriptions of AI-powered apps and bundle them with hardware. Marketing AI bundles and collaborating with software providers can drive local AI adoption. Prioritizing software over hardware and simplifying the local AI experience is crucial for the success of local AI initiatives.
Running AI locally provides privacy benefits, but the ease of cloud-based tools can overshadow local AI advantages. Chip vendors must act swiftly to make local AI simple, affordable, and widespread to compete in the fast-paced AI landscape.
