Running AI on your device is cheaper and more private than relying on the cloud.
Generative AI is slowly worming its way into every facet of technology, and next up is your smartphone. Qualcomm says that its next flagship mobile chips are going to be built specifically to run generative AI on the silicon, reducing reliance on the cloud. Running an AI on your phone could be a boon for privacy, but is generative AI ready for that kind of integration?
Google and Apple have been putting more serious machine learning accelerators in their devices for a bit now. It enables some nice features, like on-device speech-to-text and improved photo processing.
At least when the generative AI hype dies down there will still be legitimate uses for the hardware.