@MrWhosetheboss video reveals Google's Pixel 8 Pro Tensor G3 off-loads all generative AI tasks to the cloud
@MrWhosetheboss video reveals Google's Pixel 8 Pro Tensor G3 off-loads all generative AI tasks to the cloud
Popular YouTuber @Mrwhosetheboss has singled out the Google Tensor G3 as a major failing of the Pixel 8 Pro. According to the YouTuber, all of the new generative AI features found on the Pixel 8 Pro cannot be processed onboard the device, but need to be off-loaded to the cloud for processing, despit...
You're viewing a single thread.
ITT people who don't understand that generative ML models for imagery take up TB of active memory and TFLOPs of compute to process.
That's wrong. You can do it on your home PC with stable diffusion.
And a lot of those require models that are multiple Gigabytes in size that then need to be loaded into memory and are processed on a high end video card that would generate enough heat to ruin your phones battery if they could somehow shrink it to fit inside a phone. This just isn't feasible on phones yet. Is it technically possible today? Yes, absolutely. Are the tradeoffs worth it? Not for the average person.
He's inaccurate but he's not wrong. It takes a lot of power, relatively speaking, and phones are very power constrained devices.
I think the biggest misunderstanding here is that people are reading the headline as all AI tasks are offloading to the cloud, when it's just the heavy ones. Still a privacy issue for sure, but there's plenty of nuance there that people won't understand.
“He’s off by multiple orders of magnitude, and he doesn’t even mention the resource that GenAI models require in large amounts (GPU), but he’s not wrong”
They aught to just put a phone in a 3090
You can for example run some upscaling models on your phone just fine (I mentioned the SuperImage app in the photography tips megathread). Yes the most powerful and memory-hungry models will need more RAM than what your phone can offer but it's a bit misleading if Google doesn't say that those are being run on the cloud.