Why On-Device AI Is the future of consumer and enterprise applications | Computer Weekly
Summary
From optimising smart home appliances to automatically drafting a client contract, on-device generative AI—and the productivity apps it can enable—are the key to unlocking an exciting new epoch in the smartphone and PC markets. Deploying AI natively on these devices will entice enterprises due to the value generated from offline productivity, lower latencies, enhanced data privacy, improved user-device communication, and model personalisation. ABI Research has seen the earliest deployments of on-device AI within the enterprise occur in back-end operations, offices, and professional services sectors, as early applications (like Microsoft Copilot) offer a clear ROI. While smartphones and PCs hold the lions share of the on-device AI discussion for enterprises, the same benefits can be applied to the automotive, XR, and Internet of Things (IoT)/wearables spaces. For example, ultra data-sensitive applications may have model training take place in the cloud, while inferencing and fine-tuning these models—which leverage user data—occur on-device to ensure maximum privacy.