Microsoft’s Windows ML is ready to boost local AI

Microsoft has announced that its Windows ML technology is now generally available, seven years after its initial introduction. Windows ML is a key development for local AI and the chips that power its use. Windows ML aims to solve the persistent problem of consumers not caring where AI resides, as many associate "AI" with cloud-based services like ChatGPT. The technology is designed to optimize the use of available hardware resources, including CPUs, GPUs, and NPUs, for AI-powered applications. By allowing developers to build AI experiences that can run locally on a PC, Windows ML enables more responsive, private, and cost-effective AI solutions. The technology can allocate tasks or apps to the most suitable hardware, potentially prioritizing NPU efficiency or GPU power, depending on the specific requirements. This development is expected to benefit the AI ecosystem, as it provides a streamlined approach to model dependency management and on-device model inference, aligning with the growing investment in local AI by chipmakers like Qualcomm, Intel, and AMD.