Microsoft’s New On-Device AI ‘Mu’ Is Here: 5 Things You Might Have Missed

By Admin

26 Jun, 2025

Microsoft has quietly launched a new game-changing AI model called Mu, designed exclusively for Copilot+ PCs. While most of the excitement around Copilot+ revolves around flashy cloud-based features, Mu offers a refreshing and practical shift in direction it runs entirely on your device.

In this blog, we’ll explore five key things about Mu that you might have missed while scrolling through headlines. So, without wasting any more time, let’s dive in:

1. Mu Works Entirely On Your Device

In an era where AI tools often require constant internet access, Mu breaks the mold. This lightweight model runs locally using your PC’s Neural Processing Unit (NPU). That means no reliance on cloud servers, and as a result:

• You get faster performance
  
  

• Your data stays private it never leaves your device
  
  

• It works offline, perfect for travel or spotty internet conditions
  
  

2. It’s Tiny but Incredibly Fast

Mu weighs in at just 330 million parameters a fraction of the size of massive models like GPT-4 or Gemini. Yet, its performance is surprisingly impressive. On optimized machines like the Surface Laptop 7, Mu can generate over 200 tokens per second, enabling smooth, real-time interactions.

3. You Can Use Plain English to Control Settings

Forget navigating multiple layers of settings. With Mu integrated into the Windows Settings app, you can simply type in commands like:

• “Increase font size”
  
  

• “Turn on dark mode”
  
  

• “Change Wi-Fi network”
  
  

Mu understands natural language and takes you straight to the right setting saving time and clicks.

4. Optimized for All Major Chipmakers

Microsoft didn’t build Mu in isolation. They partnered with the biggest names in hardware AMD, Intel, and Qualcomm to ensure seamless compatibility. No matter what kind of Copilot+ PC you own, you’re getting a tailored version of Mu that balances performance and battery life.

5. It’s Free and Already Available for Insiders

If you're part of the Windows Insider Program and own a Copilot+ PC, you can try Mu today completely free. Microsoft plans to expand availability in the coming weeks, so more users can experience on-device AI at its finest.

A Global Trend Toward Lightweight, Local AI

Interestingly, Mu isn’t the only project aiming to make powerful AI more accessible. I recently spoke with Hrishikesh Dewan, founder and CEO of Ziroh Labs, an Indian startup that’s working on Kompact AI. This innovative platform allows complex AI models to run on regular CPUs, eliminating the need for costly GPUs. It’s a promising sign that on-device AI is going to be a global movement not just a Microsoft initiative.

As AI continues to evolve, tools like Mu and Kompact AI are quietly redefining what’s possible on everyday devices. Keep an eye on this space because the next big thing in AI might already be running on your laptop.