Meta releases Muse Glimmer, a 30B parameter local agentic AI model

The new open-weight model is designed for long-horizon reasoning and can run on consumer hardware with a single GPU.

Image: NVIDIA Developer

Meta has introduced Muse Glimmer, a 30-billion-parameter dense model optimized for local agentic workloads. Unlike chat-focused models that prioritize rapid initial responses, Muse Glimmer is engineered for sustained, multi-step tasks such as software automation, file management, and complex reasoning. The model utilizes a dense architecture that activates every parameter for each token, which Meta claims provides higher reliability and more predictable latency compared to mixture-of-experts alternatives.

To facilitate local execution, the model is available under the Apache 2.0 license. While a full-precision 30B model typically requires over 55GB of memory, Meta states that a 4-bit quantized version reduces the footprint to under 20GB. This allows the model to operate within the 24GB or 32GB memory constraints of high-end consumer systems. The company also implemented DFlash speculative decoding to enhance token generation speeds, reporting significant performance gains on hardware like the Nvidia RTX 5090 and Apple M-series chips.

The model features a 120K+ context window and was trained using logit distillation from the Muse Spark model, followed by supervised fine-tuning and reinforcement learning. Meta reports that Muse Glimmer outperforms models like Gemma4-31B and Qwen3.6-27B on several benchmarks, including those measuring coding proficiency and multi-step reasoning. It supports over 100 languages and is compatible with agent frameworks such as OpenClaw.

Deployment is supported through various inference stacks, including vLLM, SGLang, and llama.cpp. For enterprise or edge environments, the model can be deployed via Nvidia NIM containers or on hardware like the Nvidia Jetson. Developers can further refine the model using tools like NeMo AutoModel for fine-tuning or NeMo RL for reinforcement learning. The model weights are currently available for download on Hugging Face.

Sources

  1. NeowinMeta releases Muse Glimmer, a 30B open agentic AI model that runs locally on PCs
  2. NVIDIA DeveloperRun Local Agentic AI Workflows with Meta’s Muse Glimmer on NVIDIA
  3. EngadgetMeta's 'open source' Muse Glimmer model can run on a single computer