Open-weight hybrid Mamba-Transformer MoE with ~3.5B active parameters for cost-efficient, high-throughput agentic reasoning and tool use.
Open-weight hybrid Mamba-Transformer MoE with ~3.5B active parameters for cost-efficient, high-throughput agentic reasoning and tool use.
Answers to common questions about integrating and using this AI model via AnyAPI.ai
It supports up to 1M tokens in supported self-hosted configurations, with 256K as the common default due to VRAM requirements. NVIDIA's hosted model card lists more conservative limits, and third-party APIs commonly expose 128K to 262K. Verify the exact context length your chosen provider offers before building long-context workloads.
It is open-weight, released by NVIDIA under the NVIDIA Open Model License, which permits commercial use. NVIDIA published weights on Hugging Face in BF16, FP8, and NVFP4 precisions, along with datasets and recipes. This lets teams self-host, fine-tune, and deploy in air-gapped or cost-constrained environments.
Yes. It supports function/tool calling and has a configurable reasoning mode toggled via a chat-template flag, with a controllable reasoning budget. Tool use significantly improves accuracy—for example, AIME 2025 rises from 89.1% without tools to 99.2% with Python tooling, making it well suited to agentic pipelines.
It is capable but not a coding specialist. It scores 38.8% on SWE-Bench (OpenHands)—ahead of same-tier open models but below dedicated coding frontier models—and 68.3% on LiveCodeBench v6. Use it when coding is part of a broader reasoning or agentic workflow; choose a specialist model for autonomous software-engineering agents.