Nvidia Nemotron 3.5 Lightning Delivers Open Datasets and Transparent Recipes to Challenge Opaque AI Models

SANTA CLARA, Calif. — In a decisive departure from the industry convention of distributing artificial intelligence models as opaque binary files, Nvidia has released Nemotron 3.5 Lightning alongside its complete pre-training datasets, curation pipelines, and post-training alignment recipes. The release introduces a sparse Mixture-of-Experts architecture designed specifically for high-throughput enterprise agent execution while handing Chief Information Security Officers and DevSecOps engineers the transparent data lineage required to audit models for security vulnerabilities, copyright liabilities, and regulatory compliance.

The new model, officially designated NVIDIA-Nemotron-3.5-Lightning-30B-A3B, pairs 30 billion total parameters with just 3 billion active parameters per token. By coupling sparse parameter activation with native Multi-Token Prediction heads, the system delivers the analytical depth of mid-tier enterprise models at the operational latency of lightweight language engines.

Nvidia is releasing the entire pipeline code under the permissive OpenMDW-1.1 standard established in partnership with the Linux Foundation and the PyTorch Foundation. This strategic move directly challenges the semi-open licensing paradigms of rivals like Meta and Mistral, positioning Nvidia's software framework as an auditable, enterprise-grade operating system for autonomous agents.

SDG
Nemotron-RL Terminal Trajectories
Nemotron 3.5 Lightning 30B-A3B
TensorRT-LLM NVFP4 Quantization
NeMo Switchyard Router
Workstations: RTX 5090 / DGX Spark
Data Centers: Hopper H100 / Blackwell B200
NeMo Curator Ingestion & Deduplication] --> SDG[Synthetic Data & SFT Sandboxes

Technical Architecture and Benchmark Execution

Nemotron 3.5 Lightning addresses the core bottleneck of autonomous enterprise agents: repetitive, latency-sensitive sub-tasks such as executing terminal commands, parsing unstructured JSON, resolving shell errors, and querying corporate databases. Standard dense models often stall when running long tool-calling loops, accumulating latency across multi-step plans.

The 30B-A3B architecture activates only 3 billion parameters during any single forward pass, substantially reducing compute overhead. To accelerate token generation further, Nvidia integrated native speculative decoding directly into the architecture via two specialized draft engines:

• DSpark: A lightweight speculative drafting model configured for low-concurrency edge setups and developer workstations.
• DFlash: A high-throughput speculative decoding engine tuned for high-batch enterprise clusters running on Hopper and Blackwell silicon.

On agentic execution benchmarks, Nemotron 3.5 Lightning achieved an 86 percent success rate on PinchBench, matching leading 35B dense baselines while completing multi-step autonomous workloads 30 percent faster. When compiled in the TensorRT-LLM runtime with native NVFP4 (4-bit floating point) quantization, single-stream throughput scales up to 670 tokens per second.

The Open-Recipe Paradigm: Data Provenance and Synthetic Alignment

Where competing foundation models publish only post-trained weights accompanied by high-level marketing papers, Nvidia has open-sourced the underlying dataset pipeline, enabling reproducible inspection of every token stage.

Pre-training corpora were filtered using NeMo Curator, an open-source pipeline executing heuristic quality filtering, exact and MinHash/LSH fuzzy deduplication, and domain classification. The framework applies automated Personal Identifiable Information (PII) scrubbing and toxicity filtering, providing enterprise compliance teams with verifiable data hygiene rules.

# Sample NeMo Curator data ingestion and deduplication command
python -m nemo_curator.cli.deduplicate \
 --input-data-dir /data/raw_corpora \
 --output-dir /data/curated_corpora \
 --minhash-threshold 0.85 \
 --filter-pii \
 --language en

For agentic tool use, Nvidia published the Nemotron-RL Agentic Terminal Pivot v1 dataset on Hugging Face. This repository supplies verified multi-turn bash execution traces, recovery trajectories, and shell state transitions. Training on verified terminal state machines rather than unvalidated web scrapes significantly curtails CLI command and argument hallucinations during tool execution.

Synthetic generation recipes draw on the Nemotron-4 340B framework and HelpSteer2 preference alignment datasets. Every synthetically generated reasoning trajectory was validated through deterministic sandboxes—including live Python compilers and test harnesses—prior to inclusion in the supervised fine-tuning mix.

For enterprise engineering teams, genuine software openness in artificial intelligence requires inspecting training distributions and alignment code rather than trusting an opaque binary checkpoint.

Enterprise DevSecOps, Supply Chain Security, and Compliance

For security leaders, the open-recipe structure transforms model evaluation from black-box behavioral testing into verifiable software supply chain auditing.

• AI Software Bill of Materials (SBOM): Transparent dataset splits enable DevSecOps teams to inspect training shards for poisoned data injections, hidden backdoor triggers, or unauthorized source material.
• Regulatory Compliance Readiness: The documentation provided with the data curation stack fulfills transparency criteria mandated for General-Purpose AI (GPAI) under the European Union AI Act, including data provenance documentation, energy consumption tracking, and risk assessment reporting.
• Air-Gapped Privacy: Because the NVFP4-quantized model consumes under 8 gigabytes of VRAM, organizations in defense, healthcare, and finance can deploy local execution workers entirely within on-premise infrastructure or isolated virtual private clouds, eliminating data exfiltration risks inherent to commercial cloud API endpoints.
• Execution Layer Sandboxing: Integrated with NemoClaw and NeMo Guardrails, the system supports programmatic policy enforcement, blocking unauthorized shell commands or privilege escalation attempts at the inference layer.

Two-Tier Agent Architectures and Hardware Orchestration

In enterprise production environments, Nemotron 3.5 Lightning operates as a dedicated execution engine within a tiered routing topology governed by NeMo Switchyard.

sequenceDiagram
 autonumber
 actor User as Enterprise System
 participant Router as NeMo Switchyard Router
 participant Frontier as Frontier Orchestrator (Claude 3.5 / GPT-4o)
 participant Lightning as Nemotron 3.5 Lightning (Local NVFP4)
 participant Sandbox as Corporate Runtime / CLI

 User->>Router: Complex Enterprise Request
 Router->>Frontier: Plan High-Level Strategy & Architecture
 Frontier->>Router: Deconstruct into Discrete Sub-Tasks
 loop High-Throughput Execution
 Router->>Lightning: Dispatch Tool Call / SQL / Terminal Task
 Lightning->>Sandbox: Execute Command in Sandbox
 Sandbox-->>Lightning: Return Execution State / Error Trace
 Lightning-->>Router: Format Output & Structured JSON
 end
 Router-->>User: Synthesized Final Result

Under this split-architecture deployment, large frontier models handle broad multi-step planning, while localized Nemotron 3.5 Lightning instances execute individual sub-tasks—such as linting code, running regular expressions, parsing server logs, and executing SQL migrations—at hardware speed.

On Nvidia Blackwell (B200 and GB200) architectures, native Tensor Core micro-scaling leverages NVFP4 to maximize batch concurrency without precision degradation. On workstations equipped with an RTX 5090 or DGX Spark, developers can host local execution agents alongside development environments without saturating system memory.

Commercial Licensing and Deployment Verdict

Nvidia’s adoption of the OpenMDW-1.1 license establishes a distinctly permissive commercial framework. Unlike Meta's community license, which enforces a 700-million monthly active user threshold and restricts using model outputs to improve competing models, OpenMDW-1.1 imposes no commercial user caps across weights, pipeline recipes, and alignment data.

The primary operational consideration lies in software infrastructure. While Nemotron 3.5 Lightning remains functionally compatible with open-source runtimes like vLLM and SGLang, unlocking peak throughput of 670 tokens per second and native speculative decoding requires compiling the model within Nvidia's TensorRT-LLM environment.

For enterprise decision-makers evaluating long-running autonomous workflows, the Nemotron 3.5 Lightning release represents a viable, auditable alternative to opaque commercial APIs. By combining sparse MoE efficiency, complete data provenance, and permissive licensing, Nvidia has established a new benchmark for transparent, production-grade enterprise AI infrastructure.