RESEARCH PREVIEW Polaris-V1 (4B) 1.59M Token Context model preview now open.
Open-Weights Reasoning Models • Local GPU Execution

Open reasoning models,
compiled for consumer hardware.

NitrAI captures multi-step coding trajectories and mathematical proofs from frontier models—packaging them into efficient 9B & 4B architectures designed for local execution on everyday GPUs and CPUs.

GGUF / bfloat16
ollama run nitrai/opengcm-v2:9b
1.59M
Max Token Context (YaRN)
5.4 GB
Min VRAM Footprint
140+ tok/s
Local RTX 4090 Inference
opengcm-v2-eval.py
RTX 4060 (8GB VRAM)

Core Engineering Objectives

Our work focuses on extracting structural cognitive trajectories into efficient open architectures without datacenter hardware dependencies.

01

Frontier Trajectory Extraction

We extract multi-step reasoning traces, coding trajectories, and mathematical proof structures from large frontier models (GPT-5.5, Claude-Fable-5, GLM-5.2) into open-weights base architectures.

  • Verified synthetic trace datasets
  • Filtered multi-file debugging paths
  • Clean 2026 instruction tuning
02

Consumer Hardware Optimization

Models are quantized and compiled with custom CUDA and Apple Metal kernels to ensure low-latency inference on desktop and laptop hardware.

  • Apple Metal acceleration (M1–M4)
  • Consumer NVIDIA CUDA kernels
  • AVX-512 CPU execution fallback
03

Agentic & Formal Reasoning

Architectures are specifically fine-tuned for agentic multi-turn workflows, long-context code comprehension, and formal Lean 4 proof validation.

  • Multi-file system refactoring
  • Formal Lean 4 theorem proving
  • 1.59M token context retrieval

Model Specifications

Lightweight open models designed for local deployment and specialized reasoning tasks.

Open Weights Ready Base: Qwen3.5-9B

OpenGCM-v2 (9B Parameters)

OpenGCM-v2 is our flagship reasoning model, engineered to deliver structured code synthesis and formal logical proofs within a 9-billion parameter budget.

Base Architecture Qwen3.5-9B
Context Window 262,144 Tokens (262k)
Target Hardware 6GB+ VRAM / 12GB RAM
Distillation Source GPT-5.5 & Claude-Fable-5

Technical Features

  • Distilled Multi-Step Reasoning: Structured thinking tokens for theorem proving and calculus resolution.
  • Agentic Code Trajectories: Native handling of multi-file refactoring, system-level debugging, and review tasks.
  • Optimized Local Execution: Low latency and small memory footprint on standard consumer GPUs.
Download Weights
Quick Launch gguf / safetensors
# Run via Ollama (Q4_K_M)
ollama run nitrai/opengcm-v2

# Python SDK
from nitrai import NitrClient

client = NitrClient(model="opengcm-v2-9b")
res = client.reason(prompt="Analyze FFI memory layout")
print(res.text)

Distillation Workflow

A four-stage engineering pipeline for capturing reasoning patterns and compiling open weights.

Teacher Models GPT-5.5 / Claude-Fable-5
Verification Engine Lean 4 & Execution Sandbox
YaRN Context Scaling RoPE Interpolation (1.59M)
NitrAI Local Weights GGUF / bfloat16 Kernels
01

Trajectory Capture

Extracting multi-agent tool execution, code edits, and proof trees from frontier models.

02

Formal Verification

Automated filtering using Lean 4 theorem provers and sandbox test suites.

03

YaRN Context Scaling

Attention interpolation scaling effective context to 1.59M tokens.

04

Quantization & Kernels

Compiling bfloat16 weights into native Metal/CUDA kernels for local hardware.

STAGE 01 DETAIL

Frontier Trajectory Capture

We record synthetic reasoning traces from large closed models. NitrAI captures internal thinking blocks, self-correction loops, and multi-file code investigation paths rather than simple prompt-completion pairs.

VRAM Footprint & Speed Estimator

Calculate expected memory consumption and inference speeds based on target hardware.

32,768 tokens
Estimated VRAM Footprint
5.42 GB
Fits with headroom
Predicted Speed
84 tok/s
Local generation rate
Hardware Compatibility
GPU hardware acceleration supported.

Reasoning Trajectory Output

Select a task to inspect distilled reasoning streams and code output.

Select Sample Task

NitrAI Stream

Run OpenGCM-v2 Locally

Compatible with standard local inference engines and frameworks.

# Pull and run OpenGCM-v2 (9B) locally via Ollama
ollama run nitrai/opengcm-v2

# Run query with reasoning trajectory enabled
ollama run nitrai/opengcm-v2 "Analyze memory leaks in this Rust binary..."
EARLY RESEARCH ACCESS

Request Polaris-V1 (4B) Access

Test 1.59M token context windows and 2026 frontier distillation on local GPU hardware.

Research updates & model weight drops only.