Fabien Herry's picture

3 4

Fabien Herry

Gahnos

·

AI & ML interests

Currently learning to become an IA Dev

Recent Activity

liked a model 5 days ago

impira/layoutlm-document-qa

liked a Space 26 days ago

Qwen/Qwen3-TTS

reacted to mindchain's post with 🧠 about 2 months ago

Neural Traffic Control: Orchestrating Multi-Path Reasoning 🚥 The future of AI isn't just about "better" models—it’s about high-precision orchestration. We are moving from linear processing to Parallel MTP-Reasoning, where we manage neural traffic across stabilized, transparent, and recursive highways. 1️⃣ The Backbone: Stabilized High-Dimensional Routing (arXiv:2512.24880) Using DeepSeek’s mHC (Manifold-Constrained Hyper-Connections), we solve the instability of deep MoE architectures. By projecting weight updates onto the Birkhoff Polytope, we ensure that our "Simpsons-style" expert lanes maintain mathematical identity. This is the hardware-level stability needed to run multiple reasoning paths without collapse. 2️⃣ The Vision: Gemma Scope 2 & Feature Steering You can't steer what you can't see. Gemma Scope 2 provides the "X-ray" for our highways. By using Sparse Autoencoders (SAEs), our Meta-Controller identifies the active features in each expert lane. We don't just route data; we route intent by monitoring feature-drift in real-time. 3️⃣ The Logic: Recursive Open Meta-Agents (arXiv:2512.24601) We integrate the ROMA (Recursive Open Meta-Agent) framework. Instead of a flat response, the model operates in a recursive loop, refining its internal state before any output occurs. This is the "brain" of our [Meta-Controller GitHub Repo], enabling the model to simulate and discard weak logic internally. 4️⃣ The Simulation: Parallel MTP-Reasoning This is where it comes together: Multi-Token Prediction (MTP) meets Parallel Simulation. Our Python-driven controller runs three parallel Gemma 3 instances. The Process: 3 paths generated simultaneously. The Filter: A 500-token lookahead window. The Decision: The Meta-Controller uses SAE-data from Gemma Scope to select the path with the highest logical fidelity. The Result: A self-correcting, transparent, and multi-threaded reasoning engine. We aren't just scaling parameters; we are scaling architectural precision. 🧠

View all activity

Organizations

models 0

None public yet

datasets 0

None public yet