amd/SmolLM2-135M-Instruct-onnx-ryzenai-1.7-hybrid

  • Introduction

    This model was prepared using the AMD Quark Quantization tool, followed by necessary post-processing.

  • Quantization Strategy

    • AWQ / Group 128 / Asymmetric / UINT4 Weights / BFP16 activations
    • Excluded Layers: None
  • Quick Start

For quickstart, refer to Ryzen AI documentation

License

Modifications copyright(c) 2026 Advanced Micro Devices,Inc. All rights reserved.

MIT License

Copyright (c) 2026 Advanced Micro Devices, Inc

Apache 2.0

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for amd/SmolLM2-135M-Instruct-onnx-ryzenai-1.7-hybrid

Quantized
(95)
this model

Collection including amd/SmolLM2-135M-Instruct-onnx-ryzenai-1.7-hybrid