RedHatAI
/

Meta-Llama-3.1-70B-Instruct-FP8

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Will there be a 405B FP8 pushed?

#1

by RonanMcGovern - opened Jul 24, 2024

thanks

Yes! That will be released today.

Great, thanks.

RonanMcGovern changed discussion status to closed Jul 24, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment