DistilBERT Amazon Shoe Reviews β ONNX Optimized
Graph-optimized ONNX export of juliensimon/distilbert-amazon-shoe-reviews for faster CPU inference using Optimum.
Video walkthrough: Accelerate Transformer inference on CPU with Optimum and ONNX
Model Details
| Detail | Value |
|---|---|
| Base model | juliensimon/distilbert-amazon-shoe-reviews |
| Task | Star rating prediction (1β5 stars) from shoe reviews |
| Format | ONNX with graph optimizations (operator fusion, constant folding) |
Usage
from optimum.onnxruntime import ORTModelForSequenceClassification
from transformers import AutoTokenizer, pipeline
model = ORTModelForSequenceClassification.from_pretrained("juliensimon/distilbert-amazon-shoe-reviews-onnx-optimized")
tokenizer = AutoTokenizer.from_pretrained("juliensimon/distilbert-amazon-shoe-reviews-onnx-optimized")
classifier = pipeline("text-classification", model=model, tokenizer=tokenizer)
classifier("These shoes are incredibly comfortable!")
Related Models
- distilbert-amazon-shoe-reviews β Original PyTorch model
- distilbert-amazon-shoe-reviews-onnx β Vanilla ONNX export
- distilbert-amazon-shoe-reviews-onnx-quantized β ONNX with dynamic quantization
- distilbert-amazon-shoe-reviews-quantized β PyTorch dynamic quantization
- Downloads last month
- 8
Model tree for juliensimon/distilbert-amazon-shoe-reviews-onnx-optimized
Base model
juliensimon/distilbert-amazon-shoe-reviews