| --- |
| license: apache-2.0 |
| tags: |
| - generated_from_trainer |
| base_model: mistralai/Mistral-7B-Instruct-v0.1 |
| model-index: |
| - name: fiveflow/ATOMM-v0.18 |
| results: [] |
| language: |
| - ko |
| --- |
| |
| How to use |
|
|
| ```Python |
| from transformers import AutoModelForCausalLM, AutoTokenizer, TextGenerationPipeline |
| model_path = 'fiveflow/ATOMM' |
| tokenizer = AutoTokenizer.from_pretrained(model_path) |
| model = AutoModelForCausalLM.from_pretrained(model_path, |
| device_map="auto", |
| # load_in_4bit=True, |
| low_cpu_mem_usage=True) |
| |
| pipe = TextGenerationPipeline(model = model, tokenizer = tokenizer) |
| ``` |
