Spaces:
Running on Zero
Running on Zero
Models
Browse files
README.md
CHANGED
|
@@ -1,62 +1,81 @@
|
|
| 1 |
-
---
|
| 2 |
-
title: LTX 2.3 Studio
|
| 3 |
-
emoji: 🎬
|
| 4 |
-
colorFrom: purple
|
| 5 |
-
colorTo: blue
|
| 6 |
-
sdk: gradio
|
| 7 |
-
sdk_version: "5.50.0"
|
| 8 |
-
app_file: app.py
|
| 9 |
-
python_version: "3.11"
|
| 10 |
-
suggested_hardware: zero-a10g
|
| 11 |
-
hf_oauth: false
|
| 12 |
-
|
| 13 |
-
-
|
| 14 |
-
-
|
| 15 |
-
-
|
| 16 |
-
-
|
| 17 |
-
-
|
| 18 |
-
- Lightricks/LTX-2
|
| 19 |
-
-
|
| 20 |
-
-
|
| 21 |
-
-
|
| 22 |
-
---
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: LTX 2.3 Studio
|
| 3 |
+
emoji: 🎬
|
| 4 |
+
colorFrom: purple
|
| 5 |
+
colorTo: blue
|
| 6 |
+
sdk: gradio
|
| 7 |
+
sdk_version: "5.50.0"
|
| 8 |
+
app_file: app.py
|
| 9 |
+
python_version: "3.11"
|
| 10 |
+
suggested_hardware: zero-a10g
|
| 11 |
+
hf_oauth: false
|
| 12 |
+
models:
|
| 13 |
+
- openai/clip-vit-large-patch14
|
| 14 |
+
- Qwen/Qwen3-0.6B
|
| 15 |
+
- facebook/opt-125m
|
| 16 |
+
- openai/whisper-large-v3-turbo
|
| 17 |
+
- k2-fsa/OmniVoice
|
| 18 |
+
- Lightricks/LTX-2.3
|
| 19 |
+
- Kijai/LTX2.3_comfy
|
| 20 |
+
- unsloth/LTX-2.3-GGUF
|
| 21 |
+
- facebook/opt-350m
|
| 22 |
+
- eustlb/higgs-audio-v2-tokenizer
|
| 23 |
+
- google/gemma-3-12b-it-qat-q4_0-unquantized
|
| 24 |
+
- ai-forever/Real-ESRGAN
|
| 25 |
+
- Lightricks/LTX-2.3-22b-IC-LoRA-Union-Control
|
| 26 |
+
- Lightricks/LTX-2.3-22b-IC-LoRA-Motion-Track-Control
|
| 27 |
+
- k2-fsa/TTS_eval_models
|
| 28 |
+
- Lightricks/LTX-2-19b-IC-LoRA-Pose-Control
|
| 29 |
+
- Lightricks/LTX-2-19b-IC-LoRA-Detailer
|
| 30 |
+
- Comfy-Org/ltx-2
|
| 31 |
+
preload_from_hub:
|
| 32 |
+
- Comfy-Org/ltx-2 split_files/text_encoders/gemma_3_12B_it.safetensors
|
| 33 |
+
- Kijai/LTX2.3_comfy diffusion_models/ltx-2.3-22b-dev_transformer_only_bf16.safetensors,loras/ltx-2.3-22b-distilled-lora-dynamic_fro09_avg_rank_105_bf16.safetensors,text_encoders/ltx-2.3_text_projection_bf16.safetensors,vae/LTX23_audio_vae_bf16.safetensors,vae/LTX23_video_vae_bf16.safetensors,vae/taeltx2_3.safetensors
|
| 34 |
+
- Lightricks/LTX-2-19b-IC-LoRA-Detailer ltx-2-19b-ic-lora-detailer.safetensors
|
| 35 |
+
- Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Down ltx-2-19b-lora-camera-control-jib-down.safetensors
|
| 36 |
+
- Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Up ltx-2-19b-lora-camera-control-jib-up.safetensors
|
| 37 |
+
- Lightricks/LTX-2-19b-LoRA-Camera-Control-Static ltx-2-19b-lora-camera-control-static.safetensors
|
| 38 |
+
- Lightricks/LTX-2.3 ltx-2.3-22b-distilled-lora-384.safetensors,ltx-2.3-spatial-upscaler-x2-1.0.safetensors
|
| 39 |
+
- Lightricks/LTX-2.3-22b-IC-LoRA-Union-Control ltx-2.3-22b-ic-lora-union-control-ref0.5.safetensors
|
| 40 |
+
- google/gemma-3-12b-it-qat-q4_0-unquantized gemma-3-12b-it/model-00001-of-00005.safetensors,gemma-3-12b-it/model-00002-of-00005.safetensors,gemma-3-12b-it/model-00003-of-00005.safetensors,gemma-3-12b-it/model-00004-of-00005.safetensors,gemma-3-12b-it/model-00005-of-00005.safetensors,gemma-3-12b-it/model.safetensors.index.json,gemma-3-12b-it/preprocessor_config.json,gemma-3-12b-it/tokenizer.model
|
| 41 |
+
---
|
| 42 |
+
|
| 43 |
+
# LTX 2.3 All-in-One Video Generator
|
| 44 |
+
|
| 45 |
+
A Gradio app for [LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3) wrapping all six modes of the official ComfyUI All-In-One workflow under a single, focused UI. Runs locally on Apple Silicon (MPS) or NVIDIA (CUDA), and deploys to Hugging Face Spaces (ZeroGPU).
|
| 46 |
+
|
| 47 |
+
## Modes
|
| 48 |
+
|
| 49 |
+
1. **Text → Video** (+ optional Audio)
|
| 50 |
+
2. **Audio → Video** (Text + Audio → Video + Audio)
|
| 51 |
+
3. **Image → Video** (+ optional Audio)
|
| 52 |
+
4. **Lipsync** (Image + Audio → Video + Audio)
|
| 53 |
+
5. **First / Last Frame → Video** (keyframe interpolation)
|
| 54 |
+
6. **Style Transfer** (Video → Video, motion control)
|
| 55 |
+
|
| 56 |
+
## Local quickstart
|
| 57 |
+
|
| 58 |
+
Requires Python 3.11, ~80 GB free disk for model weights, and ~24 GB+ GPU memory (CUDA) or 32 GB+ unified memory (Apple Silicon).
|
| 59 |
+
|
| 60 |
+
```bash
|
| 61 |
+
git clone --recurse-submodules https://github.com/<your-handle>/ltx2.3-AIO-generator
|
| 62 |
+
cd ltx2.3-AIO-generator
|
| 63 |
+
bash setup.sh
|
| 64 |
+
source .venv/bin/activate
|
| 65 |
+
python app.py
|
| 66 |
+
```
|
| 67 |
+
|
| 68 |
+
The first run downloads ~70 GB of models into your existing `~/.cache/huggingface/hub` (no duplicate copies in this repo) and symlinks them into `comfyui/models/`.
|
| 69 |
+
|
| 70 |
+
## HF Spaces deployment
|
| 71 |
+
|
| 72 |
+
This repo is a Gradio Space. The required Pro tier provides ~50 GB persistent `/data` storage and longer per-call ZeroGPU budgets needed for Balanced and Quality presets.
|
| 73 |
+
|
| 74 |
+
```bash
|
| 75 |
+
git remote add space https://huggingface.co/spaces/<your-handle>/ltx2.3-aio
|
| 76 |
+
git push space main
|
| 77 |
+
```
|
| 78 |
+
|
| 79 |
+
## License
|
| 80 |
+
|
| 81 |
+
MIT for the AIO app code. ComfyUI and LTX-2.3 retain their respective licenses.
|