Fabrice-TIERCELIN commited on
Commit
fa1b051
·
verified ·
1 Parent(s): 7787271
Files changed (1) hide show
  1. README.md +81 -62
README.md CHANGED
@@ -1,62 +1,81 @@
1
- ---
2
- title: LTX 2.3 Studio
3
- emoji: 🎬
4
- colorFrom: purple
5
- colorTo: blue
6
- sdk: gradio
7
- sdk_version: "5.50.0"
8
- app_file: app.py
9
- python_version: "3.11"
10
- suggested_hardware: zero-a10g
11
- hf_oauth: false
12
- preload_from_hub:
13
- - Comfy-Org/ltx-2 split_files/text_encoders/gemma_3_12B_it.safetensors
14
- - Kijai/LTX2.3_comfy diffusion_models/ltx-2.3-22b-dev_transformer_only_bf16.safetensors,loras/ltx-2.3-22b-distilled-lora-dynamic_fro09_avg_rank_105_bf16.safetensors,text_encoders/ltx-2.3_text_projection_bf16.safetensors,vae/LTX23_audio_vae_bf16.safetensors,vae/LTX23_video_vae_bf16.safetensors,vae/taeltx2_3.safetensors
15
- - Lightricks/LTX-2-19b-IC-LoRA-Detailer ltx-2-19b-ic-lora-detailer.safetensors
16
- - Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Down ltx-2-19b-lora-camera-control-jib-down.safetensors
17
- - Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Up ltx-2-19b-lora-camera-control-jib-up.safetensors
18
- - Lightricks/LTX-2-19b-LoRA-Camera-Control-Static ltx-2-19b-lora-camera-control-static.safetensors
19
- - Lightricks/LTX-2.3 ltx-2.3-22b-distilled-lora-384.safetensors,ltx-2.3-spatial-upscaler-x2-1.0.safetensors
20
- - Lightricks/LTX-2.3-22b-IC-LoRA-Union-Control ltx-2.3-22b-ic-lora-union-control-ref0.5.safetensors
21
- - google/gemma-3-12b-it-qat-q4_0-unquantized gemma-3-12b-it/model-00001-of-00005.safetensors,gemma-3-12b-it/model-00002-of-00005.safetensors,gemma-3-12b-it/model-00003-of-00005.safetensors,gemma-3-12b-it/model-00004-of-00005.safetensors,gemma-3-12b-it/model-00005-of-00005.safetensors,gemma-3-12b-it/model.safetensors.index.json,gemma-3-12b-it/preprocessor_config.json,gemma-3-12b-it/tokenizer.model
22
- ---
23
-
24
- # LTX 2.3 All-in-One Video Generator
25
-
26
- A Gradio app for [LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3) wrapping all six modes of the official ComfyUI All-In-One workflow under a single, focused UI. Runs locally on Apple Silicon (MPS) or NVIDIA (CUDA), and deploys to Hugging Face Spaces (ZeroGPU).
27
-
28
- ## Modes
29
-
30
- 1. **Text → Video** (+ optional Audio)
31
- 2. **Audio → Video** (Text + Audio → Video + Audio)
32
- 3. **Image → Video** (+ optional Audio)
33
- 4. **Lipsync** (Image + Audio → Video + Audio)
34
- 5. **First / Last Frame → Video** (keyframe interpolation)
35
- 6. **Style Transfer** (Video → Video, motion control)
36
-
37
- ## Local quickstart
38
-
39
- Requires Python 3.11, ~80 GB free disk for model weights, and ~24 GB+ GPU memory (CUDA) or 32 GB+ unified memory (Apple Silicon).
40
-
41
- ```bash
42
- git clone --recurse-submodules https://github.com/<your-handle>/ltx2.3-AIO-generator
43
- cd ltx2.3-AIO-generator
44
- bash setup.sh
45
- source .venv/bin/activate
46
- python app.py
47
- ```
48
-
49
- The first run downloads ~70 GB of models into your existing `~/.cache/huggingface/hub` (no duplicate copies in this repo) and symlinks them into `comfyui/models/`.
50
-
51
- ## HF Spaces deployment
52
-
53
- This repo is a Gradio Space. The required Pro tier provides ~50 GB persistent `/data` storage and longer per-call ZeroGPU budgets needed for Balanced and Quality presets.
54
-
55
- ```bash
56
- git remote add space https://huggingface.co/spaces/<your-handle>/ltx2.3-aio
57
- git push space main
58
- ```
59
-
60
- ## License
61
-
62
- MIT for the AIO app code. ComfyUI and LTX-2.3 retain their respective licenses.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: LTX 2.3 Studio
3
+ emoji: 🎬
4
+ colorFrom: purple
5
+ colorTo: blue
6
+ sdk: gradio
7
+ sdk_version: "5.50.0"
8
+ app_file: app.py
9
+ python_version: "3.11"
10
+ suggested_hardware: zero-a10g
11
+ hf_oauth: false
12
+ models:
13
+ - openai/clip-vit-large-patch14
14
+ - Qwen/Qwen3-0.6B
15
+ - facebook/opt-125m
16
+ - openai/whisper-large-v3-turbo
17
+ - k2-fsa/OmniVoice
18
+ - Lightricks/LTX-2.3
19
+ - Kijai/LTX2.3_comfy
20
+ - unsloth/LTX-2.3-GGUF
21
+ - facebook/opt-350m
22
+ - eustlb/higgs-audio-v2-tokenizer
23
+ - google/gemma-3-12b-it-qat-q4_0-unquantized
24
+ - ai-forever/Real-ESRGAN
25
+ - Lightricks/LTX-2.3-22b-IC-LoRA-Union-Control
26
+ - Lightricks/LTX-2.3-22b-IC-LoRA-Motion-Track-Control
27
+ - k2-fsa/TTS_eval_models
28
+ - Lightricks/LTX-2-19b-IC-LoRA-Pose-Control
29
+ - Lightricks/LTX-2-19b-IC-LoRA-Detailer
30
+ - Comfy-Org/ltx-2
31
+ preload_from_hub:
32
+ - Comfy-Org/ltx-2 split_files/text_encoders/gemma_3_12B_it.safetensors
33
+ - Kijai/LTX2.3_comfy diffusion_models/ltx-2.3-22b-dev_transformer_only_bf16.safetensors,loras/ltx-2.3-22b-distilled-lora-dynamic_fro09_avg_rank_105_bf16.safetensors,text_encoders/ltx-2.3_text_projection_bf16.safetensors,vae/LTX23_audio_vae_bf16.safetensors,vae/LTX23_video_vae_bf16.safetensors,vae/taeltx2_3.safetensors
34
+ - Lightricks/LTX-2-19b-IC-LoRA-Detailer ltx-2-19b-ic-lora-detailer.safetensors
35
+ - Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Down ltx-2-19b-lora-camera-control-jib-down.safetensors
36
+ - Lightricks/LTX-2-19b-LoRA-Camera-Control-Jib-Up ltx-2-19b-lora-camera-control-jib-up.safetensors
37
+ - Lightricks/LTX-2-19b-LoRA-Camera-Control-Static ltx-2-19b-lora-camera-control-static.safetensors
38
+ - Lightricks/LTX-2.3 ltx-2.3-22b-distilled-lora-384.safetensors,ltx-2.3-spatial-upscaler-x2-1.0.safetensors
39
+ - Lightricks/LTX-2.3-22b-IC-LoRA-Union-Control ltx-2.3-22b-ic-lora-union-control-ref0.5.safetensors
40
+ - google/gemma-3-12b-it-qat-q4_0-unquantized gemma-3-12b-it/model-00001-of-00005.safetensors,gemma-3-12b-it/model-00002-of-00005.safetensors,gemma-3-12b-it/model-00003-of-00005.safetensors,gemma-3-12b-it/model-00004-of-00005.safetensors,gemma-3-12b-it/model-00005-of-00005.safetensors,gemma-3-12b-it/model.safetensors.index.json,gemma-3-12b-it/preprocessor_config.json,gemma-3-12b-it/tokenizer.model
41
+ ---
42
+
43
+ # LTX 2.3 All-in-One Video Generator
44
+
45
+ A Gradio app for [LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3) wrapping all six modes of the official ComfyUI All-In-One workflow under a single, focused UI. Runs locally on Apple Silicon (MPS) or NVIDIA (CUDA), and deploys to Hugging Face Spaces (ZeroGPU).
46
+
47
+ ## Modes
48
+
49
+ 1. **Text Video** (+ optional Audio)
50
+ 2. **Audio → Video** (Text + Audio → Video + Audio)
51
+ 3. **Image Video** (+ optional Audio)
52
+ 4. **Lipsync** (Image + Audio → Video + Audio)
53
+ 5. **First / Last Frame Video** (keyframe interpolation)
54
+ 6. **Style Transfer** (Video → Video, motion control)
55
+
56
+ ## Local quickstart
57
+
58
+ Requires Python 3.11, ~80 GB free disk for model weights, and ~24 GB+ GPU memory (CUDA) or 32 GB+ unified memory (Apple Silicon).
59
+
60
+ ```bash
61
+ git clone --recurse-submodules https://github.com/<your-handle>/ltx2.3-AIO-generator
62
+ cd ltx2.3-AIO-generator
63
+ bash setup.sh
64
+ source .venv/bin/activate
65
+ python app.py
66
+ ```
67
+
68
+ The first run downloads ~70 GB of models into your existing `~/.cache/huggingface/hub` (no duplicate copies in this repo) and symlinks them into `comfyui/models/`.
69
+
70
+ ## HF Spaces deployment
71
+
72
+ This repo is a Gradio Space. The required Pro tier provides ~50 GB persistent `/data` storage and longer per-call ZeroGPU budgets needed for Balanced and Quality presets.
73
+
74
+ ```bash
75
+ git remote add space https://huggingface.co/spaces/<your-handle>/ltx2.3-aio
76
+ git push space main
77
+ ```
78
+
79
+ ## License
80
+
81
+ MIT for the AIO app code. ComfyUI and LTX-2.3 retain their respective licenses.