Add model card metadata and usage instructions

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +71 -3
README.md CHANGED
@@ -1,3 +1,71 @@
1
- ---
2
- license: cc-by-nc-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ pipeline_tag: image-to-image
4
+ tags:
5
+ - image-stylization
6
+ - mixture-of-experts
7
+ - lora
8
+ - flux
9
+ ---
10
+
11
+ # StyleExpert: Mixture of Style Experts for Diverse Image Stylization
12
+
13
+ [StyleExpert](https://hh-lg.github.io/StyleExpert-Page/) is a semantic-aware framework for diverse image stylization based on a Mixture of Experts (MoE) architecture. It addresses the limitations of existing diffusion-based stylization methods by effectively handling complex semantics and material details, rather than just color-driven transformations.
14
+
15
+ [[📖 Paper](https://huggingface.co/papers/2603.16649)] [[🏠 Project Page](https://hh-lg.github.io/StyleExpert-Page/)] [[💻 Code](https://github.com/HVision-NKU/StyleExpert)]
16
+
17
+ ![teaser](https://github.com/HVision-NKU/StyleExpert/raw/main/assets/figures/teaser.png)
18
+
19
+ ## Model Description
20
+ StyleExpert employs a unified style encoder trained on the **StyleExpert-40K** dataset (40,000 content-style-stylized triplets). The model uses a similarity-aware gating mechanism to dynamically route styles to specialized experts within the MoE architecture, allowing it to handle styles ranging from shallow textures to deep semantics.
21
+
22
+ ## Installation
23
+
24
+ We recommend using **Python 3.10** and **PyTorch** with CUDA support.
25
+
26
+ ```bash
27
+ # Create a new conda environment
28
+ conda create -n styleexpert python=3.10
29
+ conda activate styleexpert
30
+
31
+ # Install requirements
32
+ pip install -r requirements.txt
33
+ ```
34
+
35
+ ## Quick Inference
36
+
37
+ ### Local Gradio Demo
38
+ You can run a local web interface to interact with the model:
39
+ ```bash
40
+ python app.py
41
+ ```
42
+
43
+ ### Single Case Inference via CLI
44
+ To stylize a single image using a reference style, use the following command from the [official repository](https://github.com/HVision-NKU/StyleExpert):
45
+ ```bash
46
+ python infer.py --content_path ./data/content.jpg --style_path ./data/style.jpg
47
+ ```
48
+
49
+ ### Weights Download
50
+ The model requires the base **FLUX.1-Kontext-dev** and the **StyleExpert** adapters. You can use the provided script in the GitHub repo to download all necessary components:
51
+ ```bash
52
+ bash download_models.sh --token YOUR_HF_TOKEN
53
+ ```
54
+
55
+ ## Visual Results
56
+ ![compare](https://github.com/HVision-NKU/StyleExpert/raw/main/assets/figures/compare.png)
57
+
58
+ ## Citation
59
+ If StyleExpert helps your research, please cite the following work:
60
+
61
+ ```bibtex
62
+ @article{zhu2026styleexpert,
63
+ title={Mixture of Style Experts for Diverse Image Stylization},
64
+ author={Zhu, Shihao and Ouyang, Ziheng and Kang, Yijia and Wang, Qilong and Zhou, Mi and Li, Bo and Cheng, Ming-Ming and Hou, Qibin},
65
+ journal={CVPR},
66
+ year={2026}
67
+ }
68
+ ```
69
+
70
+ ## License
71
+ This model is licensed under [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/) for non-commercial use. Underlying model weights (like FLUX.1) may be subject to their own respective licenses.