Add model card metadata and usage instructions
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,71 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: cc-by-nc-4.0
|
| 3 |
-
--
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-nc-4.0
|
| 3 |
+
pipeline_tag: image-to-image
|
| 4 |
+
tags:
|
| 5 |
+
- image-stylization
|
| 6 |
+
- mixture-of-experts
|
| 7 |
+
- lora
|
| 8 |
+
- flux
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# StyleExpert: Mixture of Style Experts for Diverse Image Stylization
|
| 12 |
+
|
| 13 |
+
[StyleExpert](https://hh-lg.github.io/StyleExpert-Page/) is a semantic-aware framework for diverse image stylization based on a Mixture of Experts (MoE) architecture. It addresses the limitations of existing diffusion-based stylization methods by effectively handling complex semantics and material details, rather than just color-driven transformations.
|
| 14 |
+
|
| 15 |
+
[[📖 Paper](https://huggingface.co/papers/2603.16649)] [[🏠 Project Page](https://hh-lg.github.io/StyleExpert-Page/)] [[💻 Code](https://github.com/HVision-NKU/StyleExpert)]
|
| 16 |
+
|
| 17 |
+

|
| 18 |
+
|
| 19 |
+
## Model Description
|
| 20 |
+
StyleExpert employs a unified style encoder trained on the **StyleExpert-40K** dataset (40,000 content-style-stylized triplets). The model uses a similarity-aware gating mechanism to dynamically route styles to specialized experts within the MoE architecture, allowing it to handle styles ranging from shallow textures to deep semantics.
|
| 21 |
+
|
| 22 |
+
## Installation
|
| 23 |
+
|
| 24 |
+
We recommend using **Python 3.10** and **PyTorch** with CUDA support.
|
| 25 |
+
|
| 26 |
+
```bash
|
| 27 |
+
# Create a new conda environment
|
| 28 |
+
conda create -n styleexpert python=3.10
|
| 29 |
+
conda activate styleexpert
|
| 30 |
+
|
| 31 |
+
# Install requirements
|
| 32 |
+
pip install -r requirements.txt
|
| 33 |
+
```
|
| 34 |
+
|
| 35 |
+
## Quick Inference
|
| 36 |
+
|
| 37 |
+
### Local Gradio Demo
|
| 38 |
+
You can run a local web interface to interact with the model:
|
| 39 |
+
```bash
|
| 40 |
+
python app.py
|
| 41 |
+
```
|
| 42 |
+
|
| 43 |
+
### Single Case Inference via CLI
|
| 44 |
+
To stylize a single image using a reference style, use the following command from the [official repository](https://github.com/HVision-NKU/StyleExpert):
|
| 45 |
+
```bash
|
| 46 |
+
python infer.py --content_path ./data/content.jpg --style_path ./data/style.jpg
|
| 47 |
+
```
|
| 48 |
+
|
| 49 |
+
### Weights Download
|
| 50 |
+
The model requires the base **FLUX.1-Kontext-dev** and the **StyleExpert** adapters. You can use the provided script in the GitHub repo to download all necessary components:
|
| 51 |
+
```bash
|
| 52 |
+
bash download_models.sh --token YOUR_HF_TOKEN
|
| 53 |
+
```
|
| 54 |
+
|
| 55 |
+
## Visual Results
|
| 56 |
+

|
| 57 |
+
|
| 58 |
+
## Citation
|
| 59 |
+
If StyleExpert helps your research, please cite the following work:
|
| 60 |
+
|
| 61 |
+
```bibtex
|
| 62 |
+
@article{zhu2026styleexpert,
|
| 63 |
+
title={Mixture of Style Experts for Diverse Image Stylization},
|
| 64 |
+
author={Zhu, Shihao and Ouyang, Ziheng and Kang, Yijia and Wang, Qilong and Zhou, Mi and Li, Bo and Cheng, Ming-Ming and Hou, Qibin},
|
| 65 |
+
journal={CVPR},
|
| 66 |
+
year={2026}
|
| 67 |
+
}
|
| 68 |
+
```
|
| 69 |
+
|
| 70 |
+
## License
|
| 71 |
+
This model is licensed under [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/) for non-commercial use. Underlying model weights (like FLUX.1) may be subject to their own respective licenses.
|