MagicOmini: Efficient Local Sketch Editing for Diffusion Transformers
Qiqi Wang, University of Chinese Academy of Sciences

MagicOmini is a minimal yet powerful local sketch-editing framework for Diffusion Transformer models like FLUX, built upon OminiControl.

1. Environment setup

conda create -n magicomini python=3.11
conda activate magicomini

2. Requirements installation

pip install torch==2.4.1 torchvision==0.19.1 torchaudio==2.4.1 --index-url https://download.pytorch.org/whl/cu124
pip install -r requirements.txt

3. Checkpoints

Click here and download the checkpoint. Remember to change the checkpoint to your path in gradio code.

1. Input images are automatically resized to 512x512 or 1024x1024 resolution.

We would like to thank the OminiControl team for their excellent work, which serves as the foundation for this project.

If you find this work useful, please consider citing:

@article{ominicontrol,
  title={OminiControl: Minimal and Universal Control for Diffusion Transformer},
  author={Xiang, Zhenxiong and Hu, Xinzhe and Zheng, Haoji and Dang, Yingqing and Li, Ying and Shi, Min and Liu, Haoming and Qiao, Yu and Shan, Ying},
  journal={arXiv preprint arXiv:2411.15098},
  year={2024}
}