midjourney

DiffSynth-Studio Adds Custom LoRA Support

DiffSynth-Studio has added custom LoRA support, allowing users to integrate their own Low-Rank Adaptation models for enhanced AI image and video generation

Someone found that DiffSynth-Studio recently added support for custom LoRA models in video generation, which is pretty useful for fine-tuning outputs.

The commits show they added a lora_path parameter that works like this:


synth = VideoSynthesizer(
 model_path="your_base_model",
 lora_path="path/to/your/lora.safetensors"
)

They also fixed some memory issues with long video generation and improved the training scripts. The repo is at github.com/modelscope/DiffSynth-Studio if anyone wants to check out the full changes.

Turns out this makes it way easier to add custom styles without retraining the entire base model - just drop in a LoRA file and adjust the weight parameter.