File size: 2,178 Bytes
6d2f223
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f89cb1a
6d2f223
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f89cb1a
 
6d2f223
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
---
tags:
- ltx-video
- image-to-video
pinned: true
language:
- en
license: other
pipeline_tag: text-to-video
library_name: diffusers
---

# LTXV_13B_LoRA_triple_face_crops

This is a fine-tuned version of [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors) trained on custom data.

## Model Details

- **Base Model:** [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)
- **Training Type:** LoRA fine-tuning
- **Training Steps:** 80000
- **Learning Rate:** 0.0002
- **Batch Size:** 1

## Sample Outputs

| | | | |
|:---:|:---:|:---:|:---:|
| ![example1](./samples/sample_0.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a box is on a table, a man is appearing out of the box</details> | ![example2](./samples/sample_1.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>dark forest, a woman walks through the forest</details> |

## Usage

This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.

### 🔌 Using Trained LoRAs in ComfyUI
In order to use the trained lora in comfy:
1. Copy your comfyui trained LoRA weights (`comfyui..safetensors` file) to the `models/loras` folder in your ComfyUI installation.
2. In your ComfyUI workflow:
   - Add the "LTXV LoRA Selector" node to choose your LoRA file
   - Connect it to the "LTXV LoRA Loader" node to apply the LoRA to your generation

You can find reference Text-to-Video (T2V) and Image-to-Video (I2V) workflows in the [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo).

### Example Prompts

Example prompts used during validation:

- `a box is on a table, a man is appearing out of the box`
- `dark forest, a woman walks through the forest`



This model inherits the license of the base model ([`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)).

## Acknowledgments

- Base model by [Lightricks](https://huggingface.co/Lightricks)
- Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)