← Back to blog

What Is LoRA Training? Definition + Examples

LoRA training fine-tunes a large generative model by inserting small adapter weight matrices, without touching the base model. Plus how it works, examples, and where to use it in AI workflows.

What Is LoRA Training?

LoRA training is a method for fine-tuning large generative models by inserting small, low-rank adapter weight matrices alongside the frozen base model weights, so you get targeted behavior without retraining billions of parameters.

Instead of updating every weight in a model like Flux or SDXL (which would require serious compute and storage), LoRA adds two thin matrices at specific layers. During training, only those matrices update. The base model never changes. At inference time, the adapter weights are merged in and the model produces output that reflects what it learned from your training set, whether that's a specific face, a brand visual style, or a consistent product design. The file you end up with is typically 50-300MB rather than the 10-20GB of the full model.

LoRA stands for Low-Rank Adaptation, coined in a 2021 paper by Hu et al. targeting language models. The image generation community adopted it quickly once diffusion models scaled up, and it's now the standard technique for personal and commercial model customization.

How LoRA training works

The key insight is that the weight updates needed for fine-tuning tend to be low-rank, meaning they can be approximated by the product of two smaller matrices. If a weight matrix in the base model is dimension 1024x1024, the LoRA adapter represents its update as two matrices of size 1024x8 and 8x1024 (where 8 is the rank, a hyperparameter you choose). That collapses 1,048,576 parameters down to 16,384.

Training steps:

  1. You freeze all base model weights.
  2. You attach adapter matrices (A and B) at selected layers, typically the attention layers.
  3. You feed in your training images, usually 10-30 captioned examples for a simple subject.
  4. The optimizer updates only the A and B matrices to minimize the loss on your data.
  5. You save the adapter as a standalone .safetensors file.

At generation time, the adapter weights are scaled by a strength parameter (often called "LoRA weight" or "scale") and added to the base model's weights before the forward pass. A scale of 0.8-1.0 gives strong adherence to the trained concept; 0.4-0.6 blends it more loosely with the base model's style range.

When you use LoRA training

Custom character. You have a mascot, a real person, or a fictional character that needs to appear consistently across dozens of generations. A LoRA trained on 15-20 clean reference images holds that identity across poses, lighting conditions, and style directions that weren't in your training set.

Brand visual style. You have an established aesthetic (a specific color treatment, a graphic language, a photographic mood) and you want new images to inherit it without prompting for every detail every time. A style LoRA encodes that visual language and applies it to any subject.

Product and asset consistency. You're generating marketing images for a physical product (a shoe, a package, a device) and the base model keeps drifting the geometry or the colorway. A product LoRA anchors the key visual attributes so outputs stay on-model.

Examples with Flux and Krea 2 LoRAs

Flux LoRAs are the current standard for still-image work. Flux's architecture responds well to LoRA fine-tuning because the transformer attention layers are where most visual identity information is encoded. A Flux LoRA trained on 20 product images with accurate captions will hold label text, material texture, and proportions across varied prompt inputs. On 8frame, you can load a Flux LoRA by pasting the Hugging Face model ID or uploading the .safetensors file directly into the model settings panel before generating.

Krea 2 LoRAs target video and high-fidelity image generation. Krea 2 has a strong native style that can overpower subtle LoRA influence at high CFG, so LoRA scale around 0.7-0.85 tends to work better than maxing it out. For character-consistent work across a campaign (same face, multiple scenes), a Krea 2 LoRA paired with a reference image gives tighter identity hold than either tool alone.

Both are usable inside 8frame without leaving the canvas. You're not switching tabs or copying outputs between tools.

Related concepts


Ready to run a LoRA generation? Open 8frame and load your adapter into the Flux or Krea 2 model settings.

Related articles

glossaryWhat Is a Creative Canvas? Definition + ExamplesglossaryWhat Is a Dolly Shot? Definition + ExamplesglossaryWhat Is a Hero Shot? Definition + Examples

Your frames start here

Watch the canvas power your creative flow in real time

Stay in the loop

Be the first to hear about our launch and get product updates