Understanding LoRA Training, Part 3: Block Weights
<p>In order to understand block weights, we need to understand Stable Diffusion U-Net architecture first.</p>
<h1>U-Net</h1>
<p>If you’ve ever tried to research the topic, you definitely stumbled upon this U-shaped diagram:</p>
<p><img alt="" src="https://miro.medium.com/v2/resize:fit:700/1*hDbvfktbQl5HdQ5UrIpWQw.png" style="height:451px; width:700px" /></p>
<p>U-Net as seen from a 100 miles away</p>
<p>An input image starts it’s way at the top left and after a transforming journey over a U-path is reborn at the top right.</p>
<p>I read a ton of articles on the subject in the last few days and the most accessible one for those of us who get easily discouraged by complex math is this one:</p>
<h2><a href="https://towardsdatascience.com/you-cant-spell-diffusion-without-u-60635f569579?source=post_page-----967711816280--------------------------------" rel="noopener follow" target="_blank">You can’t spell Diffusion without U</a></h2>
<h3><a href="https://towardsdatascience.com/you-cant-spell-diffusion-without-u-60635f569579?source=post_page-----967711816280--------------------------------" rel="noopener follow" target="_blank">Understanding the core building blocks of Stable Diffusion</a></h3>
<p><a href="https://towardsdatascience.com/you-cant-spell-diffusion-without-u-60635f569579?source=post_page-----967711816280--------------------------------" rel="noopener follow" target="_blank">towardsdatascience.com</a></p>
<p>If you are not entirely sure what U-Net is, I encourage you to read it in full. It’s relatively short and totally worth it from start to finish.</p>
<p>I especially liked how </p>
<p><a href="https://medium.com/u/a99fbdf99073?source=post_page-----967711816280--------------------------------" rel="noopener" target="_blank">Sairam Sundaresan</a></p>
<p> used the <a href="https://www.wikihow.com/Play-the-Telephone-Game" rel="noopener ugc nofollow" target="_blank">telephone game</a> as an example to describe the way U-Net blocks communicate with each other<em>.</em></p>
<p><a href="https://medium.com/@dreamsarereal/understanding-lora-training-part-3-block-weights-967711816280"><strong>Read More</strong></a></p>