Tag: QLoRA

Fine Tuning LLM: Parameter Efficient Fine Tuning (PEFT) — LoRA & QLoRA — Part 1

In this blog, we will understand the idea behind Parameter Efficient Fine Tuning (PEFT), and explore LoRA and QLoRA, Two of the most important PEFT methods. We will understnad how PEFT can be used to fine tune the model for domain specific tasks, at the lowest cost and minimal infrastrcuture. Mot...

Fine-tune Llama 2 on Your Computer with QLoRa and TRL

Llama 2 is a state-of-the-art large language model (LLM) released by Meta. In the paper presenting the model, Llama 2 demonstrates impressive capabilities on public benchmarks for various natural language generation and coding tasks. Meta also released Chat versions of Llama 2. These chat mode...