This Is Why You Can’t Use Llama-2
<h1>Open-Source Foundation Models</h1>
<p>We have seen an explosion of open-source foundation models with the likes of <a href="https://huggingface.co/meta-llama/Llama-2-70b-chat-hf" rel="noopener ugc nofollow" target="_blank">Llama-2</a>, <a href="https://huggingface.co/tiiuae/falcon-40b" rel="noopener ugc nofollow" target="_blank">Falcon</a>, and <a href="https://huggingface.co/bigscience/bloom" rel="noopener ugc nofollow" target="_blank">Bloom</a>, to name a few. However, the largest of these models are pretty much impossible to use for a person of modest means.</p>
<p>Large language models have a large number of parameters. Take Llama-2 for instance, the largest version of it has 70 billion parameters.</p>
<p>The scale of these models ensures that for most researchers, hobbyists or engineers, the hardware requirements are a significant barrier.</p>
<p>If you’re reading this I gather you have probably tried but you have been unable to use these models. Let’s look at the hardware requirements for Meta’s Llama-2 to understand why that is.</p>
<p><a href="https://pub.aimind.so/this-is-why-you-cant-use-llama-2-d33701ce0766"><strong>Website</strong></a></p>