Building Oasis a Local Code Generator Tool Using Open Source Models and Microsoft’s Guidance Library
<p>A while ago, I wrote a <a href="https://github.com/paolorechia/pydex" rel="noopener ugc nofollow" target="_blank">VSCode plugin</a> using the now-deprecated Codex API from OpenAI, and it worked fairly well to perform simple instructions on the selected code in VSCode. For instance, it could add a docstring to the function that I selected.</p>
<p>As I’ve been fiddling a lot with local LLMs (Large Language Models), the next step was naturally to see how I could build something similar that does not depend on OpenAI.</p>
<p>For this purpose, I started the <a href="https://github.com/paolorechia/oasis" rel="noopener ugc nofollow" target="_blank">oasis project</a>. When I first started, the idea was super simple: just calling directly the <code>text-generation-webui</code> API, to generate docstrings for my own code.</p>
<p>It didn’t take me long to reach similar results from my older plugin, but now using WizardLM instead of OpenAI. That was pretty exciting, however, this model is still limited in terms of license: it’s only meant for research.</p>
<p>And this time I wanted something that I could use it for commercial purposes or for my own work routine, without having trouble explaining myself about the model license.</p>
<p><a href="https://betterprogramming.pub/building-oasis-a-local-code-generator-tool-using-open-source-models-and-microsofts-guidance-aef54c3e2840">Visit Now</a></p>