Tag: LLM

Navigating the World of Chatbots with LLM Evaluation: A Databricks Case Study

Hello…there! Chatbots have become an integral part of our digital interactions, and they owe their prowess to Large Language Models (LLMs). One cutting-edge approach in chatbot development is the Retrieval Augmented Generation (RAG) architecture. It combines the best of both worlds: know...

Databricks introduces a public preview of GPU and LLM optimization support for Databricks Model Serving

Main AI News: Databricks has unveiled its latest innovation: the public preview of GPU and LLM optimization support for Databricks Model Serving. This transformative feature empowers users to effortlessly deploy a diverse array of AI models, including LLMs and Vision models, directly onto the Lak...

LLM Economics: ChatGPT vs Open-Source

TLDR: For lower usage in the 1000’s of requests per day range ChatGPT works out cheaper than using open-sourced LLMs deployed to AWS. For millions of requests per day, open-sourced models deployed in AWS work out cheaper. (As of writing this article on April 24th, 2023.) Large Lan...

Prompt Engineering to Leverage In-Context Learning in Large Language Models

Large Language Models are more and more used and their skills are surprising. Part of their success is their ability to learn from a few examples, a phenomenon known as in-context learning; in the previous article, we discussed in detail what is it and from where it originates, now we will...

Getting Started with LangChain: A Beginner???s Guide to Building LLM-Powered Applications

Since the release of ChatGPT, large language models (LLMs) have gained a lot of popularity. Although you probably don’t have enough money and computational resources to train an LLM from scratch in your basement, you can still use pre-trained LLMs to build something cool, such as: Person...

10 Exciting Project Ideas Using Large Language Models (LLMs) for Your Portfolio

One common piece of advice I often hear for job applicants is to have a portfolio showcasing your work. This doesn't only apply to artists or models but also to software developers and data scientists. A portfolio of your projects acts as public evidence of your skills. This public evidence c...

The Falcon LLM Landing in the Snowflake Data Cloud

Opinions expressed in this post are solely my own and do not represent the views or opinions of my employer. I am using feature that are in Private Preview at the time of writing. With the launch of Snowpark Container Services in Private Preview, any code or software that can be contain...