Member-only story
How to run a Generative AI Meta Llama 2 LLM locally
This post helps us understand how to run large language models on our local machine. Artificial intelligence contains four major fields
- Supervised Learning
- Generative AI
- Unsupervised Learning
- Reinforcement Learning
Let’s focus on Supervised Learning and Generative AI. Email spam identification and image classification are examples of Supervised Learning. With the given prompt — Generative AI can generate the text, image, audio or video content. LLMs — Large language models handle the content generation. These models offer immense potential for organisations to automate tasks and enhance customer interactions through chatbots. These models help in product development by generating new ideas or code snippets.
Google Vertex AI, Azure AI, and Amazon Bedrock provide API access to the Generative AI models. Meta Llama provides these LLMs as an open-source. The open-source nature further democratizes access to advanced AI technologies, allowing even small businesses or individual developers to leverage cutting-edge AI without the hefty price tag of proprietary solutions.
Step 1: Install Ollama
- First, you need to download and install Ollama. You can find the installation…