Installing, Running and Testing LLMs on Your Local Computer
14mGeneral2024-01-29
Authors
Ray Villalobos
Senior Staff Instructor at LinkedIn Learning
Course details
Discover how to set up, operate, and test LLMs on your machine, using Jan App. Explore open vs. closed-source models and installation requirements. Locally test AI models including Meta's Llama, Mistral AI, and OpenAI's closed-source ChatGPT. This course is perfect for those eager to test AI models with personal data without third-party sharing, or for those who want to use ChatGPT, but need to ensure they are not training other AIs.
Learning objectives
Understand how to install and test local LLMs via the Jan app
Explore open vs. closed-source installations
Set custom test parameters
Add OpenAI’s ChatGPT through an API key
Learning objectives
Understand how to install and test local LLMs via the Jan app
Explore open vs. closed-source installations
Set custom test parameters
Add OpenAI’s ChatGPT through an API key
Skills covered
Natural Language Processing (NLP)Artificial Intelligence (AI)One-Off
Concepts
0. Introduction
- 01 - Advantages to testing LLMs locally
1. Installing LLMs Locally
- 02 - Understanding open versus closed-source systems
- 03 - Using apps to work with LLMs
- 04 - Chatting with models
- 05 - Setting LLM options
- 06 - Using custom parameters