Oracle Cloud Infrastructure Generative AI Professional Cert Prep

Course details

This course offers an in-depth technical introduction to large language models (LLMs) for software developers, machine learning and AI engineers, and generative AI enthusiasts preparing for the Oracle Cloud Infrastructure Generative AI Professional certification exam. Explore the fundamentals of LLM architecture, fine-tuning techniques, code models, multimodal LLMs, and language agents. Additionally, learn how to get started with pretrained models, summarization, embeddings, dedicated AI clusters, and the OCI Generative AI architecture. Throughout the course, test out your new skills with practical, hands-on exercises, building a conversational chatbot with OCI Generative AI, integrating memory and implementing retrieval-augmented generation (RAG) using LangChain, and preparing the chatbot for deployment on an OCI compute instance.

Concepts

Introduction

Course overview

Fundamentals of Large Language Models

Module introduction
Introduction to large language models
LLM architectures
Prompting and prompt engineering
Issues with prompting
Training
Decoding
Hallucination
LLM applications

Generative AI Service

Module introduction
Introduction to OCI Generative AI service
Demo - Generative AI service walkthrough
Generation models
Demo - Generation models
Demo - OCI Generative AI service inference API
Demo - Setting up OCI config for Generative AI API
Summarization models
Embedding models
Demo - Summarization and embedding models
Prompt engineering
Demo - Prompt engineering with OCI Generative AI
Customize LLMs with your data
Fine-tuning and inference in OCI Generative AI
Dedicated AI cluster sizing and pricing
Demo - Dedicated AI clusters
Fine-tuning configuration
Demo - Fine-tuning and custom models
Demo - Inference using endpoint
OCI Generative AI security

Building Blocks for an LLM Application

Module introduction
RAG
Vector databases
Keyword search
Semantic search

Build an LLM Application Using OCI Generative AI Service

Module introduction
Chatbot introduction
Demo - Chatbot
Q&A chatbot architecture and basic components
Models, prompts, and chains
Demo - Set up development environment
Demo - Use prompts, models, and chains
Extending a chatbot by adding memory
Demo - Using memory
Demo - Using memory with Streamlit
Extending a chatbot by adding RAG and a vector database
Demo - RAG - Indexing using a vector database
Demo - RAG - Retrieval and generation using a vector database
Extending a chatbot by adding RAG plus memory
Demo - RAG plus memory plus tracing
Demo - Model evaluation
Chatbot technical architecture
Deploy a chatbot to a VM
Demo - Deploy a chatbot
Deploy a chatbot to OCI Data Science

Prepare for OCI Generative AI Professional Certification

Certification preparation
Sample exam questions - Part one
Sample exam questions - Part two