Learn Databricks GenAI
1h 10mIntermediate2025-03-06
Authors
Lynn Langit
Cloud Architect
Course details
In this detailed course, cloud architect and experienced technical educator Lynn Langit explores Generative AI with Databricks. Discover how to use prompt engineering in Databricks AI and BI to effectively query data with AI prompts. Learn to implement and set up Vector Search to enhance your GenAI applications. Understand the Retrieval-Augmented Generation (RAG) pattern and its integration to boost your AI projects with your data. Get hands-on with model tuning, including foundation model training and fine-tuning with Hugging Face transformers. Gain the skills you need to harness AI for data queries, implement advanced search techniques, and fine-tune AI models. This course empowers you to unlock the power of Databricks and elevate your data-driven decision-making capabilities.
Skills covered
DatabricksData EngineeringGenerative AIData AnalysisEssential TrainingArtificial Intelligence (AI)Data ScienceBusiness Analysis and StrategyBusiness Software and Tools
Concepts
0. Introduction
- 01 - Enterprise-ready GenAI - A Databricks journey
1. Prompt Engineering in Databricks
- 02 - Use AI BI Genie
- 03 - Use AI Playground
- 04 - Query LLMs
- 05 - Find pretrained foundation models
- 06 - Use Marketplace to find models
2. Vector Search in Databricks
- 07 - Understand Databricks Vector Search
- 08 - Setup for Databricks Vector Search
- 09 - Create Vector Search index
- 10 - Use Vector Search index result
3. RAG-Pattern in Databricks
- 11 - Understand RAG
- 12 - Understand agents in RAG
- 13 - Build a RAG chain
- 14 - Review the vector index
- 15 - Evaluate a RAG chain
4. Model Tuning in Databricks
- 16 - Understand foundation model training
- 17 - Supervised fine-tuning with foundation model training
- 18 - Evaluate fine-tuning MLflow experiments
- 19 - Fine-tuning with Hugging Face transformers
Conclusion
- 20 - Next steps