AI Workshop: Advanced Chatbot Development
3h 18mAdvanced2024-09-03
Authors
Axel Sirota
Course details
Businesses increasingly rely on AI-driven solutions to enhance customer interactions, streamline services, and stay competitive. In this rapidly evolving digital landscape, the ability to build and deploy sophisticated chatbots is crucial. This hands-on course empowers data scientists and ML engineers to leverage these cutting-edge tools and techniques, ensuring their organizations lead in delivering exceptional customer experiences.
Instructor Axel Sirota guides you in mastering the development and deployment of advanced chatbots and LLMs. Key objectives include understanding chatbot technologies and trends, using Hugging Face for development, and implementing chatbots with the OpenOrca dataset. Along the way, Axel covers advanced techniques to optimize performance and efficiency and provides hands-on experience deploying chatbots to Hugging Face Spaces with Gradio and to AWS ECS using Docker and Terraform.
Prerequisites
Familiarity with Python programming, as it's the primary language used in the course
Some experience with machine learning concepts and methodologies
Prior exposure to TensorFlow and Keras for model building and training
Basic knowledge of AI and natural language processing (NLP) techniques
Instructor Axel Sirota guides you in mastering the development and deployment of advanced chatbots and LLMs. Key objectives include understanding chatbot technologies and trends, using Hugging Face for development, and implementing chatbots with the OpenOrca dataset. Along the way, Axel covers advanced techniques to optimize performance and efficiency and provides hands-on experience deploying chatbots to Hugging Face Spaces with Gradio and to AWS ECS using Docker and Terraform.
Prerequisites
Familiarity with Python programming, as it's the primary language used in the course
Some experience with machine learning concepts and methodologies
Prior exposure to TensorFlow and Keras for model building and training
Basic knowledge of AI and natural language processing (NLP) techniques
Skills covered
Hugging FaceNatural Language Processing (NLP)Generative AIAmazon Web Services (AWS)AmazonArtificial Intelligence (AI)One-Off
Concepts
Introduction
- Building an AI chatbot
- Getting the most out of this course
- Version check
Understanding Chatbots and Hugging Face
- Overview of chatbot technologies and trends
- Fundamentals of chatbots
- Introduction to Hugging Face
- Demo - Exploring Hugging Face
- Designing a chatbot for customer experience
- Demo - Implementing the chatbot in Python
- Solution - Build a basic chatbot
Building an Advanced Chatbot with OpenOrca
- Introduction to OpenOrca dataset
- Demo - Building a chatbot with OpenOrca
- Further enhancing chatbot features
- Solution - Enhance the chatbot with OpenOrca
Preparing Model for Deployment
- Principles of model pruning
- Demo - Pruning the chatbot model
- Theory and practice of model distillation
- Demo - Applying model distillation to the chatbot
- Understanding and implementing quantization
- Demo - Quantizing the chatbot model
- Demo - Overview of the results
- Solution - Prepare the chatbot for deployment
Deploying to Hugging Face Spaces with Gradio
- Introduction to Gradio
- Deploying the chatbot to Hugging Face Spaces
- Demo - Deploying to Hugging Face Spaces
- Details to consider on deploying to Hugging Face Spaces
Deploying to AWS ECS Using Terraform
- How to deploy to ECS
- Demo - Creating the Dockerfile
- Demo - Writing a Terraform file for AWS ECS deployment
- Demo - Deploying the Dockerized chatbot to AWS ECS
Evaluating Chatbot Performance
- Metrics and benchmarks for chatbot performance
- Demo - benchmarking our chatbot
- Analyzing and improving your chatbot
Conclusion
- Recap of key learnings and tips
- Continuing on with AI chatbots