Introduction to AI-Native Vector Databases
2h 48mIntermediate2023-12-14
Authors
Zain Hasan
Course details
The primary purpose of vector databases is to provide fast and accurate similarity search or nearest neighbor search capabilities. The integration of AI techniques in vector databases enhances their capabilities, improves search accuracy, optimizes performance, and enables more intelligent and efficient management of high-dimensional data. In this course, Zain Hasan introduces this foundational technology—which is already being used in industries like ecommerce, social media, and more. Zain covers everything from foundational concepts around AI-first vector databases to hands-on coding labs for question answering using LLMs.
Skills covered
Natural Language Processing (NLP)Introduction toMachine LearningArtificial Intelligence FoundationsDatabase DevelopmentDatabase ManagementArtificial Intelligence (AI)Software Development
Concepts
Introduction
- Learning AI-native vector databases
- What you should know
- The superpower of vector databases
Data - What Data Do Vector Databases Store and How Is It Stored
- Structured versus unstructured data
- Human-understandable versus machine-understandable data
- Drawing out and visualizing vector representations of data
- Introduce the concept of distance between two vectors
- Challenge - Working with vectors
- Solution - Working with vectors
Natural Querying - How Do You Search for Data in a Vector Database
- Frame the query as a question or search
- Generate the question in machine-understandable language
- Adding data to a vector database
- Performing semantic searches using Weaviate
- Challenge - Vector search with Weaviate
- Solution - Vector Search with Weaviate
Machine Learning Vectors - How Does a Vector Database Understand Your Data
- Machine learning models and object classification
- Translating data from human to machine-understandable
- ML models and vector embeddings
- Challenge - Search with images and text
- Solution - Search with images and text
Scalability - What Does a Vector Database Need to Do
- Scalability - When to use a vector DB
- Ways to measure performance of a vector DB
- CRUD operations in vector DBs
- Challenge - CRUD and performance
- Solution - CRUD and performance
Demonstrate Vector DBs and Use Cases
- Vector DB1 - E-commerce RecSys
- Vector DB2 - Hybrid search
- Vector DB3 - Retrieval augmented generation
- Challenge - Vector DBs
- Solution - Vector DBs
Conclusion
- Continue your AI-native vector databases learning journey