OpenAI API: Multimodal Development with GPT-4o
37mGeneral2024-06-07
Authors
Morten Rand-Hendriksen
Senior Staff Instructor, Speaker, Web Designer, and Software Developer
Course details
In this hands-on course you’ll use the OpenAI API to leverage the multimodal capabilities of GPT-4o and function calling to extract text from images, conform the data to JSON, and call functions to save the extracted data to a spreadsheet.
Learning objectives
Apply GPT-4o API for image analysis.
Capture structured data using AI function calling.
Develop with multimodal AI capabilities.
Learning objectives
Apply GPT-4o API for image analysis.
Capture structured data using AI function calling.
Develop with multimodal AI capabilities.
Skills covered
GPTAPIsOpenAIProgramming FoundationsGenerative AIArtificial Intelligence (AI)Software DevelopmentOne-Off
Concepts
0. Introduction
- 01 - Multimodal development with GPT-4o
1. Multimodal development
- 02 - Exploring multimodal capabilities with ChatGPT
- 03 - Project setup and walk-through
- 04 - Using GPT-4o through the API
- 05 - Interpreting images with the API using GPT-4o
- 06 - Making GPT-4o output JSON
- 07 - Combining multimodal and function calling
- 08 - Converting image data to spreadsheet data
- 09 - Setting up a multimodal flow with Python and GPT-4o
Conclusion
- 10 - Next steps