Introduction to NLP Using R
2h 32mAdvanced2023-05-19
Authors
Mark Niemann-Ross
Technologist experienced in hardware, software, and science fiction
Course details
Natural language processing (NLP) is one of the most important components of artificial intelligence. It allows you to process, analyze, and understand large amounts of data in the form of natural language. In this course, instructor Mark Niemann-Ross shows you how to get started implementing NLP algorithms using R, the popular programming language for statistical computing and graphics.
Explore the basics of manipulating matrices and producing statistics, both of which are core to successful NLP. Learn how to use tools and text-mining frameworks such as tm, quanteda, and tidytext, as well as work with corpora, sources, and other types of NLP document metadata. Mark covers the best practices for preprocessing text in preparation for NLP, creating structured data, applying statistics to text, performing sentiment analysis, visualizing datasets, and more.
Explore the basics of manipulating matrices and producing statistics, both of which are core to successful NLP. Learn how to use tools and text-mining frameworks such as tm, quanteda, and tidytext, as well as work with corpora, sources, and other types of NLP document metadata. Mark covers the best practices for preprocessing text in preparation for NLP, creating structured data, applying statistics to text, performing sentiment analysis, visualizing datasets, and more.
Skills covered
RStatisticsNatural Language Processing (NLP)Artificial Intelligence (AI)Programming LanguagesData ScienceOpen SourceSoftware DevelopmentOne-Off
Concepts
Introduction
- Welcome to natural language processing with R
- Skills and tools you ll need to be successful in this course
Up and Running with tm
- What is tm and why do you need it
- tm documentation walk-through
- Real-world NLP with tm
- Real-world NLP with quanteda
- Real-world NLP with tidytext
Corpora and Sources
- Understanding corpora and sources
- Examining corpora
- Examining sources
- Custom sources
- Combining and subsetting corpora
Working with NLP Metadata
- Working with document metadata
- Make useful metadata
- Finding and filtering based on metadata
Preprocessing Text in Preparation for NLP
- Transformations
- Stop words
- Stemming
- Lemmatization
- Tokenization
- Ngrams
- Part of speech tagging
Create Structured Data
- Understanding the document-term matrix
- Create the document-term matrix
- Weighting the document-term matrix
- Focus the document-term matrix
Apply Statistics to Text
- Word and document frequency
- Hierarchical clustering
- Associated terms
Sentiment Analysis
- What is sentiment analysis
- Real-world example of sentiment analysis
- Sentiment datasets
- Sentiment tools
Visualizing Natural Language Processing
- Plotting text mining
- Plotting Zipf s and Heap s Law
- Word clouds
Conclusion
- Your next steps in NLP