Since its introduction in 2018, the BERT machine learning model has continued to perform well in a lot of language tasks. This video is a gentle introduction into some of the tasks that BERT can handle (in search engines, for example). The first 3 minutes goes over the some of its applications. Then the video discusses how the model works at a high level (and how you may use it to build a semantic search engine which is sensitive to the meanings of queries and results).
Introduction (0:00)
You have used BERT (applications) (0:25)
How BERT works (2:52)
Building a search engine (4:30)
——
The Illustrated BERT
http://jalammar.github.io/illustrated-bert/
BERT Paper:
https://www.aclweb.org/anthology/N19-1423/
Understanding searches better than ever before
https://blog.google/products/search/search-language-understanding-bert/
Google: BERT now used on almost every English query
——
Twitter: https://twitter.com/JayAlammar
Blog: https://jalammar.github.io/
Mailing List: http://eepurl.com/gl0BHL
More videos by Jay:
Explainable AI Cheat Sheet – Five Key Categories
The Narrated Transformer Language Model
Jay’s Visual Intro to AI
How GPT-3 Works – Easily Explained with Animations