Data Skeptic

Kyle and Linhda discuss attention and the transformer - an encoder/decoder architecture that extends the basic ideas of vector embeddings like word2vec into a more contextual use case.

Direct download: transformer.mp3
Category:general -- posted at: 8:31am PST

1