Ten years ago, deep learning papers were often not considered credible because their references would not go back more than a year. This year, we celebrated the 10th anniversary of two papers that founded GenerativeAI in images and text. Over the last 10 years, we have learned: a) the power of embeddings to represent concisely and effectively rich semantic information and b) the power of pretraining on vast amounts of data.
After attending the latest NeurIPS conference, one of the most prestigious artificial intelligence and machine learning…