Today Ankush Garg is speaking with Rishi Bommasani, PhD student at Stanford and one of the originator of the term Foundation Models.
They’re talking about the origins of the term Foundation Model, which he and his group advanced, in the paper "On the Opportunities and Risks of Foundation Models".
They’ll talk about self-supervision, issues of scale, the motivation behind the terminology, the origins of the Research for Foundation Models Institute at Stanford, outcome homogenization, emergence and phase transitions, and some of the social consequences to look out for.
Thank you both for this conversation. As the world is coming to terms with GPT-4, this will be increasingly relevant.
Paper: On the Opportunities and Risks of Foundation Models.
Rishi's twitter: @RishiBommasani
Center for Research on Foundation Models (CRFM)
Related Episodes
The Semantic Layer and AutoML
Today we're talking with Gaurav Rao, the EVP & GM of Machine Learning and AI at AtScale, a company centered around the semantic layer. For some time now, I've been feeling that there is a deep connection between a formal articulation of business context and the realization of the drea...
The Business and Engineering of AutoML Products with Raymond Peck
Today we're talking with Raymond Peck, a senior engineer and director in the AutoML space. He spent time at H2O, dotData, Alteryx and many other places. This is a fascinating conversation about the business, engineering, and science of machine learning automation in production. Learning about ...
TabPFN: A Revolution in AutoML?
Today we’re talking to Noah Hollmann and Samuel Muller about their paper on TabPFN - which is an incredible spin on AutoML based on Bayesian inference and transformers. [Quick note on audio quality]: Some of the tracks have not recorded perfectly but I felt that the content there was too impo...