foundation models

Terms from Artificial Intelligence for Human Computer Interaction

From entry foundation models in glossary Artificial Intelligence: humans at the heart of algorithms

A foundation model is an AI model that is trained on a vast corpus of training data of a broad type, but which can be tuned to more specific domains. The earliest examples were large language models, but there are now foundation models for other media, so the term large X model (LxM) is sometimes used. Foundation models are very expensive to create and often very large, hence expensive to run. However the ability to tune these models amortises the costs of initial production, and there are techniques to prune the large parameter spaces after training.

Used in Chap. 2: page 20