GPT-3

Terms from Artificial Intelligence: humans at the heart of algorithms

The glossary is being gradually proof checked, but currently has many typos and misspellings.

GPT-3 is a large-language model developed by OpenAI, and was influential in powering ChatGPT, which radically changed expectations as the the capabilities of AI. The apparent step-change in capability started a conversaton as to whether any intelligent behaviour could in fact be produced based on sheer volume of data and computation. GPT-3 could be tuned for different tasks using prompts and is derisgned to be used as a service by other applicatons, this led to a large growth of applications using GPT-3 as the underlying engine. However, because GPT-3 and its successors are built using large volumes of web data there are concerns about privacy and intellectual property, especially as it occasionally could reproduce verbatim portions of input documents.

Used in Chap. 6: page 76; Chap. 13: page 201; Chap. 19: page 298