LiGO {Linear Growth Operator} is a method to reduce the computation needed to train {{large language models} thus both improving computational effeiciency and reducing environmental cost.
Used on page 574
Also known as linear growth operator
Links:
- eecs.mit.edu: Learning to grow machine-learning models