A delta is a small change. For files it is a description of the differences between the files and is often used in version control systenms. In incremental algorithms it is the small change in parameter values at each step, for example the updates to weights in backpropagation.
Used on Chap. 6: pages 116, 117; Chap. 10: page 216; Chap. 20: page 505