A delta is a small change. For files it is a description of the differences between the files and is often used in version control systenms. In incremental algorithms it is the small change in parameter values at each step, for example the updates to weights in backpropagation.
Used in Chap. 6: pages 87, 88; Chap. 10: page 154; Chap. 20: page 344