A delta is a small change. For files it is a description of the differences between the files and is often used in version control systems. In incremental algorithms it is the small change in parameter values at each step, for example the updates to weights in backpropagation.
Used in Chap. 6: pages 78, 79; Chap. 10: page 142; Chap. 20: page 325