The penumbra is the area under part shadow, typically around the edge of the full shadow. In sunlight these are points on the ground where part of the sun is visble. Metaphorically, we can think of data items close to a decision boundary as being in the penumbra, as small changes to a few features might change the classification.
Used in Chap. 21: page 337