The penumbra is the area under part shadow, typically around the edge of the full shadow. In sunlight these are points on the ground where part of the sun is visble. Metaphorically, we can think of data items close to decison boundary as being in the penumbra, as small changes to a few features might change the classification.
Used on Chap. 21: page 526