Statistics is about trying to learn dependable things about the real world based on measurements of it. Statistics involves both probability and also dealing with fundamental unknowns. Usually the observations we have are related to some underlying value or state of the world, but also have some level of randomness. If we knew the underlying value/state, we may know the statistical proeprties of the observations, the 'job of statsitcis' is to invert this process, to find out about the unknown state of the world, from these probabalistic observations.
Used in Chap. 20: page 317
Links:
The job of statistics—moving from data about the real world back to knowledge about the real world. Figure 1.3 from Statistics for HCI