Chapter 20 — Probability and Statistics Foundations

20.1 Learning Objectives

By the end of this chapter, you should be able to:

understand basic probability concepts

calculate simple probabilities

distinguish theoretical and experimental probability

understand independent and dependent events

calculate averages and measures of center

understand variability and spread

interpret graphs and distributions

recognize statistical reasoning in real systems

understand randomness conceptually

connect probability and statistics to science, AI, and decision-making

20.2 Big Picture — Probability Describes Uncertainty

Much of mathematics describes:

certainty

Probability describes:

uncertainty

Examples:

weather forecasting

stock markets

AI predictions

medical diagnosis

networking reliability

game outcomes

scientific experiments

Probability allows humans to:

20.3 What Is Probability?

Probability measures:

likelihood

General formula:

Probability = favorable outcomes / total outcomes

Probability values range between:

0 and 1

Where:

0 = impossible

1 = certain

20.4 Simple Probability Example

Example:

Rolling a six-sided die.

Probability of rolling a 3:

1/6

because:

1 favorable outcome

6 total outcomes

20.5 Probability as Percent

Example:

1/4 = 0.25 = 25%

Probabilities are often expressed as:

fractions

decimals

percentages

20.6 Certain and Impossible Events

Examples:

Event Probability

sun rises tomorrow 1

rolling a 9 on standard die 0

Most real systems fall:

between certainty and impossibility

20.7 Experimental Probability

Experimental probability uses:

actual observations

Example:

A coin flipped 100 times:

52 heads

48 tails

Experimental probability of heads:

52/100 = 0.52

20.8 Theoretical Probability

Theoretical probability uses:

mathematical expectation

Example:

Fair coin:

1/2

Theoretical systems assume:

ideal conditions

20.9 Independent Events

Events are independent if:

one event does not affect another

Example:

rolling dice repeatedly

Probability multiplies.

Example:

(1/2)(1/2) = 1/4

20.10 Dependent Events

Dependent events influence each other.

Example:

drawing cards without replacement

Probabilities change after each draw.

20.11 Mean (Average)

Mean:

sum of values / number of values

Example:

2, 4, 6

Mean:

(2 + 4 + 6)/3 = 4

20.12 Median

Median:

middle value

Example:

1, 3, 5, 7, 9

Median:

5

20.13 Mode

Mode:

most frequent value

Example:

2, 2, 3, 5

Mode:

2

20.14 Range

Range measures spread.

Formula:

largest - smallest

Example:

2, 5, 9

Range:

9 - 2 = 7

20.15 Data Distributions

Statistics studies:

patterns in data

Data may cluster:

tightly

widely

symmetrically

unevenly

Understanding distributions becomes central in advanced statistics.

20.16 Graphs and Visualization

Statistics often uses:

bar graphs

histograms

line graphs

scatter plots

Visualization helps humans:

detect patterns quickly

20.17 Probability in Computing and AI

Modern AI relies heavily on:

probability

statistical inference

pattern detection

uncertainty estimation

Machine learning systems are fundamentally statistical systems.

20.18 Real-World Statistical Systems

Examples:

medical studies

financial analysis

weather prediction

sports analytics

internet traffic

AI learning systems

quality control

Modern civilization relies heavily on statistical reasoning.

20.19 Common Beginner Difficulties

Students often struggle with:

interpreting probability

distinguishing theoretical and experimental probability

organizing data

averaging errors

probability multiplication

statistical terminology

These struggles are normal.

Probability intuition develops through:

experimentation

repeated exposure

visualization

real-world examples

20.20 Mental Model

Probability measures:

uncertainty

Statistics measures:

patterns in uncertainty

Together they help humans:

reason about incomplete information

20.21 Warm-Up Problems

Problems

Find probability:

Rolling a 4 on a six-sided die.

Find probability:

Rolling an even number on a die.

Convert to percent:

1/5

Convert to decimal:

3/4

Find mean:

2, 4, 6

Find mean:

5, 10, 15, 20

Find median:

1, 3, 5, 7, 9

Find mode:

2, 2, 3, 5

Find range:

4, 9, 12

Identify event type:

Flipping coins repeatedly.

Identify event type:

Drawing cards without replacement.

Explain what probability measures.

20.22 Guided Problems

Problems

Find probability:

Rolling a number greater than 4 on a die.

Find probability:

Drawing a heart from a standard deck.

Find probability:

Flipping two heads in two flips.

Find probability:

Rolling two even numbers in two rolls.

Find mean:

3, 7, 8, 12

Find median:

2, 4, 6, 8, 10

Find mode:

1, 1, 2, 3, 3, 3

Find range:

5, 8, 15, 20

Explain difference between:

theoretical probability

experimental probability

Explain why probability is important.

Describe a real-world statistical system.

Explain why averages are useful.

20.23 Challenge Problems

Find probability:

Rolling a number less than 3 on a die.

Find probability:

Flipping three heads in three flips.

Find mean:

4, 8, 12, 16, 20

Find median:

3, 5, 7, 9, 11, 13

Find mode:

4, 4, 4, 7, 8

Find range:

12, 18, 25, 40

Explain why independent probabilities multiply.

Explain why statistics becomes important for large systems.

Describe a computing or AI application of probability.

Explain why probability and statistics are foundational in modern science and technology.

20.24 Solutions

Solutions to Warm-Up Problems

1/6

3/6 = 1/2

20%

0.75

4

12.5

5

2

8

independent

dependent

Probability measures likelihood or uncertainty.

Solutions to Guided Problems

2/6 = 1/3

13/52 = 1/4

1/4

1/4

7.5

6

3

15

Theoretical probability predicts mathematically.

Experimental probability measures observed outcomes.

Probability helps humans estimate uncertainty and risk.

Examples include:

weather forecasting

finance

AI systems

medical studies

Averages summarize large amounts of information efficiently.

Solutions to Challenge Problems

2/6 = 1/3

1/8

12

8

4

28

Independent events do not influence one another, so probabilities combine multiplicatively.

Large systems generate enormous amounts of uncertain information requiring statistical analysis.

Examples include:

machine learning

spam filtering

recommendation systems

AI prediction engines

network analysis

Probability and statistics provide the foundation for scientific reasoning, AI, engineering, finance, medicine, computing, and modern decision-making under uncertainty.