Counting and Sample Spaces
Overview
The study of probability provides the mathematical framework for reasoning about uncertainty. Before we can assign a measure of likelihood to any occurrence, we must first possess a complete and rigorous description of all possibilities. This chapter is dedicated to establishing this fundamental groundwork. We begin by formalizing the notion of a random experiment and introducing the concepts of the sample spaceβthe set of all possible outcomesβand events, which are specific subsets of this space. A precise understanding of these elements is the indispensable first step in the structured analysis of any probabilistic scenario.
Mastery of this foundational material is of paramount importance for the GATE examination, where problems are often constructed to test not merely computational skill but conceptual clarity. Once the structure of an experiment is defined, we are frequently faced with the challenge of enumeration: determining the number of outcomes that constitute an event or the total number of outcomes in the sample space. To this end, we shall develop a systematic toolkit of counting principles, including permutations and combinations. These are not simply formulas to be memorized, but powerful logical tools for dissecting complex problems. We will conclude by unifying these concepts under the three axioms of probability, which provide the definitive, formal rules that govern all of probability theory.
---
Chapter Contents
| # | Topic | What You'll Learn |
|---|-------|-------------------|
| 1 | Sample Space and Events | Defining outcomes of random experiments. |
| 2 | Counting Principles | Systematic methods for enumerating possible outcomes. |
| 3 | Probability Axioms | The fundamental rules of probability theory. |
---
Learning Objectives
After completing this chapter, you will be able to:
- Define a sample space and identify events for a given random experiment.
- Apply fundamental counting principles, including permutations and combinations, to determine the size of sample spaces and events.
- Calculate the probability of events in discrete sample spaces with equally likely outcomes.
- Understand and apply the axioms of probability to derive basic probabilistic properties.
---
We now turn our attention to Sample Space and Events...
## Part 1: Sample Space and Events
Introduction
The study of probability is fundamentally concerned with the analysis of random phenomena. Before we can assign probabilities to outcomes, we must first establish a rigorous mathematical framework for describing all possible results of an experiment. This framework is built upon the foundational concepts of the sample space and events. A clear understanding of how to define a sample space and identify events within it is the first and most critical step in solving any problem in probability theory. This chapter provides the essential vocabulary and structure required for this purpose.
We begin by formalizing the notion of a random experiment, which is any process with an uncertain outcome. From this, we define the sample space as the set of all possible outcomes. An event, then, is simply a subset of this sample space, representing a result or a collection of results that are of particular interest to us.
A random experiment is a process that satisfies three conditions:
- It can be repeated any number of times under identical conditions.
- The set of all possible outcomes is known prior to conducting the experiment.
- The specific outcome of any particular trial is not known in advance.
---
---
Key Concepts
The entire structure of probability theory rests upon a few key definitions. Mastering these is non-negotiable for success in the subject.
1. Sample Space
The sample space is the cornerstone upon which we build our analysis.
The sample space, denoted by , is the set of all possible outcomes of a random experiment. Each individual outcome in the sample space is referred to as a sample point.
A sample space can be either discrete or continuous.
* Discrete Sample Space: Contains a finite or countably infinite number of sample points. For example, the outcomes of a coin toss, , or the number of emails received in an hour, .
* Continuous Sample Space: Contains an infinite number of sample points that form a continuum. For example, the height of a student, where .
Worked Example:
Problem: Define the sample space for the experiment of rolling two distinct six-sided dice simultaneously.
Solution:
Step 1: Identify the outcomes for each die.
For the first die, the outcomes are . For the second die, the outcomes are also .
Step 2: Represent an outcome as an ordered pair.
Let an outcome be represented by an ordered pair , where is the result of the first die and is the result of the second die.
Step 3: Systematically list all possible pairs.
The sample space is the set of all such ordered pairs.
Step 4: Determine the size of the sample space.
The total number of sample points is the product of the number of outcomes for each die.
Answer: The sample space consists of 36 ordered pairs, representing all possible combinations of outcomes from the two dice.
---
2. Event
An event is what we are typically interested in measuring the probability of.
An event, denoted by a capital letter such as or , is any subset of the sample space . An event is said to have occurred if the outcome of the experiment is a sample point that belongs to that event.
* Simple Event: An event consisting of a single sample point.
* Compound Event: An event consisting of more than one sample point.
* Sure Event: The entire sample space . This event is certain to occur.
* Impossible Event: The empty set . This event can never occur.
3. Algebra of Events
Since events are sets, we can apply the operations of set theory to them. This "algebra of events" is crucial for manipulating and calculating probabilities.
* Union (): Represents the occurrence of "at least one of the events or ".
* Intersection (): Represents the "simultaneous occurrence of both events and ".
* Complement ( or ): Represents the "non-occurrence of event ".
* Mutually Exclusive Events: Two events and are mutually exclusive (or disjoint) if they cannot occur at the same time. Mathematically, this means their intersection is the empty set, .
Variables:
- = First event
- = Second event
When to use: To determine if two events can happen simultaneously. If their intersection is the empty set, , they are mutually exclusive.
---
Problem-Solving Strategies
A common source of error in probability is an incorrectly defined sample space. A systematic approach is essential.
For experiments with multiple components (e.g., two dice, three coins), do not list outcomes haphazardly. Use a systematic method like a tree diagram or a grid.
For an experiment of rolling two dice, a grid is the most reliable way to visualize all 36 outcomes. This makes it trivial to identify outcomes for events like "the sum is 7" or "the first die is greater than the second". This structured approach minimizes the risk of missing or double-counting sample points.
---
---
Common Mistakes
- β Incorrectly defining the sample space. For an experiment of tossing two distinct coins, students might write , assuming the order doesn't matter. This is incorrect.
- β Confusing 'mutually exclusive' with 'independent'. These are fundamentally different concepts. Mutually exclusive means events cannot happen together. Independence (a topic we will cover later) relates to whether the occurrence of one event affects the probability of another.
---
Practice Questions
:::question type="MCQ" question="An experiment consists of tossing a fair coin four times. What is the total number of sample points in the sample space?" options=["8", "12", "16", "24"] answer="16" hint="Each toss has 2 possible outcomes. Use the multiplication principle for the sequence of four tosses." solution="
Step 1: Identify the number of outcomes for a single toss.
For one coin toss, there are 2 outcomes: Heads (H) or Tails (T).
Step 2: Apply the multiplication principle for a sequence of independent trials.
Since the coin is tossed four times, the total number of possible outcomes is the product of the number of outcomes at each step.
Step 3: Calculate the final value.
Result:
The sample space contains 16 sample points.
Answer: \boxed{16}
"
:::
:::question type="NAT" question="Two distinct six-sided dice are rolled. Let event A be that the sum of the numbers is a prime number. How many outcomes are in event A?" answer="15" hint="List all 36 outcomes in a grid. Identify the prime sums (2, 3, 5, 7, 11) and count the pairs that produce them." solution="
Step 1: Define the sample space . The total number of outcomes is .
Step 2: Identify the possible prime sums. The minimum sum is and the maximum sum is . The prime numbers in this range are 2, 3, 5, 7, and 11.
Step 3: List the outcomes for each prime sum.
- Sum = 2: (1 outcome)
- Sum = 3: (2 outcomes)
- Sum = 5: (4 outcomes)
- Sum = 7: (6 outcomes)
- Sum = 11: (2 outcomes)
Step 4: Sum the number of outcomes for event A.
The total number of outcomes in event A is the sum of the counts from Step 3.
Result:
There are 15 outcomes in event A.
Answer: \boxed{15}
"
:::
:::question type="MSQ" question="From a standard deck of 52 playing cards, one card is drawn at random. Let event A be 'the card is a King' and event B be 'the card is a Spade'. Let event C be 'the card is a Heart'. Which of the following statements is/are true?" options=["Events A and B are mutually exclusive.", "Events B and C are mutually exclusive.", "Events A and C are not mutually exclusive.", "The sample space size is 52."] answer="Events B and C are mutually exclusive.,Events A and C are not mutually exclusive.,The sample space size is 52." hint="Check the intersection of each pair of events. A card can be a King and a Spade (King of Spades), but a card cannot be both a Spade and a Heart." solution="
Answer: \boxed{Events B and C are mutually exclusive., Events A and C are not mutually exclusive., The sample space size is 52.}
"
:::
---
Summary
- Sample Space () is Everything: Always begin a probability problem by clearly defining the sample space. An error here will invalidate all subsequent calculations.
- Events are Subsets: Remember that an event is simply a subset of the sample space (). All set operations (union, intersection, complement) apply directly to events.
- Mutually Exclusive means Disjoint: Two events are mutually exclusive if and only if their intersection is the empty set (). This means they cannot occur at the same time.
---
---
What's Next?
This topic provides the foundational language of probability. The concepts here connect directly to:
- Axioms of Probability: The rules of probability are defined over the events of a sample space. You cannot understand the axioms without first mastering the algebra of events.
- Combinatorics (Permutations and Combinations): For complex experiments, we do not list the sample space explicitly. Instead, we use counting principles to determine the size of the sample space and the size of events, which is essential for calculating probabilities.
---
Now that you understand Sample Space and Events, let's explore Counting Principles which builds on these concepts.
---
Part 2: Counting Principles
Introduction
In the study of probability, our primary objective is often to determine the likelihood of an event. This fundamentally requires us to quantify the number of possible outcomes, both for the event in question and for the entire experiment. The field of mathematics concerned with counting is known as combinatorics. While counting may seem elementary, the complexity of scenarios encountered in data analysis and computer science necessitates a systematic approach.
The foundational principles of countingβnamely, the Addition and Multiplication Principlesβprovide the essential tools for enumerating outcomes in a structured manner. A mastery of these rules is not merely an academic exercise; it forms the bedrock upon which the entire edifice of discrete probability is built. These principles allow us to determine the size of sample spaces, which is the first and most critical step in calculating probabilities.
Combinatorics is the branch of mathematics dealing with the study of finite or countable discrete structures. It is primarily concerned with "counting" the number of ways certain objects or arrangements can be formed, selected, or combined.
---
---
Key Concepts
The two most fundamental rules in combinatorics are the Rule of Sum and the Rule of Product. Understanding when to apply each is crucial for correctly solving counting problems.
1. The Addition Principle (Rule of Sum)
The Addition Principle applies when we must make a choice between two or more mutually exclusive options. If an event can occur in one of several distinct ways, we sum the number of ways for each option.
Consider two tasks, and . If task can be performed in ways and task can be performed in ways, and the two tasks cannot be performed simultaneously (they are disjoint), then the number of ways to perform either or is the sum of the number of ways for each task.
If a task can be done in one of disjoint ways, and the first way has options, the second has options, ..., and the -th way has options, then the total number of ways to perform the task is:
Variables:
- = Total number of ways to perform the task.
- = Number of ways for the -th mutually exclusive option.
When to use: When a problem involves making a single choice from a set of disjoint (mutually exclusive) options. Look for keywords like "OR".
Worked Example:
Problem: A university library has 40 textbooks on Data Structures and 30 textbooks on Algorithms. A student wishes to borrow exactly one textbook. How many choices does the student have?
Solution:
Step 1: Identify the disjoint tasks.
The student can choose a Data Structures book OR an Algorithms book. These are mutually exclusive choices.
Let be the task of choosing a Data Structures book, and be the task of choosing an Algorithms book.
Step 2: Determine the number of ways for each task.
Number of ways for is .
Number of ways for is .
Step 3: Apply the Addition Principle.
The total number of choices is the sum of the number of choices for each task.
Step 4: Compute the final answer.
Answer: The student has 70 choices.
---
2. The Multiplication Principle (Rule of Product)
The Multiplication Principle applies when a procedure or task is composed of a sequence of steps or stages. If the overall task is completed by performing a series of sub-tasks one after another, we multiply the number of ways to do each sub-task.
Let us consider a procedure that can be broken down into a sequence of two tasks, and . If task can be performed in ways, and for each of these ways, task can be performed in ways, then the total number of ways to perform the entire procedure is the product of the number of ways for each task.
If a procedure consists of a sequence of steps, and the first step can be done in ways, the second step in ways, ..., and the -th step in ways (regardless of the choices made in previous steps), then the total number of ways to complete the procedure is:
Variables:
- = Total number of outcomes for the procedure.
- = Number of ways for the -th step in the sequence.
When to use: When a problem involves constructing an outcome through a sequence of steps. Look for keywords like "AND" or a description of a multi-stage process.
Worked Example:
Problem: A user is creating a password that must consist of one uppercase letter followed by two digits. How many different passwords can be created? (Assume the English alphabet has 26 letters and digits are 0-9).
Solution:
Step 1: Decompose the procedure into a sequence of steps.
The procedure of creating a password has three steps:
Step 2: Determine the number of ways for each step.
- Number of ways to choose the first character (A-Z): .
- Number of ways to choose the second character (0-9): .
- Number of ways to choose the third character (0-9): .
Step 3: Apply the Multiplication Principle.
The total number of possible passwords is the product of the number of options at each step.
Step 4: Compute the final answer.
Answer: There are 2600 different possible passwords.
---
Problem-Solving Strategies
The key to solving basic counting problems is to correctly identify whether to add or multiply. A simple linguistic trick can often clarify the situation:
- If the problem description implies a choice of "this OR that", it usually signals the use of the Addition Principle. You are performing one action from a set of disjoint alternatives.
- If the problem description implies a sequence of events, such as "do this AND then do that", it points towards the Multiplication Principle. You are performing a series of actions to form a single outcome.
---
---
Common Mistakes
- β Confusing Addition and Multiplication: Applying the addition rule for a sequential task. For example, in the password problem, incorrectly calculating .
- β Ignoring Constraints: Overlooking restrictions mentioned in the problem, such as "digits cannot be repeated" or "the first letter must be a vowel".
---
Practice Questions
:::question type="MCQ" question="A restaurant offers 5 distinct appetizers and 8 distinct main courses. A customer wants to order either an appetizer or a main course, but not both. How many different choices does the customer have?" options=["13", "40", "3", "35"] answer="13" hint="The customer is choosing one item from two separate, mutually exclusive categories. Consider the keyword 'or'." solution="
Step 1: Identify the tasks.
The customer can either choose an appetizer OR a main course. These are disjoint choices.
- Task 1: Choose an appetizer. There are ways.
- Task 2: Choose a main course. There are ways.
Step 2: Apply the Addition Principle.
Since the choices are mutually exclusive (the customer orders one or the other), we add the number of options.
Result: The customer has 13 different choices.
Answer:
"
:::
:::question type="NAT" question="A 4-digit PIN is to be formed using the digits {0, 1, 2, 3, 5, 8}. If repetition of digits is allowed, how many different PINs can be formed?" answer="1296" hint="Forming a PIN is a 4-step process. Determine the number of options available for each of the four positions." solution="
Step 1: Decompose the task.
The task is to form a 4-digit PIN. This can be broken down into 4 sequential steps: choosing the first digit, choosing the second, choosing the third, and choosing the fourth.
Step 2: Count the options for each step.
The set of available digits is {0, 1, 2, 3, 5, 8}, which contains 6 distinct digits.
- Options for the 1st digit: 6
- Options for the 2nd digit: 6 (since repetition is allowed)
- Options for the 3rd digit: 6 (since repetition is allowed)
- Options for the 4th digit: 6 (since repetition is allowed)
Step 3: Apply the Multiplication Principle.
The total number of PINs is the product of the number of options for each position.
Step 4: Calculate the final value.
Result: A total of 1296 different PINs can be formed.
Answer:
"
:::
:::question type="MSQ" question="A committee of two is to be formed from a group of 3 computer science (CS) students and 4 electrical engineering (EE) students. The committee must consist of students from different departments. Which of the following statements is/are correct?" options=["The total number of ways to form the committee is 12.", "The problem can be solved by choosing one CS student AND one EE student.", "If the students had to be from the same department, the total number of ways would be 9.", "The problem can be solved by calculating (3+4) * (3+4-1) / 2."] answer="The total number of ways to form the committee is 12.,The problem can be solved by choosing one CS student AND one EE student." hint="The committee requires one student from each department. This is a sequence of choices. Also, evaluate the alternative scenario in the options." solution="
Solution:
The problem requires forming a committee of two students from different departments. This means we must select exactly one student from the CS group and one student from the EE group.
- Statement A: We analyze this using the Multiplication Principle.
- Statement B: This statement accurately describes the logical procedure required to solve the problem: choosing one student from the first group AND one from the second. This aligns perfectly with the Multiplication Principle. Thus, statement B is correct.
- Statement C: This statement describes a different scenario where students must be from the same department. While the calculation for that scenario () is correct, it does not pertain to the original problem statement. Therefore, it is not a correct statement about the given problem.
- Statement D: This calculation, , represents the total number of ways to choose any 2 students from the total of 7, without any restrictions. This is not what the problem asks for. Thus, statement D is incorrect.
---
Summary
- Addition Principle (Rule of Sum): Use when you have to make a single choice from a set of mutually exclusive (disjoint) options. The keyword is OR. Total ways = .
- Multiplication Principle (Rule of Product): Use when a task is composed of a sequence of steps or stages. The keyword is AND. Total ways = .
- Problem Decomposition: The first step in any counting problem is to break it down into a series of simple choices or a sequence of simple steps. Then, identify the relationship between these parts to decide whether to add or multiply.
---
---
What's Next?
The fundamental counting principles are the building blocks for more advanced combinatorial concepts frequently tested in GATE.
- Permutations and Combinations: These topics are direct extensions of the Multiplication Principle. Permutations deal with ordered arrangements, while Combinations deal with unordered selections.
- Probability: The ability to count outcomes is essential for calculating probabilities. The size of the sample space () and the event space () are often found using these principles, leading to the calculation .
---
Now that you understand Counting Principles, let's explore Probability Axioms which builds on these concepts.
---
Part 3: Probability Axioms
Introduction
In our preliminary study of probability, we often rely on an intuitive understanding based on relative frequencies or symmetry. However, for a rigorous and consistent framework, we must establish a formal mathematical foundation. This is achieved through an axiomatic approach, which defines probability not by what it is, but by the rules it must obey.
The axiomatic approach, formulated by Andrey Kolmogorov, provides a set of fundamental rules, or axioms, from which all other properties of probability can be logically derived. This framework is essential for handling complex problems in data analysis, machine learning, and other advanced fields. For the GATE examination, a firm grasp of these axioms and their immediate consequences is critical for building a robust understanding of probability theory. We shall now explore these foundational principles.
A probability space is a mathematical construct that models a random process. It is defined as a triplet , where:
- is the sample space, which is the set of all possible outcomes of an experiment.
- is the event space, a set of subsets of (called events), which must be a -algebra. For GATE purposes, we can consider to be the set of all possible events we are interested in.
- is the probability measure, a function that assigns a real number to each event . This function must satisfy the axioms of probability.
---
---
The Three Axioms of Probability
The entire structure of probability theory rests upon three deceptively simple axioms. Let be a probability space. The probability measure must satisfy the following rules for any event .
1. Axiom 1: Non-negativity
The probability of any event is a non-negative real number.
Variables:
- : Any event in the event space .
Application: This axiom establishes that probability cannot be negative. Any calculation that results in a negative probability is incorrect.
2. Axiom 2: Normalization
The probability of the entire sample space is equal to 1.
Variables:
- : The sample space, representing the event that some outcome occurs.
Application: This axiom anchors the scale of probability. The certainty of an outcome occurring from the set of all possible outcomes is defined as 1. It follows that the probability of any event must be in the range .
3. Axiom 3: Additivity
For any countable collection of pairwise disjoint (mutually exclusive) events , the probability of their union is the sum of their individual probabilities.
For disjoint events for all :
Variables:
- : A set of pairwise disjoint events.
Application: This is the cornerstone for calculating probabilities of compound events. For any two mutually exclusive events and , this simplifies to .
---
Key Consequences of the Axioms
From these three axioms, we can derive several fundamental properties of probability. These are not new axioms but are logical consequences that are frequently used in problem-solving.
1. Probability of the Impossible Event
The probability of the empty set, , which represents an impossible event, is zero.
Derivation:
Step 1: Consider the sample space and the empty set . These two events are mutually exclusive, as .
Step 2: We can write the union as .
Step 3: Apply Axiom 3 (Additivity) to this union.
Step 4: Since , we have .
Step 5: By Axiom 2, .
Step 6: Solving for , we find:
2. Probability of the Complement
For any event , the probability of its complement, , is minus the probability of .
Variables:
- : Any event.
- : The complement of event .
When to use: This is extremely useful when calculating the probability of an event is difficult, but calculating the probability of its complement (the event not happening) is easy.
3. The General Addition Rule
For any two events and (not necessarily disjoint), the probability of their union is given by the sum of their probabilities minus the probability of their intersection.
Variables:
- : Any two events.
- : The event that A or B or both occur.
- : The event that both A and B occur.
When to use: This formula is fundamental for calculating the probability of the union of any two events, especially when they overlap.
Worked Example:
Problem: Let , , and . Find the probability that either event A or event B occurs.
Solution:
Step 1: We are asked to find . The events are not mutually exclusive since .
Step 2: Apply the General Addition Rule.
Step 3: Substitute the given values into the formula.
Step 4: Compute the final result.
Answer: The probability that either A or B occurs is .
---
Problem-Solving Strategies
Before applying any addition rule, always ask: "Are the events mutually exclusive?"
- If YES (), use the simple form: .
- If NO (), you must use the general form: .
---
Common Mistakes
- β Incorrectly Assuming Independence for Disjointness: Students often confuse mutually exclusive events with independent events. Disjoint events (if they have non-zero probabilities) are always dependent. Do not mix up the formulas for these two distinct concepts.
- β Forgetting to Subtract the Intersection: A frequent error is to calculate as even when the events overlap. This overestimates the true probability.
- β Violating the Axioms: Calculating a final probability that is greater than 1 or less than 0. This is a clear sign of a conceptual or calculation error. Always check if your final answer lies in the range .
---
Practice Questions
:::question type="MCQ" question="Let and be two events in a sample space . If and , and and are mutually exclusive, what is the value of ?" options=["0.2","0.4","1.4","Cannot be determined"] answer="0.2" hint="Recall the addition rule for mutually exclusive events." solution="For mutually exclusive events, . The additivity axiom simplifies to . We are given and .
:::
:::question type="NAT" question="For two events and , it is known that and . If , calculate the value of ." answer="0.5" hint="First, find from its complement. Then, use the general addition rule." solution="Step 1: Find using the complement rule.
Step 2: Use the general addition rule: .
Step 3: Solve for .
:::
:::question type="MSQ" question="Which of the following statements are direct consequences of the three axioms of probability for any events and from a sample space ?" options=["If , then ","P() = ","P() = 1","P() = 0"] answer="If , then ,P() = 1,P() = 0" hint="Evaluate each statement based on the axioms. Note that one statement relates to independence, which is a separate definition, not an axiom." solution="
- If , then : This is a correct consequence. We can write , where and are disjoint. By Axiom 3, . By Axiom 1, , so .
- P() = : This is the definition of statistical independence, not a direct consequence of the axioms for any two events. It only holds if the events are independent.
- P() = 1: The union of an event and its complement is the entire sample space, . By Axiom 2, . So, . This is correct.
- P() = 0: As derived earlier, this is a direct consequence of Axioms 2 and 3. This is correct.
:::
---
Summary
- The Three Axioms are Foundational: All probability rules are derived from Non-negativity (), Normalization (), and Additivity ( for disjoint ).
- Master the Consequences: The most frequently applied rules in GATE problems are the direct consequences of the axioms: , the Complement Rule , and the General Addition Rule .
- Distinguish Disjoint and General Cases: Always verify if events are mutually exclusive before applying an addition rule. Using the simpler version for non-disjoint events is a common and critical error.
---
What's Next?
The axioms of probability provide the essential groundwork for more advanced topics. Master these before proceeding.
- Conditional Probability: This concept builds directly on the axiomatic framework to define the probability of an event given that another event has occurred. The formula for conditional probability, , relies on the probabilities established by the axioms.
- Random Variables: A random variable is a function that maps outcomes from a sample space to real numbers. The probabilities associated with the values of a random variable must adhere to the axioms we have just discussed.
---
Chapter Summary
From our exploration of counting and sample spaces, we have established the foundational principles of probabilistic reasoning. The following points are essential for mastery and application in the GATE examination.
- The Sample Space () is Exhaustive and Mutually Exclusive. The sample space is the set of all possible outcomes of a random experiment. It is imperative that the defined outcomes are mutually exclusive (only one can occur) and collectively exhaustive (no possible outcome is left out).
- Events are Subsets of the Sample Space. An event is any collection of outcomes, i.e., a subset of . The probability of an event is a measure of its likelihood. We have seen that set theory operations (union, intersection, complement) correspond directly to logical operations on events (OR, AND, NOT).
- The Choice of Counting Principle is Dictated by the Problem's Structure. We must discern whether a task involves sequential stages (Multiplication Principle) or disjoint choices (Addition Principle). The distinction between arrangements where order matters (Permutations, ) and selections where it does not (Combinations, ) is critical for correctly determining the size of sample spaces and events.
- Kolmogorov's Axioms are the Bedrock of Probability Theory. All properties of probability are derived from three fundamental axioms:
- for any event .
- .
- For any sequence of mutually exclusive events , .
- The Complement Rule Simplifies Complex Calculations. For any event , the probability of its complement, , is given by . It is often far simpler to calculate the probability of an event not happening than the probability of it happening.
- For Equally Likely Outcomes, Probability is a Ratio of Cardinalities. In a finite sample space where every outcome is equally likely, the probability of an event is the ratio of the number of outcomes favorable to to the total number of outcomes in the sample space: . This formula directly links the principles of counting to probability.
---
Chapter Review Questions
:::question type="MCQ" question="A committee of 4 is to be selected from a group of 6 computer science engineers and 5 electronics engineers. If the selection is made randomly, what is the probability that the committee consists of exactly 2 computer science engineers?" options=["5/11", "4/11", "1/3", "15/330"] answer="A" hint="The total number of ways to form the committee is the size of the sample space. The numerator is the number of ways to select 2 from each discipline." solution="
The problem requires us to find the probability of a specific composition for a committee selected from a larger group. This is a classic application of combinations, as the order of selection does not matter.
Step 1: Determine the size of the sample space, .
The sample space consists of all possible 4-member committees that can be formed from the total group of engineers. The number of ways to choose 4 people from 11 is given by the combination formula .
Step 2: Determine the size of the event space, .
The event is the selection of a committee with exactly 2 computer science (CS) engineers. Since the committee must have 4 members, this implies we must also select exactly 2 electronics (EC) engineers.
- The number of ways to choose 2 CS engineers from 6 is:
- The number of ways to choose 2 EC engineers from 5 is:
By the multiplication principle, the total number of ways to form the desired committee is the product of these two values:
Step 3: Calculate the probability.
Using the formula for equally likely outcomes, :
Thus, the correct option is A.
"
:::
:::question type="NAT" question="How many 5-digit numbers can be formed using the digits {0, 1, 2, 3, 4} without repetition, such that the resulting number is divisible by 2?" answer="60" hint="A number is divisible by 2 if its last digit is even. Consider the case where the last digit is 0 separately from the cases where it is 2 or 4, due to the restriction on the first digit." solution="
To solve this, we must count the number of valid arrangements (permutations) subject to two constraints: (1) it must be a 5-digit number (so the first digit cannot be 0), and (2) it must be divisible by 2 (the last digit must be even). The available even digits are {0, 2, 4}.
We use the addition principle by breaking the problem into disjoint cases based on the last digit.
Case 1: The last digit is 0.
Let the 5-digit number be represented by five slots: _ _ _ _ _.
- The 5th slot (units place) is fixed as 0. (1 way)
- The 1st slot can be filled by any of the remaining 4 digits {1, 2, 3, 4}. (4 ways)
- The 2nd slot can be filled by any of the remaining 3 digits. (3 ways)
- The 3rd slot can be filled by any of the remaining 2 digits. (2 ways)
- The 4th slot can be filled by the last remaining digit. (1 way)
Case 2: The last digit is 2.
- The 5th slot is fixed as 2. (1 way)
- The 1st slot cannot be 0 and cannot be 2. Thus, it can be filled by any of the digits {1, 3, 4}. (3 ways)
- The 2nd slot can now be filled by any of the remaining digits, including 0. We have used two digits, so there are 3 remaining. (3 ways)
- The 3rd slot can be filled by any of the remaining 2 digits. (2 ways)
- The 4th slot can be filled by the last remaining digit. (1 way)
Case 3: The last digit is 4.
This case is symmetric to Case 2.
- The 5th slot is fixed as 4. (1 way)
- The 1st slot cannot be 0 and cannot be 4. It can be filled by any of {1, 2, 3}. (3 ways)
- The remaining slots can be filled in ways.
Final Calculation:
By the addition principle, the total number of such 5-digit numbers is the sum of the counts from the disjoint cases.
Total = (Numbers ending in 0) + (Numbers ending in 2) + (Numbers ending in 4)
Total = .
"
:::
:::question type="MCQ" question="For two events A and B in a sample space , we are given , , and . What is the value of ?" options=["0.2", "0.3", "0.8", "0.5"] answer="C" hint="Use De Morgan's laws to simplify the expression . You will first need to find using the inclusion-exclusion principle." solution="
The problem asks for the probability of the union of two complementary events. We can solve this by first finding the probability of the intersection of the original events and then applying De Morgan's laws.
Step 1: Find using the Principle of Inclusion-Exclusion.
The formula for the union of two events is:
We are given the values for , , and . We can rearrange the formula to solve for :
Substituting the given values:
Step 2: Simplify the target expression using De Morgan's Laws.
De Morgan's laws state that for any two sets (or events) A and B:
Step 3: Calculate the final probability using the complement rule.
The probability of the complement of an event is . Applying this to our simplified expression:
We found in Step 1. Therefore:
Thus, the correct option is C.
"
:::
---
What's Next?
Having completed Counting and Sample Spaces, you have established a firm foundation for the quantitative analysis of uncertainty. The principles of defining outcomes, systematically counting them, and assigning probabilities according to a rigorous axiomatic framework are indispensable.
Key connections:
- Previous Learning: The concepts of sets, subsets, and operations like union and intersection from Discrete Mathematics are the formal language we use to define sample spaces and events. This chapter has effectively applied set theory in a new context.
- Future Chapters: The tools developed here are not an end in themselves but a prerequisite for more advanced topics.
- Random Variables: The sample space that we have learned to construct is the domain of a random variable. A random variable is a function that maps outcomes from the sample space to real numbers, allowing us to analyze experiments numerically.
- Probability Distributions: The probabilities we have calculated for discrete events form the basis of Probability Mass Functions (PMFs) for discrete random variables. Understanding combinations (e.g., binomial coefficients) is essential for deriving and working with standard distributions like the Binomial and Hypergeometric distributions.