• Descriptive
    • Moments
    • Concentration
    • Central Tendency
    • Variability
    • Stem-and-Leaf Plot
    • Histogram & Frequency Table
    • Data Quality Forensics
    • Conditional EDA
    • Quantiles
    • Kernel Density Estimation
    • Normal QQ Plot
    • Bootstrap Plot

    • Multivariate Descriptive Statistics
  • Distributions
    • Binomial Probabilities
    • Geometric Probabilities
    • Negative Binomial Probabilities
    • Hypergeometric Probabilities
    • Multinomial Probabilities
    • Poisson Probabilities

    • Exponential
    • Gamma
    • Erlang
    • Weibull
    • Rayleigh
    • Lognormal
    • Pareto
    • Inverse Gamma

    • Beta
    • Power
    • Beta Prime (Inv. Beta)
    • Triangular

    • Normal (area)
    • Logistic
    • Laplace
    • Cauchy (standard)
    • Cauchy (location-scale)
    • Gumbel

    • Normal RNG
    • ML Fitting
    • Tukey Lambda PPCC
    • Box-Cox Normality Plot
    • Sample Correlation r

    • Empirical Tests
  • Hypotheses
    • Theoretical Aspects of Hypothesis Testing
    • Bayesian Inference
    • Minimum Sample Size

    • Empirical Tests
    • Multivariate (pair-wise) Testing
  • Models
    • Manual Model Building
  • Time Series
    • Time Series Plot
    • Decomposition
    • Exponential Smoothing

    • Blocked Bootstrap Plot
    • Mean Plot
    • (P)ACF
    • VRM
    • Standard Deviation-Mean Plot
    • Spectral Analysis
    • ARIMA

    • Cross Correlation Function
    • Granger Causality
  1. Hypothesis Testing
  2. 93  What if \(\sigma\) is unknown?
  • Preface
  • Getting Started
    • 1  Introduction
    • 2  Why Do We Need Innovative Technology?
    • 3  Basic Definitions
    • 4  The Big Picture: Why We Analyze Data
  • Introduction to Probability
    • 5  Definitions of Probability
    • 6  Jeffreys’ axiom system
    • 7  Bayes’ Theorem
    • 8  Sensitivity and Specificity
    • 9  Naive Bayes Classifier
    • 10  Law of Large Numbers

    • 11  Problems
  • Probability Distributions
    • 12  Bernoulli Distribution
    • 13  Binomial Distribution
    • 14  Geometric Distribution
    • 15  Negative Binomial Distribution
    • 16  Hypergeometric Distribution
    • 17  Multinomial Distribution
    • 18  Poisson Distribution

    • 19  Uniform Distribution (Rectangular Distribution)
    • 20  Normal Distribution (Gaussian Distribution)
    • 21  Gaussian Naive Bayes Classifier
    • 22  Chi Distribution
    • 23  Chi-squared Distribution (1 parameter)
    • 24  Chi-squared Distribution (2 parameters)
    • 25  Student t-Distribution
    • 26  Fisher F-Distribution
    • 27  Exponential Distribution
    • 28  Lognormal Distribution
    • 29  Gamma Distribution
    • 30  Beta Distribution
    • 31  Weibull Distribution
    • 32  Pareto Distribution
    • 33  Inverse Gamma Distribution
    • 34  Rayleigh Distribution
    • 35  Erlang Distribution
    • 36  Logistic Distribution
    • 37  Laplace Distribution
    • 38  Gumbel Distribution
    • 39  Cauchy Distribution
    • 40  Triangular Distribution
    • 41  Power Distribution
    • 42  Beta Prime Distribution
    • 43  Sample Correlation Distribution

    • 44  Problems
  • Descriptive Statistics & Exploratory Data Analysis
    • 45  Types of Data
    • 46  Datasheets

    • 47  Frequency Plot (Bar Plot)
    • 48  Frequency Table
    • 49  Contingency Table
    • 50  Binomial Classification Metrics
    • 51  Confusion Matrix
    • 52  ROC Analysis

    • 53  Stem-and-Leaf Plot
    • 54  Histogram
    • 55  Data Quality Forensics
    • 56  Quantiles
    • 57  Central Tendency
    • 58  Variability
    • 59  Skewness & Kurtosis
    • 60  Concentration
    • 61  Notched Boxplot
    • 62  Scatterplot
    • 63  Pearson Correlation
    • 64  Rank Correlation
    • 65  Partial Pearson Correlation
    • 66  Simple Linear Regression
    • 67  Moments
    • 68  Quantile-Quantile Plot (QQ Plot)
    • 69  Normal Probability Plot
    • 70  Probability Plot Correlation Coefficient Plot (PPCC Plot)
    • 71  Box-Cox Normality Plot
    • 72  Kernel Density Estimation
    • 73  Bivariate Kernel Density Plot
    • 74  Conditional EDA: Panel Diagnostics
    • 75  Bootstrap Plot (Central Tendency)
    • 76  Survey Scores Rank Order Comparison
    • 77  Cronbach Alpha

    • 78  Equi-distant Time Series
    • 79  Time Series Plot (Run Sequence Plot)
    • 80  Mean Plot
    • 81  Blocked Bootstrap Plot (Central Tendency)
    • 82  Standard Deviation-Mean Plot
    • 83  Variance Reduction Matrix
    • 84  (Partial) Autocorrelation Function
    • 85  Periodogram & Cumulative Periodogram

    • 86  Problems
  • Hypothesis Testing
    • 87  Normal Distributions revisited
    • 88  The Population
    • 89  The Sample
    • 90  The One-Sided Hypothesis Test
    • 91  The Two-Sided Hypothesis Test
    • 92  When to use a one-sided or two-sided test?
    • 93  What if \(\sigma\) is unknown?
    • 94  The Central Limit Theorem (revisited)
    • 95  Statistical Test of the Population Mean with known Variance
    • 96  Statistical Test of the Population Mean with unknown Variance
    • 97  Statistical Test of the Variance
    • 98  Statistical Test of the Population Proportion
    • 99  Statistical Test of the Standard Deviation \(\sigma\)
    • 100  Statistical Test of the difference between Means -- Independent/Unpaired Samples
    • 101  Statistical Test of the difference between Means -- Dependent/Paired Samples
    • 102  Statistical Test of the difference between Variances -- Independent/Unpaired Samples

    • 103  Hypothesis Testing for Research Purposes
    • 104  Decision Thresholds, Alpha, and Confidence Levels
    • 105  Bayesian Inference for Decision-Making
    • 106  One Sample t-Test
    • 107  Skewness & Kurtosis Tests
    • 108  Paired Two Sample t-Test
    • 109  Wilcoxon Signed-Rank Test
    • 110  Unpaired Two Sample t-Test
    • 111  Unpaired Two Sample Welch Test
    • 112  Two One-Sided Tests (TOST) for Equivalence
    • 113  Mann-Whitney U test (Wilcoxon Rank-Sum Test)
    • 114  Bayesian Two Sample Test
    • 115  Median Test based on Notched Boxplots
    • 116  Chi-Squared Tests for Count Data
    • 117  Kolmogorov-Smirnov Test
    • 118  One Way Analysis of Variance (1-way ANOVA)
    • 119  Kruskal-Wallis Test
    • 120  Two Way Analysis of Variance (2-way ANOVA)
    • 121  Repeated Measures ANOVA
    • 122  Friedman Test
    • 123  Testing Correlations
    • 124  A Note on Causality

    • 125  Problems
  • Regression Models
    • 126  Simple Linear Regression Model (SLRM)
    • 127  Multiple Linear Regression Model (MLRM)
    • 128  Logistic Regression
    • 129  Generalized Linear Models
    • 130  Multinomial and Ordinal Logistic Regression
    • 131  Cox Proportional Hazards Regression
    • 132  Conditional Inference Trees
    • 133  Leaf Diagnostics for Conditional Inference Trees
    • 134  Hypothesis Testing with Linear Regression Models (from a Practical Point of View)

    • 135  Problems
  • Introduction to Time Series Analysis
    • 136  Case: the Market of Health and Personal Care Products
    • 137  Decomposition of Time Series
    • 138  Ad hoc Forecasting of Time Series
  • Box-Jenkins Analysis
    • 139  Introduction to Box-Jenkins Analysis
    • 140  Theoretical Concepts
    • 141  Stationarity
    • 142  Identifying ARMA parameters
    • 143  Estimating ARMA Parameters and Residual Diagnostics
    • 144  Forecasting with ARIMA models
    • 145  Intervention Analysis
    • 146  Cross-Correlation Function
    • 147  Transfer Function Noise Models
    • 148  General-to-Specific Modeling
  • References
  • Appendices
    • Appendices
    • A  Method Selection Guide
    • B  Presentations and Teaching Materials
    • C  R Language Concepts for Statistical Computing
    • D  Matrix Algebra
    • E  Standard Normal Table (Gaussian Table)
    • F  Critical values of Student’s \(t\) distribution with \(\nu\) degrees of freedom
    • G  Upper-tail critical values of the \(\chi^2\)-distribution with \(\nu\) degrees of freedom
    • H  Lower-tail critical values of the \(\chi^2\)-distribution with \(\nu\) degrees of freedom

Table of contents

  • 93.1 Case 1
  • 93.2 Case 2
DRAFT This draft is under development — DO NOT CITE OR SHARE.
  1. Hypothesis Testing
  2. 93  What if \(\sigma\) is unknown?

93  What if \(\sigma\) is unknown?

Testing one-sided and two-sided hypotheses about the mean is straightforward if the population standard deviation \(\sigma\) is known. In practice, however, this is rarely the case which implies that we have to rely on the sample standard deviation \(s\) as an approximation for \(\sigma\).

As explained before, we use the \(t\)-distribution for small samples and the (Gaussian) normal distribution for large samples. Of course, one may also opt to use the \(t\)-distribution by default because it converges to normality as \(N\) approaches \(+\infty\).

93.1 Case 1

The duration of phone calls in a particular region is investigated. The population duration has an asymmetric distribution. We wish to test the Null Hypothesis H\(_0: \mu = \mu_0 = 7\) minutes versus the Alternative Hypothesis H\(_A: \mu \neq \mu_0 = 7\) minutes, given that \(\alpha = 0.05\).

For computation, we convert everything to seconds: \(\mu_0 = 7 \times 60 = 420\) seconds.

A simple random sample (\(N = 1000\)) was drawn and the sample statistics were computed (\(m = 475.2\) seconds and \(s = 151\) seconds).

Since \(N\) is large, we can describe \(\bar{X}\) as follows

\[Y = \frac{1}{\frac{151}{\sqrt{1000}} \sqrt{2 \pi}} e^{-\frac{1}{2} \left( \frac{\bar{X} - 420}{\frac{151}{\sqrt{1000}}} \right)^2}\]

The region of acceptance can be obtained by finding \(k\) in P\((420 - k \leq \bar{X} \leq 420 + k) = 0.95\):

\[ \begin{aligned}\text{P} \left( \frac{420 - k - 420}{\frac{151}{\sqrt{1000}}} \leq \frac{\bar{X} - 420}{\frac{151}{\sqrt{1000}}} \leq \frac{420 + k -420}{\frac{151}{\sqrt{1000}}} \right) &= \text{P} \left( \frac{-k}{4.775} \leq Z \leq \frac{k}{4.775} \right)\\ &= 0.95\end{aligned} \]

The Gaussian Table (Appendix E) allows us to find \(k\)

\[\frac{k}{4.775} = 1.96 \Rightarrow k = 1.96 \times 4.775 \simeq 9.36\]

Using the rough mental approximation \(1.96 \simeq 2\) gives \(k \simeq 9.55\), so the approximate region of acceptance is (410, 430). This allows us to conclude that \(m = 475.2 \notin (410, 430)\) (hence H\(_0\) is rejected). Note: the conclusion does not change using the \(t\)-distribution (Appendix F).

93.2 Case 2

Consider the data in Table 93.1 which displays the number of sleeping hours gained from an experimental intervention.

Table 93.1: Experimental Sleep Intervention
student 1 2 3 4 5 6 7 8 9 10
extra sleep 0.7 -1.1 -0.2 1.2 0.1 3.4 3.7 0.8 1.8 2.0

We assume that the students who received the treatment have been independently and randomly chosen from the population.

Because \(N = 10\) is small, we additionally assume that the population distribution of the extra-sleep variable is approximately normal.

We assume the intervention can only increase sleeping hours, hence we employ a one-sided test:

\[ \begin{align*} &\text{H}_0: \mu = \mu_0 = 0 \\ &\text{H}_A: \mu > \mu_0 = 0 \end{align*} \]

The sample statistics have been computed: \(m = 1.24\) and \(s = 1.45\).

Since \(N = 10\) is small, the statistic \(Z = \frac{\bar{X} - \mu}{\frac{s}{\sqrt{N}}}\) does not follow a standard normal distribution. Under the normality assumption with unknown \(\sigma\), it follows a Student-\(t\) distribution instead: \(t = \frac{\bar{X} - \mu}{\frac{s}{\sqrt{N}}}\)

The region of acceptance can be computed by finding \(k\) in P\((\bar{X} \leq \mu + k) = 0.95\):

\[\text{P} \left( \frac{\bar{X} - \mu}{\frac{s}{\sqrt{N}}} \leq \frac{\mu + k -\mu}{\frac{s}{\sqrt{N}}} \right) = 0.95\]

or

\[\text{P} \left( t \leq \frac{k}{\frac{s}{\sqrt{N}}} \right) = 0.95\]

Using the \(t\)-distribution (Appendix F) we find \(t \simeq 1.83\) which implies

\[k \simeq 1.83 \frac{s}{\sqrt{N}} = \frac{1.83 * 1.45}{\sqrt{10}} \simeq 0.84\]

Hence the region of acceptance is \(\bar{X} \leq 0 + 0.84 = 0.84\). Since \(m = 1.24 > 0.84\) we have to reject H\(_0\). The conclusion is that the intervention increases sleeping hours.

92  When to use a one-sided or two-sided test?
94  The Central Limit Theorem (revisited)

© 2026 Patrick Wessa. Provided as-is, without warranty.

Feedback: e-mail | Anonymous contributions: click to copy (Sats) | click to copy (XMR)

Cookie Preferences