• Descriptive
    • Moments
    • Concentration
    • Central Tendency
    • Variability
    • Stem-and-Leaf Plot
    • Histogram & Frequency Table
    • Data Quality Forensics
    • Conditional EDA
    • Quantiles
    • Kernel Density Estimation
    • Normal QQ Plot
    • Bootstrap Plot

    • Multivariate Descriptive Statistics
  • Distributions
    • Binomial Probabilities
    • Geometric Probabilities
    • Negative Binomial Probabilities
    • Hypergeometric Probabilities
    • Multinomial Probabilities
    • Dirichlet
    • Poisson Probabilities

    • Exponential
    • Gamma
    • Erlang
    • Weibull
    • Rayleigh
    • Maxwell-Boltzmann
    • Lognormal
    • Pareto
    • Inverse Gamma
    • Inverse Chi-Square

    • Beta
    • Power
    • Beta Prime (Inv. Beta)
    • Triangular

    • Normal (area)
    • Logistic
    • Laplace
    • Cauchy (standard)
    • Cauchy (location-scale)
    • Gumbel
    • Fréchet
    • Generalized Extreme Value

    • Normal RNG
    • ML Fitting
    • Tukey Lambda PPCC
    • Box-Cox Normality Plot
    • Noncentral t
    • Noncentral F
    • Sample Correlation r

    • Empirical Tests
  • Hypotheses
    • Theoretical Aspects of Hypothesis Testing
    • Bayesian Inference
    • Minimum Sample Size

    • Empirical Tests
    • Multivariate (pair-wise) Testing
  • Models
    • Manual Model Building
    • Guided Model Building
  • Time Series
    • Time Series Plot
    • Decomposition
    • Exponential Smoothing

    • Blocked Bootstrap Plot
    • Mean Plot
    • (P)ACF
    • VRM
    • Standard Deviation-Mean Plot
    • Spectral Analysis
    • ARIMA

    • Cross Correlation Function
    • Granger Causality
  1. Probability Distributions
  2. 52  Problems
  • Preface
  • Getting Started
    • 1  Introduction
    • 2  Why Do We Need Innovative Technology?
    • 3  Basic Definitions
    • 4  The Big Picture: Why We Analyze Data
  • Introduction to Probability
    • 5  Definitions of Probability
    • 6  Jeffreys’ axiom system
    • 7  Bayes’ Theorem
    • 8  Sensitivity and Specificity
    • 9  Naive Bayes Classifier
    • 10  Law of Large Numbers

    • 11  Problems
  • Probability Distributions
    • 12  Bernoulli Distribution
    • 13  Binomial Distribution
    • 14  Geometric Distribution
    • 15  Negative Binomial Distribution
    • 16  Hypergeometric Distribution
    • 17  Multinomial Distribution
    • 18  Poisson Distribution

    • 19  Uniform Distribution (Rectangular Distribution)
    • 20  Normal Distribution (Gaussian Distribution)
    • 21  Gaussian Naive Bayes Classifier
    • 22  Chi Distribution
    • 23  Chi-squared Distribution (1 parameter)
    • 24  Chi-squared Distribution (2 parameters)
    • 25  Student t-Distribution
    • 26  Fisher F-Distribution
    • 27  Exponential Distribution
    • 28  Lognormal Distribution
    • 29  Gamma Distribution
    • 30  Beta Distribution
    • 31  Weibull Distribution
    • 32  Pareto Distribution
    • 33  Inverse Gamma Distribution
    • 34  Rayleigh Distribution
    • 35  Erlang Distribution
    • 36  Logistic Distribution
    • 37  Laplace Distribution
    • 38  Gumbel Distribution
    • 39  Cauchy Distribution
    • 40  Triangular Distribution
    • 41  Power Distribution
    • 42  Beta Prime Distribution
    • 43  Sample Correlation Distribution
    • 44  Dirichlet Distribution
    • 45  Generalized Extreme Value (GEV) Distribution
    • 46  Frechet Distribution
    • 47  Noncentral t Distribution
    • 48  Noncentral F Distribution
    • 49  Inverse Chi-Squared Distribution
    • 50  Maxwell-Boltzmann Distribution
    • 51  Distribution Relationship Map

    • 52  Problems
  • Descriptive Statistics & Exploratory Data Analysis
    • 53  Types of Data
    • 54  Datasheets

    • 55  Frequency Plot (Bar Plot)
    • 56  Frequency Table
    • 57  Contingency Table
    • 58  Binomial Classification Metrics
    • 59  Confusion Matrix
    • 60  ROC Analysis

    • 61  Stem-and-Leaf Plot
    • 62  Histogram
    • 63  Data Quality Forensics
    • 64  Quantiles
    • 65  Central Tendency
    • 66  Variability
    • 67  Skewness & Kurtosis
    • 68  Concentration
    • 69  Notched Boxplot
    • 70  Scatterplot
    • 71  Pearson Correlation
    • 72  Rank Correlation
    • 73  Partial Pearson Correlation
    • 74  Simple Linear Regression
    • 75  Moments
    • 76  Quantile-Quantile Plot (QQ Plot)
    • 77  Normal Probability Plot
    • 78  Probability Plot Correlation Coefficient Plot (PPCC Plot)
    • 79  Box-Cox Normality Plot
    • 80  Kernel Density Estimation
    • 81  Bivariate Kernel Density Plot
    • 82  Conditional EDA: Panel Diagnostics
    • 83  Bootstrap Plot (Central Tendency)
    • 84  Survey Scores Rank Order Comparison
    • 85  Cronbach Alpha

    • 86  Equi-distant Time Series
    • 87  Time Series Plot (Run Sequence Plot)
    • 88  Mean Plot
    • 89  Blocked Bootstrap Plot (Central Tendency)
    • 90  Standard Deviation-Mean Plot
    • 91  Variance Reduction Matrix
    • 92  (Partial) Autocorrelation Function
    • 93  Periodogram & Cumulative Periodogram

    • 94  Problems
  • Hypothesis Testing
    • 95  Normal Distributions revisited
    • 96  The Population
    • 97  The Sample
    • 98  The One-Sided Hypothesis Test
    • 99  The Two-Sided Hypothesis Test
    • 100  When to use a one-sided or two-sided test?
    • 101  What if \(\sigma\) is unknown?
    • 102  The Central Limit Theorem (revisited)
    • 103  Statistical Test of the Population Mean with known Variance
    • 104  Statistical Test of the Population Mean with unknown Variance
    • 105  Statistical Test of the Variance
    • 106  Statistical Test of the Population Proportion
    • 107  Statistical Test of the Standard Deviation \(\sigma\)
    • 108  Statistical Test of the difference between Means -- Independent/Unpaired Samples
    • 109  Statistical Test of the difference between Means -- Dependent/Paired Samples
    • 110  Statistical Test of the difference between Variances -- Independent/Unpaired Samples

    • 111  Hypothesis Testing for Research Purposes
    • 112  Decision Thresholds, Alpha, and Confidence Levels
    • 113  Bayesian Inference for Decision-Making
    • 114  One Sample t-Test
    • 115  Skewness & Kurtosis Tests
    • 116  Paired Two Sample t-Test
    • 117  Wilcoxon Signed-Rank Test
    • 118  Unpaired Two Sample t-Test
    • 119  Unpaired Two Sample Welch Test
    • 120  Two One-Sided Tests (TOST) for Equivalence
    • 121  Mann-Whitney U test (Wilcoxon Rank-Sum Test)
    • 122  Bayesian Two Sample Test
    • 123  Median Test based on Notched Boxplots
    • 124  Chi-Squared Tests for Count Data
    • 125  Kolmogorov-Smirnov Test
    • 126  One Way Analysis of Variance (1-way ANOVA)
    • 127  Kruskal-Wallis Test
    • 128  Two Way Analysis of Variance (2-way ANOVA)
    • 129  Repeated Measures ANOVA
    • 130  Friedman Test
    • 131  Testing Correlations
    • 132  A Note on Causality

    • 133  Problems
  • Regression Models
    • 134  Simple Linear Regression Model (SLRM)
    • 135  Multiple Linear Regression Model (MLRM)
    • 136  Logistic Regression
    • 137  Generalized Linear Models
    • 138  Multinomial and Ordinal Logistic Regression
    • 139  Cox Proportional Hazards Regression
    • 140  Conditional Inference Trees
    • 141  Leaf Diagnostics for Conditional Inference Trees
    • 142  Conditional Random Forests
    • 143  Hypothesis Testing with Linear Regression Models (from a Practical Point of View)

    • 144  Problems
  • Introduction to Time Series Analysis
    • 145  Case: the Market of Health and Personal Care Products
    • 146  Decomposition of Time Series
    • 147  Ad hoc Forecasting of Time Series
  • Box-Jenkins Analysis
    • 148  Introduction to Box-Jenkins Analysis
    • 149  Theoretical Concepts
    • 150  Stationarity
    • 151  Identifying ARMA parameters
    • 152  Estimating ARMA Parameters and Residual Diagnostics
    • 153  Forecasting with ARIMA models
    • 154  Intervention Analysis
    • 155  Cross-Correlation Function
    • 156  Transfer Function Noise Models
    • 157  General-to-Specific Modeling
  • Model Building Strategies
    • 158  Introduction to Model Building Strategies
    • 159  Manual Model Building
    • 160  Model Validation
    • 161  Regularization Methods
    • 162  Hyperparameter Optimization Strategies
    • 163  Guided Model Building in Practice
    • 164  Diagnostics, Revision, and Guided Forecasting
    • 165  Leakage, Target Encoding, and Robust Regression
  • References
  • Appendices
    • Appendices
    • A  Method Selection Guide
    • B  Presentations and Teaching Materials
    • C  R Language Concepts for Statistical Computing
    • D  Matrix Algebra
    • E  Standard Normal Table (Gaussian Table)
    • F  Critical values of Student’s \(t\) distribution with \(\nu\) degrees of freedom
    • G  Upper-tail critical values of the \(\chi^2\)-distribution with \(\nu\) degrees of freedom
    • H  Lower-tail critical values of the \(\chi^2\)-distribution with \(\nu\) degrees of freedom

Table of contents

  • 52.1 Generating Random Numbers
    • 52.1.1 Task 1
    • 52.1.2 Task 2
    • 52.1.3 Task 3
  • 52.2 ML Fitting
    • 52.2.1 Task 4
    • 52.2.2 Task 5
    • 52.2.3 Task 6
    • 52.2.4 Task 7
    • 52.2.5 Task 8
  1. Probability Distributions
  2. 52  Problems

52  Problems

52.1 Generating Random Numbers

52.1.1 Task 1

  • Problem
  • Solution

Generate 50 Random Numbers from an F(20,10) Distribution. Hint: search for the term “Distributions” in RStudio’s help box and click on the link for the F Distribution to find the R command that is needed.

Since there’s no R module available, we write a short script and execute it in RStudio.

r <- rf(50, df1 = 20, df2 = 10)
print(r)
 [1] 0.9600980 2.5529219 0.8517120 0.9944066 2.7898486 1.1362247 0.6225367
 [8] 0.8149503 0.7710999 4.1213062 0.7085785 0.9861683 0.8502074 2.2856887
[15] 0.9680113 0.3881425 2.2849964 0.9842273 0.4332338 0.6668899 1.8469863
[22] 1.9830417 1.4707803 2.0688908 0.6141726 0.7665957 0.5562082 0.5148523
[29] 1.0638904 0.9722421 1.7244171 0.4407797 0.6130662 0.7833626 0.7822931
[36] 1.1573225 0.5827040 1.6021046 0.4970075 0.5305095 1.4738108 0.3497711
[43] 1.4640165 1.2884755 1.1211016 2.9705336 0.7389396 0.7737166 0.6686511
[50] 0.7345296

52.1.2 Task 2

  • Problem
  • Solution

Empirically show that the Histogram of the Chi-squared Density becomes increasingly bell-shaped and resembles a Normal Histogram as the degrees of freedom increase.

We just need to plot Histograms for increasing numbers of degrees of freedom. The third Histogram looks very similar in shape to a Normal Density.

Strictly speaking, convergence to a standard Normal requires standardization: \[ \frac{\chi^2(n)-n}{\sqrt{2n}} \Rightarrow \text{N}(0,1). \]

hist(rchisq(500, df = 2))

hist(rchisq(500, df = 20))

hist(rchisq(500, df = 2000))

52.1.3 Task 3

  • Problem
  • Solution

Generate 30 random numbers from the N(5,2) Density function, plot the corresponding Histogram, and overlay the theoretical Density function. Evaluate whether or not the Histogram resembles the theoretical Density.

Repeat the experiment but with 300 observations and comment on what you observe.

To make this solution reproducible, we first set the random seed to 142. After that, we generate random numbers through the rnorm function and display the corresponding Histogram and overlayed curve based of the N(5,2) Density function.

The output clearly illustrates the effect of the Law of Large Numbers from Chapter 10 (the Histogram with 300 random numbers is much closer to the theoretical Density function than with only 30 values).

set.seed(142)
mymean = 5
mysd = 2
x = rnorm(30, mean = mymean, sd = mysd)
myhist<-hist(x, freq=F)
curve(1/(mysd*sqrt(2*pi))*exp(-1/2*((x-mymean)/mysd)^2), min(x), max(x), add=T)

x = rnorm(300, mean = mymean, sd = mysd)
myhist<-hist(x, freq=F)
curve(1/(mysd*sqrt(2*pi))*exp(-1/2*((x-mymean)/mysd)^2), min(x), max(x), add=T)

52.2 ML Fitting

The following tasks are based on a spreadsheet which contains simulated distributions: online spreadsheet.

Note: this spreadsheet refreshes random values over time. For strict reproducibility, save a local snapshot (or reproduce the data in R with a fixed set.seed).

Quick intuition: in these tasks, ML fitting and plots are used as screening tools. They help us see whether a candidate distribution is plausible, but they are not formal goodness-of-fit tests. For formal testing procedures and p-value based decisions, see Section 124.1 and Chapter 125 (also summarized in Section 2).

52.2.1 Task 4

  • Problem
  • Solution

Examine any variable \(U_i\) for \(i = 1, 2, …, 12\) (in columns A:L) and show that it cannot be described well by a Normal Density function. Hint: use the so-called ML Fitting module to do this.

Just copy & paste the values of the chosen column (in the online spreadsheet) into the “Univariate Dataset” text box and observe the output of the analysis. Note: the spreadsheet always updates the random values – therefore, your result will not exactly look identical.

Interactive Shiny app (click to load).
Open in new tab

52.2.2 Task 5

  • Problem
  • Solution

What is the distribution of the data series from Task 4? Use a theoretical argument to answer this question.

The Histogram from Figure that is displayed in the ML Fitting module (see solution of Task 4) is consistent with the fact that the random numbers were generated by a digital computer which typically uses a Uniform Distribution (see Section 19.11).

52.2.3 Task 6

  • Problem
  • Solution

Show that the data series in column M is approximately normally distributed (based on ML Fitting).

The formula of column M is based on Section 20.22 (i.e. a sum of twelve Uniform variates minus 6). Hence, we expect the data in column M to be approximately normally distributed with \(\mu = 0\) and \(\sigma = 1\).

The ML Fitting method yields the following results (your results may be slightly different):

  • mean = 0.003791167

  • standard deviation = 1.028944237

The estimates of both parameters are close to the theoretical values. Due to the Law of Large Numbers, these estimates will get closer to the theoretical values as the number of simulated random numbers increases.

Interactive Shiny app (click to load).
Open in new tab

52.2.4 Task 7

  • Problem
  • Solution
  • ML Fitting column N
  • ML Fitting column O

Examine the data in columns N and O. Show that these are not normally distributed and explain (based on theoretical argumentation) why they have a \(\chi^2(n)\) distribution. What is the parameter \(n\)?

The data in columns N and O do not appear to be normally distributed based on the computations found in tab “ML Fitting column N” and “ML Fitting column O”.

The theoretical reason for this is that both columns contain a formula which computes -2 times the natural logarithm of the product of Uniformly distributed variates as is described in Section 23.13. In theory the parameter \(n\) should be equal to 12 (i.e. twice the number of Uniform variates).

Interactive Shiny app (click to load).
Open in new tab
Interactive Shiny app (click to load).
Open in new tab

52.2.5 Task 8

  • Problem
  • Solution
  • ML Fitting column P

If \(Y \sim \text{N}(0,1)\), what is the distribution of \(Y^2\)? Hint: there is a theoretical argument and you can also use the simulated data in column P.

According to theory, the variable \(Y^2 \sim \chi^2(n=1)\) because of Section 23.16. The parameter \(n = 1\) because we only use one normal variate. The ML Fitting method applied to column P can be found in the “ML Fitting column P” tab.

The computation shows that the estimated degrees of freedom is very close to 1 (i.e. the theoretical value). In addition, the Histogram shows that the Chi-squared density function fits the data well.

Interactive Shiny app (click to load).
Open in new tab
Descriptive Statistics & Exploratory Data Analysis

© 2026 Patrick Wessa. Provided as-is, without warranty.

Feedback: e-mail | Anonymous contributions: click to copy (Sats) | click to copy (XMR)

Cookie Preferences