Ian Talks Statistics A-Z

By Ian Eress

Unlock the mysteries of statistics with this guide to the key concepts and definitions. From famous statisticians to theories and software tools, this book provides a clear and accessible reference to the field of statistics. Written for beginners, it is the perfect resource for anyone looking to deepen their understanding of this rapidly evolving field. With clear explanations, this book is your go-to reference for all things statistics.

 

• Language: English
• Publisher: Ian Eress
• Release date: Mar 2, 2023
• ISBN: 9798215619148

Ian Eress

Born in the seventies. Average height. Black hair. Sometimes shaves. Black eyes. Nearsighted. Urban. MSc. vim > Emacs. Mac.

Book preview

Ian Talks Statistics A-Z

Ian Eress

Published by Ian Eress, 2023.

While every precaution has been taken in the preparation of this book, the publisher assumes no responsibility for errors or omissions, or for damages resulting from the use of the information contained herein.

IAN TALKS STATISTICS A-Z

First edition. March 2, 2023.

Copyright © 2023 Ian Eress.

ISBN: 979-8215619148

Written by Ian Eress.

Table of Contents

A

B

C

D

E

F

G

H

I

J

K

L

M

N

O

P

Q

R

S

T

U

V

W

X

Y

Z

INDEX

For Caitlyn

A

Aalen, Odd Olai (1947–1987): Odd Olai Aalen is a Norwegian statistician who is known for his contributions to the field of survival analysis, particularly in the development of the nonparametric Aalen-Johansen estimator and the theory of counting processes.

Survival analysis is a statistical method used to analyze the time until an event of interest occurs, like the death or failure of a mechanical component. The Aalen-Johansen estimator is a non-parametric method used to estimate the probability of experiencing a certain event, given that the individual has survived up to a particular time point. This estimator is particularly useful in situations where there may be competing risks, like multiple potential causes of death.

Aalen has also developed methods for analyzing longitudinal data, like the landmark method for estimating dynamic treatment regimes and the joint model for longitudinal and time-to-event data. These methods are useful for understanding how treatments or interventions may affect outcomes over time.

In addition to his research contributions, Aalen has also played a significant role in the development of statistics in Norway and internationally. He has served as president of the International Biometric Society and has received numerous awards for his contributions to the field of statistics.

Abbey, Helen (1915–2001): Helen Abbey is an Australian statistician who has made significant contributions to the field of survey methodology, particularly in the development of weighting methods for complex surveys and the analysis of nonresponse and measurement errors.

Survey methodology is the scientific process of collecting, analyzing, and interpreting data from a sample of individuals or households to estimate the characteristics of a larger population. In complex surveys, like those conducted by national statistical agencies, the sample design and data collection methods can be quite intricate, and the resulting data can be subject to biases due to nonresponse, measurement error, and other factors.

Abbey has developed methods for weighting survey data to adjust for these biases and improve the accuracy of estimates. She has also contributed to the development of imputation methods for handling missing data in surveys and the analysis of measurement errors in survey responses.

In addition to her research contributions, Abbey has played a significant role in promoting the use of statistics in Australia and internationally. She has served as president of the Statistical Society of Australia and has received numerous awards for her contributions to the field of statistics and survey methodology.

Abbott, Edith (1876–1957): Edith Abbott was an American economist, social worker, and statistician who made significant contributions to the field of social statistics and was a pioneer in the use of statistics in social work research.

Abbott's work in social statistics focused on the collection and analysis of data related to social problems, like poverty, unemployment, and crime. She recognized the importance of accurate and reliable data in understanding and addressing these issues, and worked to develop methods for collecting and analyzing such data.

Abbott was also a leading figure in the development of social work research. She believed that social workers needed to be trained in research methods and to use data and statistics to inform their practice. She played a key role in the establishment of the Social Service Review, a leading journal in the field of social work research, and served as its editor for many years.

In addition to her contributions to statistics and social work research, Abbott was a strong advocate for social justice and worked to promote the welfare of vulnerable populations. She was the first woman appointed to the faculty of the University of Chicago's School of Social Service Administration and was also the first woman to be appointed to the President's Committee on Social Security.

Abbott's work in statistics and social work has had a lasting impact on both fields, and she is widely recognized as a trailblazer and pioneer in the use of data and statistics in the social sciences.

Abelson, Robert P. (1928–2005): Robert P. Abelson was an American psychologist and statistician who made significant contributions to the field of social psychology, particularly in the areas of hypothesis testing, causal inference, and research design.

Abelson's work in statistics focused on developing methods for evaluating the evidence for and against hypotheses, and for making causal inferences in observational studies. He was a strong advocate for the use of multiple methods and sources of data to support causal claims and emphasized the importance of carefully designing studies and analyzing data in a rigorous and transparent manner.

One of Abelson's most influential contributions to statistics and psychology was the development of the null hypothesis significance testing (NHST) framework, which is widely used in psychology and other social sciences to evaluate statistical evidence for or against hypotheses. Abelson argued that NHST, while useful in certain contexts, was sometimes misused and overinterpreted and that researchers needed to be more cautious and thoughtful in their use of statistical tests.

Abelson also made significant contributions to research design, advocating for the use of experimental and quasi-experimental methods to establish causal relationships between variables. He emphasized the importance of carefully selecting comparison groups and controlling for potential confounding factors and argued that causal inference required a combination of statistical and theoretical reasoning.

In addition to his contributions to statistics and psychology, Abelson was also a highly regarded educator and mentor and was known for his engaging and accessible writing style. His work has had a lasting impact on the fields of statistics, psychology, and social science research, and he is widely recognized as one of the leading thinkers in these areas.

Abramovitz, Moses (1912–2000): Moses Abramovitz was an American economist who made significant contributions to the field of economic growth and development, particularly in the areas of productivity growth, technological change, and statistical analysis.

Abramovitz's work in statistics focused on developing methods for measuring and analyzing productivity growth and technological change, which are key drivers of economic growth and development. He recognized the importance of accurately measuring these variables and understanding their underlying causes, and worked to develop new statistical methods and frameworks for analyzing them.

One of Abramovitz's most influential contributions to statistics and economics was his development of the residual method for measuring total factor productivity (TFP), which measures the extent to which technological progress and other factors contribute to economic growth beyond the growth of inputs like labor and capital. This method is still widely used in empirical studies of productivity growth and economic development.

Abramovitz also made significant contributions to the study of economic growth and development, arguing that technological change and productivity growth were key drivers of long-run economic growth. He emphasized the importance of investment in research and development and other forms of innovation and argued that policies that encouraged innovation and entrepreneurship were critical for promoting economic growth and development.

In addition to his research contributions, Abramovitz was a highly regarded teacher and mentor, and his work has had a lasting impact on the fields of economics, statistics, and economic development. He is widely recognized as one of the leading thinkers in these areas, and his work continues to inform research and policy debates in these fields today.

Achenwall, Gottfried (1719–1772): Gottfried Achenwall was an 18th-century German philosopher, economist, and statistician who is considered one of the founders of modern statistics.

Achenwall's work in statistics focused on developing methods for collecting, analyzing, and interpreting data, particularly in the areas of social and economic statistics. He was a strong advocate for the use of empirical evidence and data in decision-making and believed that statistics could provide a scientific basis for understanding social and economic phenomena.

One of Achenwall's most important contributions to statistics was his development of a classification system for statistical data, which organized data according to various attributes like time, place, and category. This system was widely adopted and helped to standardize the collection and reporting of statistical data across different fields and regions.

Achenwall also made significant contributions to the development of statistical theory and methodology, particularly in the areas of probability and sampling. He was one of the first statisticians to recognize the importance of randomness and chance in statistical analysis and helped to develop methods for sampling and inference that are still widely used today.

In addition to his contributions to statistics, Achenwall was also a prominent philosopher and economist and wrote extensively on topics like natural law, political economy, and education. He was a highly influential figure in his time and helped to lay the groundwork for the development of modern statistics as a scientific discipline.

ADaMSoft: ADaMSoft is an open-source software package designed for statistical analysis and data mining. It was developed by the ADaMSoft Team, a group of researchers and statisticians from various academic institutions around the world.

ADaMSoft provides a wide range of statistical analysis tools and methods. This includes regression analysis, hypothesis testing, clustering, classification, and data visualization. The software is designed to be user-friendly and accessible to both novice and advanced users and includes a graphical user interface and a command-line interface for more advanced users.

One of the key features of ADaMSoft is its flexibility and extensibility. The software is designed to work with a wide range of data formats. This includes CSV, Excel, SPSS, and SAS, and can also be easily integrated with other software packages and programming languages like R and Python.

ADaMSoft is also designed to be highly efficient and scalable and includes parallel processing capabilities for large datasets and computationally intensive tasks. This makes it well-suited for use in a wide range of applications. This includes scientific research, business analytics, and data-driven decision-making.

Overall, ADaMSoft is a powerful and versatile statistical analysis tool that provides a wide range of features and capabilities for both novice and advanced users. Its open-source nature and community-driven development make it a popular choice among researchers and statisticians around the world.

Adelstein, Abraham Manie (1916–1992): Abraham Manie Adelstein was an American statistician who made significant contributions to the fields of biostatistics and public health.

Adelstein's work focused on developing statistical methods and models for analyzing data related to public health issues, particularly in the areas of cancer research and epidemiology. He was a pioneer in the development of methods for analyzing survival data, which are used to study the length of time that patients survive after a particular treatment or diagnosis.

One of Adelstein's most important contributions to biostatistics was his development of the Adelstein estimator, a method for estimating the survival function of a population based on incomplete or censored data. This method has become a widely used tool for analyzing survival data and has helped to advance our understanding of the effectiveness of different treatments and interventions for various diseases.

In addition to his research contributions, Adelstein was also a dedicated teacher and mentor and played a significant role in training the next generation of biostatisticians and public health researchers. He was a respected member of the statistical community and received numerous awards and honors for his contributions to the field.

Overall, Abraham Manie Adelstein was a highly influential figure in the field of biostatistics, and his work continues to inform research and practice in public health and other related fields today.

Adkins, Dorothy (1912–1975): Dorothy Adkins was an American statistician who made significant contributions to the field of biostatistics, particularly in the areas of clinical trials and epidemiology.

Adkins received her Ph.D. in statistics from Columbia University in 1951 and went on to work as a biostatistician at the New York State Department of Health and the Memorial Sloan Kettering Cancer Center. During her career, she played a key role in the design and analysis of numerous clinical trials and epidemiological studies and was widely recognized for her expertise in these areas.

One of Adkins' most important contributions to biostatistics was her development of methods for designing and analyzing randomized clinical trials, which are widely used today to evaluate the safety and efficacy of new medical treatments and interventions. She also developed methods for analyzing data from longitudinal studies, which are used to study changes in health outcomes over time.

Adkins was a highly respected member of the statistical community and served as president of the Eastern North American Region of the International Biometric Society and as a fellow of the American Statistical Association. She also played a significant role in mentoring and training the next generation of biostatisticians and was known for her dedication to promoting the use of statistical methods in public health research and practice.

Overall, Dorothy Adkins was a pioneering figure in the field of biostatistics, and her work continues to inform research and practice in public health and other related fields today.

ADMB: ADMB (Automatic Differentiation Model Builder) is a software package that is used for statistical modeling and data analysis. ADMB is designed to help researchers and statisticians build complex models and analyze large datasets with ease.

ADMB uses automatic differentiation to calculate the derivatives of complex functions, which makes it a powerful tool for solving optimization problems and fitting complex statistical models. This approach allows users to build models that are more flexible and accurate than traditional methods, and to analyze large datasets in a fraction of the time required by other software packages.

One of the key advantages of ADMB is its ability to handle complex hierarchical models, which are commonly used in ecology, fisheries science, and other fields. ADMB allows users to build models that incorporate multiple levels of variation and dependencies, which can help to improve the accuracy and reliability of statistical analyses.

ADMB is also designed to be user-friendly and flexible, with a range of features and tools that are accessible to both novice and advanced users. The software includes a graphical user interface and a command-line interface and can be easily integrated with other software packages and programming languages.

Overall, ADMB is a powerful and versatile tool for statistical modeling and data analysis and is widely used in research and applications across a range of fields. This includes ecology, fisheries science, and environmental science. Its flexible and user-friendly design, coupled with its ability to handle complex models and large datasets, make it a popular choice among researchers and statisticians around the world.

Admissible Decision Rule: In statistical decision theory, an admissible decision rule is a decision rule that satisfies certain criteria related to its optimality and efficiency. Specifically, an admissible decision rule is one that cannot be improved upon by any other decision rule in terms of minimizing the expected loss or error rate associated with a particular decision problem.

To understand this concept more concretely, consider a decision problem where a decision maker must choose between two actions, A and B, based on some available information or data. The decision maker's goal is to minimize the expected loss or error associated with this decision.

A decision rule is a set of instructions that tells the decision maker which action to choose based on the available information. An admissible decision rule is one that minimizes the expected loss or error rate over all possible decision rules for this problem.

The concept of admissible decision rules is important in statistical decision theory because it provides a way to evaluate the optimality and efficiency of different decision rules. By identifying admissible decision rules, researchers and decision-makers can identify the best possible decision rules for a given problem, and use these rules to make more informed and accurate decisions in practice.

The concept of admissible decision rules is closely related to other concepts in statistical decision theory, like Bayes risk and minimax risk. These concepts all relate to the idea of identifying optimal decision rules based on various criteria and are important tools for decision-making and data analysis in a wide range of fields.

Ahsan, Riaz (1951–2008): Riaz Ahsan is a Pakistani statistician who has made significant contributions to the field of statistics, particularly in the areas of survey sampling, design of experiments, and statistical inference.

Ahsan received his Ph.D. in statistics from the University of California, Berkeley in 1975, and went on to work as a professor of statistics at the Quaid-i-Azam University in Islamabad, Pakistan. During his career, he has published numerous research papers and books on a wide range of statistical topics and has made important contributions to the development of statistical theory and methods.

One of Ahsan's most important contributions to the field of statistics has been his work on survey sampling, where he has developed new methods and techniques for estimating population parameters from survey data. His work has helped to improve the accuracy and reliability of survey data and has had important applications in fields like public health, economics, and social sciences.

Ahsan has also made important contributions to the design of experiments, where he has developed new methods for designing experiments that are more efficient and informative than traditional methods. His work has helped to improve the quality of experimental data and has had important applications in fields like engineering, agriculture, and environmental science.

Overall, Riaz Ahsan is a highly respected figure in the field of statistics, and his work has had a significant impact on statistical theory and practice. He has received numerous awards and honors for his contributions to the field.

Aitchison, Beatrice (1908–1997): Beatrice Aitchison (1910-1997) was a British statistician who made significant contributions to the field of survey sampling and statistical analysis.

Aitchison received her Bachelor's and Master's degrees in mathematics from the University of London in the 1930s. She then went on to work for the British government during World War II, where she was involved in the development of statistical methods for military operations.

After the war, Aitchison began working at the University of London, where she continued her research in statistics. She made important contributions to the development of survey sampling methods, particularly in the area of stratified sampling. She also developed new methods for analyzing survey data. This includes the use of regression analysis to model relationships between variables.

One of Aitchison's most significant contributions to the field of statistics was her development of the Aitchison-Young estimator, which is a method for estimating population totals from survey data that is widely used today. She also developed new methods for estimating variances in survey data, which helped to improve the accuracy and reliability of survey results.

In addition to her research, Aitchison was an active member of the statistical community. She was involved in several professional organizations and served as president of the Royal Statistical Society from 1977 to 1979. She was also a mentor and role model for many young statisticians, particularly women, and encouraged them to pursue careers in the field.

Overall, Beatrice Aitchison was a highly respected and influential figure in the field of statistics, and her work has had a lasting impact on the development of survey sampling methods and statistical analysis. She is remembered today as a pioneering researcher and a trailblazer for women in statistics.

Aitchison, John (1926–2016): John Aitchison (1926-2016) was a British statistician who made significant contributions to the fields of compositional data analysis and multivariate analysis.

Aitchison received his Ph.D. in statistics from the University of Cambridge in 1953. He then went on to work at several institutions. This includes the University of Edinburgh, Imperial College London, and the University of Glasgow.

Aitchison's most significant contribution to the field of statistics was his development of the Aitchison geometry, which is a mathematical framework for analyzing compositional data. Compositional data are data that arise from parts of a whole, like percentages or proportions. Aitchison's work on compositional data analysis helped to develop new statistical methods for analyzing these types of data and has had important applications in fields like environmental science, geology, and chemistry.

Aitchison also made important contributions to multivariate analysis, where he developed new methods for analyzing data that involve multiple variables. He was particularly interested in developing methods for analyzing data that are constrained by mathematical relationships, like proportions that must add up to one.

In addition to his research, Aitchison was also a highly respected teacher and mentor. He wrote several influential books on statistics. This includes The Statistical Analysis of Compositional Data and Multivariate Statistical Analysis: A Primer. He also mentored many young statisticians and was known for his kindness, generosity, and enthusiasm for the field.

Overall, John Aitchison was a highly respected and influential figure in the field of statistics, and his work has had a lasting impact on the development of compositional data analysis and multivariate analysis. He is remembered today as a pioneering researcher and a dedicated mentor to generations of statisticians.

Aitken, Alexander (1895–1967): Alexander Aitken (1895-1967) was a New Zealand mathematician and statistician who made important contributions to the fields of numerical analysis, probability theory, and statistical inference.

Aitken received his Ph.D. in mathematics from the University of Edinburgh in 1921 and then went on to work at several institutions. This includes the University of Edinburgh and the University of Manchester. During World War II, he worked for the British government, where he made important contributions to the development of mathematical and statistical methods for military operations.

Aitken's most significant contributions to the field of statistics were in the area of statistical inference, where he developed new methods for estimating parameters and testing hypotheses in small samples. He was particularly interested in developing methods that were robust to outliers and other deviations from normality. Aitken also made important contributions to numerical analysis, where he developed new methods for solving equations and calculating eigenvalues.

In addition to his research, Aitken was also a dedicated teacher and mentor. He wrote several influential textbooks on mathematics and statistics. This includes Determinants and Matrices and Statistics and the Evaluation of Evidence for Forensic Scientists.

Overall, Alexander Aitken was a highly respected and influential figure in the fields of mathematics and statistics. His work has had a lasting impact on the development of statistical inference and numerical analysis, and he is remembered today as a pioneering researcher and a dedicated mentor to generations of mathematicians and statisticians.

Akaike, Hirotsugu (1927–2009): Hirotsugu Akaike (1927-2009) was a Japanese statistician who made important contributions to the fields of time series analysis, model selection, and information theory.

Akaike received his Ph.D. in statistics from the University of Tokyo in 1956. He then went on to work at several institutions. This includes the Institute of Statistical Mathematics in Tokyo and the Kyoto University. He was also a professor at the University of Tokyo and a fellow of the Japan Academy.

Akaike's most significant contributions to the field of statistics were in the area of model selection, where he developed the Akaike Information Criterion (AIC). The AIC is a measure of the relative quality of statistical models for a given set of data. It takes into account both the goodness of fit of the model and the number of parameters used in the model and provides a way to compare models with different numbers of parameters. The AIC has become a widely used tool in statistics and has had important applications in fields like econometrics, engineering, and biology.

Akaike also made important contributions to time series analysis, where he developed new methods for identifying and estimating dynamic models. He was particularly interested in developing methods that were robust to the presence of autocorrelation and other sources of serial dependence.

In addition to his research, Akaike was also a dedicated teacher and mentor. He wrote several influential textbooks on time series analysis and model selection and was known for his clear and accessible writing style.

Overall, Hirotsugu Akaike was a highly respected and influential figure in the field of statistics. His work on model selection and time series analysis has had a lasting impact on the development of statistical methodology, and he is remembered today as a pioneering researcher and a dedicated mentor to generations of statisticians.

Algebra Of Random Variables: The Algebra of Random Variables is a mathematical framework that allows us to perform operations on random variables in the same way that we perform operations on ordinary variables in algebra. In statistics, this framework is used to derive important properties of statistical models, like their expected values and variances.

In the Algebra of Random Variables, random variables are treated as mathematical objects that can be added, subtracted, multiplied, and divided. For example, if we have two random variables X and Y, we can define a new random variable Z = X + Y that represents the sum of X and Y. We can then use the rules of algebra to derive the expected value and variance of Z in terms of the expected values and variances of X and Y.

The Algebra of Random Variables is particularly useful in the development of statistical models and in the estimation of their parameters. For example, in linear regression, we can use the Algebra of Random Variables to derive the expected value and variance of the regression coefficients, which are used to estimate the relationship between two variables. In Bayesian statistics, we can use the Algebra of Random Variables to derive the posterior distribution of a parameter given the data and prior information.

Overall, the Algebra of Random Variables is an important tool in statistics that allows us to perform mathematical operations on random variables and derive important properties of statistical models. By treating random variables as mathematical objects, we can develop more powerful and flexible statistical models and estimation methods.

Aliaga, Martha (1937–2011): Martha Aliaga is a statistician and data scientist who has worked in a variety of academic and industry settings. She is particularly known for her work in survey research and statistical education.

Aliaga received her Ph.D. in statistics from the University of California, Los Angeles (UCLA) in 1994. She then went on to work as a research statistician at the RAND Corporation, where she contributed to a wide range of projects in areas like health policy, education, and national security. She also worked as a senior statistician at the American Institutes for Research and as an associate professor at the University of Central Florida.

Throughout her career, Aliaga has been a strong advocate for statistical education and data literacy. She has developed and taught numerous courses in statistics and data analysis, and has been involved in a variety of initiatives to promote statistical literacy among students and the general public. She has also served as an editor for several statistical journals and has contributed to the development of statistical software tools and resources.

Aliaga is particularly known for her work in survey research, where she has developed new methods for analyzing and visualizing survey data. She has written extensively on topics like sampling methods, survey weights, and missing data, and has developed software tools for survey data analysis. Her work has had important applications in fields like public health, social policy, and market research.

Overall, Martha Aliaga is a respected and influential figure in the field of statistics. Her contributions to survey research and statistical education have had a lasting impact on the field, and she continues to be a strong advocate for the use of statistics and data analysis in a variety of applications.

Allen, R. G. D. (1906–1983): R.G.D. Allen was a British economist and statistician who made important contributions to the development of economic theory and statistical methodology. He is perhaps best known for his work on the measurement of consumer surplus, which is a key concept in modern welfare economics.

Allen was born in 1900 and studied at the University of Oxford, where he earned a degree in classics before switching to economics. After completing his studies, he worked as a civil servant and as a research fellow at several universities in the UK and Canada. In the 1930s, he became interested in the measurement of consumer surplus, which is the difference between what consumers are willing to pay for a good and what they actually pay.

Allen's work on consumer surplus was groundbreaking in several respects. He was one of the first economists to rigorously define and measure consumer surplus, and his methods were widely adopted by other economists in subsequent decades. He also used statistical techniques to estimate consumer demand functions, which allowed him to quantify the effects of changes in price and income on consumer behavior.

In addition to his work on consumer surplus, Allen made important contributions to other areas of economics and statistics. He was a pioneer in the use of linear programming and input-output analysis, which are mathematical techniques used to model complex economic systems. He also wrote influential papers on the theory of production and the measurement of economic growth.

Overall, R.G.D. Allen was a highly influential figure in the development of economic theory and statistical methodology. His work on consumer surplus and other topics helped to lay the foundations of modern welfare economics, and his innovative use of statistical techniques has had a lasting impact on the field of economics.

Alternative Hypothesis: In statistics, an alternative hypothesis is a statement that contradicts or opposes a null hypothesis. It represents a hypothesis that is believed to be true if the null hypothesis is rejected based on the results of a statistical test.

In general, a hypothesis is a statement about a population parameter or a relationship between variables that is being tested using data from a sample. The null hypothesis represents the status quo or the commonly accepted view and is formulated in terms of equality or no difference between two groups or variables. The alternative hypothesis, on the other hand, represents the opposite of the null hypothesis and is formulated in terms of inequality or a difference between the two groups or variables being compared.

For example, suppose a researcher is interested in testing whether a new drug is more effective than an existing drug for treating a particular condition. The null hypothesis would be that the new drug is no more effective than the existing drug, while the alternative hypothesis would be that the new drug is more effective than the existing drug.

After collecting data, the researcher would use statistical tests to determine whether there