Papers › Linear and Quadratic Discriminant Analysis: Tutorial

Linear and Quadratic Discriminant Analysis: Tutorial

1 Jun 2019arXiv:1906.02590archive 2025-07-28

Benyamin Ghojogh, Mark Crowley

This tutorial explains Linear Discriminant Analysis (LDA) and Quadratic Discriminant Analysis (QDA) as two fundamental classification methods in statistical and probabilistic learning. We start with the optimization of decision boundary on which the posteriors are equal. Then, LDA and QDA are derived for binary and multiple classes. The estimation of parameters in LDA and QDA are also covered. Then, we explain how LDA and QDA are related to metric learning, kernel principal component analysis, Mahalanobis distance, logistic regression, Bayes optimal classifier, Gaussian naive Bayes, and likelihood ratio test. We also prove that LDA and Fisher discriminant analysis are equivalent. We finally clarify some of the theoretical concepts with simulations we provide.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Dimensionality ReductionGeneral ClassificationMetric Learningregression

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

LDA

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections