Method used in statistics, pattern recognition, and other fields
Not to be confused with latent Dirichlet allocation.
Linear discriminant analysis (LDA), normal discriminant analysis (NDA), or discriminant function analysis is a generalization of Fisher's linear discriminant, a method used in statistics and other fields, to find a linear combination of features that characterizes or separates two or more classes of objects or events. The resulting combination may be used as a linear classifier, or, more commonly, for dimensionality reduction before later classification.
LDA is closely related to analysis of variance (ANOVA) and regression analysis, which also attempt to express one dependent variable as a linear combination of other features or measurements.[1][2] However, ANOVA uses categorical independent variables and a continuous dependent variable, whereas discriminant analysis has continuous independent variables and a categorical dependent variable (i.e. the class label).[3] Logistic regression and probit regression are more similar to LDA than ANOVA is, as they also explain a categorical variable by the values of continuous independent variables. These other methods are preferable in applications where it is not reasonable to assume that the independent variables are normally distributed, which is a fundamental assumption of the LDA method.
LDA is also closely related to principal component analysis (PCA) and factor analysis in that they both look for linear combinations of variables which best explain the data.[4] LDA explicitly attempts to model the difference between the classes of data. PCA, in contrast, does not take into account any difference in class, and factor analysis builds the feature combinations based on differences rather than similarities. Discriminant analysis is also different from factor analysis in that it is not an interdependence technique: a distinction between independent variables and dependent variables (also called criterion variables) must be made.
LDA works when the measurements made on independent variables for each observation are continuous quantities. When dealing with categorical independent variables, the equivalent technique is discriminant correspondence analysis.[5][6]
Discriminant analysis is used when groups are known a priori (unlike in cluster analysis). Each case must have a score on one or more quantitative predictor measures, and a score on a group measure.[7] In simple terms, discriminant function analysis is classification - the act of distributing things into groups, classes or categories of the same type.
^Fisher, R. A. (1936). "The Use of Multiple Measurements in Taxonomic Problems" (PDF). Annals of Eugenics. 7 (2): 179–188. doi:10.1111/j.1469-1809.1936.tb02137.x. hdl:2440/15227.
^McLachlan, G. J. (2004). Discriminant Analysis and Statistical Pattern Recognition. Wiley Interscience. ISBN 978-0-471-69115-0. MR 1190469.
^Analyzing Quantitative Data: An Introduction for Social Researchers, Debra Wetcher-Hendricks, p.288
^Martinez, A. M.; Kak, A. C. (2001). "PCA versus LDA" (PDF). IEEE Transactions on Pattern Analysis and Machine Intelligence. 23 (2): 228–233. doi:10.1109/34.908974. Archived from the original (PDF) on 2008-10-11. Retrieved 2010-06-30.
^Abdi, H. (2007) "Discriminant correspondence analysis." In: N.J. Salkind (Ed.): Encyclopedia of Measurement and Statistic. Thousand Oaks (CA): Sage. pp. 270–275.
^Perriere, G.; Thioulouse, J. (2003). "Use of Correspondence Discriminant Analysis to predict the subcellular location of bacterial proteins". Computer Methods and Programs in Biomedicine. 70 (2): 99–105. doi:10.1016/s0169-2607(02)00011-1. PMID 12507786.
^Büyüköztürk, Ş. & Çokluk-Bökeoğlu, Ö. (2008). Discriminant function analysis: Concept and application. Egitim Arastirmalari - Eurasian Journal of Educational Research, 33, 73-92.
and 28 Related for: Linear discriminant analysis information
Lineardiscriminantanalysis (LDA), normal discriminantanalysis (NDA), or discriminant function analysis is a generalization of Fisher's linear discriminant...
stage based on backpropagation. Lineardiscriminantanalysis (LDA) is a generalization of Fisher's lineardiscriminant, a method used in statistics, pattern...
of linear subspace learning methods such as principal component analysis (PCA), independent component analysis (ICA), lineardiscriminantanalysis (LDA)...
Fisher discriminantanalysis (KFD), also known as generalized discriminantanalysis and kernel discriminantanalysis, is a kernelized version of linear discriminant...
machines, and lineardiscriminantanalysis), as well as in various other models, such as principal component analysis and factor analysis. In many of these...
applied to lineardiscriminantanalysis as well as the support vector machine. Tharwat, Alaa (2016). "Linear vs. quadratic discriminantanalysis classifier:...
multiple measurements in taxonomic problems as an example of lineardiscriminantanalysis. It is sometimes called Anderson's Iris data set because Edgar...
Principal component analysis (PCA) is a linear dimensionality reduction technique with applications in exploratory data analysis, visualization and data...
between-samples SSP matrix. Similar terminology may also be used in lineardiscriminantanalysis, where W and B are respectively referred to as the within-groups...
multiclass lineardiscriminantanalysis, naive Bayes classifiers, and artificial neural networks. Specifically, in multinomial logistic regression and linear discriminant...
each, all of which are linear classifiers, are: generative classifiers: naive Bayes classifier and lineardiscriminantanalysis discriminative model: logistic...
the generalized functional linear regression model based on the FPCA approach is used. Functional LinearDiscriminantAnalysis (FLDA) has also been considered...
alternative to Fisher's 1936 method, lineardiscriminantanalysis. If the assumptions of lineardiscriminantanalysis hold, the conditioning can be reversed...
multiple measurements in taxonomic problems" as an example of lineardiscriminantanalysis. Iris versicolor is a flowering herbaceous perennial plant, growing...
basic setup (the perceptron algorithm, support vector machines, lineardiscriminantanalysis, etc.) is the procedure for determining (training) the optimal...
between flats Principal component analysisLineardiscriminantanalysis Regularized canonical correlation analysis Singular value decomposition Partial...
correlation Coding (social sciences) Descriptive statistics Discriminant correlation analysis (DCA) Earl R. Babbie, The Practice of Social Research, 12th...
distinguish between two or more groups of cases. Lineardiscriminantanalysis (LDA) computes a linear predictor from two sets of normally distributed data...
multiple measurements in taxonomic problems" as an example of lineardiscriminantanalysis. Iris virginica is a perennial plant that grows up to 0.6–0.9 m...
distribution used for multivariate statistical testing and Fisher's lineardiscriminantanalysis that is used for supervised classification. In order to use the...
weather analysis, urban planning, logistics, and epidemiology. The mathematical basis for geostatistics derives from cluster analysis, lineardiscriminant analysis...
discrimination may refer to: Statistical discrimination (economics) Lineardiscriminantanalysis (statistics) This disambiguation page lists articles associated...
Factor analysis searches for such joint variations in response to unobserved latent variables. The observed variables are modelled as linear combinations...
Global Information