Minimum redundancy feature selection is an algorithm frequently used in a method to accurately identify characteristics of genes and phenotypes and narrow down their relevance and is usually described in its pairing with relevant feature selection as Minimum Redundancy Maximum Relevance (mRMR). This method was first proposed in 2003 by Hanchuan Peng and Chris Ding,[1] followed by a theoretical formulation based on mutual information, along with the first definition of multivariate mutual information, published in IEEE Trans. Pattern Analysis and Machine Intelligence in 2005. [2]
Feature selection, one of the basic problems in pattern recognition and machine learning, identifies subsets of data that are relevant to the parameters used and is normally called Maximum Relevance. These subsets often contain material which is relevant but redundant and mRMR attempts to address this problem by removing those redundant subsets. mRMR has a variety of applications in many areas such as cancer diagnosis and speech recognition.
Features can be selected in many different ways. One scheme is to select features that correlate strongest to the classification variable. This has been called maximum-relevance selection. Many heuristic algorithms can be used, such as the sequential forward, backward, or floating selections.
On the other hand, features can be selected to be mutually far away from each other while still having "high" correlation to the classification variable. This scheme, termed as Minimum Redundancy Maximum Relevance (mRMR) selection has been found to be more powerful than the maximum relevance selection.
As a special case, the "correlation" can be replaced by the statistical dependency between variables. Mutual information can be used to quantify the dependency. In this case, it is shown that mRMR is an approximation to maximizing the dependency between the joint distribution of the selected features and the classification variable.
Studies have tried different measures for redundancy and relevance measures. A recent study compared several measures within the context of biomedical images.[3]
^Chris Ding and Hanchuan Peng, "Minimum Redundancy Feature Selection from Microarray Gene Expression Data". 2nd IEEE Computer Society Bioinformatics Conference (CSB 2003), 11–14 August 2003, Stanford, CA, USA. Pages 523–529.
^Peng, H.C., Long, F., and Ding, C., "Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, No. 8, pp. 1226–1238, 2005.
^Auffarth, B., Lopez, M., Cerquides, J. (2010). Comparison of redundancy and relevance measures for feature selection in tissue classification of CT images. Advances in Data Mining. Applications and Theoretical Aspects. p. 248--262. Springer. http://www.csc.kth.se/~auffarth/publications/redrel.pdf
and 24 Related for: Minimum redundancy feature selection information
Minimumredundancyfeatureselection is an algorithm frequently used in a method to accurately identify characteristics of genes and phenotypes and narrow...
with feature selection in Visual Basic Archived 2009-02-14 at the Wayback Machine (includes executable and source code) Minimum-redundancy-maximum-relevance...
both the relevance and redundancy of variables, such as the minimumredundancyfeatureselection. Mutual information is used in determining the similarity...
Corner detectors are not usually very robust and often require large redundancies introduced to prevent the effect of individual errors from dominating...
be redundant information. The selection of a tag SNP as a representative of these groups reduces the amount of redundancy when analyzing parts of the genome...
the learned function. In addition, there are many algorithms for featureselection that seek to identify the relevant features and discard the irrelevant...
unsorted sequence Selection algorithm: finds the kth largest item in a sequence Ternary search: a technique for finding the minimum or maximum of a function...
preventing total or partial process shutdown due to hardware failure. Other redundancy scenarios could be related to safety-critical processes, for example,...
following major characteristics: It reduces or eliminates certain types of redundancy through the use of node sharing. It stores partial matches when performing...
demand. Data centers can vary widely in terms of size, power requirements, redundancy, and overall structure. Four common categories used to segment types of...
freely available tool called packJPG is based on the 2007 paper "Improved Redundancy Reduction for JPEG Files." As of version 2.5k of 2016, it reports a typical...
Duplex feature of the physical layer is used to achieve this. A line topology is the simpler of the two possible arrangements and provides no redundancy. However...
ciphertext-only attack. Concealed messages in tampered executable files, exploiting redundancy in the targeted instruction set. Pictures embedded in video material (optionally...
two channels, both of which are currently good enough for minimum communications. The redundancy-based scoring inherent in ALE thus allows for selecting...
75% of the previous wages for up to sixteen months. Other measures are: Redundancy Fund (Cassa integrazione guadagni, or CIG): cash benefits provided as...
density). This relates free energy minimization to the principle of minimumredundancy. Free energy minimisation provides a useful way to formulate normative...
regarding mask selection. Centre-mounted snorkels (also known as front snorkels) are the only type approved for use subject to meeting minimum and maximum...
systems and new displays. The MFDs are interchangeable and designed for redundancy in the event of failure, flight information can be presented on any of...
changes in depth. This can be achieved by accurate selection of ballast weight, which should be the minimum to allow neutral buoyancy with depleted gas supplies...
components, tripled independent systems ("Blue", "Green", and "Yellow") for redundancy, with an emergency ram air turbine (RAT) stored in the port-inner elevon...
to use multiple paths to maximize resource usage and increase redundancy. The redundancy offered by Multipath TCP in the context of wireless networks enables...
software design System diagnostics design Fault tolerant systems (e.g. by redundancy) Predictive and preventive maintenance (e.g. reliability-centered maintenance)...
Global Information