An example of a decision stump that discriminates between two of three classes of Iris flower data set: Iris versicolor and Iris virginica. The petal width is in centimetres. This particular stump achieves 94% accuracy on the Iris dataset for these two classes.
A decision stump is a machine learning model consisting of a one-level decision tree.[1] That is, it is a decision tree with one internal node (the root) which is immediately connected to the terminal nodes (its leaves). A decision stump makes a prediction based on the value of just a single input feature. Sometimes they are also called 1-rules.[2]
Depending on the type of the input feature, several variations are possible. For nominal features, one may build a stump which contains a leaf for each possible feature value[3][4] or a stump with the two leaves, one of which corresponds to some chosen category, and the other leaf to all the other categories.[5]For binary features these two schemes are identical. A missing value may be treated as a yet another category.[5]
For continuous features, usually, some threshold feature value is selected, and the stump contains two leaves — for values below and above the threshold. However, rarely, multiple thresholds may be chosen and the stump therefore contains three or more leaves.
Decision stumps are often[6] used as components (called "weak learners" or "base learners") in machine learning ensemble techniques such as bagging and boosting. For example, a Viola–Jones face detection algorithm employs AdaBoost with decision stumps as weak learners.[7]
The term "decision stump" was coined in a 1992 ICML paper by Wayne Iba and Pat Langley.[1][8]
^ abIba, Wayne; Langley, Pat (1992). "Induction of One-Level Decision Trees" (PDF). ML92: Proceedings of the Ninth International Conference on Machine Learning, Aberdeen, Scotland, 1–3 July 1992. Morgan Kaufmann. pp. 233–240. doi:10.1016/B978-1-55860-247-2.50035-8. ISBN 978-1-55860-247-2.
^Holte, Robert C. (1993). "Very simple classification rules perform well on most commonly used datasets" (PDF). Machine Learning. 11 (1): 63–90. doi:10.1023/A:1022631118932. S2CID 6596.
^Loper, Edward L.; Bird, Steven; Klein, Ewan (2009). Natural language processing with Python. Sebastopol, CA: O'Reilly. ISBN 978-0-596-51649-9. Archived from the original on 2010-06-18. Retrieved 2010-06-10.
^This classifier is implemented in Weka under the name OneR (for "1-rule").
^ abThis is what has been implemented in Weka's DecisionStump classifier.
^Reyzin, Lev; Schapire, Robert E. (2006). "How Boosting the Margin Can Also Boost Classifier Complexity" (PDF). ICML′06: Proceedings of the 23rd international conference on Machine Learning. pp. 753–760. doi:10.1145/1143844.1143939. ISBN 978-1-59593-383-6. S2CID 2483269.
^Viola, Paul; Jones, Michael J. (2004). "Robust Real-Time Face Detection" (PDF). International Journal of Computer Vision. 57 (2): 137–154. doi:10.1023/B:VISI.0000013087.49260.fb. S2CID 2796017.
^Oliver, Jonathan J.; Hand, David (1994). "Averaging Over Decision Stumps". Machine Learning: ECML-94, European Conference on Machine Learning, Catania, Italy, April 6–8, 1994, Proceedings. Lecture Notes in Computer Science. Vol. 784. Springer. pp. 231–241. doi:10.1007/3-540-57868-4_61. ISBN 3-540-57868-4. These simple rules are in effect severely pruned decision trees and have been termed decision stumps Iba & Langley 1992
A decisionstump is a machine learning model consisting of a one-level decision tree. That is, it is a decision tree with one internal node (the root)...
classification. Decision tree pruning Binary decision diagram CHAID CART ID3 algorithm C4.5 algorithm Decisionstumps, used in e.g. AdaBoosting Decision list Incremental...
Look up stump in Wiktionary, the free dictionary. Stump may refer to: Tree stump, the rooted remains of a felled tree Stump (cricket), one of three small...
formulas are either a variable or its negation. Decisionstump Ronald L. Rivest (Nov 1987). "Learning decision lists" (PDF). Machine Learning. 2 (3): 229–246...
decisionstumps or decision trees as weak hypotheses. As an example, boosting decisionstumps creates a set of T {\displaystyle T} weighted decision stumps...
learners (such as decisionstumps), it has been shown that it can also effectively combine strong base learners (such as deep decision trees), producing...
"television audiences could hear the rattle of stumps". Later, the technology became part of the Decision Review System; the microphone detects the sound...
with the stumps? ii) did the batsman hit the ball first with his bat? (i.e. the ball hitting the pad first is a pre-condition of any decision to be given...
interaction between variables in the model. With J = 2 {\displaystyle J=2} (decisionstumps), no interaction between variables is allowed. With J = 3 {\displaystyle...
we search the space H {\displaystyle {\mathcal {H}}} for a single decisionstump h ( ⋅ ; ω ∗ ) {\displaystyle h(\cdot ;\omega ^{*})} maximizing the left...
ball would have passed over the stumps or struck them. The MCC guidance states that it is easier to make a decision when the ball strikes the batter...
term wicket has several meanings: It is either of the two sets of three stumps and two bails at each end of the pitch. The fielding team's players can...
in 2001. The band consists of lead vocalist and rhythm guitarist Patrick Stump, bassist Pete Wentz, lead guitarist Joe Trohman, and drummer Andy Hurley...
its impact on the rules, e.g. for lbw decisions in which it is necessary to distinguish between off and leg stumps. Tail common colloquialism for the lower...
he won 30 of 43 decisions (.698). After winning 14 games for the 1957 Birmingham Barons of the Double-A Southern Association, Stump made his Major League...
following algorithms and models: Collaborative Filtering Decisionstumps (one-level decision trees) Density Estimation Trees Euclidean minimum spanning...
radio host, Tom Valentine. During his campaign, part of Gritz's standard stump speech was an idea to pay off the national debt by minting a coin at the...
Retrieved August 11, 2014. Canerdy, Beverly (March 12, 1984). "D.C. mayor stumps for Jackson". Clarion-Ledger. p. 12. Retrieved May 13, 2022. Boyd, Gerald...
After birth, the umbilical cord stump will dry up and drop away by the time the baby is three weeks old. If the stump still has not separated after three...
pass through the two-stump wicket each time without hitting the stumps or the bail. As a result of Lumpy's protests, the middle stump was introduced, although...
the tree cut down. As the crowd departs, the stump starts cackling and makes the charlatan confess. The stump cackles again, demanding the king never hurt...
Global Information