An artificial neural network's learning rule or learning process is a method, mathematical logic or algorithm which improves the network's performance and/or training time. Usually, this rule is applied repeatedly over the network. It is done by updating the weights and bias levels of a network when a network is simulated in a specific data environment.[1] A learning rule may accept existing conditions (weights and biases) of the network and will compare the expected result and actual result of the network to give new and improved values for weights and bias.[2] Depending on the complexity of actual model being simulated, the learning rule of the network can be as simple as an XOR gate or mean squared error, or as complex as the result of a system of differential equations.
The learning rule is one of the factors which decides how fast or how accurately the artificial network can be developed. Depending upon the process to develop the network there are three main models of machine learning:
Unsupervised learning
Supervised learning
Reinforcement learning
^Simon Haykin (16 July 1998). "Chapter 2: Learning Processes". Neural Networks: A comprehensive foundation (2nd ed.). Prentice Hall. pp. 50–104. ISBN 978-8178083001. Retrieved 2 May 2012.
^S Russell, P Norvig (1995). "Chapter 18: Learning from Examples". Artificial Intelligence: A Modern Approach (3rd ed.). Prentice Hall. pp. 693–859. ISBN 0-13-103805-2. Retrieved 20 Nov 2013.
An artificial neural network's learningrule or learning process is a method, mathematical logic or algorithm which improves the network's performance...
Association rulelearning is a rule-based machine learning method for discovering interesting relations between variables in large databases. It is intended...
order to make a prediction. Rule-based machine learning approaches include learning classifier systems, association rulelearning, and artificial immune systems...
of learning language and communication, and the stage where a child begins to understand rules and symbols. This has led to a view that learning in organisms...
Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning. Reinforcement learning differs...
In statistics and machine learning, ensemble methods use multiple learning algorithms to obtain better predictive performance than could be obtained from...
In machine learning, the delta rule is a gradient descent learningrule for updating the weights of the inputs to artificial neurons in a single-layer...
Explanation-based learning Feature GloVe Hyperparameter Inferential theory of learningLearning automata Learning classifier system LearningruleLearning with errors...
a weight of one. At each time step, the input is fed forward and a learningrule is applied. The fixed back-connections save a copy of the previous values...
Multimodal learning, in the context of machine learning, is a type of deep learning using multiple modalities of data, such as text, audio, or images....
= ∑ j = 0 n x j w j {\displaystyle y=\sum _{j=0}^{n}x_{j}w_{j}} The learningrule used by ADALINE is the LMS ("least mean squares") algorithm, a special...
network with two learning layers. In 1970, modern backpropagation method, an efficient application of a chain-rule-based supervised learning, was for the...
In machine learning and statistics, the learning rate is a tuning parameter in an optimization algorithm that determines the step size at each iteration...
abstract concept learning are topics like religion and ethics. Abstract-concept learning is seeing the comparison of the stimuli based on a rule (e.g., identity...
network with two learning layers. In 1970, modern backpropagation method, an efficient application of a chain-rule-based supervised learning, was for the...
Deep learning is the subset of machine learning methods based on neural networks with representation learning. The adjective "deep" refers to the use of...
from are based on a consistent and simple rule. Both offline data collection models, where the model is learning by interacting with a static dataset and...
the value function for the current state using the rule: V ( S t ) ← ( 1 − α ) V ( S t ) + α ⏟ learning rate [ R t + 1 + γ V ( S t + 1 ) ⏞ The TD target...
Supervised learning (SL) is a paradigm in machine learning where input objects (for example, a vector of predictor variables) and a desired output value...
Decision tree learning is a supervised learning approach used in statistics, data mining and machine learning. In this formalism, a classification or...
In machine learning, support vector machines (SVMs, also support vector networks) are supervised max-margin models with associated learning algorithms...