An artificial neural network's learning rule or learning process is a method, mathematical logic or algorithm which improves the network's performance and/or training time. Usually, this rule is applied repeatedly over the network. It is done by updating the weights and bias levels of a network when a network is simulated in a specific data environment.[1] A learning rule may accept existing conditions (weights and biases) of the network and will compare the expected result and actual result of the network to give new and improved values for weights and bias.[2] Depending on the complexity of actual model being simulated, the learning rule of the network can be as simple as an XOR gate or mean squared error, or as complex as the result of a system of differential equations.
The learning rule is one of the factors which decides how fast or how accurately the artificial network can be developed. Depending upon the process to develop the network there are three main models of machine learning:
Unsupervised learning
Supervised learning
Reinforcement learning
^Simon Haykin (16 July 1998). "Chapter 2: Learning Processes". Neural Networks: A comprehensive foundation (2nd ed.). Prentice Hall. pp. 50–104. ISBN 978-8178083001. Retrieved 2 May 2012.
^S Russell, P Norvig (1995). "Chapter 18: Learning from Examples". Artificial Intelligence: A Modern Approach (3rd ed.). Prentice Hall. pp. 693–859. ISBN 0-13-103805-2. Retrieved 20 Nov 2013.
An artificial neural network's learningrule or learning process is a method, mathematical logic or algorithm which improves the network's performance...
Association rulelearning is a rule-based machine learning method for discovering interesting relations between variables in large databases. It is intended...
order to make a prediction. Rule-based machine learning approaches include learning classifier systems, association rulelearning, and artificial immune systems...
of learning language and communication, and the stage where a child begins to understand rules and symbols. This has led to a view that learning in organisms...
In statistics and machine learning, ensemble methods use multiple learning algorithms to obtain better predictive performance than could be obtained from...
Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning. Reinforcement learning differs...
= ∑ j = 0 n x j w j {\displaystyle y=\sum _{j=0}^{n}x_{j}w_{j}} The learningrule used by ADALINE is the LMS ("least mean squares") algorithm, a special...
a weight of one. At each time step, the input is fed forward and a learningrule is applied. The fixed back-connections save a copy of the previous values...
network with two learning layers. In 1970, modern backpropagation method, an efficient application of a chain-rule-based supervised learning, was for the...
Multimodal learning, in the context of machine learning, is a type of deep learning using multiple modalities of data, such as text, audio, or images....
In machine learning and statistics, the learning rate is a tuning parameter in an optimization algorithm that determines the step size at each iteration...
In machine learning, the delta rule is a gradient descent learningrule for updating the weights of the inputs to artificial neurons in a single-layer...
network with two learning layers. In 1970, modern backpropagation method, an efficient application of a chain-rule-based supervised learning, was for the...
Supervised learning (SL) is a paradigm in machine learning where input objects (for example, a vector of predictor variables) and a desired output value...
Deep learning is the subset of machine learning methods based on neural networks with representation learning. The adjective "deep" refers to the use of...
from are based on a consistent and simple rule. Both offline data collection models, where the model is learning by interacting with a static dataset and...
the value function for the current state using the rule: V ( S t ) ← ( 1 − α ) V ( S t ) + α ⏟ learning rate [ R t + 1 + γ V ( S t + 1 ) ⏞ The TD target...
Explanation-based learning Feature GloVe Hyperparameter Inferential theory of learningLearning automata Learning classifier system LearningruleLearning with errors...
Deep reinforcement learning (deep RL) is a subfield of machine learning that combines reinforcement learning (RL) and deep learning. RL considers the problem...
In machine learning, support vector machines (SVMs, also support vector networks) are supervised max-margin models with associated learning algorithms...