Paul Werbos at the International Joint Conference on Neural Networks (IJCNN) in Seattle on 8 July 1991.
Born
(1947-09-04) September 4, 1947 (age 76)
Nationality
American
Alma mater
Harvard University
Known for
Backpropagation
Awards
IEEE Neural Network Pioneer Award (1995) IEEE Frank Rosenblatt Award (2022)
Scientific career
Fields
Social science Machine Learning
Thesis
Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences(1974)
Doctoral advisor
Karl Deutsch
Other academic advisors
Yu-Chi Ho
Paul John Werbos (born 1947) is an American social scientist and machine learning pioneer. He is best known for his 1974 dissertation, which first described the process of training artificial neural networks through backpropagation of errors.[1] He also was a pioneer of recurrent neural networks.[2]
Werbos was one of the original three two-year Presidents of the International Neural Network Society (INNS). In 1995, he was awarded the IEEE Neural Network Pioneer Award for the discovery of backpropagation and other basic neural network learning frameworks such as Adaptive Dynamic Programming.[3]
Werbos has also written on quantum mechanics and other areas of physics.[4][5] He also has interest in larger questions relating to consciousness, the foundations of physics, and human potential.
He served as program director in the National Science Foundation for several years until 2015.
^The thesis, and some supplementary information, can be found in his book, Werbos, Paul J. (1994). The Roots of Backpropagation : From Ordered Derivatives to Neural Networks and Political Forecasting. New York: John Wiley & Sons. ISBN 0-471-59897-6.
^Werbos, P. (1990). "Backpropagation Through Time: What It Does and How to Do It". Proceedings of the IEEE. 78 (10): 1550–1560. doi:10.1109/5.58337. S2CID 18470994.
^"Award Recipients | IEEE Computational Intelligence Society". cis.ieee.org. Archived from the original on 2013-01-17. Retrieved 2017-09-12.
^Werbos, Paul J. (2005). "A Conjecture About Fermi–Bose Equivalence". arXiv:hep-th/0505023. Bibcode:2005hep.th....5023W. {{cite journal}}: Cite journal requires |journal= (help)
^"Discussion with Paul Werbos on the Nature of Quantum Nonlocality". December 7, 2012.
Paul John Werbos (born 1947) is an American social scientist and machine learning pioneer. He is best known for his 1974 dissertation, which first described...
was applied in the way that has become standard, for the first time by PaulWerbos. In 1985, an experimental analysis of the technique was conducted by...
was applied in the way that has become standard, for the first time by PaulWerbos. In 1985, an experimental analysis of the technique was conducted by...
Winkelstein James D. Watson Owen Webster Richard Weiszmann Guenter Wendt PaulWerbos James Westphal Douglas Whalen Woodrow Whitlow Jr. William T. Wickner...
work of the backpropagation method, such as the 1974 dissertation of PaulWerbos. In the same year, Rumelhart also published Parallel Distributed Processing:...
backpropagation is a special case, was proposed by Seppo Linnainmaa in 1970, and PaulWerbos proposed to use it to train neural networks in 1974. During the same...
(1962); Arthur E. Bryson and Yu-Chi Ho (1969); Seppo Linnainmaa (1970); PaulWerbos (1974). In fact, backpropagation and gradient descent are straight forward...
Werbos, Paul (1982). "Applications of advances in nonlinear sensitivity analysis". System modeling and optimization. Springer. pp. 762–770. Werbos, P...
differentiable functions. In 1982, PaulWerbos applied backpropagation to MLPs in the way that has become standard. Werbos described how he developed backpropagation...
Heinrich Welker – Germany (1912–1981) Gregor Wentzel – Germany (1898–1978) PaulWerbos – United States (born 1947) Siebren van der Werf – Netherlands (born...
published by Seppo Linnainmaa (1970) and applied to neural networks by PaulWerbos. These two discoveries helped to revive the exploration of artificial...
backpropagation already in 1960 in the context of control theory. In 1982, PaulWerbos applied backpropagation to MLPs in the way that has become standard....
mode of automatic differentiation (first applied to neural networks by PaulWerbos) is used in experiments by David Rumelhart, Geoff Hinton and Ronald J...
the so-called distal teacher approach that had been developed by Paul Munro, PaulWerbos, D. Nguyen and Bernard Widrow, Michael I. Jordan and David Rumelhart...
mode of automatic differentiation (first applied to neural networks by PaulWerbos) is used in experiments by David Rumelhart, Geoff Hinton and Ronald J...
published by Seppo Linnainmaa in 1970 and applied to neural networks by PaulWerbos. 1985 The autonomous drawing program, AARON, created by Harold Cohen...
been solved by the backpropagation algorithm. "This was long before PaulWerbos. Backprop to me is almost miraculous." Unable to train multilayered neural...
honorarium. 2024: Bernadette Bouchon-Meunier 2023: Marios Polycarpou 2022: PaulWerbos 2021: James M. Keller 2020: Xin Yao 2019: Erkki Oja 2018: Enrique H....
report). Cambridge University, Engineering Department. CUED/F-INFENG/TR.1. Werbos, Paul J. (1988). "Generalization of backpropagation with application to a recurrent...
4th Int. Workshop Soft Computing Applications. Arad, Romania: IEEE. Werbos, Paul J. (1994). The Roots of Backpropagation. From Ordered Derivatives to...
Programming. Athena Scientific. ISBN 1-886529-10-8. Miller, W. Thomas; Werbos, Paul; Sutton, Richard (1990). Neural Networks for Control. Shibata, Katsunari;...
with R, Second Edition. Simon and Schuster. ISBN 978-1-63835-078-1. Werbos, Paul J. (1988). "Generalization of backpropagation with application to a recurrent...
report). Cambridge University, Engineering Department. CUED/F-INFENG/TR.1. Werbos, Paul J. (1988). "Generalization of backpropagation with application to a recurrent...
Regicide". Archived from the original on 2011-09-27. Retrieved 2011-07-30. Werbos, Chris; Latham, Andrew (6 April 2020). "The Medieval Foundations of the...
Global Information