Movatterモバイル変換


[0]ホーム

URL:


Jump to content
WikipediaThe Free Encyclopedia
Search

Ronald J. Williams

From Wikipedia, the free encyclopedia
American computer scientist
Ronald J. Williams
Born
Ronald James Williams

1945 (1945)
DiedFebruary 16, 2024(2024-02-16) (aged 78–79)
Other namesRon J. Williams
Known forBackpropagation
Teacher forcing
Policy gradient method
Academic background
EducationCalifornia Institute of Technology
UCSD
Doctoral advisorDonald Werner Anderson
Other advisorDavid Rumelhart
Academic work
InstitutionsUCSD
Northeastern University

Ronald James Williams (1945 – February 16, 2024)[1] was an American mathematician andcomputer scientist who spent the majority of his career atNortheastern University. He is considered one of the pioneers ofneural networks. In 1986, he co-authored the seminal paper inNature on thebackpropagation algorithm along withDavid Rumelhart andGeoffrey Hinton, which triggered a boom in neural network research.[2]

Education and career

[edit]

Williams was born inSouthern California. He studied atCalifornia Institute of Technology as a undergraduate student and received a B.S. in mathematics there in 1966. He received his M.A. and Ph.D. in mathematics, both atUniversity of California, San Diego (UCSD) in 1972 and 1975, respectively. His Ph.D. thesis was supervised by Donald Werner Anderson. He worked for a defense contractor for some time after graduation. From 1983 to 1986, Williams was a member of theParallel Distributed Processing research group headed byDavid Rumelhart at the Institute for Cognitive Science at UCSD.[3] In 1986, Williams accepted a professorship in computer science atNortheastern University inBoston, where he remained afterwards.[1]

In addition to the backpropagation paper, Williams made fundamental contributions to the fields ofrecurrent neural networks, where he, along with David Zipser, invented theteacher forcing algorithm[4] and made important contributions tobackpropagation through time.[5] Inreinforcement learning, Williams introduced the REINFORCE algorithm in 1992,[6][7] which became the firstpolicy gradient method.

Besides his works on neural networks, Williams, together with Wenxu Tong andMary Jo Ondrechen, developed Partial Order Optimum Likelihood (POOL), a machine learning method used in the prediction of active amino acids in protein structures. POOL is a maximum likelihood method with a monotonicity constraint and is a general predictor of properties that depend monotonically on the input features.[8]

References

[edit]
  1. ^abDonaghy, Roger (2024-03-05)."A tribute to Ron Williams, Khoury professor and machine learning pioneer".Khoury College of Computer Sciences. Retrieved2024-06-25.
  2. ^David E. Rumelhart, Geoffrey E. Hinton und Ronald J. Williams. Learning representations by back-propagating errors., Nature (London) 323, S. 533–536
  3. ^"Reinforcement learning is direct adaptive optimal control".IEEE Control Systems.12 (2):19–22. 1992.doi:10.1109/37.126844.ISSN 1066-033X.
  4. ^Williams, Ronald J.; Zipser, David (1989)."A Learning Algorithm for Continually Running Fully Recurrent Neural Networks".Neural Computation.1 (2):270–280.doi:10.1162/neco.1989.1.2.270.ISSN 0899-7667.
  5. ^R. J. Williams and D. Zipser. Gradient-based learning algorithms for recurrent networks and their computational complexity. In Back-propagation: Theory, Architectures and Applications. Hillsdale, NJ: Erlbaum, 1994.
  6. ^Williams, R. J. (1992). Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8, 229–256.
  7. ^"REINFORCE Algorithms".www.cs.cmu.edu. Retrieved2025-10-12.
  8. ^W. Tong, Y. Wei, L.F. Murga, M.J. Ondrechen, and R.J. Williams (2009). Partial Order Optimum Likelihood (POOL): Maximum Likelihood Prediction of Active Site Residues Using 3D Structure and Sequence Properties. PLoS Computational Biology, 5(1): e1000266.

External links

[edit]
International
Academics
Retrieved from "https://en.wikipedia.org/w/index.php?title=Ronald_J._Williams&oldid=1322841489"
Categories:
Hidden categories:

[8]ページ先頭

©2009-2025 Movatter.jp