Ablation (artificial intelligence)

From Wikipedia, the free encyclopedia

In artificial intelligence (AI), particularly machine learning (ML), ablation is the removal of a component of an AI system. An ablation study studies the performance of an AI system by removing certain components, to understand the contribution of the component to the overall system. The term is by analogy with biology (removal of components of an organism), and, continuing the analogy, is particularly used in the analysis of artificial neural nets, by analogy with ablative brain surgery.[1] Other analogies include other neuroscience biological systems such as Drosophilla central nervous system, and the vertebrate brain. Ablation studies itself require that the system exhibit graceful degradation: that they continue to function even when certain components are missing or degraded.[2] By some researchers, ablation studies have been deemed a convenient technique in investigating artificial intelligence and its durability to structural damages.[3] Ablation studies damage and or remove certain components in a controlled setting in order to play out all possible outcomes. In doing so observing how each action impacts the systems's overall performance and capabilities. The ablation process can be used to test systems that perform tasks such as speech recognition, visual object recognition, and robot control.[4]

History[]

The term is credited to Allen Newell[5], one of the founders of artificial intelligence, who used it in his 1974 tutorial on speech recognition, published in Newell (1975). The term is by analogy with ablation in biology. The motivation was that, while individual components are engineered, the contribution of an individual component to the overall system performance is not clear; removing components allows this analysis.[2] Newell compared the human brain to artificial computers. With this in thought, Newell saw both as knowledge systems whereas procedures such as ablation can be performed on both to test certain hypotheses.

References[]

  1. ^ Meyes, Richard; Lu, Melanie; de Puiseau, Constantin Waubert; Meisen, Tobias (2019-01-24). "Ablation Studies in Artificial Neural Networks". arXiv:1901.08644. Cite journal requires |journal= (help)
  2. ^ a b Newell 1975.
  3. ^ [1]
  4. ^ "Ablation Studies to Uncover Structure of Learned Representations in Artificial Neural Networks". ProQuest.
  5. ^ Cohen & Howe 1988, p. 40, Ablation and substitution studies..


Retrieved from ""