VOOZH about

URL: https://link.springer.com/article/10.1007/BF00116250?error=cookies_not_supported&code=4dc4bfb7-5925-4790-90be-b2dee48be4c3

⇱ Explanation-based generalization: A unifying view | Machine Learning | Springer Nature Link


Skip to main content

Explanation-based generalization: A unifying view

  • Published:

Abstract

The problem of formulating general concepts from specific training examples has long been a major focus of machine learning research. While most previous research has focused on empirical methods for generalizing from a large number of training examples using no domain-specific knowledge, in the past few years new methods have been developed for applying domain-specific knowledge to for-mulate valid generalizations from single training examples. The characteristic common to these methods is that their ability to generalize from a single example follows from their ability to explain why the training example is a member of the concept being learned. This paper proposes a general, domain-independent mechanism, called EBG, that unifies previous approaches to explanation-based generalization. The EBG method is illustrated in the context of several example problems, and used to contrast several existing systems for explanation-based generalization. The perspective on explanation-based generalization afforded by this general method is also used to identify open research problems in this area.

Article PDF

Similar content being viewed by others

Discover the latest articles, books and news in related subjects, suggested using machine learning.

References

  • Borgida, A., Mitchell, T. & Williamson, K.E. (1985). Learning improved integrity constraints and schemas from exceptions in data and knowledge bases. In M.L. Brodie & J. Mylopoulos (Eds.), On knowledge base management systems. New York, NY: Springer Verlag.

    Google Scholar 

  • DeJong, G. (1981). Generalizations based on explanations. Proceedings of the Seventh International Joint Conference on Artificial Intelligence (pp. 67–69). Vancouver, B.C., Canada: Morgan Kaufmann.

    Google Scholar 

  • DeJong, G. (1983). Acquiring schemata through understanding and generalizing plans. Proceedings of the Eighth International Joint Conference on Artificial Intelligence (pp. 462–464). Karlsruhe, West Germany: Morgan Kaufmann.

    Google Scholar 

  • DeJong, G. (1985). A brief overview of explanatory schema acquisition. Proceedings of the Third International Machine Learning Workshop. Skytop, PA, June.

  • DeJong, G., & Mooney, R. (in press). Explanation-based learning: An alternative view. Machine learning.

  • Dietterich, T.G., London, B., Clarkson, K., & Dromey, G. (1982). Learning and Inductive Inference. In P.R. Cohen, & E.A. Feigenbaum (Eds.), The handbook of artificial intelligence. Los Altos, CA: William Kaufmann, Inc.

    Google Scholar 

  • Dijkstra, E.W. (1976). A discipline of programming. Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Ellman, T. (1985). Explanation-based learning in logic circuit design. Proceedings of the Third International Machine Learning Workshop. Skytop, PA, June.

  • Fikes, R., Hart, P., & Nilsson, N.J. (1972). Learning and executing generalized robot plans. Artificial intelligence, 3, 251–288. Also in B.L. Webber & N.J. Nilsson (Eds.), Readings in artificial intelligence.

    Google Scholar 

  • Kedar-Cabelli, S.T. (1984). Analogy with purpose in legal reasoning from precedents. (Technical Report LRP-TR-17). Laboratory for Computer Science Research, Rutgers University, New Brunswick, NJ.

    Google Scholar 

  • Kedar-Cabelli, S.T. (1985). Purpose-directed analogy. Proceedings of the Cognitive Science Society Conference. Irvine, CA: Morgan Kaufmann.

    Google Scholar 

  • Keller, R.M. (1983). Learning by re-expressing concepts for efficient recognition. Proceedings of the National Conference on Artificial Intelligence (pp 182–186). Washington, D.C.: Morgan Kaufmann.

    Google Scholar 

  • Keller, R.M. (1985). Development of a framework for contextual concept learning. Proceedings of the Third International Machine Learning Workshop. Skytop, PA, June.

  • Keller, R.M. (1986). Contextual learning: A performance-based model of concept acquisition. Unpublished doctoral dissertation, Rutgers University.

  • Kibler, D., & Porter, B. (1985). A comparison of analytic and experimental goal regression for machine learning. Proceedings of the Ninth International Joint Conference on Artificial Intelligence. Los Angeles, CA: Morgan Kaufmann.

    Google Scholar 

  • Laird, J.E., Rosenbloom, P.S., Newell, A. (1984). Toward chunking as a general learning mechanism. (pp 188–192). Proceedings of the National Conference on Artificial Intelligence. Austin, TX: Morgan Kaufmann.

    Google Scholar 

  • Laird, J.E., Rosenbloom, P.S., & Newell, A. (1986). SOAR: The architecture of a general learning mechanism. Machine learning, 1, 11–46.

    Google Scholar 

  • Lebowitz, M. (1985). Concept learning in a rich input domain: Generalization-based memory. In R.S. Michalski, J.G. Carbonell & T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach, Vol. 2. Los Altos, CA: Morgan Kaufmann.

    Google Scholar 

  • Mahadevan, S. (1985). Verification-based learning: A generalization strategy for inferring problemdecomposition methods. Proceedings of the Ninth International Joint Conference on Artificial Intelligence. Los Angeles, CA: Morgan Kaufmann.

    Google Scholar 

  • Michalski, R.S. (1983). A theory and methodology of inductive learning. Artificial intelligence, 20, 111–161. Also in R.S. Michalski, J.G. Carbonell & T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach.

    Article  Google Scholar 

  • Minton, S. (1984). Constraint-based generalization: Learning game-playing plans from single examples. (pp 251–254). Proceedings of the National Conference on Artificial Intelligence. Austin, TX: Morgan Kaufmann.

    Google Scholar 

  • Mitchell, T.M. (1978). Version spaces: An approach to concept learning. PhD thesis, Department of Electrical Engineering, Stanford University. Also Stanford CS reports STAN-CS-78-711, HPP-79-2.

  • Mitchell, T.M. (1980). The need for biases in learning generalizations (Technical Report CBM-TR-117). Rutgers University, New Brunswick, NJ.

    Google Scholar 

  • Mitchell, T.M. (1982). Generalization as search. Artificial intelligence, March, 18(2), 203–226.

    Google Scholar 

  • Nitchell, T.M. (1983). Learning and Problem Solving. Proceedings of the Eighth International Joint Conference on Artificial Intelligence (pp 1139–1151). Karlsruhe, West Germany: Morgan Kaufmann.

    Google Scholar 

  • Mitchell, T.M. (1984). Toward combining empirical and analytic methods for learning heuristics. In A. Elithorn & R. Banerji (Eds.), Human and artificial intelligence. Amsterdam: North-Holland Publishing Co. Also Rutgers Computer Science Department Technical Report LCSR-TR-27, 1981.

    Google Scholar 

  • Mitchell, T.M., Utgoff, P.E., & Banerji, R.B. (1983). Learning by experimentation: Acquiring and refining problem-solving heuristics. In R.S. Michalski, J.G. Carbonell & T.M. Mitchell (Eds.), Machine learning. Palo Alto, CA: Tioga.

    Google Scholar 

  • Mitchell, T.M., Mahadevan, S., & Steinberg, L. (1985). LEAP: A learning apprentice for VLSI design. Proceedings of the Ninth International Joint Conference on Artificial Intelligence (pp. 573–580). Los Angeles, CA: Morgan Kaufmann.

    Google Scholar 

  • Mooney, R. (1985). Generalizing explanations of narratives into schemata. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Mostow, D.J. (1981). Mechanical transformation of task heuristics into operational procedures. PhD thesis, Department of Computer Science, Carnegie-Mellon University, Pittsburgh, PA.

  • Mostow, D.J. (1983). Machine transformation of advice into a heuristic search procedure. In R.S. Michalski, J.G. Carbonell, & T.M. Mitchell (Eds.), Machine learning. Palo Alto, CA: Tioga.

    Google Scholar 

  • Nilsson, N.J. (1980). Principles of artificial intelligence. Palo Alto, CA: Tioga.

    Google Scholar 

  • O’Rorke, P. (1984). Generalization for explanation-based schema acquisition. Proceedings of the National Conference on Artificial Intelligence (pp 260–263). Austin, TX: Morgan Kaufmann.

    Google Scholar 

  • O’Rorke, P. (1985). Recent progress on the ‘mathematician’s apprentice’ project. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Quinlan, J.R. (1985). The effect of noise on concept learning. In R.S. Michalski, J.G. Carbonell & T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach, Vol. 2. Los Altos, CA: Morgan Kaufmann. Modified, also in Proceedings of the Second International Machine Learning Workshop.

    Google Scholar 

  • Rajamoney, S. (1985). Conceptual knowledge acquisition through directed experimentation. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Salzberg, S., & Atkinson, D.J. (1984). Learning by building causal explanations. Proceedings of the Sixth European Conference on Artificial Intelligence (pp 497–500). Pisa, Italy.

  • Schank, R.C. (1982). Looking at learning. Proceedings of the Fifth European Conference on Artificial Intelligence (pp 11–18). Paris, France.

  • Schooley, P. (1985). Learning state evaluation functions. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Segre, A.M. (1985). Explanation-based manipulator learning. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Shavlik, J.W. (1985). Learning classical physics. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Sims, M. (1985). An investigation of the nature of mathematical discovery. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Silver, B. (1983). Learning equation solving methods from worked examples. Proceedings of the Second International Machine Learning Workshop (pp. 99–104). Urbana, IL.

  • Soloway, E.M. (1978). Learning = interpretation + generalization: A case study in knowledge-directed learning. PhD thesis, Department of Computer and Information Science, University of Massachusetts, Amherst. Computer and Information Science Report COINS TR-78-13.

  • Tadepalli, P.V. (1985). Learning in intractable domains. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Utgoff, P.E. (1983). Adjusting bias in concept learning. Proceedings of the Eighth International Conference of Artificial Intelligence (pp. 447–449). Karlsruhe, West Germany: Morgan Kaufmann.

    Google Scholar 

  • Utgoff, P.E. (1984). Shift of bias for inductive concept learning. PhD thesis, Department of Computer Science, Rutgers University, New Brunswick, NJ.

  • Utgoff, P.E. (1985). Shift of bias for inductive concept learning. In R.S. Michalski, J.G. Carbonell & T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach, Vol. 2. Los Altos, CA: Morgan Kaufmann. Modified, also in Proceedings of the Second International Machine Learning Workshop.

    Google Scholar 

  • Waldinger, R. (1977). Achieving several goals simultaneously. In E. Elcock & D. Michie, D. (Eds.), Machine intelligence 8, London: Ellis Horwood, Limited. Also in B.L. Webber & N.J. Nilsson (Eds.), Readings in artificial intelligence.

    Google Scholar 

  • Watanabe, M. (1985). Learning implementation rules in operating-conditions depending on states in VLSI design. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Williamson, K. (1985). Learning from exceptions to constraints in databases. Proceedings of the Third International Machine Learning Workshop. Skytop, PA.

  • Winston, P.H. (1985). Learning by augmenting rules and accumulating censors. In R.S. Michalski, J.G. Carbonell & T.M. Mitchell (Eds.), Machine learning: An artificial intelligence approach, Vol. 2. Los Altos, CA: Morgan Kaufmann.

    Google Scholar 

  • Winston, P.H. Binford, T.O., Katz, B., & Lowry, M. (1983). Learning physical descriptions from functional definitions, examples, and precedents. National Conference on Artificial Intelligence (pp. 433–439). Washington, D.C.: Morgan Kaufmann.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Rutgers University, 08903, New Brunswick, NJ, U.S.A.

    Tom M. Mitchell, Richard M. Keller & Smadar T. Kedar-Cabelli

Authors
  1. Tom M. Mitchell
  2. Richard M. Keller
  3. Smadar T. Kedar-Cabelli

About this article

Cite this article

Mitchell, T.M., Keller, R.M. & Kedar-Cabelli, S.T. Explanation-based generalization: A unifying view. Mach Learn 1, 47–80 (1986). https://doi.org/10.1007/BF00116250

Download citation

  • Received:

  • Issue date:

  • DOI: https://doi.org/10.1007/BF00116250

Key words