Sung-Bae Cho (1994) Exploiting Modularity in Neural Networks
. Psycoloquy: 5(61) Categorization (12)
Versions: ASCII formatted
Psycoloquy 5(61): Exploiting Modularity in Neural Networks
EXPLOITING MODULARITY IN NEURAL NETWORKS
Book Review of Murre on Categorization
Sung-Bae Cho
ATR Human Information Processing Research Laboratories
2-2 Hikaridai, Seika-cho, Soraku-gun,
Kyoto 619-02, Japan
and
KAIST Center for Artificial Intelligence Research
373-1 Koosung-dong, Yoosung-ku,
Taejeon 305-701, Korea
sbcho@hip.atr.co.jp
sbcho@gorai.kaist.ac.kr
Abstract
In his intriguing book, Jacob Murre (1992) presents a
brilliant work on modular neural networks for learning and
categorization. Beyond simply proposing the model, he considers its
hardware implementation issues and some practical applications.
Unfortunately, however, the applications he suggests as practical
turn out to be uncompetitive with state-of-the-art models. In this
review, I demur slightly on two points, scalability and
practicality, and introduce some conventional techniques to overcome
these problems.
Keywords
Neural networks, neurobiology, psychology engineering,
CALM, Categorizing And Learning Module, neurocomputers,
catastrophic interference, genetic algorithms.
References
- Cho, S.-B. & Kim, J.H. (1995) Multiple Network Fusion Using Fuzzy Logic. IEEE Trans. Neural Networks. 6. (In Press).
- de Garis, H. (1994) Project Report: An Artificial Brain (ATR's CAM-Brain Project Aims to Build/Evolve a Artificial Brain with a Million Neural Net Modules Inside a Trillion Cell Cellular Automata Machine). New Generation Computing. 12: 215-221. Ohmsha Ltd, and Springer Verlag.
- Hansen, L.K. & Salamon, P. (1990) Neural Network Ensembles. IEEE Trans. Pattern Analysis and Machine Intelligence. 12: 993-1001.
- Jacobs, R.A., Jordan, M.I., Nowlan S.J. & Hinton, G.E. (1991) Adaptive Mixtures of Local Experts. Neural Computation. 3: 79-87.
- Murre, J.M.J. (1992) Learning and Categorization in Modular Neural Networks. UK: Harvester/Wheatsheaf; US: Erlbaum.
- Murre, J.M.J. (1992) Precis of: Learning and Categorization in Modular Neural Networks. PSYCOLOQUY 3(68) categorization.1.murre.
- Scofield, C., Kenton, L. & Chang, J. (1991) Multiple Neural Net Architectures for Character Recognition. In Proc. Compcon. 487-491. San Francisco, CA, IEEE Computer Society Press.
- Waibel, A. (1988) Connectionist Glue: Modular Design of Neural Speech Systems. In, Proc. 1988 Connectionist Models Summer School. 417-425.
- Wolpert, D. (1992) Stacked Generalization. Neural Networks. 5: 241-259.