Risto Miikkulainen (1994) Representation of Structure on Linguistic Maps
. Psycoloquy: 5(86) Language Network (8)
Versions: ASCII formatted
Psycoloquy 5(86): Representation of Structure on Linguistic Maps
REPRESENTATION OF STRUCTURE ON LINGUISTIC MAPS
Reply to Edelman on Language-Network
Risto Miikkulainen
Department of Computer Sciences
The University of Texas at Austin
Austin, TX 78712
risto@cs.utexas.edu
Abstract
In his review of Subsymbolic Natural Language Processing
(Miikkulainen, 1993, 1994), Edelman (1994) makes several useful
analogies between language processing and vision. His main
argument is that approaches based on common information processing
principles in the brain, such as maps and receptive fields, are
more likely to lead to insights into human cognition. I very much
agree with this idea, and discuss a few concrete ways in which
language processing models can benefit from principles in use in
current visual processing models.
Keywords
computational modeling, connectionism, distributed neural
networks, episodic memory, lexicon, natural language processing,
scripts.
References
- Caramazza, A. and Zurif, E.B. (1976). Dissociation of Algorithmic and Heuristic Processes in Language Comprehension: Evidence from Aphasia. Brain and Language, 3:572--582.
- Edelman, S. (1994). Biological Constraints and the Representation of Structure in Vision and Language. PSYCOLOQUY 5(57) language-network.3.edelman.
- Huang, M.S. (1983). A Developmental Study of Children's Comprehension of Embedded Sentences with and without Semantic Constraints. Journal of Psychology, 114:51-56.
- Marshall, J.A. (1990). Self-Organizing Neural Networks for Perception of Visual Motion. Neural Networks, 3:45-74.
- Miikkulainen, R. (1993). Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon, and Memory. Cambridge MA: MIT.
- Miikkulainen, R. (1994). Precis of: Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon and Memory. PSYCOLOQUY 5(46) language-network.1.miikkulainen.
- Miikkulainen, R. and Bijwaard, D. (1994). Parsing Embedded Clauses with Distributed Neural Networks. In Proceedings of the 12th National Conference on Artificial Intelligence, 858-864. San Mateo, CA: Morgan Kaufmann. (expanded version available by anonymous ftp from cs.utexas.edu: pub/neural-nets/papers/miikkulainen.subsymbolic-caseroles.ps.Z)
- Pollack, J.B. (1990). Recursive Distributed Representations. Artificial Intelligence 46:77-105.
- Sirosh, J. and Miikkulainen, R. (1994). Cooperative Self-Organization of Afferent and Lateral Connections in Cortical Maps. Biological Cybernetics, 71:65-78. (ftp: cs.utexas.edu:pub/neural-nets/papers/ sirosh.cooperative-selforganization.tar)
- Stolz, W.S. (1967). A study of the Ability to Decode Grammatically Novel Sentences. Journal of Verbal Learning and Verbal Behavior, 6:867-973.