Risto Miikkulainen (1995) Subsymbolic Processing of Embedded Structures
. Psycoloquy: 6(02) Language Network (11)
Versions: ASCII formatted
Psycoloquy 6(02): Subsymbolic Processing of Embedded Structures
SUBSYMBOLIC PROCESSING OF EMBEDDED STRUCTURES
Reply to Deane on Language-Network
Risto Miikkulainen
Department of Computer Sciences
The University of Texas at Austin
Austin, TX 78712
risto@cs.utexas.edu
Abstract
Deane (1994) points out that the template-matching
approach of DISCERN (Miikkulainen, 1993; 1994a) cannot scale up to
realistic linguistic input without fundamental modifications such
as a stack or a short-term memory. I agree with this observation
and will briefly discuss a more sophisticated parsing model that
employs some of the methods Deane suggests.
Keywords
computational modeling, connectionism, distributed neural
networks, episodic memory, lexicon, natural language processing,
scripts.
References
- Das, S., Giles, C.L. and Sun, G.Z. (1992) Learning Context-free Grammars: Capabilities and Limitations of a Recurrent Neural Network with an External Stack Memory. In Proceedings of the 14th Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum.
- Deane, P. (1994) Narrowing the Gap: Miikkulainen and the Connectionist Modeling of Linguistic Competence. PSYCOLOQUY 5(77) language-network.4.deane.
- Edelman, S. (1994) Biological Constraints and the Representation of Structure in Vision and Language. PSYCOLOQUY 5(57) language-network.3.edelman.
- Elman, J.L. (1990) Finding structure in time. Cognitive Science, 14:179-211.
- Miikkulainen, R. (1993) Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon, and Memory. Cambridge MA: MIT.
- Miikkulainen, R. (1994a) Precis of: Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon and Memory. PSYCOLOQUY 5(46) language-network.1.miikkulainen.
- Miikkulainen, R. (1994b) Representation of Structure on Linguistic Maps. PSYCOLOQUY 5(86) language-network.8.miikkulainen.
- Miikkulainen, R. and Bijwaard, D. (1994) Parsing Embedded Clauses with Distributed Neural Networks. In Proceedings of the 12th National Conference on Artificial Intelligence. San Mateo, CA: Morgan Kaufmann. (an expanded version is available by anonymous ftp from cs.utexas.edu: pub/neural-nets/papers/miikkulainen.subsymbolic-caseroles.ps.Z)
- Pollack, J.B. (1990) Recursive Distributed Representations. Artificial Intelligence 46:77-105.
- Simmons, R.F. and Yu, Y.H. (1990) Training a Neural Network to Be a Context-Sensitive Grammar. Proceedings of the Fifth Rocky Mountain Conference on Artificial Intelligence, Las Cruces, NM, 251-256.