It is argued that Harnad's (2001) proposed solution to the symbol grounding problem falls short of the mark because it does not address the issues of HOW sensory invariants are embodied as symbols and, subsequently, how those symbols cause change. There is no guarantee that, as the outputs of neural nets, such symbols are not arbitrary encodings, which means the physical characteristics of sensory inputs preserved by Harnad's analog processes would be lost, having no effect on system behavior when the symbols are processed. Even if they are embodied by the symbols, processing on digital computers would mask their effects as those characteristics.
REPRINT OF: Boyle, F.C. (1993). Transduction and degree of grounding. Think 2: 12-78 (Special Issue on "Connectionism versus Symbolism" D.M.W. Powers & P.A. Flach, eds.). http://cwis.kub.nl/~fdl/research/ti/docs/think/2-1/index.stm
1. Although I agree in general with Harnad's (2001) symbol grounding proposal, I do not believe 'transduction' (or 'analog process') per se is useful in distinguishing between what might best be described as different 'degrees' of grounding and, hence, for determining whether a particular system might be capable of cognition. By `degrees of grounding' I mean whether the effects of grounding go 'all the way through' or not. Why is transduction limited in this regard? Because transduction is a physical process which does not speak to the issue of representation, and, therefore, does not explain how the informational aspects of signals impinging on sensory surfaces become embodied as symbols or how those symbols subsequently cause behavior, both of which, I believe, are important to grounding and to a system's cognitive capacity. Immunity to Searle's Chinese Room (CR) argument does not ensure that a particular system is cognitive, and whether or not a particular degree of groundedness enables a system to pass the Total Turing Test (TTT) may never be determined.
2. It is clear that transduction is necessary to realize robotic capacity and for grounding, as Harnad emphasises. But how would the symbols in Harnad's "hybrid analog/symbolic robot" be any less arbitrary than symbols as bitmaps of the objects and categories to which they refer -- perhaps projected onto a digital medium (e.g., a laser disk) through a camera -- in a 'core' symbol manipulation system? Though Harnad would most likely consider this arrangement of computer and camera a "computational core-in-a-vat" (para. 24) system, digitizing the camera's analog input is certainly an example of "processing analog sensory input" (para. 7). Thus, not only would such a system be immune to Searle's CR argument, but bitmaps are nonarbitrary in relation to what they are bitmaps of, especially if they are produced directly from analog images. Could such a system pass the TTT? With efferent decoders and transducers, there is no a priori reason to suppose it cannot; that is, no reason to assume that its symbols would not "cohere systematically with its robotic transactions with the objects, events and states of affairs that its symbols are interpretable as being about" (para. 25). Yet, intuitively, such a system could hardly be said to lay claim to mentality any more than the CR system. And based on transduction alone, neither could Harnad's robot, because transduction does not distinguish the degree to which symbols in his system and the computer-plus-camera are grounded.
3. What would determine the degree of grounding is how symbols are causal. For example, even though the computer-plus-camera system is grounded, and the CR is not, these two systems are physically similar with respect to how their symbols cause change. In other words, the symbols in the computer-plus-camera system are not grounded 'all the way through'; once these 'bitmap symbols' are input to the computer via the camera, the two systems become identical insofar as the forms of the symbols in both are arbitrary with respect to how they cause change. Why? Because in digital computers, symbols cause change through the physical process of pattern matching (Boyle, 1990; 1991; 1992); like pieces in a puzzle, they 'fit' (match) the left-hand sides (matchers) of rules whose right-hand side actions are subsequently triggered, so that as long as there is a fit and the matcher is associated with the appropriate action -- that is, an action which conforms with a systematic interpretation of the symbols -- it does not matter what the symbols look like (e.g. whether they are bitmaps or propositional representations of their referents). Furthermore, it does not matter through what physical processes -- what sorts of encodings or transductions -- the symbols originated. Thus, if Harnad's "symbols and symbolic activity" function through pattern matching, then regardless of how they are connected to the sensory projections of the objects to which they refer (e.g. by connectionist networks, pointers, etc.), his robot would be little more than a computational system with a particular peripheral transduction mechanism, even though he sees the presence of a "second constraint, that of the nonarbitrary `shape'of the sensory invariants that connect the symbol to the analog sensory projection of the object to which it refers" (para. 29) as a significant difference.
4. But how could this 'second constraint' really be a constraint if it does not affect how the symbols cause change (it cannot be a constraint just because a connection exists between analog forms and symbols)? If the symbols effect change through pattern matching (PM), then the nonarbitrary shape of the sensory invariants is superfluous and Harnad's robot would be cognitively equivalent to the computer-plus- camera system. Therefore, the only way for the nonarbitrary shape of the sensory invariants to affect behavior is through a causal mechanism other than PM, one which would presumably ground the system 'all the way through'. Harnad actually alludes to this mechanism when he notes that discrimination could be accomplished by "superimposing analog projections of objects" (para. 26) and that category structures could be generated through "analog reduction" (Harnad 1990). Such processes involve what I call 'structure-preserving superposition' or SPS (Boyle, 1991; 1992), which is fundamentally different than PM. Thus, if Harnad wants to distinguish his robot from so-called computational core-in- a-vat systems, he should consider the category structures themselves as symbols and have them effect change via SPS, which would ground the system 'all the way through'. Obviously, SPS is an analog process, but, more importantly, it is a causal mechanism that enables symbols to be causal according to what they represent in a physically principled way.
Boyle, C.F. (1990) `Informing: the Basis of a Solution to the Mind-Body Problem'. In: Proceedings of the 34th Annual Conference of the International Society for the Systems Sciences, (Portland, OR), 1190--1200.
Boyle, C.F. (1991) `On the Physical Limitations of Pattern Matching'. In: Journal of Experimental and Theoretical Artificial Intelligence, 3 (2):191--218.
Boyle, C.F. (1992) `Projected Meaning, Grounded Meaning and Intrinsic Meaning'. In: Proceedings of the 14th Annual Meeting of the Cognitive Science Society. (New Jersey: Lawrence Erlbaum).
Harnad, S. (1990) `The Symbol Grounding Problem'. Physica D, 335-346. http://cogprints.soton.ac.uk/documents/disk0/00/00/06/15/index.html
Harnad, S. (2001) Grounding symbols in the analog world with neural nets -- A hybrid model. PSYCOLOQUY 12(034) http://www.cogsci.soton.ac.uk/cgi/psyc/newpsy?12.034