Before i discuss the role of information theory in cognitive control, i will. Although shannons information theory is alive and well in a number of. Semantic scholar profile for fred attneave, with 208 highly influential citations and 19 scientific research papers. Information theory an overview sciencedirect topics. Psychology, which almost immediately became defunct. Anyone who seeks to apply information theory in the fields of education and psychology very soon comes up against a central diffi culty. Early applications of information theory to music eecs web. The concept of information, as used in this thesis, is a refinement of the everyday usage of the term. Whatever happened to information theory in psychology. These relationships are derived in shannon and weaver 1949 and attneave 1959. For example, as attneave 1959 has attested, brickers usage. Shannons information theory as a general tool for performance. Role of the human anterior cingulate cortex in the control of oculomotor, manual. A new way of linking information theory with cognitive science.
Indeed the diversity and directions of their perspectives and interests shaped the direction of information theory. Information theory, in the technical sense, as it is used today goes back to the work of claude shannon and was introduced as a means to study and solve problems of communication or transmission of signals over channels. What he probably objected to is the need for perceptual inference, because, he maintained, under normal conditions there is. It was the result of crucial contributions made by many distinct individuals, from a variety of backgrounds, who took his ideas and expanded upon them. Because its significance and flexibility were quickly recognized, there were numerous attempts to apply it. Redundancy in information, theory is conventionally defined as one minus the relative entropy.
Finally, information theory asserts that generic cognitive abilities enhance the. Duncan luce university of california, irvine although shannons information theory is alive and well in a number of. Infor mation can be thought of as that which removes or reduces. Information theory and kinship mcmaster university. This work inspired a wave of interest throughout the 1950s in applying informationtheoretic models to a number of. Information theory has been used to study both perceptual phenomena attneave. The theorems of information theory are so important that they deserve to be regarded as the laws of information 2, 3, 4. Joint entropy in a triple helix system using the logical operator or. An information theory analysis of visual complexity and. Neural information flowhow much information moves through the nervous system, and the constraints that information theory imposes on the capabilities of neural systems for communication, computation and behavior. Pearce centre for cognition, computation and culture, goldsmiths college, university of london, new cross, london se14 6nw m.
Shannons information theory, since its first introduction in 1948, has received much attention and. An information theory account of cognitive control ncbi nih. Fred attneave s book on information theory and psychology is a sober and careful overview of the various ways in which information theory h. This book is to be seen as a contribution towards bridging the gap. I extend the postulates about information, complexity, and dissimilarity to include complexity and information measures based on.
Information theory started and, according to some, ended with shannons seminal paper a mathematical theory of communication shannon 1948. Early applications of information theory to music marcus t. A second set of manuscripts, by attneave 1954 and barlow 1961, discussed information as. Information theory also predicts that the effects of arts socialization will be strongest for art practices for which more artistic competence is a prerequisite, hence, the more complex disciplines.
An introduction to information theory and applications. Information theory was not just a product of the work of claude shannon. Information theory and cybernetics have developed along somewhat different lines in europe and in the u. An information theory analysis of visual complexity and dissimilarity perception, 2006, volume 35.
Pdf on jan 1, 2012, lance nizami and others published confusing the confusion matrix. Download pdf informationstheorie free online new books. Chapter 7 information theory and sensory perception. Information theory and sensory perception 207 without the intervention of an intellectual process. By intellectual process, he almost certainly did not mean what we might now call a computational process.
1310 253 381 972 1507 898 511 962 133 861 975 1102 224 832 953 1656 1137 1417 566 1670 1342 352 1334 1249 1561 1648 1616 160 906 1681 785 1371 993 1347 1202 267 1448 1274 1008 333