Information Integration from Distributed Threshold-Based Interactions

Abstract

We consider distributed units that interact by message-passing. Each message carries a tag and causes the receiving unit to send out messages as a function of the tags it has received and a threshold. This simple model abstracts some of the essential characteristics of several artificial intelligence systems and of biological systems epitomized by the brain. We study the integration of information inside a temporal window as the dynamics unfolds. We quantify information integration by the total correlation, relative to the window’s duration, of a set of random variables valued as a function of message arrival. Total correlation refers to the rise of information gain above that which the units achieve individually, being therefore related to some models of consciousness. We report on extensive computational experiments exploring the interrelations of the model’s parameters (two probabilities and the threshold). We find that total correlation can occur at significant fractions of the maximum possible value and reinterpret the model’s parameters in terms of the current best estimates of some quantities pertaining to cortical structure and dynamics. We find the resulting possibilities to be well aligned with the time frames within which percepts are thought to be processed and eventually rendered conscious.