Chapter 17 - Neural wiring optimization
Introduction
Neuroconnectivity architecture sometimes shows virtually perfect network optimization, rather than just network satisficing. Long-range connections are a critically constrained resource in the brain, hence, there may be great selective pressure to optimize finely their deployment. The formalism of scarcity of interconnections is network optimization theory, which characterizes efficient use of limited connection resources. The field matured decades ago for microcircuit design, typically to minimize the total length of wire needed to make a given set of connections among components. For layout of neural components, such connection minimization has been reported for the nematode nervous system (Cherniak, 1994a), rat amygdala and olfactory cortex (Cherniak and Rodriguez-Esteban, 2010), cat sensory cortex, and macaque visual cortex (Cherniak et al., 2004). Corresponding arbor optimization also applies for some types of dendrites and axons (Cherniak et al., 1999). Results for more primitive nervous systems help fill in some of the evolutionary trajectory of neural optimization phenomena.
Such optimality contrasts with the familiar picture for biological design, of only moderately good engineering: for example, the first chapter of Descent of Man (Darwin, 1871) enumerated many instances of rudimentary structures in humans that are no longer in use (although the neural examples are in fact functional). Instead, it is almost as if neural connections had an unbounded cost. When this simple “save wire” idea is treated as a generative principle for nervous system organization, it turns out to have some applicability: To an extent, across evolutionary levels, wire-minimization yields brain structure.
A caveat is that, in general, network optimization problems are easy to state, but vastly computationally costly to solve exactly. These connection cost-minimization problems are a major hurdle of microcircuit design and are known to be NP-complete (nondeterministic polynomial time complete), that is, de facto intractable (Garey and Johnson, 1979). Computation costs of solving problems of comparatively small size typically grow exponentially, to cosmic scale: exactly solving some could consume more space and/or time than exists in the known Universe. The archetypal example of an NP-complete problem is Traveling Salesman: For a given set of points on a map, simply find the shortest roundtrip tour.
Section snippets
Neuron arbor optimization
The basic concept of an optimal tree is as follows: Given a set of loci in 3D space, find the minimum-cost tree that interconnects them, for instance, the set of interconnections of least total volume. If branches are allowed to join at points other than the given terminal loci (the “leaves” and “root”), the minimum tree is of the most economical type, a Steiner tree. If the synapse sites and origin of a dendrite or axon are treated in this way, optimization of the dendrite or axon can be
Component placement optimization
Another key problem in microcircuit design is component placement optimization (also characterized as a quadratic assignment problem). Given a set of interconnected components, find the location of the components on a 2D surface that minimizes total cost of connections (e.g., wirelength). A familiar example is siting of computer chips on a motherboard. Again, this concept seems to account for aspects of neuroanatomy at multiple hierarchical levels.
Why the brain is in the head is a one-component
Related optimization results
Some other recently reported instances of biological network optimization provide perspective on the above neural optimization cases. For example, an amoeboid organism, the plasmodium of the slime mold Physarum polycephalum, is capable of solving a maze, that is, not just finding some path across a labyrinth, but a shortest path through it to food sources (Nakagaki et al., 2000). Generating such a minimum-length solution is a network optimization feat for any simple creature. However, it should
Mapping neural optimization
Mechanisms of neural optimization are best understood against the background that the key problems of network optimization theory are NP-complete; hence, exact solutions in general are computationally intractable. For example, blind trial and error exhaustive search for the minimum-wiring layout of a 50-component system (such as all areas of a mammalian cerebral cortex hemisphere), even at a physically unrealistic rate of one layout per picosecond, would still require more than the age of the
References (33)
Neural component placement
Trends in Neurosciences
(1995)- et al.
Shape and efficiency of wood ant foraging networks
Behavioral Ecology and Sociobiology
(2009) - et al.
Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys
The Journal of Comparative Neurology
(1996) - et al.
Wiring optimization can relate neuronal structure and function
Proceedings of the National Academy of Sciences of the United States of America
(2006) Local network optimization in the brain
(1990)Component placement optimization in the brain
(1991)Local optimization of neuron arbors
Biological Cybernetics
(1992)Component placement optimization in the brain
The Journal of Neuroscience
(1994)Philosophy and computational neuroanatomy
Philosophical Studies
(1994)Network optimization in the brain [I, 1991]: From C. elegans to cerebral cortex
(2003)
Network optimization in the brain [II, 2000]: Cerebral cortex layout
Innateness and brain-wiring optimization: Non-genomic nativism
Brain wiring optimization and non-genomic nativism
Large-scale optimization of neuron arbors
Large-scale optimization of neuron arbors
Physical Review E
Optimal-wiring models of neuroanatomy
Cited by (21)
Biomechanical models and mechanisms of cellular morphogenesis and cerebral cortical expansion and folding
2023, Seminars in Cell and Developmental BiologyCitation Excerpt :An important general corollary is that mechanical tension should keep wiring length short and overall neural circuitry compact. Indeed, minimization of wiring length has long been considered an important principle of nervous system architecture [4–8]. The TBM hypothesis has been widely cited, most commonly in relation to the process of cortical folding.
The human connectome from an evolutionary perspective
2019, Progress in Brain ResearchCitation Excerpt :It is thus hypothesized that nervous systems minimize their wiring costs in an effort to minimize expenditure of biological resources (Cherniak, 1994; Perez-Escudero and de Polavieja, 2007). Indeed, the connectomes of C. elegans and the rhesus macaque, among other species, were found to exhibit near-minimal physical wiring cost (Chen et al., 2006; Cherniak, 2012; Ercsey-Ravasz et al., 2013). Furthermore, modeling studies demonstrated that in silico networks wired based on cost minimization rules resemble the modular topology of real brain networks (Chen et al., 2006; Ercsey-Ravasz et al., 2013).
Evolution of the Human Brain: Design Without a Designer
2016, Evolution of Nervous Systems: Second EditionA Predictive Network Model of Cerebral Cortical Connectivity Based on a Distance Rule
2013, NeuronCitation Excerpt :Moreover, the EDR graph model quantitatively captures this behavior observed in the data. In contrast to an earlier study (Kaiser and Hilgetag, 2006) that examined optimal placement using an inconsistent database with a correspondingly low density and weights restricted to one of four possible ranks, we found that the G29x29 network does correspond to an optimized layout, confirming the findings of others (Cherniak, 2012; Klyachko and Stevens, 2003; Raj and Chen, 2011) (see Supplemental Information). This supports numerous studies showing that wire minimization is an important design constraint of the cortex (Cherniak, 1994, 2012; Cherniak et al., 1999, 2004; Chklovskii, 2000; Chklovskii and Koulakov, 2004; Chklovskii et al., 2002; Klyachko and Stevens, 2003; Koulakov and Chklovskii, 2001; Raj and Chen, 2011; Rivera-Alba et al., 2011).
The integrated information theory of consciousness: A case of mistaken identity
2022, Behavioral and Brain Sciences