Edited by: Marcus Kaiser, Newcastle University, UK
Reviewed by: Roger Guimera, Northwestern University, USA; Pedro Valdes-Sosa, Cuban Neuroscience Center, Cuba
The idea that complex systems have a hierarchical modular organization originated in the early 1960s and has recently attracted fresh support from quantitative studies of large scale, real-life networks. Here we investigate the hierarchical modular (or “modules-within-modules”) decomposition of human brain functional networks, measured using functional magnetic resonance imaging in 18 healthy volunteers under no-task or resting conditions. We used a customized template to extract networks with more than 1800 regional nodes, and we applied a fast algorithm to identify nested modular structure at several hierarchical levels. We used mutual information, 0 <
Almost 50 years ago, Herbert Simon wrote an essay entitled “The architecture of complexity” (Simon,
Our understanding of complexity has progressed considerably since that time, partly due to the availability of large data-sets that now allow us to explore empirically the architecture of complex systems and thereby to feedback on theoretical considerations (Strogatz,
A quantity called modularity has been introduced in order to measure the decomposability of a network into modules (Guimerà et al.,
There is already strong evidence that brain networks have a modular organization; see Bullmore and Sporns (
In this study, we report on progress towards addressing each of these issues. We applied a recently developed, computationally efficient algorithm (Blondel et al.,
Eighteen right-handed healthy volunteers (15 male, 3 female) were recruited from the GlaxoSmithKline (GSK) Clinical Unit Cambridge, a clinical research facility in Addenbrooke's Hospital, Cambridge, UK. All volunteers (mean age 32.7 years ± 6.9 SD) had a satisfactory medical examination prior to study enrolment and were screened for any other current Axis I psychiatric disorder using the Structured Clinical Interview for the DSM-IV-TR Axis I Disorders (SCID). Participants were also screened for normal radiological appearance of structural MRI scans by a consultant neuroradiologist, and female participants were screened for pregnancy. Urine samples were used to confirm abstinence from illicit drugs and breath was analysed to ensure that no participant was under the influence of acute alcohol intoxication. All volunteers provided written informed consent and received monetary compensation for participation. The study was reviewed and approved by the Cambridge Local Research Ethics Committee (REC06/Q0108/130; PI: TW Robbins).
Whole-brain echoplanar imaging (EPI) data depicting BOLD contrast were acquired at the Wolfson Brain Imaging Centre, University of Cambridge, UK, using a Siemens Magnetom Tim Trio whole body scanner operating at 3 T with a birdcage head transmit/receive coil. Gradient-echo, EPI data were acquired for the whole brain with the following parameters: repetition time = 2000 ms; echo time = 30 ms, flip angle = 78°, slice thickness = 3 mm plus 0.75 mm interslice gap, 32 slices parallel to the inter-commissural (AC-PC) line, image matrix size = 64 × 64, within-plane voxel dimensions = 3.0 mm × 3.0 mm.
Participants were asked to lie quietly in the scanner with eyes closed during the acquisition of 300 images. The first four EPI images were discarded to account for T1 equilibration effects, resulting in a series of 296 images, of which the first 256 images were used to estimate wavelet correlations.
The images were corrected for motion and registered to the standard stereotactic space of the Montreal Neurological Institute EPI template image using an affine transform (Suckling et al.,
The mean time series of each region was extracted and wavelet-filtered using Brainwaver R package
This choice of frequency interval was guided by the fact that prior work on resting-state fMRI functional connectivity has found that the greatest power in connectivity occurs in frequency bands lower than 0.1 Hz (Cordes et al.,
Each association matrix was thresholded to create an adjacency matrix
In recent years, many methods have been proposed to discover the modular organization of complex networks. A key step was taken when Girvan and Newman popularized graph-partitioning problems by introducing the concept of modularity. Modularity is by far the most widespread quantity for measuring the quality of a partition 𝒫 of a network. In its original definition, an unweighted and undirected network that has been partitioned into communities has modularity (Newman and Girvan,
A popular method for discovering the modules of a network consists in optimizing modularity, namely in finding the partition having the largest value of 𝒬. However, it is typically impossible computationally to sample modularity exhaustively by enumerating all the possible partitions of a network into communities. Several heuristic algorithms have therefore been proposed to provide good approximations, and so to allow for the analysis of large networks in reasonable times. The computational expediency of the algorithm has become a crucial factor due to the increasing size of the networks to be analysed.
More recently, methods to study hierarchical modularity, also called nested modularity, have been introduced (Sales-Pardo et al.,
Once a maximally modular partition of the network has been identified, it is possible to assign topological roles to each node based on its density of intra- and inter-modular connections (Guimerà and Amaral,
Intra-modular connectivity is measured by the normalized within-module degree,
Inter-modular connectivity is measured by the participation coefficient,
The two-dimensional space defined by these parameters, the {
The hubness of a node can be defined by its within-module degree: If a given node
The limits for the participation coefficient are different for hubs and non-hubs. For non-hubs, if a given node has value 0 <
These different categories allowed us to classify the nodes according to their topological functions in the network. For example, a provincial hub is a hub with greater intra- vs inter-modular connectivity, thus having a pivotal role in the function realized by its module, whereas a connector hub will play a central role in transferring information from its module to the rest of the network.
The results of modular decomposition were visualized in anatomical space using Caret software for cortical surface mapping
To compare the different modularity partitions obtained at different hierarchical levels in the same subject, or at the same hierarchical level in different subjects, we used the normalized mutual information, as defined in Kuncheva and Hadjitodorov (
The initial application of this quantity was to evaluate different modularity partition algorithms (Danon et al.,
The networks constructed for each individual had the same number of nodes
It was possible to define a hierarchical modular decomposition for each of the 18 subjects in the sample. At the highest hierarchical level, the mean brain functional network modularity for the group was 0.604, with SD = 0.097. By comparison, modularity at the highest level for 18 random networks with an equivalent number of nodes (1808) and edges (8000) was 0.303 (SD = 0.003). There was a significant increase in brain network modularity compared to random network modularity (Kolmogorov–Smirnov test,
The similarity of network community structure between each pair of subjects, at each level of the hierarchy, was calculated using Eq. 4. The resulting similarity matrices for level 3 (the highest level) and level 1 (the lowest non-trivial level) are shown in Figure
The average pairwise similarity was 0.57 at level 3 and 0.63 at level 1, indicating a reasonable degree of consistency between subjects in modular organization of functional networks. The similarity between subjects was highly correlated over levels of the modular hierarchy: for example, if a pair of networks had a similar modular partition at the highest level, the sub-modular organization at lower levels was also similar.
Simply by summing the pairwise similarity scores for each row of the similarity matrix, it was possible to identify the individual subject (number 2) that was most similar to all other subjects in the sample, i.e. the most representative subject, and the subject (4) that was least similar to the rest of the sample. In what follows, we will focus attention on the modular decomposition of the most representative subject.
The hierarchical modular decomposition of the most representative subject's brain functional network is shown in Figure
| Module description | # Nodes | Connector nodes | Provincial hubs | Connector hubs | Sub-modules | Size of sub-modules |
|---|---|---|---|---|---|---|
| Central (sensorimotor) | 239 | 8 | 1 | 4 | 11 | 115, 96, 8, 4, 3 |
| Parieto-frontal (default/attention) | 138 | 10 | 1 | 0 | 10 | 115, 3 |
| Medial occipital (primary visual) | 132 | 3 | 0 | 0 | 1 | 132 |
| Lateral occipital (secondary visual) | 101 | 7 | 0 | 1 | 1 | 101 |
| Fronto-temporal (symbolic) | 89 | 0 | 2 | 3 | 24 | 19, 8, 6, 5 |
Central module (somatosensorimotor): The largest high level module comprised extensive areas of lateral cortex in premotor, precentral and postcentral areas, extending inferiorly to superior temporal gyrus, as well as to premotor and dorsal cingulate cortex medially. At a lower hierarchical level, medial and lateral cortex were segregated in different sub-modules and, within lateral cortex, precentral and postcentral areas were segregated from superior temporal cortex.
Parieto-frontal module (default/attentional): This module comprised medial posterior parietal and posterior cingulate cortex, extending to medial temporal lobe structures inferiorly, and areas of inferior parietal and dorsal prefrontal cortex laterally.
Medial occipital module (primary visual): This module comprised medial occipital cortex and occipital pole, including primary visual areas.
Lateral occipital (secondary visual): This module comprised dorsal and ventral areas of lateral occipital cortex, including secondary visual areas.
Fronto-temporal module (symbolic): This module comprised dorsal and ventral lateral prefrontal cortex, medial prefrontal cortex, and areas of superior temporal cortex. It was less symmetrically organized than most of the other high level modules and was decomposed to a larger number of sub-modules at lower levels.
Note that most high level modules are bilaterally symmetrical, comprise both lateral and medial cortical areas, and tend to be spatially concentrated in an anatomical neighbourhood. Sub-modular decomposition sometimes resulted in a dominant sub-module, comprising most of the nodes in the higher level module, with some much smaller sub-modules each comprising a few peripheral nodes. For example, this was the pattern for the occipital modules. An alternative result was a more even-handed decomposition of a high level module into multiple sub-modules; this was the pattern for the prefronto-temporal module. In Simon's terminology, the number of sub-modules into which a module can be decomposed is its span of control, and so we can describe occipital modules as having a greater span of control than, say, the fronto-temporal module.
On the basis of the highest level (level 3) of modular decomposition, we assigned topological roles to each of the regional nodes. A node was defined as a hub or non-hub (more or less highly connected) with a provincial, connector or kinless role (depending on its balance of intra- vs inter-module connectivity). Provincial hubs will play a key role in intra-modular processing; connector hubs will play a key role in inter-modular processing.
Figure
We can see that most nodes (743, i.e. 95% of the nodes) have either the role of ultra-peripheral nodes or peripheral nodes and a small minority (39, i.e. 5% of the nodes) have the topologically important roles of hubs and/or connector status. Inter-modular connections, and the connector nodes and hubs which mediate them, are most numerous in posterior modules containing regions of association cortex; the fronto-temporal module is sparsely connected to other modules and the medial occipital module also has relatively few connector nodes.
This work is a first attempt to uncover the hierarchical organization of brain functional networks and to compare the stability of hierarchical modular decompositions across individuals. There are, however, three possible weaknesses in our analysis that we would like to address in this section.
A first consideration concerns the choice of the Louvain method (LM) in order to uncover nested modules in the brain networks. LM was first proposed in order to uncover optimal partitions of a graph by maximising modularity. This is a greedy method which is known to be very fast and very precise (Blondel et al.,
To do so, we have tested LM on a benchmark network with known hierarchical structure (Sales-Pardo et al.,
On the same benchmark network, the algorithm typically finds two levels (one corresponding to 64 modules and one corresponding to 16 modules) but it may occasionally find three levels (one level corresponding to 64 modules and two levels similar to the partition into 16 modules). When σ = 1.0, for instance, over 100 realizations of the graph, the algorithm finds two levels on 86 realizations, and three levels on 14 realizations. This result is encouraging as it suggests that the algorithm only produces significant partitions. However, it is possible to find situations where it is not the case, e.g. random graphs. It is therefore still necessary to verify the significance of intermediate partitions, as we will discuss below.
A second consideration concerns the comparison of the partition of the original network with randomized data, as the algorithm also gives a hierarchical decomposition for randomly generated networks. To show that the representative brain network under study (subject ID 2) displays a non-random hierarchical modular structure, we have randomized the original data and processed the hierarchical structure of randomized networks, with two kind of randomization. First, by computing 100 randomizations of the time points in the original time-series (in green on Figure
In order to show that the intermediate levels considered in this paper are significant, we have followed the argument that significant partitions should be robust, in the sense that they should only be weakly altered by a modification of the optimization algorithm. As argued by Ronhovde and Nussinov (
A third consideration concerns the number
In this study, we have applied recently developed tools for characterizing the hierarchical, modular structure of complex systems to functional brain networks generated from human fMRI data recorded under no-task or resting state conditions. Where previous comparable work was limited by the computational expense of available modularity algorithms, meaning that only one or a few relatively low resolution networks (comprising 10 s of nodes) could be analysed, here we were able to obtain modular decompositions on a larger number of higher resolution networks (each comprising 1000s of nodes). In addition, we used an information-based measure to quantify the similarity of community structure between two different networks and so to find a principled way of focusing attention on a single network that is representative of the group.
There was clear evidence for hierarchical modularity in these data and the community structure of the networks at all levels of the hierarchy was reasonably similar across subjects (
Another plausible aspect of the results was the clear evidence for a symmetrical posterior-to-anterior progression of cortical modules. This was seen most clearly on the medial surfaces of the cerebral hemispheres in terms of their division into medial occipital, parieto-frontal and central modules. A posterior-to-anterior organization of cortical modules in adult brain functional networks is arguably compatible with the abundant evidence from neurodevelopmental studies which have shown rostro-caudal modularity of the spinal cord, brain stem, hind brain and diencephalon defined by segmented patterns of gene expression (Redies and Puelles,
One important potential benefit of a modular analysis of complex networks is that it allows us to be more precise about the topological role of any particular node in the network. For example, rather than simply saying that a particular region has a high degree we may be able to say that it has a disproportionately important role in transfer of information between modules, rather than within a module. In these data, the location of connector nodes and hubs with a prominent role in inter-modular communication was concentrated in posterior areas of association cortex. The fronto-temporal module, on the other hand, was rather sparsely connected to other modules. One possible explanation for these anatomical differences in inter-modular communication may relate to the stationarity of functional connectivity between brain regions. Our measure of association between brain regions (the wavelet correlation corresponding to a frequency interval of 0.03–0.06 Hz) provides an estimate of functional connectivity “on average” over the entire period of observation (8 min 35 s). If there is significant variability over time in the strength of functional connections between modules this may be manifest in terms of reduced connectivity on average over a prolonged period. Thus one possible explanation for the sparser inter-modular connections of the fronto-temporal module is that the interactions of this system with the rest of the brain network may be more non-stationary or labile over time. This interpretation could be tested by future studies using time-varying measures of functional connectivity, such as phase synchronization (Kitzbichler et al.,
One of the challenges in analysis of network community structure is the richness of the results (every node will have a modular assignment and a topological role) and the difficulties attendant on properly managing inter-individual variability in such novel metrics. In previous work, we estimated a functional connectivity matrix for each subject, then thresholded the group mean association, and explored the community structure of the group mean network. This allows us to focus attention on a single network but it neglects between-subject variability and, like any use of the mean in small samples, it is potentially biased by one or more outlying values for the functional connectivity. Here we have explored an alternative approach, using an information-based measure of similarity to quantify between subject differences in network organization and to identify the most representative subject in the sample. One can imagine that this measure could be combined with resampling based approaches to statistical inference in order to estimate, for example, the probability that the community structure identified in a single patient is significantly dissimilar to a reference group of brain networks in normal volunteers. However, it fair to say that there are a number of technical challenges to be addressed in using modularity measures for statistical comparisons between different groups.
As this is the first study to attempt a hierarchical modular decomposition of human brain functional networks, there is little guidance in the existing literature as to what the correct structure of the network should resemble. Our results are encouraging in that they have been able to identify well defined neuroanatomical systems, but they remain empirical and require further validation in appropriate animal models. However, our analysis of simulated data (Section
In Simon's theoretical analysis, near-decomposability was considered to be a ubiquitous property of complex systems because it conferred advantages of adaptive speed in response to evolutionary selection pressures as well as shorter-term developmental or environmental contingencies. In relation to the modularity of human brain systems, this view prompts a number of questions. Perhaps the most immediately addressable, at least by functional neuroimaging, is the question of how the modularity of brain network organization relates to cognitive performance and the capacity to shift attention rapidly between different stimuli or tasks. According to Simon's theory, this key aspect of the brain's cognitive function should depend critically on modular or sub-modular components and the rapid reconfiguration of inter-modular connections between them. Future studies, applying graph theoretical techniques to modularity analysis of fMRI data recorded during task performance (rather than in no-task state) may be important in testing this prediction.
We have described graph theoretical tools for analysis of hierarchical modularity in human brain functional networks derived from fMRI. Our main claims are that these techniques are computationally feasible and generate plausible and reasonably consistent descriptions of the brain functional network community structure in a group of normal volunteers. The potential importance theoretically of this analysis has been highlighted by reference to Simon's seminal theory of hierarchy and decomposability in the design of information processing systems.
Edward Bullmore is employed half-time by GlaxoSmithKline and half-time by University of Cambridge.
This research was supported by a Human Brain Project grant from the National Institute of Mental Health and the National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD, USA. Renaud Lambiotte was supported by UK EPSRC. Alex Fornito was supported by a National Health and Medical Research Council CJ Martin Fellowship (ID: 454797). Karen D. Ersche is a recipient of the Betty Behrens Research Fellowship at Clare Hall, University of Cambridge. The experiment was sponsored by GlaxoSmithKline and conducted at the GSK Clinical Unit Cambridge.
1
2
3