## New Research In

### Physical Sciences

### Social Sciences

#### Featured Portals

#### Articles by Topic

### Biological Sciences

#### Featured Portals

#### Articles by Topic

- Agricultural Sciences
- Anthropology
- Applied Biological Sciences
- Biochemistry
- Biophysics and Computational Biology
- Cell Biology
- Developmental Biology
- Ecology
- Environmental Sciences
- Evolution
- Genetics
- Immunology and Inflammation
- Medical Sciences
- Microbiology
- Neuroscience
- Pharmacology
- Physiology
- Plant Biology
- Population Biology
- Psychological and Cognitive Sciences
- Sustainability Science
- Systems Biology

# Universal transition from unstructured to structured neural maps

Edited by Terrence J. Sejnowski, Salk Institute for Biological Studies, La Jolla, CA, and approved April 5, 2017 (received for review September 28, 2016)

## Significance

To save wiring, neurons in the brain that are connected to one another should be located in close vicinity. We use computational models based on multidimensional scaling to explore the implications of this simple premise regarding the organization of the visual cortex. Assuming only that neurons with similar orientation preference are more strongly connected, we predict the emergence of characteristic pinwheels where preferred orientations organize in a continuous circular manner. We find that a universal transition exists between completely unstructured and such structured neural maps when increasing neuron numbers even without changing the selectivity of the connections. Our results are a simple explanation for the existence of salt-and-pepper arrangements in rodents and pinwheel arrangements in cat visual cortex.

## Abstract

Neurons sharing similar features are often selectively connected with a higher probability and should be located in close vicinity to save wiring. Selective connectivity has, therefore, been proposed to be the cause for spatial organization in cortical maps. Interestingly, orientation preference (OP) maps in the visual cortex are found in carnivores, ungulates, and primates but are not found in rodents, indicating fundamental differences in selective connectivity that seem unexpected for closely related species. Here, we investigate this finding by using multidimensional scaling to predict the locations of neurons based on minimizing wiring costs for any given connectivity. Our model shows a transition from an unstructured salt-and-pepper organization to a pinwheel arrangement when increasing the number of neurons, even without changing the selectivity of the connections. Increasing neuronal numbers also leads to the emergence of layers, retinotopy, or ocular dominance columns for the selective connectivity corresponding to each arrangement. We further show that neuron numbers impact overall interconnectivity as the primary reason for the appearance of neural maps, which we link to a known phase transition in an Ising-like model from statistical mechanics. Finally, we curated biological data from the literature to show that neural maps appear as the number of neurons in visual cortex increases over a wide range of mammalian species. Our results provide a simple explanation for the existence of salt-and-pepper arrangements in rodents and pinwheel arrangements in the visual cortex of primates, carnivores, and ungulates without assuming differences in the general visual cortex architecture and connectivity.

Models assuming short cables and fast signal propagation in the circuit predict the precise placement of neurons and brain areas (1⇓⇓–4), the existence of topographic maps (5), and the existence of ocular dominance (OD) columns and orientation preference (OP) maps in the visual cortex (6, 7). The latter examples have become model systems to study structured neural maps because of the combination of striking striped patterns of OD and the intricate arrangement of OPs in a radial symmetry around pinwheel-like structures (8⇓⇓–11). A number of modeling approaches have been shown to predict different map properties and their possible biological origin (12⇓⇓–15). Examples are the link between the shape of the visual cortex and the overall stripe pattern of OD columns (16, 17) as well as the link between monocular deprivation and stripe thickness (16, 18). In accordance with these observations, the enlargement of specific brain areas has been predicted by competitive Hebbian models (Kohonen maps) in regions with increased input (19) and has been found in monkeys and cats (20, 21). Furthermore, the order of OD and OP map development has been linked to the ratio between OD and OP wavelength (22), and a constant density of pinwheels relative to the cortical hypercolumn size has been predicted in models and confirmed by experiments (14, 23).

Although particular models can predict some properties of visual cortex maps very well (7), other properties are absent or contradictory to experimental observations (24, 25). Structured maps in the visual cortex have been described in primates, carnivores, and ungulates but are reported to be absent in rodents, which instead exhibit unstructured, seemingly random arrangements commonly referred to as salt-and-pepper configurations (26⇓–28). Phase transitions between an unstructured and a structured map have been described in a variety of models as a function of various model parameters (12, 13). Still, the biological correlate of the phase transition and therefore, the reason for the existence of structured and unstructured neural maps in closely related species remain unknown. Models in which minimal wiring constraints are applied to neurons arranged on a grid show that switching from a nonselective to a selective connectivity between neurons of similar OP can lead to a transition between salt-and-pepper and pinwheel arrangements (6). The results from these models indicate that a difference in selective connectivity could lead to the formation of unstructured vs. structured maps. However, similar grid-like arrangements using Ising-like XY models that also can predict pinwheel arrangements as well as OD columns (29, 30) show an alternative transition of unstructured to structured maps. This phase transition occurs even with a fixed connection selectivity while varying the so-called temperature, a measure that relates to the entropy or the amount of noise in the system (*Methods*). These results indicate that a simple transition to organized neural maps could occur without a direct alteration of the connectivity (31). Such a transition would be compatible with the pronounced selective connectivity between neurons of similar OP observed in mice with their salt-and-pepper organization (32⇓⇓–35). We show here by using a neural placement model based on multidimensional scaling (MDS) and a modified XY model that, in both models, changes in a parameter characterizing the amount of interconnectivity between orientation-selective neurons can lead to the phase transition. We further show that this parameter is directly related to the temperature in our XY model. We conclude that increasing the interconnectivity, which is reflected in higher total numbers of neurons, may lead to structured maps without changing the connection selectivity, a theory that we support with biological data, which we curated from the available literature.

## Results

In the following section, we use a general method to predict the optimal placement of neurons given an arbitrary connectivity based on MDS (36). MDS can be used to find locations with pairwise distances that match a given set of target values by minimizing a respective stress function. To predict the positions of neurons, we use their corresponding connection similarities as distances. Thus, we ensure that neurons with similar connectivity in the circuit are located in close vicinity and hence, that the amount of wiring length is optimized (*Methods*). This model allowed us to dissect the variables leading to the organization of neural maps. To show our method, we first used a surrogate binary connection matrix that we obtained from the geometric proximity of randomly distributed points in a square arrangement arbitrarily divided into six layers. Because the connection matrix then reflects the spatial relations between nearby points, it should be possible to retrieve the location of all points from the binary connectivity matrix alone. Using MDS, we were indeed able to faithfully recover the original locations (Fig. 1*A*), indicating that our optimal placement method conserved neighborhood relations present in the connectivity and favored short distances between connected points. Under these conditions, the mean deviation between original and recovered positions was about 2.4% of the side length of the square after careful alignment of the points (average over 51 trials). Using the optimized locations, the amount of cable required to connect the points according to the binary matrix was then only about 35% of the cable required when using a random placement. The reconstruction worked precisely over a wide range of levels of connection sparsities.

Using the same method, we then predicted the optimal placement of orientation-selective neurons. With the simple assumption that neurons with similar OPs are selectively connected, we predicted the arrangement of a single pinwheel (Fig. 1*B*). As expected from previous optimal wiring models (6), increasing the specific selectivity in the connection probability (*γ* in Fig. 1*B*) resulted in the appearance of pinwheel arrangements. Unexpectedly, however, we observed a transition from a salt-and-pepper to a pinwheel configuration when increasing the number of neurons (Fig. 1*C*, left to right and Fig. S1) for any fixed selectivity. Increasing the number of neurons effectively increases the interconnectivity (i.e., the overall number of neurons that a neuron is connected to) without altering the specificity. Interestingly, total interconnectivity is reduced when increasing selectivity *γ* in our connection function, indicating that seemingly opposing forces determine how much structure is in the final neural map (*SI Text* and Figs. S2 and S3). We quantified the amount of resulting structure by calculating correlation coefficients between OP and azimuth in the putative pinwheels, clearly visualizing the transition in the parameter space (10) (*Methods*, Fig. 1*D*, and Fig. S1). Incidentally, when using relatively unselective connection functions, we still predicted pinwheels for cell numbers above 1,000, thereby matching the numbers found in the cat visual cortex (10). Also, the amount of cable used was around 75% compared with random placements for all parameter values, with a slight improvement for more selective connectivities (Fig. 1*E*). Seemingly unstructured salt-and-pepper arrangements, therefore, still minimize the amount of cable used and are precisely ordered (6), albeit at higher spatial frequencies compared with the lower spatial frequencies found in pinwheel maps.

Although the MDS model robustly showed a structural transition with increasing interconnectivity, it did not become clear why this transition occurred or how general it was with respect to other neural arrangements. To address these questions, we used XY models from statistical mechanics that calculate interactions of continuous periodic spins on a lattice. These models are known to exhibit well-defined characteristic phase transitions in the resulting geometric arrangements of their spins (37, 38). Such Ising-like models have previously been shown to predict OP and OD maps when using a nonlocal type of interactions with a “Mexican-Hat” shape, corresponding to neural models of lateral inhibition (29, 30, 39).

In our XY model, we considered *n* neurons with the following pairwise interaction between two neurons *i* and *j*:*d*(*i*,*j*) is the distance from neuron *i* to *j*, *α* is the decay power of the interaction strength with distance, and *ρ* and the average neuronal span *λ* as described later. The interaction strength can be interpreted as the connection probability between two neurons that increases with neuronal interconnectivity and decays with distance as a power law. It was previously shown that, when the decay power *α* is greater than or equal to four, this class of models becomes similar to a short-range XY model described previously (37, 38) and exhibits similar phase transitions (40, 41). Incorporating the connection probabilities into the partition function (details are in *Methods*)*T*, a model parameter that is related to the entropy of the system and therefore, the amount of disorder in the resulting map. Varying the amount of interconnectivity *u* is inversely proportional to varying *T*, because they both combine to an effective temperature *u* and *T* (*Methods* and Fig. 2). The transition was clearly observed when changing not only *T* but also the amount of interconnectivity *u*.

Our results show a phase transition that is dependent on the interconnectivity, the connection selectivity, and the noise of the system. In both models, map structure can be influenced by changing the interconnectivity by varying either *n* in the MDS model or *u* in the XY model. We provide a detailed explanation of the relationship between our MDS and XY models as well as the role of all parameters involved in *SI Text* (Figs. S2–S4).

The progression from unstructured to structured arrangements seen in both the XY model and the MDS model for OP arrangements is, therefore, likely to be a general feature of neural maps. To show that this is also the case for simple topographic arrangements, we calculated the optimal placement of neurons selectively connected as groups on various grid configurations with a probability that decayed as a function of the Manhattan distance (Fig. 3*A*). Neural maps conserving neighborhood relations from the grid configurations emerged in all cases. A 1D chain of six groups of neurons led to six distinct layers (Fig. 3*B*), a 2D 4 × 4 connectivity led to a typical topographic map as observed in various systems throughout the brain (Fig. 3*C*), and a 3D grid connecting a 4 × 4 grid input from one eye with a 4 × 4 grid from the other eye (Fig. 3*A*, *Right* shows connection probability) led to a 2D arrangement conserving the neighborhood relations in both grids and forming a map of OD columns typical of the ones observed in the visual system (Fig. 3*D*). As is the case with OP maps, OD maps in biology exist in cats and monkeys (5) but are absent in rodents (42, 43) and tree shrews (44), adding to the evidence that the transition that we observe in the model could be pertinent to neural maps in general. In all three cases shown in Fig. 3, higher interconnectivity through a larger number of neurons led to more structure in the resulting topographic maps. Incidentally, increasing the feature space (i.e., from one to three dimensions between Fig. 3 *B*–*D*) also seemed to increase the threshold number of neurons required for the emergence of structured maps, indicating that the number of features also played a role in determining the amount of structure in the neural map.

To support our theory with experimental data, we curated the available literature for numbers of neurons in mammalian V1 (Table S1) and their corresponding expression of OP and OD maps (Table S2) in a broad range of species and body sizes. According to our curated data, map structure seems to be critically dependent on the number of neurons in V1 (Fig. 4*A*), which directly relates to neuron numbers and interconnectivity in our models (*Discussion*).

## Discussion

We have shown that connectivity and neural placement are consistent with optimal wiring as has been previously suggested (5, 6) but that a phase transition between an unstructured and a structured map can occur without changing the selectivity of the connections. This finding is in line with recent experimental measurements that indeed have shown a selective connectivity in the salt-and-pepper arrangements in rodents (32⇓⇓–35) (Fig. 4*B*).

Phase transitions between unstructured and structured maps have previously been observed in a number of modeling studies (12, 13), including those using elastic net models (7, 16, 22) and competitive Hebbian models (Kohonen map models) (45). There, phase transitions depending on receptive field (7, 16, 22) and neighborhood size (19, 45) are reminiscent of the phase transition depending on the interconnectivity in our models. Elastic net models have been shown to predict the order of map development for a set of given features with respect to the sizes of their particular cortical hypercolumn, indicating a possible link between the phase transition and cell numbers similar to our own results (22). The similarity of the resulting neural maps and the corresponding phase transitions in all of these models (46⇓⇓–49) indicate a common underlying theme. Accordingly, the XY and the MDS model are related. It is, therefore, not surprising that we find analogous relationships regarding the phase transition in both models, and we would predict equivalent phase transitions with interconnectivity to be present in other models. However, despite their similarities, different models highlight different aspects of visual cortex maps (12, 50).

In our MDS model, the relationships between interconnectivity, neuron numbers, and maps became particularly visible. Changing the number of neurons *n* in the MDS model naturally led to an increase in the number of connections per neuron (i.e., the interconnectivity) if the connection selectivity was fixed. Likewise, in the XY model, the interconnectivity was proportional to the cell density *ρ* and the neuronal span *λ* if one assumes a fixed connection probability within the interaction range of a neuron (Fig. 4*C*). Therefore, changing the interconnectivity *u* in the XY model was analogous to changing the number of neurons *n* in the MDS model. To better study this relationship, we also decoupled the interconnectivity from the number of neurons in the MDS model (Fig. S3). This study confirmed that changing the number of neurons without increasing the interconnectivity has no visible effect on the obtained map layouts. However, direct application of noise in the MDS model, analogous to changing the temperature *T* in the XY model, unsurprisingly resulted in unstructured maps. A higher number of neurons then increased the resistance to such noise (Fig. S2) similarly to increasing *u* in the XY model. Overall, the numerical analysis of the phase transition in the MDS model showed that noise and interconnectivity affect the map structure similarly as in the XY model, indicating a similarity of the phase transition in both models (Fig. S4).

We validated our model prediction by curating absolute numbers of neurons in mammalian V1 from the available literature (Fig. 4 *A* and *B* and Table S1) and found that neuronal map structure increases with the number of neurons. The question then emerges as to how the number of neurons in V1 relates to neuronal interconnectivity. Because V1 represents the visual field in a retinotopic manner, for potential pinwheels (or any type of cortical hypercolumns) to exist, these pinwheels should not exceed a maximum relative size. Otherwise, no part of the visual field would represent the entire feature space (51). The absolute number of neurons in V1, therefore, directly determines the maximum number of neurons available to form a pinwheel. Accordingly, for a fixed relative connectivity, the amount of interconnectivity would increase with the absolute number of neurons in V1.

Based on our findings, we believe that cortical maps did not “evolve” to fulfill a certain function (52). Our results rather indicate that cortical maps emerge as a consequence of optimal wiring and connectivity requirements. This conclusion is also supported by a number of strong arguments. From an evolutionary perspective, it is unlikely that fundamental differences in neural maps in closely related species are caused by differences in the visual cortex architecture (53). Our theory is further supported by experimental studies, which show that the emergence of visual cortex map patterns depends on the input (54⇓–56) and that OD columns are capriciously expressed in some New World monkeys, excluding functional consequences from having structured OD maps (57, 58). OP maps have also been observed in birds (59), which altogether lack a cortical architecture (60), further indicating that neural maps in the visual system are more likely to be a product of neuronal optimization principles based on the afferent input. These findings may lead to the conclusion that structured maps could be a sign of increased neural organization or superior optimization compared with homologous areas without structured maps in different species. We would argue against such a conclusion based on our MDS model results, because wiring length is similarly optimized in unstructured and structured map layouts (Fig. 1*E*). In conclusion, our model results suggest a simple explanation for the difference of visual cortex maps between rodents and primates, carnivores, ungulates, and tree shrews without assuming a difference in the general functional architecture or how optimal the network layout is.

Although data for connection selectivity between neurons of similar tuning are available only for cats and mice, a higher connection selectivity in carnivores and possibly, primates and tree shrews together with a generally higher number of neurons could explain the presence of structured visual cortex maps in those species and their absence in rodents. However, it has been shown that sheep show some form of a structured map (61) and that ungulates in general possess similar neuronal scaling rules as rodents (62). The emergence of a structured map in larger rodents is, therefore, likely. The agouti is a rodent with neuronal numbers in V1 that are as high as those of other species with structured OP maps (Fig. 4*A* and Tables S1 and S2). Although occurrences of structured maps in the agouti and the even larger capybara have not yet been reported, they likely possess OP maps. The existence of structured visual cortex maps in rodents has mainly been questioned because of a study that showed the presence of an unstructured map in the gray squirrel—a highly visual rodent (27). Here, it has been claimed that ferret, tree shrew, and gray squirrel possess similar V1 sizes and visual acuity, leading to the conclusion that visual cortex map structure cannot be determined by these factors (27). However, the gray squirrel has a smaller V1 than the tree shrew and the ferret (Table S1). Most likely, it also has a smaller neuronal density than tree shrew and ferret and as a consequence, a much lower number of neurons in V1. Thus, the results obtained for the gray squirrel (27) do not contradict our results.

In addition to a sharp separation of map structures given by the neuronal numbers in V1, there seems to be a progression in the strength of the expression of the maps depending on the number of neurons (Tables S1 and S2). For example, tree shrews that are on the lower end of the spectrum show an intermediate OP map pattern, which is characterized by a more stripe-like appearance in large parts of their V1 (63). Additionally, they lack an OD map entirely (64⇓–66). New World monkeys with V1 neuron numbers between those of tree shrews and macaques (Table S1) show a robust OP map (Table S2) but an intermediate OD map pattern, which is, furthermore, erratically expressed between different individuals (57, 58). Also, carnivores seem to show a progression of map structure depending on the number of neurons in V1. The OP and OD map of the ferret have been described as less structured and regular than those of the cat, and neuronal numbers in cat V1 are very likely to be greater than those in the ferret V1 (Tables S1 and S2).

Our models suggest that a certain number of neurons per hypothetical hypercolumn are necessary to form a structured OP map. The area of V1 required for a pinwheel should, therefore, vary with neuronal density, and hypercolumn sizes would scale accordingly (14, 23). In the light of our results, the different hypercolumn sizes observed in different species could be explained by individual neuronal densities in visual cortex. In line with this argument, neuronal density in cat was shown to be about one-half of the density measured in macaque, but hypercolumn sizes were twice as large (Table S1) (44). Although we provide biological data that are as reliable and comprehensive as possible, the collected data are largely fragmented over more than a dozen different studies and confined in the diversity of species that they provide (Tables S1 and S2). To confirm our theory, additional experiments providing better data for more species are necessary. Neuronal numbers and connection selectivities should be obtained by standardized methods, ideally in the same individuals where the map structure is assessed. However, it would be particularly interesting to see whether structured visual cortex maps are expressed in the largest existing rodent, the capybara, and conversely, whether they are missing in the smallest primates, carnivores, or ungulates.

## Methods

To show the transition between unstructured and structured circuit arrangements, we take advantage of two separate models that generate the patterns of OP maps. The first model is our own model based on optimal placement of neurons to minimize wiring in the circuit using MDS; the second model is based on an adaptation of the Ising-like XY model, where spatial patterns emerge from interactions between nodes on a regular lattice.

### Determining Connection Probabilities from Euclidean Distances.

The connection probabilities in Fig. 1*A* were calculated from the Euclidean distances between each pair of nodes *i*,*j* using the following function:

where *d*(*i,j*) is the Euclidean distance between nodes *i* and *j*, and *d*_{max} is the maximum distance to establish a connection. In Fig. 1*A*, we used 1,000 neurons uniformly distributed in a square area. We divided the square into six layers of the same size and attributed to each layer a unique color that we correspondingly assigned to the neurons of the respective layer. For calculating the connection probabilities, a *d*_{max} of 0.4 was used.

### Calculating Connection Dissimilarity for the MDS Model.

Given a binary connectivity matrix **C** for *n* neurons, we determined the connection dissimilarity *δ*_{i,j} of two connected neurons *i* and *j* by calculating the Jaccard distance

where *i*th row of **C**, and **C**_{i,k} is the entry at the *i*th row and *k*th column of **C**. After calculating the dissimilarity for all connected neurons, we obtained the remaining dissimilarities by summing up the calculated dissimilarity values over the shortest paths between nonconnected neurons.

### Optimal Placement Using MDS.

MDS finds positions **X** of *n* nodes in *r* dimensions, such that the Euclidean distances *d*(*i,j*) between the nodes *i* and *j* best match given dissimilarity values *δ*_{i,j}. For calculating the optimal neural placement, we used the dissimilarity of the connectivity between neurons *i* and *j* as defined above to calculate their 2D positions by ordinal MDS. The positions **X** are calculated in MDS by minimizing the stress function *σ*:

where *f*(*δ*_{i,j}) transforms the dissimilarity values into spatial distances. In ordinal MDS, this function *f* has to be monotonic, must only fulfill the condition *σ* (36). We used the MATLAB function mdscale to perform the ordinal MDS.

### Optimal Placement for a Single Pinwheel Using MDS.

Random OPs *θ* ∈ [0, *π*] were associated with *n* neurons used for one pinwheel. The probability *p* of connecting two neurons *i* and *j* was determined by

a function of the preferred orientations *θ*_{i} and *θ*_{j} of both neurons. This type of periodic connectivity is analogous to previous models predicting OP maps (6). Here, *a* defines the constant connection probability between all *n* neurons, and *b* is the maximum connection probability between two neurons *i* and *j*. The selectivity of the connection is given by *γ*, a parameter of crucial importance in Fig. 1.

### Estimation of Cable Saved by Optimal Placement.

To quantify the amount of cable that was saved by the optimal placement of *n* neurons, we compared the arrangement obtained using MDS with the arrangement of *n* randomly located neurons in an area with similar dimensions. Random positions were obtained using a uniform distribution within the bounding box around the positions determined using MDS (Fig. 1*A*) or for a circular bounding box (Fig. 1*C*). For any connectivity matrix **C** that has been used to calculate the neuronal positions using MDS and the distance matrix **D** of the positions determined by MDS, we calculated the total wiring length *L* as follows:

For the distances of the random positions **D**_{rand}, the total wiring length connecting the random positions *L*_{rand} was calculated analogously. The proportion of wiring length compared to random was then defined in percentage by 100⋅*L*/*L _{rand}*.

### Correlation Coefficient Between Preferred Orientation and Pinwheel Azimuth.

To quantify how much the MDS neural placement followed a pinwheel arrangement, we calculated the correlation between OP and azimuth for all neurons in each modeled arrangement. A reference vector was defined by the mean direction of the coordinates of the first 10 neurons, with a preference to the smallest orientations greater than or equal to 0. For each neuron, the azimuth was then calculated with respect to the reference vector and plotted against the preferred orientation (Fig. 1*C*). The Pearson correlation coefficients for Fig. 1*D* were then calculated for data points with an azimuth in the range between 1/4*π* and 7/4*π* to avoid data points that possess an OP near *π* but reside near the 0 azimuth and vice versa. For the results shown in Fig. 1*D*, 40 modeled neural arrangements were calculated for each parameter pair, and we used the average of the absolute values of the corresponding correlation coefficients.

### XY Model for Studying the Phase Transition with Interconnectivity.

The 2D XY model is an Ising-like model (67), where the state of a single spin **s**_{i} can take values *θ* from **s**_{i}⋅**s**_{j} then is equal to the scalar product of the two corresponding orientation vectors: cos(2*θ*_{i} − 2*θ*_{j}). The system is described by the following Hamiltonian operator:

where *J* is a positive constant. We modified the original XY model (67) to be able to better compare it with variables from the MDS model and better study the effect of interconnectivity by replacing the constant *J* with an *n* × *n* matrix **J** that incorporates the strength of the interaction **J**_{ij} between all pairs of neurons *i*,*j* ∈ {1, …, *n*}. Assuming that neuronal connection probability decays strongly with distance, we used a simple power law relationship: **J**_{ij} ∼ *λ*(*d*(*i*,*j*)⋅*ρ*^{−1})^{−α}, where *d*(*i*,*j*) is the distance between two neurons, *ρ* is the neuronal density, and *λ* represents the neuronal span. For ease of notation, we considered the following connection function:

where we introduced the interconnectivity as parameter *ρ* or the average neuronal span *λ* will, therefore, increase the amount of interconnectivity *u*. The Hamiltonian operator then becomes

where the factor

In the limit of *α* → ∞, this model becomes equivalent to the common short-range XY model that only takes into account interactions with the nearest neighbors.

### Increasing Radius of Interaction Is Equivalent to Decreasing Temperature.

In a statistical system, such as the Ising XY model that we used, the properties of the system, including its characteristic phase transitions, can be obtained from the partition function *Z*. This function is defined as the sum over all possible configurations of its Boltzmann weights:

Inserting Eq. **8** into Eq. **9** leads to

It was shown previously (40, 41, 69) that, when *α* is greater than or equal to four, the system described by Eq. **10** belongs to the Kosterlitz–Thouless universality class (37, 38). The system thereby exhibits phase transitions driven by the temperature *T*, a model parameter that is related to the entropy of the system. Below the critical temperature, the system exhibits long-range correlations that decay as a power law and share similarities with cortical OP maps, including alternating clockwise and anticlockwise pinwheel formations. Above the critical temperature, the correlation length decays exponentially, and mesoscopic patterns can exist only on a short scale. Eq. **10** can be rewritten in terms of effective temperature: *u* is inversely proportional to changing the temperature *T*. Increasing the interconnectivity as well as decreasing the temperature, therefore, both lead to a phase transition in this class of systems (40, 41).

### Numerical Simulations for XY Model Using a Hybrid Monte Carlo Technique.

To visualize the phase transition in the XY model with increasing interconnectivity, we performed numerical simulations based on a standard method for XY model predictions using a hybrid Monte Carlo method (70). The original Hamiltonian operator of the system (Eq. **8**) was considered as a potential that depends on the *n* OPs of all neurons in the system. We introduced an additional parameter *ϕ* for each of these dfs representing the velocity of each orientation:

At each Monte Carlo iteration, all of the nodes of the grid evolved according to the equation, whereas the system returned to its previous state with a probability

10,000 neurons on a grid were associated with random initial orientations, and up to 1,000 iterations were performed according to the following algorithm.

### Algorithm.

*i*) Select*n*parameters from a normal distribution centered around zero with an SD of*T.**ii*) Numerically integrate

for each node.

*iii*) Calculate the difference between the new and the old Hamiltonian operators and accept the new values*θ*if the change is not rejected according to the rejection probability (Eq.**12**).

The resulting *θ* produced by this algorithm follows the same statistics as the partition function. Fig. 2 was generated in this way for *α* = 4 and 25 different combinations of temperature and levels of interconnectivity.

## SI Text

### Extended Data for Fig. 1.

In Fig. S1, we show a larger range of OP map realizations for our MDS model similar to Fig. 1. Fig. S1*A* focuses on the region where the phase transition is most pronounced. Fig. S1*A*, *Right* describes the type of data used for the correlation measure *r* in Fig. 1*D* in greater detail. Note that both right- and left-handed pinwheels were predicted (Fig. 1*C* and Fig. S1*A*) with corresponding points along the diagonal or antidiagonal in the OP vs. azimuth plot (Fig. S1*A*, *Right*). The entire parameter range is shown in Fig. S1*B*.

### Noise in the MDS Model.

Noise is represented by the temperature *T* in the XY model, but there is no explicit parameter in the MDS model used in the manuscript that determines the amount of noise in the system. However, noise is introduced by the random nature of the connectivity and the distortions in the development of a structured map caused by unselective connections. To better understand the relationship between connectivity and noise in the MDS model, we designed an initial highly selective noise-free connectivity that we subsequently subjected to noise (Fig. S2*A*). Similar to decreasing connection selectivity, increasing noise leads to an unstructured map. This relationship suggests that noise and unselective connections can be considered equivalent with respect to their effect on resulting map patterns (Fig. S2*B*).

### Neuronal Numbers, Interconnectivity, and Connection Selectivity in the MDS Model.

In the manuscript, we showed a phase transition in our MDS model with number of neurons *n* and discussed in depth the relationship of *n* to the interconnectivity. To more formally compare the XY model with the MDS model, we introduce here a modified connection function that decouples interconnectivity from the number of neurons:**4**, but the connection probability is normalized by the number of neurons. Because we showed that there is no difference between noise and unselective connectivity, we define *a* as the amount of noise and *b* as the amount of selective interconnectivity. Note that the results obtained by this connection function are representative of the results that can be obtained using the original connection function, because there is a one to one correspondence between both functions. Because both parameters are normalized by the number of neurons *n*, interconnectivity can be set independently from *n*. Hence, we are able to analyze the effect of numbers of neurons, interconnectivity, and connection selectivity separately. However, we want to clarify that, although the interconnectivity can be set independently of the number of neurons, the maximum amount of interconnectivity is dependent on the number of neurons (because the maximum interconnectivity refers to the maximum amount of possible connections, which are limited by *n*), and therefore, increasing the latter is indispensable for reaching certain amounts of interconnectivity. Furthermore, it is also not our intention to suggest that structured maps arise because of a higher interconnectivity for a fixed number of neurons. We rather believe that higher numbers of neurons (e.g., in V1) increase the interconnectivity for a fixed relative connectivity, which then leads to the phase transition. In agreement with our expectations, varying the number of neurons but keeping the other parameters fixed does not lead to a change in map structure (Fig. S3*A*). However, varying the amount of interconnectivity by uniformly increasing noisy and selective connections (by increasing *a* and *b*) leads to a transition from a salt-and-pepper to a pinwheel organization (Fig. S3*B*). Thus, we show that the effect of the numbers of neurons on the phase transition seems to depend only on the interconnectivity. Furthermore, we show that the effect of the connection selectivity on map structure is unsurprisingly not affected using the connection function given in Eq. **S1** (Fig. S3*C*).

### MDS and XY Model Relationship.

Although we have shown that the phase transitions of the MDS and the XY models are based on similar parameters, their exact relationship is still not clear. The phase transition in the XY model is a Kosterlitz–Thouless transition of infinite order, and the interdependence of the critical noise *T*_{crit} and the interconnectivity *u* is analytically given by **S1** enabled us to numerically study the effects of the amount of unselective interconnectivity [i.e., of noise (*a*), the amount of selective interconnectivity (*b*), and the number of neurons (*n*)] on the phase transition separately. The correlation to the azimuth *r* that quantifies the amount of structure in the OP map depends on the set values for *a* and *b*, which we have shown to correspond to *T* and *u* in the XY model. We analytically showed that the phase transition in the XY model is determined by the effective temperature *T*_{eff} = *T*/*u*^{α} (*Methods*). To show a similar relationship between noise and interconnectivity, we fitted the calculated correlation values *r* for the results of different values of *a*, *b*, and *n* and a fixed *γ* = 1 to a sigmoid function given by*r* is the correlation to the azimuth (definition are in *Methods*), and *x*_{1}, *x*_{2}, and *x*_{3} are the fitting parameters.

According to the fit function in Eq. **S2**, the order parameter that corresponds to the effective temperature in the MDS model is given by *A*, we show the results of the fit and the data that have been fitted in the space of *X*_{eff} and *r*. To show an analogous behavior of the MDS and XY models regarding the phase transition, the fitting parameters *x*_{1} and *x*_{2} should have the same sign in both models, and *x*_{3} should be constant. Because the phase transition is analytically given by *T*_{eff} = *T*/*u*^{α}, it follows that *x*_{1} = −4 and *x*_{2} = 1 for *α* = 4 in the XY model. Accordingly, we found numerically that the phase transition observed in the MDS model matches the characteristics of the XY model phase transition. Specifically, we found that *x*_{1} is always negative (Fig. S4*B*, *Left*), that *x*_{2} is always positive (Fig. S4*B*, *Center*), and that *x*_{3} is constant (Fig. S4*B*, *Right*). Thus, similar to in the XY model, where the order parameter of the phase transition is given by a power law between noise *T* and interconnectivity *u*, the critical amount of noise *a* in the MDS model is also given by a power law in dependence on the interconnectivity*n* = 284 in the MDS model and shown for a wide range of interconnectivity and noise values in Fig. S4*C*.

The constancy of *x*_{3} confirms more systematically what we have shown in Fig. S3: the number of neurons has no effect on the phase transition, at least regarding the effective interconnectivity. This relationship can also be seen in the fitted curves in Fig. S4*A*, because there is no discernible regular shift of these curves regarding the respective number of neurons. However, because the values of *x*_{1} and *x*_{2} change with the number of neurons, the critical composite amount of noise and interconnectivity fluctuates when changing the number of neurons. Thus, the identical relationship between noise and interconnectivity in the XY model cannot be replicated in the MDS model.

In conclusion, the two models exhibit two different phase transitions, but these transitions are driven by similar parameters representing the noise and the interconnectivity, which affect the order parameters *X*_{eff} and *T*_{eff} in a similar way.

### Biological Data.

To support our model results by biological data, we curated the available literature to obtain the number of neurons in V1. Thereby, we obtained a dataset from a wide range of species containing thickness, area, number of neurons, and neuronal density in V1 (Table S1). Furthermore, we characterized the visual cortex map structures for all of the mammalian species given in Table S1 when available (Table S2).

## Acknowledgments

We thank A. Bird, A. Borst, F. Effenberger, P. Jedlicka, J. Muellerleile, M. Schölvinck, and T. Tchumatchenko for useful comments on the manuscript. This work was supported by Bundesministerium für Bildung und Forschung Grant 01GQ1406 (Bernstein Award 2013), Deutsche Forschungsgemeinschaft Grant CU 217/2-1, and the International Max Planck Research School for Neural Circuits in Frankfurt.

## Footnotes

- ↵
^{1}To whom correspondence may be addressed. Email: mweigand{at}fias.uni-frankfurt.de or cuntz{at}fias.uni-frankfurt.de.

Author contributions: M.W., F.S., and H.C. designed research, performed research, contributed new reagents/analytic tools, analyzed data, and wrote the paper.

The authors declare no conflict of interest.

This article is a PNAS Direct Submission.

This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1616163114/-/DCSupplemental.

## References

- ↵
- ↵.
- Cherniak C,
- Mokhtarzada Z,
- Rodriguez-Esteban R,
- Changizi K

- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵.
- Kaschube M, et al.

- ↵
- ↵
- ↵
- ↵.
- Miller KD,
- Keller JB,
- Stryker MP

- ↵
- ↵.
- Hubel DH,
- Wiesel TN,
- LeVay S

- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵.
- Van Hooser SD,
- Heimel JA,
- Chung S,
- Nelson SB,
- Toth LJ

- ↵
- ↵.
- Cowan JD,
- Friedman AE

- ↵
- ↵
- ↵
- ↵.
- Ko H,
- Mrsic-Flogel TD,
- Hofer SB

- ↵
- ↵
- ↵.
- Borg I,
- Groenen PJF

- ↵
- ↵.
- Kosterlitz JM,
- Thouless DJ

- ↵
- ↵.
- Defenu N,
- Trombettoni A,
- Codello A

- ↵
- ↵
- ↵.
- Horton JC,
- Hocking DR

- ↵
- ↵
- ↵.
- Goodhill GJ,
- Finch S,
- Sejnowski TJ

- ↵
- ↵.
- Yuille AL,
- Kolodny JA,
- Lee CW

- ↵.
- Mitchison G

- ↵
- ↵
- ↵.
- Horton JC,
- Adams DL

- ↵.
- Jacob F

- ↵.
- Constantine-Paton M,
- Law MI

- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- ↵.
- Herculano-Houzel S,
- Catania K,
- Manger PR,
- Kaas JH

- ↵.
- Bosking WH,
- Zhang Y,
- Schofield B,
- Fitzpatrick D

- ↵
- ↵
- ↵
- ↵.
- Itzykson C,
- Drouffe J-M

- ↵
- ↵.
- Berganza MI,
- Leuzzi L

- ↵
- ↵.
- Martin KAC,
- Schröder S

- .
- Rockel AJ,
- Hiorns RW,
- Powell TPS

- .
- Srinivasan S,
- Carlo CN,
- Stevens CF

- .
- Charvet CJ,
- Cahalane DJ,
- Finlay BL

- .
- Collins CE,
- Airey DC,
- Young NA,
- Leitch DB,
- Kaas JH

- .
- Carlo CN,
- Stevens CF

- .
- Peters A

- .
- Andelin AK,
- Bruning DJ,
- Felleman DJ,
- Olavarria JF

- .
- Picanço-Diniz CW,
- Silveira LCL,
- de Carvalho MSP,
- Oswaldo-Cruz E

- .
- Keil W, et al.

- .
- Girman SV,
- Sauvé Y,
- Lund RD

- .
- Laing RJ,
- Turecek J,
- Takahata T,
- Olavarria JF

- .
- Chapman B,
- Stryker MP,
- Bonhoeffer T

- .
- Xu X,
- Bosking WH,
- White LE,
- Fitzpatrick D,
- Casagrande VA

- .
- Xu X, et al.

- .
- Bartfeld E,
- Grinvald A

- .
- Yacoub E,
- Harel N,
- Ugurbil K

- .
- Horton JC,
- Hedley-Whyte ET

## Citation Manager Formats

## Sign up for Article Alerts

## Article Classifications

- Biological Sciences
- Neuroscience