Notebooks

Self-Organization

Last update: 21 Apr 2025 21:17
First version: 7 July 1997

Something is self-organizing if, left to itself, it tends to become more organized. This is an unusual, indeed quite counter-intuitive property: we expect that, left to themselves, things get messy, and that when we encounter a very high degree of order, or an increase in order, something, someone, or at least some peculiar thing, is responsible. (This is the heart of the Argument from Design.) But we now know of many instances where this expectation is simply wrong, of things which can start in a highly random state and, without being shaped from the outside, become more and more organized. Thus self-organization, which I find to be one of the most interesting concepts in modern science --- if also one of the most nebulous, because the ideas of organization, pattern, order and so forth are, as used normally, quite vague.

Self-organization is not just something I find interesting, it's also my research topic. More exactly, I did my Ph.D. dissertation on quantitative measures of self-organization, especially in cellular automata; the idea was to remove some of the vagueness in the idea of organization, and so make self-organization at least a bit less nebulous. I've explained this at (doubtless excessive) length in my "Is the Primordial Soup Done Yet?", which is based on a talk I gave to Madison Chaos & Complexity Seminar in 1996, and which served as the basis for the first two chapters of my dissertation.

Well, I think I did come up with a good quantitative measure of self-organization. The complexity of a process ought to be measured by how much information is needed to predict its future behavior. (This is done locally for spatially extended systems --- how much do I need to know to predict what this point is going to do?) This in turn depends on the organization of the process, on its causal architecture; the higher the complexity, the greater the (effective) number of parts in that architecture. An autonomous process --- one which receives either constant or purely random inputs from the outside --- self-organizes if its complexity increases over time. So far as I can tell, this definition matches all the cases where people are agreed, intuitively, about whether or not something self-organizes, and it can definitely be applied to real data sets from real experiments. If you want to know more about this, read my paper with Kris Shalizi and Rob Haslinger, "Quantifying Self-Organization with Optimal Predictors", nlin.AO/0409024.

This leaves, however, the problem of "exorcising demons": how to tell self-organization from being organized by something else? How much can the outside world increase something's complexity, if the relevant part of the outside world has only a certain amount of complexity itself? There seem to be many situations like this --- embryological development, learning (with or without instruction), etc. Mitch Porter has been taxing me for not tackling this point since 1996, but I have only the vaguest notion of how to proceed.

Many writers conflate the notion of self-organization with that of emergence. Properly defined, however, there can be self-organization without emergence and emergence without self-organization. There is a link between them, but it's fairly subtle. See ch. 11 the dissertation.

History of the idea. (Discussed at more length in ch. 1 of my dissertation.) The idea that the dynamics of a system can tend, of themselves, to make it more orderly, is very old. The first statement of it (naturally, a clear and distinct one) that I can find is by Descartes, in the fifth part of his Discourse on Method, where he presents it hypothetically, as something God could have arranged to have happen, if He hadn't wanted to create everything Himself. Descartes elaborated on the idea at great length in a book called Le Monde, which he never published during his life, for obvious reasons. (I strongly suspect the hypothetical form of his discussion was simply to keep himself out of trouble with the churches, but I'm not enough of a scholar of his life and thought to show that.) Of course, the ancient atomists (among others) had argued that a designing intelligence was unnecessary, but their arguments were all of the "worlds enough and time" variety: given enough time and space and matter, organization is bounded to happen somewhere, sometime, by sheer chance. (Lucretius gives this the interesting twist that stable forms, produced by chance, will last longer than unstable ones, but doesn't take it anyplace.) What Descartes introduced was the idea that the ordinary laws of nature tend to produce organization. --- Since there are people, taken seriously by fellow scholars, who say that self-organization u.s.w. represents a break with the Cartesian, mechanistic, reductionist, etc. tradition of science, I find this more amusing and significant than it probably is. (For related history, see Avram Vartanian, From Descartes to Diderot.)

More modernly, the term "self-organizing" seems to have been introduced in 1947 by W. Ross Ashby, and not (as some references claim) by a pair of computer scientists in 1954; the paper of theirs which is generally cited in support of this claim in fact refers to Ashby! It had the misfortune to get wrapped up with general systems theory in the 1960s, but was taken up by physicists and people working on complex systems in the 1970s and 1980s, which is when the real deluge began. When queried with the keyword self-organ*, Disertation Abstracts finds nothing before 1954, and only four total before 1970. There were 17 in the years 1971--1980; 126 in 1981--1990; and 593 in 1991--2000. A truly distressing number of these are in the social sciences. Some of them use the term in a perfectly legitimate way, e.g., "the self-organization of a miner's union". (In fact, Raymond Aron speaks of ideas and interests "organizing themselves" in The Opium of the Intellectuals, the French original of which was published in 1955. It would be interesting to know what the French phrase translated this way is, when it was introduced, and whether Aron might have run across Ashby or some other cyberneticist.) Still, there's an immense quantity of fluff peddled under this label. (I have mentioned only a few of the least offensive below.)

"Self-organized criticality" is a rather different story, though I now encounter a fair number of physicists who infer the meaning of "self-organized" backwards from that term.

Self-organization in action: some instances of evolutionary computation and Darwin Machines; qwerty; cellular automata (some of them), dissipative structures, and pattern formation in general; the so-called edge of chaos. Nest-building by social insects. Flocking.

Many phase transitions look self-organizing (e.g., magnetization, crystal growth, and liquid crystal phenomena) --- but are all of them? (Of course, the transitions in the opposite direction would be self-disorganization, and all of them are or can be in thermodynamic equilibrium.)

Iffy. Turbulence. Ecosystems, especially during succession. "Financial euphoria" and other market behavior. (Iffy phenomena are reasons to want a test for self-organization.)

Addendum, 17 December 2007: I have just found an earlier (but apparently passing and incidental) use of "self-organizing": "The self-organisation of society depends on commonly diffused symbols evoking commonly diffused ideas, and at the same time indicating commonly understood action" --- A. N. Whitehead, Symbolism: Its Meaning and Effect (Macmillan, 1927), p. 76.

    Recommended, technical:
  • nlin.AO, electronic preprints in adaptation and self-organizing systems; see also statistical mechanics
  • Computational Mechanics Group at SFI [Disclaimer: I was a part of this research group from 1998 to 2002]
  • J. Doyne Farmer, Alan Lapedes, Norman Packard and Burton Wendroff (eds.), Evolution, Games, and Learning: Models for Adaptation in Machines and Nature (a.k.a. Physica D 22 (1986).)
  • David Griffeath, Primordial Soup Kitchen [For the papers]
  • Stuart Kauffman, The Origins of Order: Self-Organization and Selection in Evolution [Brief comments]
  • Paul Krugman, The Self-Organizing Economy [Review]
  • Daniel Polani, "Measuring Self-Organization via Observers", pp. 667--675 in W. Banzhaf et al. (eds.), Advances in Artificial Life, 7th European Conference (ECAL 2003) [This definition is actually very close to the one I advocate.]
  • Max Rietkerk, Stefan C. Dekker, Peter C. de Ruiter and Johan van de Koppel, "Self-Organized Patchiness and Catastrophic Shifts in Ecosystems", Science 305 (2004): 1926--1929
  • Satoshi Sawai, Peter A. Thomason and Edward C. Cox, "An autoregulatory circuit for long-range self-organization in Dictyostelium cell populations", Nature 433 (2005): 323--326
  • M. G. Shats, H. Xia and H. Punzmann, "Self-organization in turbulence as a route to order in plasma and fluids", physics/0409074
  • Jose G. Venegas, Tilo Winkler, Guido Musch, Marcos F. Vidal Melo, Dominick Layfield, Nora Tgavalekos, Alan J. Fischman, Ronald J. Callahan, Giacomo Bellani and R. Scott Harris, "Self-organized patchiness in asthma as a prelude to catastrophic shifts", Nature 434 (2005): 777--782
    Disrecommended:
  • Hermann Haken [Did good deeds by encouraging work in the area in the 1970s and early 1980s. His books, however, have been repeating the same handful of ideas ever since, with no real applicability beyond the few examples he started with. "Synergetics" is a truly awful name, too.]
  • Wolfgang Krohn, Günther Küppers and Helga Nowotny (eds.), Selforganization: Portrait of a Scientific Revolution [The only available study of the history of the concept. Not reliable, however, scientifically, historically or methodologically.]
  • Humberto Maturana and Francisco Varela [I have read extensively in their works, starting with Autopoesis, without extracting a single distinctive insight or result of value. I regret this, since everyone I know who's met them says they are very engaging, modest, and open people.]
  • Ilya Prigogine [Like Haken, encouraged people to work on these problems in the 1970s. His own theories, however, are completely outmoded, and his philosophizing below even the usual standard for Nobel Prize winners.]
    To read, eventually:
  • Don Anderson, Plate tectonics as a far-from-equilibrium, self-organized system
  • Maarten C. Boerlijst, Selfstructuring: a Substrate for Evolution [Ph.D. thesis, Utrecht University, 1994]
  • Eric Bonabeau, Guy Theraulaz, Jean-Louis Deneubourg, Serge Aron and Scott Camazine, "Self-Organization in Social Insects," SFI Working Paper 97-04-032 = Trends in Ecology and Evolution 12 (1997): 188--193
  • Eric Bonebeau, Guy Theraulazx and Francois Cogne, "The Design of Complex Architectures by Simple Agents," SFI Working Paper 98-01-005
  • Sven Brueckner et al (eds.), Engineering Self-Organizing Systems
  • Scott Camazine, Nigel R. Franks and Jean-Louis Deneubourg, Self-Organization in Biological Systems
  • Gail A. Carpenter and Stephen Grossberg (eds.), Pattern Recognition by Self-Organizing Neural Networks
  • Debashish Chowdhury, Katsuhiro Nishinari and Andreas Schadschneider, "Self-organized patterns and traffice flow in colonies of organisms: from bacteria and social insect to vertebrates", q-bio.PE/0401006
  • Seung-Bae Cools, Carlos Gershenson, and Bart D'Hooghe, "Self-organizing traffic lights: A realistic simulation", nlin.AO/0610040
  • Rashimi Desai and Raymond Kapral, Dynamics of Self-Organized and Self-Assembled Structures
  • Peter Dittrich and Pietro Speroni di Fenizio, "Chemical organization theory: towards a theory of constructive dynamical systems", q-bio.MN/0501016
  • Peter Gács, "Reliable Cellular Automata with Self-Organization," math.PR/0003117
  • Carlos Gershenson
  • G. Gregoire and H. Chate, "Onset of collective and cohesive motion", cond-mat/0401208
  • Robert L. Jack Michael F. Hagan and David Chandler, "Fluctuation-dissipation ratios in the dynamics of self-assembly", Physical Review E 76 (2007): 021119
  • Karin John and Markus Bär, "Alternative mechanisms of structuring biomembranes: Self-assembly vs. self-organization", q-bio.CB/0506033 = Physical Review Letters 95 (2005): 198101
  • William Jones and C. N. R. Rao (eds.), Supramolecular Organization and Materials Design ["Supramolecular chemistry deals with the design, synthesis, and study of molecular structures held together by non-covalent interactions. Structures of this type are ubiquitous in nature and are frequently used as blueprints for the design of synthetic equivalents. This reference demonstrates the seminal importance of supramolecular chemistry and self-organization in the design and synthesis of novel organic materials, inorganic materials, and biomaterials. With contributions from leading workers in the field, the book shows how the bottom-up approach of supramolecular chemistry can be used not only to synthesize new materials, but to operate specific molecular devices as well."]
  • Pier Luigi Luisi, The Emergence of Life: From Chemical Origins to Synthetic Biology
  • Pedro Márquez-Zacarías, Andrés Ortiz-Muñoz, Emma P. Bingham, "The Nature of Organization in Living Systems", arxiv:2503.03950
  • Jonathan H. McCoy, Will Brunner, Werner Pesch and Eberhard Bodenschatz, "Self-Organization of Topological Defects due to Applied Constraints", Physical Review Letters 101 (2008): 254102
  • Roderick J. McIntosh, Ancient Middle Niger: Urbanism and the Self-Organizing Landscape
  • Pierre-Yves Oudeyer, Self-Organization in the Evolution of Speech [Thanks to Dr. Oudeyer for sending me a copy of this book]
  • Ricard V. Solé and Jordi Bascompte, Self-Organization in Complex Ecosystems
  • Ricard V. Solé, Eric Bonebeau, Jordi Delgado, Pau Fernández and Jesus Marín, "Pattern Formation and Optimization in Army Ant Raids," SFI Working Paper 99-10-074
  • Quentin F. Stout, "Using Clerks in Parallel Processing", pp. 272--279 in Proceedings of the 23rd IEEE Symposium on Foundations of Computer Science (1982) [Abstract: "Some models of parallel computers consist of copies of a single finite state automaton connected together in a regular fashion. In such computers a self-organizing structure called clerks can be useful, enabling one to simulate a more powerful computer for which optimal algorithms are easier to design. The computation proceeds by having the cellular automata organize themselves into clerks, and then a stepwise simulation of the more powerful computer is performed. For a system of n automata, each clerk contains \Theta(log n) automata, so first they need to determine log(n), despite the fact that no single automata can count higher than a fixed number." Link]
  • David J. T. Sumpter, Collective Animal Behavior
  • Konrad Thurmer, Robert Q. Hwang and Norman C. Bartelt, "Surface Self-Organization Caused by Dislocation Networks", Science 311 (2006): 1272--1274
  • J. Scott Turner, The Tinkerer's Accomplice: How Design Emerges From Life Itself
  • Alexandros G. Vanakaras and Demetri J. Photinos, "Molecular Theory of Dendritic Liquid Crystals: Self Organization and Phase Transitions", cond-mat/0501184
  • R. Vilela Mendes
    • "Conditional Exponents, Entropies and Measure of Dynamical Self-Organization," adap-org/9802001
    • "Characterizing Self-Organization and Coevolution by Ergodic Invaraints," Physica A 276 (2000): 550--571
Non-trivial edit dates: 10 March 2025; 25 November 2024; 17 December 2007; 24 November 2001; 28 September 2001; 30 May 2000; 7 July 1997

permanent link for this note RSS feed for this note

Notebooks :

AltStyle によって変換されたページ (->オリジナル) /