Showing posts with label information theory. Show all posts
Showing posts with label information theory. Show all posts

Friday, March 21, 2025

Levy Things and Data Management

 

There's a whole bag of words referring to this one phenomenon we call foraging behavior. Animals poke around for food, poke, poke, poke, and then move to another spot, and poke, poke, poke. A big jump followed by a bunch of little jumps, followed by a big jump, etc. The explore-exploit heuristic it's also called. This behavior is found in many other places, from the way people look for a job to the way atoms move. That's called Brownian motion, or the Drunkard's Walk. It's found in the unconscious  uncontrollable way our eyes move when we look at things, and it's kind of even related to the way we choose baby names over decades. 

The following articles are mostly tangentially related to this phenomenon; they're about navigation and vision, and information theory in general. 
 
A new mechanism for animal food caching behavior discovered
Aug 2024, phys.org

Contrary to the long-held belief that scatter-hoarding animals rely on memory to retrieve cached food items, the researchers propose a static mechanism similar to hash functions used in computing. Hash functions in computing are algorithms that convert input data of any size into a fixed-size string of characters, which typically represents the data in a unique and efficient manner.

The researchers' mathematical model aligns with the activity of hippocampal spatial cells, which respond to an animal's positional attention. The remapping ensures that these cells activate consistently across subsequent visits to the same area but differ between areas.

This remapping, combined with unique cognitive maps, generates persistent hash functions that can aid both food caching and retrieval.

In other words: Both layers are arranged in a two-dimensional grid, with each cell corresponding to a specific location. The cache site is determined by the activity level of the output neurons, known as the cache score.

via Department of Cognition and Brain Sciences and The Department of Animal Sciences at Hebrew University of Jerusalem: Sharon Mordechay et al, A non-memory-based functional neural framework for animal caching behavior, Scientific Reports (2024). DOI: 10.1038/s41598-024-68003-8



Grid cells' rhythmic sweeps reshape understanding of brain's spatial navigation
Feb 2025, phys.org

Grid cells alternate between tracking an animal's real-time position and scanning the environment ahead in a highly regular pattern—sweeping 30 degrees to the right, then 30 degrees to the left—at a rapid pace of ten times per second.

These rhythmic sweeps create a more efficient way to anchor locations relative to one another, providing a richer and more adaptable navigation system than previously imagined.

So it's not exactly the eyes sweeping but the brain?

via Kavli Institute at the Norwegian University of Science and Technology: Abraham Z. Vollan et al, Left–right-alternating theta sweeps in entorhinal–hippocampal maps of space, Nature (2025). DOI: 10.1038/s41586-024-08527-1


How eye saccades enable mammals to simultaneously chase prey and navigate through complex environments
Feb 2025, phys.org

It's almost like we're not designed to look at static images:

Researchers reconstructed the visual fields of freely moving ferrets that were chasing a fleeing target and discovered that eye saccades (very rapid coordinated eye movements) align the world motion—and not the actual thing they are chasing—to the retina and retinal specializations used for high-acuity vision.

Saccades achieve this by countering head rotations to align the area of the sharpest vision with the direction of intended travel and the area of the least motion-induced blur. 

via Max Planck Institute for Neurobiology of Behavior and Max Planck Florida Institute for Neuroscience: Eye saccades align optic flow with retinal specializations during object pursuit in freely moving ferrets, Current Biology (2025). DOI: 10.1016/j.cub.2024.12.032.


Friday, February 14, 2025

The Entelechy of Information

 

Things that aren't alive behave as if they are, making us question what life is.  Darwin's theory of evolution started with a Tree of Life for language, not for Life. This is a great piece, and she's the one who did the 'black traffic stop' study btw, very clever.


Study traces an infectious language epidemic
May 2024, phys.org

Note for context: More than 692,000 preventable hospitalizations were reported among unvaccinated patients from November to December 2021 alone, and at a minimum cost of $13.8 billion.

They used GPT-4 to find Covid prevention-opposed posts in banned subreddits. They were looking for something called "gists" - Reyna has shown that individuals learn and recall information better when it is expressed in a cause and effect relationship, and not just as rote information. This holds true even if the information is inaccurate or the implied connection is weak. Reyna calls this cause-and-effect construction a "gist."

The results show that, indeed, social media posts that linked a cause, such as "I got the COVID vaccine," with an effect, such as "I've felt like death ever since," quickly showed up in people's beliefs and affected their offline health decisions. In fact, the total and new daily COVID-19 cases in the U.S. could be significantly predicted by the volume of gists on banned subreddit groups.

Rho's work is grounded in a social science framework called Fuzzy Trace Theory that was pioneered by Valerie Reyna, a Cornell University professor of psychology and a collaborator on this Virginia Tech project.

via Eugenia Rho and Society + AI & Language Lab in the Department of Computing at the College of Engineering at Virginia Tech: Xiaohan Ding et al, Leveraging Prompt-Based Large Language Models: Predicting Pandemic Health Decisions and Outcomes Through Social Media Language, arXiv (2024). DOI: 10.48550/arxiv.2403.00994

And this, an important to note to stand by itself:
Many other social media platforms have barred outside researchers from using their data.

(And this is why they used reddit, which I think as of today no longer allows ^this. Regardless consider for a moment that digital social-mediated misinformation is a thing, and it's a real risk, and yet we can't even study it anymore because it's all totally proprietary. But don't consider the fact that data - all the data - is created by the users, yet it's not owned by the users to the extent that they, or anyone, can study it; that's for another post.)

Image credit: Plant root via Fiber Optic 2x - Dr Adolfo Ruiz De Segovia Nikon Small World - 2024


Back to language as an epidemic, behold Legalese:
Study explains why laws are written in an incomprehensible style
Aug 2024, phys.org

A 2022 study found legal documents frequently have long definitions inserted in the middle of sentences - a feature known as "center-embedding" which makes text more difficult to understand, even for lawyers. "Legalese somehow has developed this tendency to put structures inside other structures, in a way which is not typical of human languages." 

"Lawyers don't like it, laypeople don't like it, so the point of this current paper was to try and figure out why they write documents this way."

Hypotheses:
"Copy and edit hypothesis" - legal documents begin with a simple premise, and then additional information and definitions are inserted into already existing sentences, creating complex center-embedded clauses.

"Magic spell hypothesis" - the convoluted style of legal language signals a kind of authority, "if you want to write something that's a magic spell, people know that the way to do that is you put a lot of old-fashioned rhymes in there."

Test:
They did two experiments, one with people split in two groups for writing laws and then adding to them, or writing laws all at once. They found that people wrote center-embeddings regardless of whether they had to copy and edit.

The other experiment gave people laws from another country and asked them to rewrite them, both as law itself and as a description of the law. They found that people put embeddings in the law but not the description. 

They're now investigating the origins of center-embedding in legal documents, back to the Hammurabi Code of 1750 BC.

via MIT, University of Melbourne, University of Chicago Law School: Martínez, Eric, Even laypeople use legalese, Proceedings of the National Academy of Sciences (2024). DOI: 10.1073/pnas.2405564121


But in case you still weren't convinced that contagion is a function of information systems, and not of living systems ... or perhaps you'd rather believe that language is in fact a form of life:
How new words arise in social media
Sep 2024, phys.org

They analyzed 650 million tweets written in French between 2012 and 2014 to identify 400 words that were new to appear on the social media network then called Twitter, then they tracked the diffusion of these words over the following five years, and looked at the position and connectivity of users who adopted the words.

"lexical innovations" - new words

On average, the words that eventually persisted were used by people who were more central to their community, and remained in circulation at low levels for a longer period before entering a growth phase (18.5 months in circulation compared to 6.5 months for buzzes).

Words that became only temporary buzzes were used by people with less central positions within a social network and had a more rapid rise in use - followed by a rapid decline.

via École Normale Supérieure in France: Tarrade L, Chevrot J-P, Magué J-P (2024) How position in the network determines the fate of lexical innovations on Twitter, PLOS Complex Systems (2024). DOI: 10.1371/journal.pcsy.0000005

Thursday, January 14, 2021

Hear Ye


Network of sounds - New research reveals the magic secret of human networks
Aug 2020, phys.org

On Synchronization, and human synchronization in particular:

There's a bunch of violinists in the room, all with head phones on. They all hear their own violin, as well as those of others. But each person is connected to only some of the others, creating a complex communication network, think of a criss-crossing links-and-nodes graph. But then, they slow down some of the connections, so there is no universal timing for the music they play. Instead, they fall in and out of sync with each other, depending on who they're connected to.

And then, they delay all the players, making it impossible to sync with anyone, and so each player ends up cancelling-out what they hear from all but one, so they can try to sync with that one person. 

The main point of doing all this is so you can watch how people shift their attention from one player to the other, by the speed at which they're playing. (I think). And that means that ultimately, we can now study how a network functions when each node has it's own decision-making ability. A highway network full of autonomous car nodes, or a social network full of infobot nodes, or a society spreading a pandemic, of course. 

via the Weizmann Institute, along with Stony Brook: Synchronization of complex human networks, Nature Communications (2020). DOI: 10.1038/s41467-020-17540-7. http://dx.doi.org/10.1038/s41467-020-17540-7


The rhythm of change - What a drum-beat experiment reveals about cultural evolution
Oct 2020, phys.org

This experiment is awesome. Santa Fe Institute and Dan Sperber, and you know what that means. It goes like this:

120 non-musicians are given a drum, and asked to play Telephone. You may know this as Chinese Whispers, or a transmission chain, or iterated learning. It's meant to mimic the propagation of information through culture. After being broken into groups, the first person copies a recording of a drumbeat rhythm, and the second person copies not the recording but the first person, and the third person copies the second person, and so on. (That's the game of Telephone.)

The rationale is that musical instruments are literally physically constrained by the socioeoconomic status of the culture making them, and so instruments can be an ideal denominator for comparing something as complex as culture.

And the outcome was that by placing the drums in different arrangements, they found clear differences in the "evolution" of the reiterated rhythms. This suggests that ecological factors, such as physical distance and motor activity, can affect the evolution of cultural products, and these effects can even be measured.

Motor constraints influence cultural evolution of rhythm, Proceedings of the Royal Society B (2020). doi: 10.6084/m9.figshare.c.5178247. https://pubmed.ncbi.nlm.nih.gov/33109010/


War songs and lullabies behind origins of music
Nov 2020, phys.org

Auditory cheesecake and a new evolutionary theory of the origins of music:
Music comes from the need for groups to impress allies and foes, and for parents to signal their attention to infants.

The researchers also take issue with other music origin theories including that making music arose out of a need for social bonding, or that it is merely a fancy evolutionary byproduct with no real purpose—'auditory cheesecake' as the cognitive psychologist Steven Pinker once called it.
It's not about sexual selection; it's not about bonding; it's about the audience:
"If we study music in traditional societies, we see it used consistently to form political alliances," said Hagen.

Elaborate musical performances from war dances to military bands and even college marching bands, are often used to show a coalition's strength and impress outsiders. Hagen pointed out that many state visits include a performance by a national orchestra or military band. Studies also show that people can detect how well synchronized musicians are, and connect that higher synchrony to a coalition's strength.

"We need to invest a lot in infants since human babies are born helpless and need all sorts of help from the adults around them," said psychologist Samuel Mehr, director of Harvard's Music Lab. "The parent or caregiver needs a reliable way to signal to the infant that they are attending to them. But attention is a covert property of the mind. It's hard to determine if someone is actually paying attention to you." Directed song gives the infant a signal that the adult is paying attention to their needs, Mehr added. When singing, the adults cannot be talking to other people. The music also alerts the baby to the adult's physical location. "That's information that can't really be faked," he said.
Samuel A. Mehr et al, Origins of music in credible signaling, Behavioral and Brain Sciences (2020). DOI: 10.1017/S0140525X20000345. https://pubmed.ncbi.nlm.nih.gov/32843107/

Post Script:
AI program writes music and lyrics
May 2020, phys.org
OpenAI this week announced the creation of an open source system called Jukebox that creates unique melodies and harmonies along with lyrics and vocalizations in the styles of popular artists from a large field of musical genres.

As an example, Jukebox does not yet compose larger musical themes such as choruses and repeating phrases.