Tuesday, September 14, 2021

On Memory in Times Past


Ancient Australian Aboriginal memory tool superior to 'memory palace' learning
May 2021, phys.org

Imagine that.

Although this article is about how the Memory Palace technique of memorization is second place to the Aboriginal technique of attaching facts to the landscape, via a narrative, I found this passage interesting: "The memory palace technique dates back to the early Greeks and was further utilized by Jesuit priests. Handwritten books were scarce and valuable, and one reading would have to last a person's lifetime, so ways to remember the contents were developed."

via Monash University: PLOS One (2021)

The Fingerbot


Using the human hand as a powerless infrared radiation source
Apr 2021, phys.org

The future is so obvious once it happens.

The idea of your fingers manipulating computer screens floating in mid air seems pretty natural. I never thought of my finger as a remote control, but it does make perfect sense. This also reminds me of the Nintendo Wii hack from many years ago, where you place the Wii controller in a stationary position, and have it read an IR light pen as you draw on a surface with it. The light-point is followed by the Wii, and translated into lines on a projected screen. You use the Wii backwards to write on the projected surface in real time. Graffiti Research Labs took this a step further with their Laser Tag project. Now we can imagine doing that with our fingers. No Wii necessary, only some basic intelligence in your camera, and it will be able to learn how to see your fingers and take direction from them. 

via Shanghai Jiao Tong University: Shun An et al. Human hand as a powerless and multiplexed infrared light source for information decryption and complex signal generation, Proceedings of the National Academy of Sciences (2021). DOI: 10.1073/pnas.2021077118

Image credit: It's a fingerbot, so you can inject an analog loop into your IoT wifi smart home mesh network. But they changed the name to switchbot; probably a good idea. 

Post Script:
Speaking of Laser Tag...
This is the EyeWriter, which allows paralyzed graffiti artists to write graffiti with their eyeballs.

And this is his graffiti, TEMPT circa 2009.

Wednesday, September 8, 2021

Artificial Intuition - It's What Computers Crave


AKA The Pendulum of the Anthropocene

Ten years ago I recall myself meta-presenting to my high school class Iain McGilchrist on the TED stage, via RSA Animate. He wrote a book called The Master and His Emissary: The Divided Brain and the Making of the Western World, about the left brain right brain dichotomy and about how the history of humans since the Enlightenment is a story of the shift from right-brained religious order to left-brained scientific discovery.

But I being an art teacher, and they being young people who had no reason to believe that the entire history of humankind is any indication of human futures, I speculated aloud, for their sake -- are we really destined to continue on this trajectory forever? What if the pendulum were to swing in the other direction? Could there be a world where the Right brain of feelings and emotions are more important than facts and data?

I didn't think what I was speculating could actually be true. My job was to ask the craziest questions imaginable, in the hopes of stretching the most malleable material on Earth -- the minds of young people. I myself could never imagine a world where the right brain became the dominant force. But I always held back my own biases, because one thing I was certain about was that the world these kids would grow up in would be very different from the world I grew up in, and they only way to prepare them was to forget everything I knew, and say nothing else but "what if".

And then it happened. Facts became optional. Computers became creative. Only 500 years after its appearance, Reason has begun to lose its appeal, and its utility. 

First, we see algorithms generating theories without any data:

The Ramanujan Machine - Researchers have developed a 'conjecture generator' that creates mathematical conjectures
Feb 2021, phys.org

"The Ramanujan Machine" generates conjectures without proving them, by "imitating" intuition using AI and considerable computer automation.

via Israel Institute of Technology: Gal Raayoni et al. Generating conjectures on fundamental constants with the Ramanujan Machine, Nature (2021). DOI: 10.1038/s41586-021-03229-4

And then, we see algorithms generating data without any theories:

New machine learning theory raises questions about nature of science
Feb 2021, phys.org

Instead of teaching the program the laws of physics, he just shows it all the orbits of all the planets until it can produce its own orbits. No more rules baby:

And he goes on: "I would argue that the ultimate goal of any scientist is prediction. You might not necessarily need a law. For example, if I can perfectly predict a planetary orbit, I don't need to know Newton's laws of gravitation and motion. I go directly from data to data.
-Hong Qin, physicist at the U.S. Department of Energy's Princeton Plasma Physics Laboratory

via Princeton Plasma Physics Laboratory: Hong Qin, Machine learning and serving of discrete field theories, Scientific Reports (2020). DOI: 10.1038/s41598-020-76301-0

Another one, we let the algorithms imagine, just to see what they come up with:

Enabling the 'imagination' of artificial intelligence
Jul 2021, phys.org

They're really good at synthesizing, but not at creating imagery from scratch. Here, "controllable disentangled representation learning" or what the article calls "imagination".

via University of Southern California: Yunhao Ge et al, Zero-shot Synthesis with Group-Supervised Learning. Open Review. https://openreview.net/forum?id=8wqCDnBmnrT


Thursday, September 2, 2021

Becoming the Artificial Unconscious


Yves Tanguy – Indefinite Divisibility – 1942

The first step to becoming a computer is to think like a computer. The next step to becoming a computer is to materialize those thoughts, perhaps in the form of pictures. 

The Surrealists did this with our collective unconscious. At a time in history when humans were becoming "modern", they took the dark mess of confusion that was our subconscious and made it visible. They used automatic artmaking, dream recall, and mind games like Exquisite Corpse to hack through our subconscious and bring back precious material to help us understand ourselves and what we were becoming. 

The above image is an example of the unconscious mind made visible by Yves Tanguy from 1942.

Today, we are again becoming new kinds of human. Our minds are merging with the computer algorithms we have created, so they in turn create us, in a never-ending feedback loop of evolution. 

Art has lots of purposes, but I like to think the most important purpose of all is to teach us how to be human. And today, being human has a lot do with being a computer. This is what computer-brains look like on the inside:

BigGAN-generated image by Mario Klingemann - 2019

They're also calling it social media performance art. But I think artists have been doing this for quite a while, under the name generative digital art, or algorithmic art. I just wonder what the Surrealists would say if they could see this stuff.

Post Script:
Melbourne artist and coder Sam Hains created Zero Likes, an AI trained to respond only to those lost and lonely images that miss out on attention.

Dog layers on a bed with a blanket - Sam Hains Zero Likes - 2017

Post Post Script:
First of all, the MIT Press has a journal called Leonardo. Next, here is a nice explanation of the artistic process by neuroscience researchers, written in the online science magazine Medical Express.

"Ultimately, we sought to explain the role of implicit learning processes in artistic cognition, or how the competition between different brain networks can lead to a more effective artistic intuition."

And they found that "weaker" prefrontal circuits, which are related to executive functions, can actually lead to more effective artistic cognition. The researchers refer to this phenomenon as the Andras effect.

"For example, if a photographer can tune down her control functions and access to long-term memories, she can perceive a 'different world'; a world without expectations or past memories," Nemeth said. "We can call this intuitive photography."

Kate Schipper et al. How do competitive neurocognitive processes contribute to artistic cognition? – The Andras-effect, Leonardo (2020). DOI: 10.1162/leon_a_02007

I'm also thinking now about how the chemical promiscuity of olfactory receptors makes mindful, environmental odor exploration (paying attention to smells) a great means to exercise your artistic mind. 

Tuesday, August 24, 2021

Word Wrastlin


Parquet Deformations are great for learning how to code. (Image source)

Or for learning how to think in general. This is a parquet deformation of sorts, the metamagical Fake-False continuum, a la Douglas Hofstadter.


And these are a couple examples of not a continuum, but at lease single quantum instantiation -- it's both at the same time.

You Are Loved You Are Covid

My Favorite Color Is Glitter My Favorite Color Is Hitler



Wednesday, August 18, 2021

Mandibulips and the Swarm Amplified Human


It starts out like this -- our body parts are already a swarm. We take it for granted that our body parts know where they are and what they're doing, and can talk to each other. "Stereotypical body control is taken care of by neural subsystems so that the conscious cognitive system can deal with more complex world dynamics." -link

What we don't take for granted, and what we might even find uncomfortable to imagine because it means radically redefining the human condition, is that our assemblage of body parts will one day extend to the technosphere of nanobots, controlled not by us alone but by an emergent swarm cognition consisting of all the nodes in our extended neural network, and all of this wired directly into our own big bundle of blinking neurons in our head.

But then, in the same way these "nodes" of flying, crawling, swimming bots will join with us, our body parts will disarticulate to become part of the greater network. In the beginning, we will need "humans-in-the-loop," but eventually, we will need bigger and more centralized centers of control to interact with control the decentralized swarms. There will be humans in the loop, only a bit more efficient, so that one human will control multiple body-swarm entities. Your hands will no longer be your own. We will share everything. Today, your privacy is gone, tomorrow, the body itself. 

A theoretical approach for designing a self-organizing human-swarm system
Aug 2021, phys.org
Bio-inspired metaphor for design, the swarm-amplified human, which essentially proposes that the swarm should self-organize itself into and act like human body parts."

The paper highlights the potential benefits of using human state classification as a control input fed to a robot swarm, rather than having a human user controlling the swarm at all times.

"Designing robot swarms that are an extension of the human body relates to integrating neural logic into robot swarms on the network level, which has received only limited attention so far," Hasbach said. "We have proposed some ideas on how robot swarms could be thought of as neural systems."
^That's just the press release for this theoretical framework. I'd like to paste a few lines from the paper itself because if I didn't tell you, you might think it came from a good scifi novel. In other words, you can't make this stuff up:
Because no holistic theory has been explicitly formulated that can inform how humans and robot swarms should interact.

Joint human–swarm loops, that is, a cybernetic system made of human, swarm and interface. 

An intelligent system that balances between centralized and decentralized control.

The robot swarm should be integrated into the human’s low-level nervous system function.

The swarm amplified human treats the swarm as an extension of the human nervous system, integrated at low-level sensory–motor behaviour

Interfacing at the low-level nervous system means essentially two things (Figure 9). First, as said before, low-level stereotypic sensory–motor control often feels automatic to the conscious mind. When walking down the street, you rarely think about walking. Therefore, the (cognitive) state of humans should be translated by the interface into commands for the swarm clusters. This is referred to as passive or implicit interaction, that is, unconscious control, which can be contrasted to active/explicit control (e.g. deliberate gesture control).

This feeling of being in control over the swarm clusters (alias artificial body parts) 

The SAH [swarm amplified human], therefore, relates to the notion of a cyborg that ‘[…] deliberately incorporates exogenous components extending the self-regulatory control function of the organism in order to adapt it to new environments’
-Clynes, M. E., Kline, N. S. (1960). Cyborgs and space. Astronautics, 5, 26–27.

Rather than claiming that neural networks and biological swarms share the actual same computational basis, we argue that both can be modelled as self-organizing systems. Thus, both humans and swarms are abstracted into one common computational reference frame to integrate the swarm at the low-level of neural sensory–motor loops. 

swarm amplified human - figure 11

Humans also need training to learn sensory–motor patterns for their real body parts. No human baby is able to walk after birth... Similarly, the operator should be exposed to different situations so that he is able to develop an intuition of swarm dynamics as well as how his own states influence these dynamics. 

A more biologically plausible and more efficient algorithm may be a searching robot chain that originates from the human, similar to growing biological axons that are guided by molecular cues.

Human agent moving through a swarm gradient. 

By convergence, global information about the environment can be estimated by the swarm connectome and provided to the human, similar to sensory upstreams in the biological nervous system.

To include the swarm in the human’s nervous system, the brain must be tricked into integrating the swarm into its body representation. This is achieved if the human operator has the illusion that the swarm feels like part of himself, if it feels like an artificial body part. 

In the future, Tom may be equipped with an advanced brain–computer interface technology that provides high-resolution classifications of cognitive states and adapted sensory–motor signals. This could allow him, for example, to feel the location (i.e. the direction and the distance) of a victim, alike to having a sixth sense, while allocating more robots to the estimated location of the victim, similar to closing your hands around an object.

Rather than being the target of the interaction, the swarm should self-organize as the interface between the human operator and relevant features of the environment. This mimics the formation of neural pathways in the nervous system that are tuned to relevant environmental stimuli.
Notes:
via Fraunhofer Institute for Communication, Information Processing and Ergonomics (FKIE) and University of Bonn in Germany: The design of self-organizing human-swarm intelligence. Jonas D Hasbach, Maren Bennewitz. Adaptive Behavior (2021). DOI: 10.1177/10597123211017550

New Word:
Excursively - given to making excursions in speech, thought, etc.; wandering; digressive. Example: Robustness and scalability is created by treating the swarm as a distributed neural machinery that excursively relies on local interactions. 

Post Script:
"So quite ya yappin' fore I get to clappin'
And have your body parts mix and matching fella"
-What Happened to That Boy, Birdman feat. Clipse (Neptunes), 2002

Post Post Script:
Happened to see this from an older post, but it doesn't hurt to plaster this one all over town until it gets old (it never gets old)
Dec 2011, Nature

Wednesday, August 4, 2021

User Friendly

The book User Friendly is great and highly recommended for anyone interested in design. This piece here has seemingly little to do with user design, but it's real good for the talk here on Network Address about algos and predictive analytics.

The Cambridge Analytica operation, circa 2013, showed us how powerful predictive analytics could be when combined with persistent pervasive behavior surveillance; I think most people forget how much "it knows"

A few dozen "likes" can guess:
  • race (95%)
  • marital status (88%)
  • political party (85%)
  • marital status
  • religiosity
  • cigarette smoking
  • drug use
  • separated parents
70 likes gets you:
  • the Big 5 personality trait survey responses
  • better than a friend could guess
150 likes:
  • better than a parent
300 likes:
  • better than a partner
Post Script:
"Facebook doesn't spread information so much as affirmation" and it "allows the fringes to feel like the center" p264
User Friendly: How the Hidden rules of Design Are Changing the Way We Live, Work, and Play
Cliff Kuang and Robert Fabricant, 2019

Post Post Script:
"The best designs dissolve into behavior" (p304)
-Naoto Fukasawa