Showing posts with label omnibots. Show all posts
Showing posts with label omnibots. Show all posts

Monday, October 31, 2022

Panoptic Supremacy


EU to unveil landmark law to force Big Tech to police illegal content
Apr 2022, Financial Times via Ars Technica

Dark patterns - techniques that dupe people into unwillingly clicking:

"The controversial practice of targeting users online based on their religion, gender or sexual preferences will be banned under the Digital Services Act, according to four people with knowledge of the discussions."



Satellites will act as thermometers in the sky
Jul 2022, BBC News

Satellite Vu is attracting a lot of interest with its plans to fly a network of spacecraft to map heat signatures across the planet.

Such observations have long been made, but not at the resolution (3-4m) and frequency (several times a day) that the London firm is promising.

This will allow Satellite Vu to map the temperature profiles of individual buildings, offices and factories.

"With infrared, what you see in daytime, you can see at night. And whereas most other Earth observation data-sets are looking at the outside of buildings, we can even get an inference of what's going on inside - whether there's activity in that building, whether a house is occupied, whether there's productive machinery in a factory," said Anthony Baker, CEO and co-founder of Satellite Vu.

The data will also provide intelligence to the financial and insurance sectors - and even the military - by showing how temperatures in a scene have changed. It's possible, for example, to see that planes recently left an airfield from the cool "ghost images" they leave behind having earlier shadowed the ground from the Sun.


Inside Fog Data Science, the Secretive Company Selling Mass Surveillance to Local Police
Sep 2022, Electronic Frontier Foundation

Summarizing for context:
Finally, evidence suggests that Fog’s service relies on using advertising identifiers to link data together, so simply disabling your ad ID may stymie Fog’s attempts to track you. One email suggests that Apple’s App Tracking Transparency initiative — which made ad ID access opt-in and resulted in a drastic decrease in the number of devices sharing that information — made services like Fog less useful to law enforcement. And former police analyst Davin Hall told EFF that the company wanted to keep its existence secret so that more people would leave their ad IDs enabled. 


Tuesday, September 20, 2022

Whatever Happened To Good Old Fashioned Robots


Twisted soft robots navigate mazes without human or computer guidance
May 2022, phys.org

Physical intelligence vs Computational intelligence, active matter, and the Internet of Everything.
Also, Translucent Rotini:

The soft robots are made of liquid crystal elastomers in the shape of a twisted ribbon, resembling translucent rotini. 

When you place the ribbon on a surface that is at least 55 degrees Celsius (131 degrees Fahrenheit), which is hotter than the ambient air, the portion of the ribbon touching the surface contracts, while the portion of the ribbon exposed to the air does not. This induces a rolling motion in the ribbon. And the warmer the surface, the faster it rolls.

"It's much like the robotic vacuums that many people use in their homes," Yin says. "Except the soft robot we've created draws energy from its environment and operates without any computer programming."

via North Carolina State University: Twisting for Soft Intelligent Autonomous Robot in Unstructured Environments, Proceedings of the National Academy of Sciences (2022). DOI: 10.1073/pnas.2200265119



A marsupial robotic system that combines a legged and an aerial robot
Jun 2022, phys.org

"Our idea comes from a very simple concept: the complementarity of walking and flying robots," De Petris explained.

via DARPA Subterranean Challenge and winning team CERBERUS of NTNU, UNR, ETH Zurich, UC Berkley, Oxford and Flyability: Paolo De Petris et al, Marsupial walking-and-flying robotic deployment for collaborative exploration of unknown environments. arXiv:2205.05477v1 [cs.RO], arxiv.org/abs/2205.05477


Robotic lightning bugs take flight
Jun 2022, phys.org

Electroluminescent soft artificial muscles for flying, insect-scale robots that communicate with each other. 

These researchers previously demonstrated a new fabrication technique to build soft actuators, or artificial muscles, that flap the wings of the robot. and are made by alternating ultrathin layers of elastomer and carbon nanotube electrode in a stack and then rolling it into a squishy cylinder. When a voltage is applied to that cylinder, the electrodes squeeze the elastomer, and the mechanical strain flaps the wing. Electroluminescent zinc sulfate particles into the elastomeric artificial muscles. 

via MIT: Suhan Kim et al, FireFly: An Insect-Scale Aerial Robot Powered by Electroluminescent Soft Artificial Muscles, IEEE Robotics and Automation Letters (2022). DOI: 10.1109/LRA.2022.3179486


Robotic arms connected directly to brain of partially paralyzed man allows him to feed himself
Jul 2022, phys.org

A person with very limited upper body mobility, who hasn't been able to use his fingers in about 30 years, has just fed himself dessert using his mind and some smart robotic hands.

The new paper outlines an innovative model for shared control that enables a human to maneuver a pair of robotic prostheses with minimal mental input. "This shared control approach is intended to leverage the intrinsic capabilities of the brain machine interface and the robotic system, creating a 'best of both worlds' environment where the user can personalize the behavior of a smart prosthesis,"

via Johns Hopkins Applied Physics Laboratory and the Department of Physical Medicine and Rehabilitation in the Johns Hopkins School of Medicine: Shared control of bimanual robotic limbs with a BMI for self-feeding, Frontiers in Neurorobotics (2022). DOI: 10.3389/fnbot.2022.918001


Extra 'eye' movements are the key to better self-driving cars
Jul 2022, phys.org
 
With the help of Levy patterns, also called a foraging behavior model:

When tested with shifted images that mimicked naturally altered visual input that would occur when the eyes move, performance dropped drastically to chance level. Classification improved significantly after training the network with shifted images, as long as the direction and size of the eye movements that resulted in the shift were also included. Adding the eye movements and their corresponding motor commands to the network model allowed the system to better cope with visual noise in the images. "This advancement will help avoid dangerous mistakes in machine vision,"

via RIKEN: Andrea Benucci et al, Motor-related signals support localization invariance for stable visual perception, PLOS Computational Biology (2022). DOI: 10.1371/journal.pcbi.1009928

Learning From Scratch


Engineers build a robot that learns to understand itself, rather than the world around it
Jul 2022, phys.org

A Columbia Engineering team announced today they have created a robot that—for the first time—is able to learn a model of its entire body from scratch, without any human assistance. In a new study published by Science Robotics, the researchers demonstrate how their robot created a kinematic model of itself, and then used its self-model to plan motion, reach goals, and avoid obstacles in a variety of situations. It even automatically recognized and then compensated for damage to its body.

The researchers placed a robotic arm inside a circle of five streaming video cameras. The robot watched itself through the cameras as it undulated freely.

After about three hours, the robot stopped. Its internal deep neural network had finished learning the relationship between the robot's motor actions and the volume it occupied in its environment.

Yeah I'm creeped out.

via Columbia University School of Engineering and Applied Science: Boyuan Chen, Fully body visual self-modeling of robot morphologies, Science Robotics (2022). DOI: 10.1126/scirobotics.abn1944.



DayDreamer: An algorithm to quickly teach robots new behaviors in the real world
Jul 2022, phys.org

Their approach, introduced in a paper pre-published on arXiv, is based on learning models of the world that allow robots to predict the outcomes of their movements and actions.

The algorithm builds a world model based on its past "experiences" to teach robots new behaviors based on "imagined" interactions, reducing the need for extensive trial and error training in the real-world.

"We saw the robots adapt to changes in lighting conditions, such as shadows moving with the sun over the course of a day," 

via University of California, Berkeley: Philipp Wu et al, DayDreamer: world models for physical robot learning. arXiv:2206.14176v1 [cs.RO], arxiv.org/abs/2206.14176


Post Script:
"A promising direction would be to train the robots to explore their surroundings in the absence of a task through artificial curiosity, and then later adapt to solve tasks specified by users even faster," Hafner added.

Further Readings:
Ted Chiang's Digients (in Lifecycle of Software Objects)

Wednesday, September 7, 2022

It Knows


AKA The Great Recognizer

Neural network can read tree heights from satellite images
Apr 2022, phys.org

We need to be reminded of how powerful data can be when it's f**king massive. It doesn't even have to be related. Like for example I can tell which zip code you grew up in, even the street and maybe even the house, based on really really fine-grained data about your teethbrushing habits, delivered by your smart toothbrush of course.

It sounds crazy, but given enough data, nothing is crazy. 

We don't even have to know how to do it, just give a neural network enough data, and it will figure out the problem for you:

"Since we don't know which patterns the computer needs to look out for to estimate height, we let it learn the best image filters itself."

All you need are some training data, so in this case that means a bunch of trees for which we do know the height. Then we take the (otherwise flat) satellite data, mash it with the height data for the known trees to teach the network, and then unleash the network on the unknowns.  

And why do we want to know how tall trees are? "Because whenever we cut down trees, we release carbon into the atmosphere, and we don't know how much carbon we are releasing."

via ETH Zurich: Nico Lang, Walter Jetz, Konrad Schindler, Jan Dirk Wegner, A high-resolution canopy height model of the Earth. arXiv:2204.08322v1 [cs.CV], arxiv.org/abs/2204.08322

Image source: The 4 Trends That Prevail on the Gartner Hype Cycle for AI, 2021, Gartner, Sep 2021
via: Intelligent Sensing: Enabling the Next “Automation Age” by Marco Cassis of STMicroelectronics at International Solid-State Circuits Conference 2022


Anxious individuals identified by analyzing their walking gait
May 2022, phys.org

The best method for identifying anxious individuals was walking. The team successfully identified people who were anxious with 75% accuracy.

They had to complete a balance test and a two-minute walk while wearing sensors. Based on these data, the team determined the young people who report being anxious walk in a way that's very similar to older adults who are fearful of falling. They find that young, anxious adults are constantly scanning for threats from side to side while walking and have trouble turning. The researchers also reported that anxious people have worse balance than those who are anxious.

via Clarkson University: Maggie Stark et al, Identifying Individuals Who Currently Report Feelings of Anxiety Using Walking Gait and Quiet Balance: An Exploratory Study Using Machine Learning, Sensors (2022). DOI: 10.3390/s22093163


Using electric signals from human brains, new software can perform computerized image editing
Jun 2022, phys.org

"All the existing software has been previously trained with labeled input. So, if you want an app which can make people look older, you feed it thousands of portraits and tell the computer which ones are young, and which are old.

Here, the brain activity of the subjects was the only input.

This is an entirely new paradigm in artificial intelligence—using the human brain directly as the source of input."

"All the existing software has been previously trained with labeled input. So, if you want an app which can make people look older, you feed it thousands of portraits and tell the computer which ones are young, and which are old. Here, the brain activity of the subjects was the only input. This is an entirely new paradigm in artificial intelligence—using the human brain directly as the source of input."

But alas:
"Collecting individual brain signals does involve ethical issues..."

We are the data, and we have lots of it.

Be a real shame if someone were to save our brainwaves and then sell them on the data market, where they could in turn unintentionally feed back to us our own biases after having been amplified by some behaviorally-exploitative algorithm...

via University of Copenhagen and University of Helsinki: Brain-Supervised Image Editing. Keith M. Davis III et al. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Jun 2022. 


People with similar faces likely have similar DNA
Aug 2022, phys.org

They recruited human doubles from the photographic work of François Brunelle, a Canadian artist who has been obtaining worldwide pictures of look-alikes since 1999. They obtained headshot pictures of 32 look-alike couples. 

Physical traits such as weight and height, as well as behavioral traits such as smoking and education, were correlated in look-alike pairs. Taken together, the results suggest that shared genetic variation not only relates to similar physical appearance, but may also influence common habits and behavior.

Eventually the all-seeing omnibot will be able to create a complete living human population gene network based only on our faces (and it will predict our habits and behaviors too).

via Barcelona Supercomputing Center and Josep Carreras Leukaemia Research Institute Barcelona: Manel Esteller, Look-alike humans identified by facial recognition algorithms show genetic similarities, Cell Reports (2022). DOI: 10.1016/j.celrep.2022.111257


Algorithm predicts crime a week in advance, but reveals bias in police response
Jul 2022, phys.org

Algorithm that forecasts crime by learning patterns in time and geographic locations from public data on violent and property crimes. The model can predict future crimes one week in advance with about 90% accuracy.

Not like that!
In a separate model, the research team also studied the police response to crime by analyzing the number of arrests following incidents and comparing those rates among neighborhoods with different socioeconomic status. They saw that crime in wealthier areas resulted in more arrests, while arrests in disadvantaged neighborhoods dropped. Crime in poor neighborhoods didn't lead to more arrests, however, suggesting bias in police response and enforcement.

via University of Chicago: Ishanu Chattopadhyay, Event-level prediction of urban crime reveals a signature of enforcement bias in US cities, Nature Human Behaviour (2022). DOI: 10.1038/s41562-022-01372-0


AI reveals unsuspected math underlying search for exoplanets
May 2022, phys.org

I forget about the singularity sometimes, but it's happening right now; we're already in the singularity:
Artificial intelligence (AI) algorithms trained on real astronomical observations now outperform astronomers in sifting through massive amounts of data to find new exploding stars, identify new types of galaxies and detect the mergers of massive stars, accelerating the rate of new discovery in the world's oldest science.

But that's already been the case, now it appears the AI has discovered "unsuspected connections hidden in the complex mathematics arising from general relativity". 
The algorithm figured out new rules of gravitational microlensing:
"I argue that they constitute one of the first — if not the first — time that AI has been used to directly yield new theoretical insight in math and astronomy."-Joshua Bloom, UC Berkeley professor of astronomy

"Keming's machine learning algorithm uncovered this degeneracy that had been missed by experts in the field toiling with data for decades. This is suggestive of how research is going to go in the future when it is aided by machine learning, which is really exciting." -Scott Gaudi, professor of astronomy at Ohio State

via University of California - Berkeley: Keming Zhang et al, A ubiquitous unifying degeneracy in two-body microlensing systems, Nature Astronomy (2022). DOI: 10.1038/s41550-022-01671-6


Post Script:
"AI software has collaborated with mathematicians to successfully develop a theorem about the structure of knots, but the suggestions given by the code were so unintuitive that they were initially dismissed. Only later were they discovered to offer invaluable insight. The work suggests AI may reveal new areas of mathematics where large data sets make problems too complex to be comprehended by humans."
-DeepMind AI collaborates with humans on two mathematical breakthroughs, Matthew Sparkes, New Scientist, Dec 2021 [link]

They're talking about knots. Instead of feeding it facebook photos or product reviews, they gave it math problems...about knots. The "connection between algebraic and geometric invariants of knots".

And why knots? Because theories about knots can also be applied to quantum field theory. Don't ask me why, but they do, and it's called topology.

via Google DeepMind: Advancing mathematics by guiding human intuition with AI. Davies, A., Veličković, P., Buesing, L. et al. Nature 600, 70–74 (2021). DOI: 10.1038/s41586-021-04086-x


Post Post Script, On Synthetic Data:
'Fake' data helps robots learn the ropes faster
Jul 2022, phys.org

How to be a human:
For the rope-looping simulation and experiment, Mitrano and Berenson expanded the data set by extrapolating the position of the rope to other locations in a virtual version of a physical space—so long as the rope would behave the same way as it had in the initial instance. Using only the initial training data, the simulated robot hooked the rope around the engine block 48% of the time. After training on the augmented data set, the robot succeeded 70% of the time.
via  University of Michigan: Data Augmentation for Manipulation, arXiv:2205.02886v3 [cs.RO]  https://doi.org/10.48550/arXiv.2205.02886