Showing posts with label meta. Show all posts
Showing posts with label meta. Show all posts

Monday, January 13, 2025

Science Doesn't Work For Free


This post is about how science works, and how it doesn't. 

Science is hard work, and requires lots of money, most of which comes from public funds and school tuitions. But some of it comes from people-like entities called corporations. Sometimes it's hard to tell what money goes where and from who, and we want to know because those who fund science are ultimately creating our reality.

Infiltrating academia is the most surreptitious, subversive, insidious (and let's face it - effective) way to control the minds of a population, every big industry (Big Agra, Big Rubber, Big Cheese, Big PFAS?) will spend more money manipulating reality by way of academic scientific pursuits than making their own products and services. 

This first article is from the Barabasi labs and uses network science, so the way they do their study is interesting:

Study reveals complex dynamics of philanthropic funding for US science
Jun 2024, phys.org

The IRS in recent years has made the tax form that nonprofits must file disclosing their revenue, expenditures, and other organizational information machine readable. Researchers then analyzed more than 3.6 million tax records filed by approximately 685,000 universities and research institutions between 2010 and 2019. 

"Some philanthropists make it very explicit that they give to their local communities. The Gates Foundation's biggest donation was to the University of Washington; they favor things in Seattle much more than they declared."

The authors also found that the amount of philanthropic dollars institutions receive is highly correlated to the degree of support provided by the National Science Foundation.

Additionally, private donors and nonprofits tend to support the same organizations over time, the analysis showed. with an 80% chance that a donor who gave to an organization two years in a row would support it the following year; for funding relationships that had lasted seven years, the probability is 90%.

Such a tool could enhance the public's understanding of the impact of philanthropy on science and help researchers gain access and awareness of the philanthropic options that could advance their work.

via Virginia University and Albert-László Barabási at Northeastern University: Louis M. Shekhtman et al, Mapping philanthropic support of science, Scientific Reports (2024). DOI: 10.1038/s41598-024-58367-2



Next - Science depends on a written record of experiments and results. Maintaining the record of science, i.e., scientific journals, is done almost exclusively by the private industry. Sometimes, both the scientsits and the publishers have an incentive to NOT realize they're doing something wrong (Upton Sinclair: "It is difficult to get a man to understand something when his salary depends on his not understanding it").

Here's a story about how bad science happens, and what it can do to the rest of us. This is about retractions:

University of Minnesota retracts pioneering studies in stem cells, Alzheimer's disease
Jun 2024, phys.org

Dr. Karen Ashe and colleagues gained global attention in 2006 when they found amyloid beta star 56 as a molecular target in the onset of Alzheimer's disease.

Colleagues at other institutions struggled to replicate their findings, which prompted others to look closer at the images of cellular or molecular activity in mice on which their findings were based.

Verfaillie and colleagues corrected the Nature paper in 2007, which contained an image of cellular activity in mice that appeared identical to an image in a different paper that supposedly came from different mice. The U then launched an investigation over complaints of image duplications or manipulations in more of Verfaillie's papers.

It eventually cleared her of misconduct, but blamed her for inadequate training and oversight and claimed that a junior researcher had falsified data in a similar study published in the journal Blood.

The journal Nature stated that the paper contained "excessive manipulation, including splicing, duplication and the use of an eraser tool" to edit the images.

(This is almost 20 years later, and after lots of people invested lots of money in chasing this result.)

via The Star Tribune:
Sylvain Lesné et al, RETRACTED ARTICLE: A specific amyloid-β protein assembly in the brain impairs memory, Nature (2006). DOI: 10.1038/nature04533
Yuehua Jiang et al, RETRACTED ARTICLE: Pluripotency of mesenchymal stem cells derived from adult marrow, Nature (2002). DOI: 10.1038/nature00870

Less sensational, or perhaps more sensational, is this absolute bomb - dropped on all of us who've been obediently following the one-drink-a-day advice for about one generation since it first came out.

The worldwide public health community has been scratching its head over this since it emerged from the data, many years ago. People who drink once a day seem to live longer than people who drink none. Therefore, one drink a day must be good for you! Hmmm. Turns out the only people in a large population who we can get to serve as a "normal healthy person who doesn't ever drink" is a person who's suffering from former substance abuse, and abstaining from alcohol not for any other reason than the fact that it's going to ruin their life. And those people have a built-in health burden that makes them a bad reference point for a "normal healthy person", and then makes all the rest of us look less healthy when compared to them.  It's called the Former Drinker Paradox, or a number of other names, and it's likely going to be the canonical case study in public health research courses for decades to come. 

This is a story about the scientific method, study design, and the need to understand how large numbers work when mashed together:

Study debunks link between moderate drinking and longer life
Jul 2024, phys.org

Reminder - "lower quality" studies, with older participants, no distinction between former drinkers and lifelong abstainers, linked moderate drinking to greater longevity. So moderate drinkers were compared with "abstainer" and "occasional drinker" groups that included some older adults who had quit or cut down on drinking because they'd developed any number of health conditions. "That makes people who continue to drink look much healthier by comparison."

"If you look at the weakest studies," Stockwell said, "that's where you see health benefits."

Yes, the weak studies. 

Further reading: Stockwell, T., et al. Why do only some cohort studies find health benefits from low volume alcohol use? A systematic review and meta-analysis of study characteristics that may bias mortality risk estimates. Journal of Studies on Alcohol and Drugs (2024). DOI: 10.15288/jsad.23-00283. 

Next - The scientists who make the content in the journals and the people who run the publishing industry are not the same people, yet they both seem to be having a hard time resisting the temptation to use robots:

Flood of 'junk': How AI is changing scientific publishing
Aug 2024, phys.org

A bioinformatics professor at Brigham Young University in the United States told AFP that he had been asked to peer review the study in March.

After realizing it was "100 percent plagiarism" of his own study - but with the text seemingly rephrased by an AI program - he rejected the paper.

He said he was "shocked" to find the plagiarized work had simply been published elsewhere, in a new Wiley journal called Proteomics.

More than 13,000 papers were retracted last year, by far the most in history, according to the US-based group Retraction Watch. The paper in question in this writeup, however, has not yet been retracted.
Note: usually I try to add the academic paper here at the bottom, and which is usually taken from the bottom of the writeup, but in this case I think there is no paper, and the bottom of the writeup points to ... the journal that reprinted the obviously fake paper. Proteomics. Remember the name. But also remember that the science aggregator website (phys.org) probably uses some level of automation (remember when we used to call AI simply "automation"?) to place the article information at the bottom of the writeup, explaining how this happened here. This is the future. 

Paper mills: The 'cartel-like' companies behind fraudulent scientific journals
Oct 2024, phys.org via Rizqy Amelia Zein for The Conversation

In just five years, the numbers of retractions jumped from 10 in 2019 to 2,099 in 2023. [link]

Paper Mills - By paying around €180 to €5,000 (approximately US$197–$5,472), a person can have their name listed as the author of research paper, without having to painstakingly do research and write the results.

And this is how:
  • plagiarize other published articles
  • contain false and stolen data
  • include engineered and duplicated images
  • rewrite scientific articles using generative artificial intelligence 
  • translate published articles from other languages into English
  • sell authorship slots before an article is accepted, guaranteed to publish
  • offer fake peer review services to convince potential buyers
  • bribing rogue journal editors with as  much as $20,000 [link]
  • unusual collaboration patterns: An article on the activity of ground beetles attacking crops in Kazakhstan, for example, is written by authors who are neither affiliated with institutions in Kazakhstan nor experts in insects or agriculture. The authors' backgrounds are suspiciously heterogeneous, ranging from anesthesia, dentistry, to biomedical engineering. 
Journals rarely state outright that a retraction is due to paper mill fraud, so Retraction Watch data as of May 2024 only recorded 7,275 retractions of articles related to the paper mill out of a total of 44,000 retractions recorded. In fact, it is estimated that up to 400,000 paper mill articles have infiltrated scientific literature over the past two decades.

via The Conversation under Creative Commons license


Even the survey participants themselves can't resist!

Survey participants are turning to AI, putting academic research results into question
Nov 2024, phys.org

"AI use has probably caused scholars and researchers and editors to pay increased scrutiny to the quality of their data."

The authors surveyed about 800 participants on Prolific (like Mechanical Turk) to learn how they engage with LLMs. All had taken surveys on Prolific at least once; 40% had taken seven surveys or more in the last 24 hours. 

The authors also noted that these responses included more "dehumanizing" language when describing Black Americans, Democrats, and Republicans. In contrast, LLMs consistently used more neutral, abstract language, suggesting that they may approach race, politics, and other sensitive topics with more detachment.

Participants who were newer to Prolific or identified as male, Black, Republican, or college-educated, were more likely to say they'd used AI writing assistance.

Societal inflection point: To see how human-crafted answers differ from AI-generated ones, the authors looked at data from three studies fielded on gold-standard samples before the public release of ChatGPT in November 2022. 

via Stanford Graduate School of Business, New York University and Cornell: Simone Zhang et al, Generative AI Meets Open-Ended Survey Responses: Participant Use of AI and Homogenization, SocArXiv (2024). DOI: 10.31235/osf.io/4esdp


Bonus Reminder:
Ensuring Free, Immediate, and Equitable Access to Federally Funded Research
This memorandum provides policy guidance to federal agencies with research and development
expenditures on updating their public access policies. In accordance with this memorandum,
OSTP recommends that federal agencies, to the extent consistent with applicable law:
  1. Update their public access policies as soon as possible, and no later than December 31st, 2025, to make publications and their supporting data resulting from federally funded research publicly accessible without an embargo on their free and public release;
  2. Establish transparent procedures that ensure scientific and research integrity is maintained in public access policies; and,
  3. Coordinate with OSTP to ensure equitable delivery of federally funded research results and data. Aug 25 2022.

Wednesday, October 2, 2024

Public Trust in Science


How much trust do people have in different types of scientists?
Apr 2024, phys.org

2,780 participants from the United States were asked about trust in 45 different types of scientists, from agronomists to zoologists. 

Participants were quizzed on how they see scientists with regard to:
  • Competence: how clever and intelligent they consider scientists
  • Assertiveness: how confident and assertive
  • Morality: how just and fair
  • Warmth: how friendly and caring

On a 7-point scale, with 7 being most trusted:
  • political scientists - 3.71
  • economists - 4.28
  • neuroscientists - 5.53
  • and marine biologists  - 5.54
"Nevertheless, one thing is clear: the diversity of scientific fields must be taken into account to more precisely map trust, which is important for understanding how scientific solutions can best find their way to policy."
via University of Amsterdam: Vukašin Gligorić et al, How social evaluations shape trust in 45 types of scientists, PLOS ONE (2024). DOI: 10.1371/journal.pone.0299621


Wednesday, January 10, 2024

So Many Metas


A somewhat systematic review of previous systematic reviews and meta-analyses about nutrition and Alzheimer's
May 2023, phys.org

The team conducted a review of systematic reviews aka meta-analysis studies around the topic of nutrition in disease. (So their's is a meta-meta-analysis.)

This is why kids need to go to school:

There is a risk that a systematic review of multiple meta-data studies could artificially weight specific study findings if they are included multiple times across the different meta-analyses.

What may be important to know is that both of these meta-analyses included the same study from 2015, titled "Intakes of fish and polyunsaturated fatty acids and mild-to-severe cognitive impairment risks: A dose-response meta-analysis of 21 cohort studies," which is itself a meta-analysis that could contain studies included in other meta-analyses covered by the current study.

Note: This is 100% related to the AI-feeding-AI problem we're not even beginning to talk about yet -- because when you use meta-analysis of past meta-analyses, you risk multiplying the dirty data. 

via International Education College of Zhejiang Chinese Medical University, Hangzhou: Inmaculada Xu Lou et al, Effect of nutrition in Alzheimer's disease: A systematic review, Frontiers in Neuroscience (2023). DOI: 10.3389/fnins.2023.1147177



Do measurements produce the reality they show us?
Aug 2023, phys.org

The observable values of a physical system depend on the dynamics of the measurement interaction by which they are observed. "This is a major step towards explaining the meaning of 'superposition' in quantum mechanics".

"Our results show that the physical reality of an object cannot be separated from the context of all its interactions with the environment, past, present and future, providing strong evidence against the widespread belief that our world can be reduced to a mere configuration of material building blocks," said Hofmann.

I've never heard it this way - 

Fully resolved measurements require a complete randomization of the system dynamics; this corresponds to a superposition of all possible system dynamics. 

"Context-dependent realities can explain a wide range of seemingly paradoxical quantum effects. We are now working on better explanations of these phenomena. Ultimately, the goal is to develop a more intuitive understanding of the fundamental concepts of quantum mechanics that avoids the misunderstandings caused by a naïve belief in the reality of microscopic objects," said Hofmann.

Hiroshima University: Tomonori Matsushita et al, Dependence of measurement outcomes on the dynamics of quantum coherent interactions between the system and the meter, Physical Review Research (2023). DOI: 10.1103/PhysRevResearch.5.033064


From stock markets to brain scans, new research harmonizes hundreds of scientific methods to understand complex systems
Sep 2023, phys.org

They looked at hundreds of different methods for measuring interaction patterns in complex system, and worked out which ones are most useful for understanding a given system. They call it the scientific orchestra, and each method is an instrument, and they thought maybe some instruments are better for certain kinds of data, so they tried to find out.

We're talking about methods like Brownian motion, coupled maps, coupled oscillators, simulated fMRI, simulated climate, wave equations, or uncorrelated noise to understand data like stock markets, river flow, brain waves, earthquakes.

In total, we applied our 237 methods to more than 1,000 datasets. By analyzing how these methods behave when applied to such diverse scientific systems, we found a way for them to "play in harmony" for the first time.

They found that the methods were grouped differently than what we traditionally think, and that when properly orchestrated, the full ensemble of scientific methods demonstrated improved performance over any single method on its own.

via Centre for Complex Systems, The University of Sydney: Oliver M. Cliff et al, Unifying pairwise interactions in complex dynamics, Nature Computational Science (2023). DOI: 10.1038/s43588-023-00519-x

AI Art - Mechanical Goddess - 2024

Five factors that assess well-being of science predict support for increasing US science funding
Sep 2023, phys.org

Drawing on 13 questions in APPC's 2022 nationally representative Annenberg Science Knowledge survey (ASK) survey of 1,154 U.S. adults, researchers identified five factors that form a Factors Assessing Science's Self-Preservation (FASS) model. The model can be used to assess the extent to which public perceptions align with the self-presentation of science and scientists live up to the ways in which they define themselves and their work to the public.
  • credible
  • prudent
  • unbiased
  • self-correcting
  • beneficial
via Annenberg Public Policy Center of the University of Pennsylvania: Yotam Ophir et al, Factors Assessing Science's Self-Presentation model and their effect on conservatives' and liberals' support for funding science, Proceedings of the National Academy of Sciences (2023). DOI: 10.1073/pnas.2213838120


Artificial intelligence predicts the future of artificial intelligence research
Oct 2023, phys.org

(Asimov's Foundation no?)

An algorithm that not only assists researchers in orienting themselves systematically but also predictively guides them in the direction in which their own research field is likely to evolve.

Science4Cast is a graph-based representation of knowledge which becomes more complex over time as more scientific articles are published. Each node in the graph represents a concept in AI, and the connections between nodes indicate whether and when two concepts were studied together.

For example, the question "What will happen" can be described as a mathematical question about the further development of the graph. Science4Cast is fed with real data from over 100,000 scientific publications spanning a 30-year period, resulting in a total of 64,000 nodes. 

via Max-Planck Institute for the Science of Light in Erlangen: Mario Krenn et al, Forecasting the future of artificial intelligence with machine learning-based link prediction in an exponentially growing knowledge network, Nature Machine Intelligence (2023). DOI: 10.1038/s42256-023-00735-0

Tuesday, January 9, 2024

Good Science vs Bad Science


Top science publisher withdraws flawed climate study
Aug 2023, phys.org

Retraction Watch -- a blog that tracks withdrawals of academic papers, counted 5,000 such cases in 2022 -- about a tenth of a percent of the total number of studies published, its co-founder Ivan Oransky told AFP.

Top science publisher Springer Nature said it has withdrawn a climate change study by
four Italian scientists* in the European Physical Journal Plus, published by Springer Nature, because it manipulated data, cherry picked facts and ignored others that would contradict their assertions. The study had drawn positive attention from climate-skeptic media.

The paper had been freshly reviewed and found "not suitable for publication and that the conclusions of the article were not supported by available evidence or data provided by the authors".

*Notice it says here that the Italian scientists and not climate scientists. The four experts writing a climate science paper are in fact three physicists and an agricultural meteorologist, two of whom are also signatories on the World Climate Declaration, a text that "repeated various debunked claims about climate change". Furthermore, the study was not published in a climate journal; "This is a common avenue taken by 'climate skeptics' in order to avoid peer review by real experts in the field."

via Agence France-Presse AFP: Gianluca Alimonti et al, RETRACTED ARTICLE: A critical assessment of extreme events trends in times of global warming, The European Physical Journal Plus (2022). DOI: 10.1140/epjp/s13360-021-02243-9

Post Script: (To explain the rise of article fraud) "Experts pointed to widespread concerns about peer-review standards in the lucrative academic publishing industry." And one has to ask, why is the academic publishing industry so lucrative in the first place? (And one has to answer with a chart showing the amount of money that goes into government lobbying or overall public psychological operations campaigns by big business such as Big Oil's Climate Footprint (climate change is your fault), Big Tobacco's Throat Soothing (smoking is good for a sore throat), Big Dairy's Drink Milk (regardless of whether you're lactose tolerant or not), Big Tech's Move Fast Break Things (including federal safety regulations and basic human rights), or you name it.

Controlling people's thoughts is a lucrative business, that's why.

Post-Post: I watched the movie Andromeda Strain, was impressed by the scientific credibility of the premise (and the infrared FLIR gun that has apparently been around since the 70's), and I had to look up Michael Crichton, the writer.

But that's where things went wrong. I got lost in a wiki-hole on the Gell-Mann Effect, and discovered that Michale Crichton was a climate denier, heavy in the aughts, when Big Fossil was funding a global misinformation campaign. Problem is, he's a trained medical scientist. Not a climate scientist or even an environmental scientist. But the entry that brought me here is literally a famous quote of his, Michael Crichton, about how experts fail to maintain a critical stance when reading mainstream media about topics they are not experts in

Completely unrelated image credit: AI Art - Four Polished Females Wearing Glittering Bronze Holographic Bodysuits on a Mansion Lawn - 2023


Thursday, January 4, 2024

Not-bots, Fauxbots, Fleshbots and Semi-Sentience on the Rise


ChatGPT makes materials research much more efficient
Apr 2023, phys.org

"This isn't programming in the traditional sense; the method of interacting with these bots is through language," Morgan says. "Asking the program to extract data and then asking it to check if it is sure with normal sentences feels closer to how I train my children to get correct answers than how I usually train computers. It's such a different way to ask a computer to do things. It really changes how you think about what your computer can do."

via University of Wisconsin-Madison: Maciej P. Polak et al, Flexible, Model-Agnostic Method for Materials Data Extraction from Text Using General Purpose Language Models, arXiv (2023). DOI: 10.48550/arxiv.2302.04914

Also: Maciej P. Polak et al, Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineering—Example of ChatGPT, arXiv (2023). DOI: 10.48550/arxiv.2303.05352

Image credit: In one of the first instances, phys.org uses a Stable Diffusion-generated image in the thumbnail, along with this statement: "This image was generated using Stable Diffusion, a text-to-image generator, using the prompt "researchers working with huge piles of data." -Dane Morgan and Maciej Polak, University of Wisconsin-Madison, 2023 [link]


New 'AI scientist' combines theory and data to discover scientific equations
Apr 2023, phys.org

The system rediscovered Kepler's third law of planetary motion, and produced a good approximation of Einstein's relativistic time-dilation law.

The new AI scientist—dubbed "AI-Descartes" by the researchers—joins the likes of AI Feynman and other recently developed computing tools that aim to speed up scientific discovery. At the core of these systems is a concept called symbolic regression, which finds equations to fit data. Given basic operators, such as addition, multiplication, and division, the systems can generate hundreds to millions of candidate equations, searching for the ones that most accurately describe the relationships in the data.

The system works particularly well on noisy, real-world data, which can trip up traditional symbolic regression programs that might overlook the real signal in an effort to find formulas that capture every errant zig and zag of the data. It also handles small data sets well, even finding reliable equations when fed as few as ten data points.

"In this work, we needed human experts to write down, in formal, computer-readable terms, what the axioms of the background theory are, and if the human missed any or got any of those wrong, the system won't work."

via IBM Research, Samsung AI, and University of Maryland Baltimore County: Combining Data and Theory for Derivable Scientific Discovery with AI-Descartes, Nature Communications (2023). DOI: 10.1038/s41467-023-37236-y


Researchers say AI emergent abilities are just a 'mirage'
Apr 2023, phys.org

"Previously claimed emergent abilities … might likely be a mirage induced by researcher analyses" 

Researchers contend that when results are reported in non-linear, or discontinuous, metrics, they appear to show sharp, unpredictable changes that are erroneously interpreted as indicators of emergent behavior, however an alternate means of measuring the identical data using linear metrics shows "smooth, continuous" changes that, contrary to the former measure, reveal predictable—non-emergent—behavior.

Large numbers getcha every time:

"The Stanford team added that failure to use large enough samples also contributes to faulty conclusions."

It's one of the easiest to spot when looking at the success of predictive powers, whether it's the weather, a sports bettor, or your financial advisor -- the law of large numbers makes us suck at identifying patterns. If you flip a perfect coin, there's a 50% chance of it landing on either heads or tails, which is what you would call a perfect chance, right down the middle. But if you flip the coin 10 times, you will probably not get 5 heads and 5 tails. You might have to flip it 100 times for that, or maybe even 10,000. And it depends on how many decimals you want to use, and if you start to get into millions and trillions of flips, then you'll have to cancel the variables in your system, like the weight of the respective sides of the coin, or the tendency for you hand to flip a certain way, or the prevailing winds, or patterns of seismic vibrations of the earth. 

People who understand very well the law of large numbers, or more likely people who don't udnerstand it and don't want to -- can do a good job convincing others of seeing whatever patterns they want, just by manipulating the metrics, like looking at performance from January to January instead of September to September, or 18 months instead of 12, or:

"The main takeaway," the researchers said, "is for a fixed task and a fixed model family, the researcher can choose a metric to create an emergent ability or choose a metric to ablate an emergent ability."

via Stanford University: Rylan Schaeffer et al, Are Emergent Abilities of Large Language Models a Mirage?, arXiv (2023). DOI: 10.48550/arxiv.2304.15004

AI Art - A doctor use his stethoscope on a huge mechanical brain pink background 1 - 2023

Study finds source validation issues hurt ChatGPT reliability
May 2023, phys.org

Only about half of generated sentences were fully supported by citations, and one quarter of citations failed to support associated sentences.

Moreover, the team found citation recall and precision were inversely correlated with fluency and perceived utility. "The responses that seem more helpful are often those with more unsupported statements or inaccurate citations," they observed.

As a consequence, they concluded, "This facade of trustworthiness increases the potential for existing generative search engines to mislead users."

via Stanford University's Human-Centered AI research group: Nelson F. Liu et al, Evaluating Verifiability in Generative Search Engines, arXiv (2023). DOI: 10.48550/arxiv.2304.09848


Online consumers at risk from 'intelligent' price manipulation, say experts
May 2023, phys.org

"Widespread use of intelligent algorithmics and dynamic pricing by online retailers, puts the public at risk of 'adversarial collusion"

More sophisticated algorithms can manipulate weaker algorithms and therefore collude together to increase prices for everyone, subtly undermine the competitiveness of online markets and harm consumers.

via University of Oxford: Luc Rocher, Adversarial competition and collusion in algorithmic markets, Nature Machine Intelligence (2023). DOI: 10.1038/s42256-023-00646-0


Ethical, legal issues raised by ChatGPT training literature
May 2023, phs.org

"Our work here has shown that OpenAI models know about books in proportion to their popularity on the web and the accuracy of such models is strongly dependent on the frequency with which a model has seen information in the training data."

Few if any details about data used to train the models are known to the public.

Also, science fiction and fantasy books dominate the list of memorized books, presenting a built-in bias on the nature of responses ChatGPT may provide. 

We should be thinking about whose narrative experiences are encoded in these models.

via University of California, Berkeley: Kent K. Chang et al, Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4, arXiv (2023). DOI: 10.48550/arxiv.2305.00118

Post Script: I'm more interested in the simple statistical reality of algorithms trained on a completely "wild" dataset. The internet as a dataset is not curated, it's not designed, it's neither tamed nor maintained in any way; it is completely wild. When you apply the current state of the art in machine learning to a wild dataset, you multiply the wild part. 

AI Art - A doctor use his stethoscope on a huge mechanical brain pink background 2 - 2023

AI: War crimes evidence erased by social media platforms
Jun 2023, BBC News

AI-powered church service in Germany draws a large crowd
Jun 2023, Ars Technica

New tool explains how AI 'sees' images and why it might mistake an astronaut for a shovel
Jun 2023, phys.org

CRAFT -- for Concept Recursive Activation FacTorization for Explainability -- was a joint project with the Artificial and Natural Intelligence Toulouse Institute.

One of the concepts associated with the tench (a type of fish) is the face of a white male, because there are many photos online of white male sports fishermen holding fish that look like tench. In another example, the predominant concept associated with a soccer ball in neural networks is the presence of soccer players on the field. 

One way to explain AI vision is through what's called attribution methods, which employ heatmaps to identify the most influential regions of an image that impact AI decisions. However, these methods mainly focus on the most prominent regions of an image—revealing "where" the model looks, but failing to explain "what" the model sees in those areas.

But with CRAFT we can see how the system is ranking the concepts. 

With the 'image of an astronaut was incorrectly classified as a shovel' problem, CRAFT showed that the neural network identified the concept of "dirt" commonly found in members of the image class "shovel" and the concept of "ski pants" typically worn by people clearing snow from their driveway with a shovel.

via Brown University's Carney Institute for Brain Science: Thomas Fel et al, CRAFT: Concept Recursive Activation FacTorization for Explainability (2023)

AI Art - A doctor use his stethoscope on a huge mechanical brain pink background 3 - 2023

Study says AI data contaminates vital human input
Jun 2023, phys.org

They dubbed this phenomenon "artificial artificial artificial intelligence."

(But you should know this is because of the already-in-use term for Mechanical Turks, dubbed "artificial artificial intelligence"; and although they used to provide human input are now relying on AI-generated content, thus the "artificial" hole of recursion.)

"It is tempting to rely on crowdsourcing to validate large language model outputs or to create human gold-standard data for comparison," Veselovsky said. "But what if crowd workers themselves are using LLMs … in order to increase their productivity, and thus their income, on crowdsourcing platforms?"

Based on a limited study of the use of large language models by workers at MTurk, Amazon's crowd sourcing operation, the EPFL researchers estimated that 33% to 46% of worker assignments were completed with the aid of large language models.

via École polytechnique fédérale de Lausanne (EPFL), Lausanne, Switzerland: Veniamin Veselovsky et al, Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks, arXiv (2023). DOI: 10.48550/arxiv.2306.07899

Post Script: Figure this one out flesh engine of the future!  "fringe benefits, french benefits, and friends with benefits" boy is that a good one.


Is it growing pains or is ChatGPT just becoming dumber?
Jul 2023, phys.org

"We don't fully understand what causes these changes in ChatGPT's responses because these models are opaque."

"Any results on closed-source models are not reproducible and not verifiable, and therefore, from a scientific perspective, we are comparing raccoons and squirrels." -Sasha Luccioni of the AI company Hugging Face

via Stanford and UC Berkeley: Lingjiao Chen et al, How is ChatGPT's behavior changing over time?, arXiv (2023). DOI: 10.48550/arxiv.2307.09009

Monday, May 15, 2023

Megadata vs Magadata


The death of open access mega-journals?
Mar 2023, phys.org

"...explosive growth of mega-journals may be accompanied by the fall of some previously prestigious journals."

Many newer mega-journals have begun specializing in discipline-focused journals that are publishing faster and in greater volume than traditional journals can keep up with.

And because getting more citations and publishing more stories in a current year helps lift the impact factor, self-citing journals are skewing the imapct factor of the journal. 

Using an internally-developed AI tool to help identify outlier characteristics that indicate that a journal may no longer meet quality criteria, the Web of Science has removed the impact factor of nearly two dozen journals, including one of the world's largest, the International Journal of Environmental Research and Public Health. Many of the journals published by Hindawi and two by MDPI have had their impact factor ratings removed, likely reflecting concerns with the integrity of the publishing process.
  • Hiring "guest editors" who may not be reviewing studies in their field of expertise
  • Quick turnaround times from submitting a paper to publication (200 hundred days in traditional publishing, 30 for Hindawi)
  • Hindawi was purchased by Wiley publishing in 2021 for $300 million and has already had to deal with thousands of retractions after uncovering thousands of fraudulent papers filled with off-subject citations.

via opinion letter by researchers from Italy and Stanford: John P. A. Ioannidis et al, The Rapid Growth of Mega-Journals Threats and Opportunities, JAMA (2023). DOI: 10.1001/jama.2023.3212

Megajournals may perpetuate and accentuate an already dysfunctional system of scientific evaluation and publication,” they write. The pay-for-publication model creates an incentive for authors trying to meet institutions’ quotas for publications, and “megajournals may drain an already strained pool of reviewers from traditional journals.” Ioannidis calls for more research comparing the quality of peer review in megajournals and traditional ones, and he suggests institutions and funders reward researchers for studies that are transparent and rigorous. 
-Fast-growing open-access journals stripped of coveted impact factors: Web of Science delists some 50 journals, including one of the world’s largest, Mar 2023, Jeffrey Brainard for Science [link]

And by the way:

AI language models open a potential Pandora's box of medical research fraud
Mar 2023, phys.org

Meta things -- they wanted to see if artificial intelligence could write a fabricated research paper and then investigate how best to detect it, so they ran their AI-generated text through a free, online, AI rephrasing tool -- the consensus unanimously flipped to "likely human," suggesting we need better AI detection tools, since these technologies could be used to write entire studies with false data, nonexistent participants and meaningless results.

via Faisal Elali of the State University of New York Downstate Health Sciences University: Faisal R. Elali et al, AI-generated research paper fabrication and plagiarism in the scientific community, Patterns (2023). DOI: 10.1016/j.patter.2023.100706


Monday, July 25, 2022

Double Inversions and Meta Recursions


At the risk of appearing to support quantum consciousness...it sure looks like consciousness is about as hard to study as a quantum particle, and for somehow similar reasons. 

For a quantum-entangled proton, the moment you "observe" it, even if that observation is a single photon of light needed to detect the entangled proton, the moment you hit it with your detector-photon, you irreversibly change the entangled photon. Schrödinger's cat is both dead and alive only until you open the box to look. Then it's either one or the other, but not both.

Another way of saying this is that quantum experiments are so sensitive, that the measurer (you and your measuring device) must be part of the measurement. But this logically impossible, albeit fun to think about, and to think about thinking about.

Research on consciousness is something like this. If you design a study to investigate a particular theory, the study itself will help to prove that theory. But if you try to investigate a different and competing theory, the study will prove that theory instead. And so on.


The nature of consciousness experiments found to largely determine their results
Mar 2022, phys.org

"Moreover, when you put together all of the findings that were reported in these experiments, it seems like almost the entire brain is involved in creating the conscious experience, which is not consistent with any of the theories. In other words, it would appear that the real picture is larger and more complex than any of the existing theories suggest. It would seem that none of them is consistent with the data, when aggregated across studies, and that the truth lies somewhere in the middle."

Also, and most importantly, remember this whenever you see other studies on consciousness.

via Tel-Aviv University: Itay Yaron et al, The ConTraSt database for analysing and comparing empirical studies of consciousness theories, Nature Human Behaviour (2022). DOI: 10.1038/s41562-021-01284-5


Same goes for studies on brains in general:
For accuracy, brain studies of complex behavior require thousands of people
Mar 2022, phys.org

The results of most studies are unreliable because they involved too few participants.

Using publicly available data sets—involving a total of nearly 50,000 participants—the researchers analyzed a range of sample sizes and found that brainwide association studies need thousands of individuals to achieve higher reproducibility. Typical brainwide association studies enroll just a couple dozen people.

Such so-called underpowered studies are susceptible to uncovering strong but spurious associations by chance while missing real but weaker associations. Routinely underpowered brainwide association studies result in a glut of astonishingly strong yet irreproducible findings that slow progress toward understanding how the brain works, the researchers said.

But don't despair just yet:

"The field of genomics discovered a similar problem about a decade ago with genomic data and took steps to address it. The NIH (National Institutes of Health) began funding larger data-collection efforts and mandating that data must be shared publicly, which reduces bias and as a result, genome science has gotten much better. Sometimes you just have to change the research paradigm. Genomics has shown us the way."

via Washington University School of Medicine: Scott Marek, Reproducible brain-wide association studies require thousands of individuals, Nature (2022). DOI: 10.1038/s41586-022-04492-9




Something something consciousness study:
Largest ever psychedelics study maps changes of conscious awareness to neurotransmitter systems
Mar 2022, phys.org

Interesting because they use words, by way of testimonials, and a good dose of machine learning:

The researchers gathered 6,850 testimonials from people who took a range of 27 different psychedelic drugs. In a first-of-its-kind approach, they designed a machine learning strategy to extract commonly used words from the testimonials and link them with the neurotransmitter receptors that likely induced them. The interdisciplinary team could then associate the subjective experiences with brain regions where the receptor combinations are most commonly found—these turned out to be the lowest and some of the deepest layers of the brain's information processing layers.

via McGill University: Galen Ballentine et al, Trips and neurotransmitters: Discovering principled patterns across 6850 hallucinogenic experiences, Science Advances (2022). DOI: 10.1126/sciadv.abl6989.


Post Script on the Nature of Unreliability:
New maps show airplane contrails over the US dropped steeply in 2020
Mar 2022, phys.org

I'm not adding this here because of the drop in contrails. I'm adding it because today I learned:

About half of the aviation industry's contribution to global warming comes directly from planes' carbon dioxide emissions. The other half is thought to be a consequence of their contrails. The signature white tails are produced when a plane's hot, humid exhaust mixes with cool humid air high in the atmosphere. Emitted in thin lines, contrails quickly spread out and can act as blankets that trap the Earth's outgoing heat.

So contrails are bad. But contrails are often confused with chemtrails, which are a popular conspiracy theory. In fact, you can usually guess someone's ability to be a careful thinker by whether they even know the difference between chemtrails and contrails (Not too much different from knowing the difference between astronomy and astrology). Because if you're with someone who's looking at a contrail, and makes some sinister comment about chemtrails, then there's a pretty good chance they also think the government is very intentionally performing multi-generational chemogenetic experiments on the population.

But now I realize that making sinister comments about contrails is totally normal. 

via MIT: Vincent R Meijer et al, Contrail coverage over the United States before and during the COVID-19 pandemic, Environmental Research Letters (2022). DOI: 10.1088/1748-9326/ac26f0


Reporting bias makes homeopathy trials look like homeopathy works
Mar 2022, Ars Technica

The Achilles heel of the randomized control trial (RCT) - the meta-study. Yes, apparently, homeopathic proponents, and the like, don't realize that meta-studies exist. 

"There's always a bias toward publishing positive results—ones where the treatments have an effect."

The secret? Just don't publish the negative results. Got it.

To deal with that issue, the field has settled on preregistering clinical trials. In these cases, the design of the trial, the outcomes being measured, and other details are placed in a public database before the trial even starts. 

via Department for Evidence-based Medicine and Evaluation, Danube University Krems, Austria and RTI International, Research Triangle Park, North Carolina: BMJ Evidence-Based Medicine, 2019. DOI: 10.1136/bmjebm-2021-111846 


Bonus:
Vitamins, supplements are a 'waste of money' for most Americans
Jun 2022, phys.org

Based on a systematic review of 84 studies, the United States Preventive Services Task Force (USPSTF) new guidelines state there was "insufficient evidence" that taking multivitamins, paired supplements or single supplements can help prevent cardiovascular disease and cancer in otherwise healthy, non-pregnant adults.

"The harm is that talking with patients about supplements during the very limited time we get to see them, we're missing out on counseling about how to really reduce cardiovascular risks, like through exercise or smoking cessation," Linder said.

via Northwestern University: Multivitamins and Supplements—Benign Prevention or Potentially Harmful Distraction?, JAMA (2022).

Monday, July 26, 2021

Meta-Materials Mega-Thread

The phrase "metallic-organic framework" (MOF) has been appearing in headlines with more frequency, seemingly out of nowhere. Then again, when the material science revolution is fully underway, we will also wonder where the heck it came from. 

MOFs fall into the same general category as meta-materials, related to nano-this and graphene-that. These articles are a reminder that we're in for a whole new world. Kind of like what plastic did for the post-war world we live in today, or the synthetic chemical revolution of the late 1800's that gave our world "colors". 

Image credit: Metal Organic Framework by Mike Gipple at NETL

Programmable synthetic materials
Aug 2020, phys.org
In the future, MOFs could form the basis of programmable chemical molecules: for instance, an MOF could be programmed to introduce an active pharmaceutical ingredient into the body to target infected cells and then break down the active ingredient into harmless substances once it is no longer needed. Or MOFs could be programmed to release different drugs at different times.

via University of California Berkeley: Sequencing of metals in multivariate metal-organic frameworks, Science (2020). DOI: 10.1126/science.aaz4304 
Breakthrough technology purifies water using the power of sunlight
Aug 2020, phys.org
Metal-organic frameworks are a class of compounds consisting of metal ions that form a crystalline material with the largest surface area of any material known. In fact, MOFs are so porous that they can fit the entire surface of a football field in a teaspoon.

via Monash University: A sunlight-responsive metal–organic framework system for sustainable water desalination, Nature Sustainability (2020). DOI: 10.1038/s41893-020-0590-x
Study shows promising material can store solar energy for months or years
Dec 2020, phys.org
In tests, the researchers exposed the material to UV light, which causes the azobenzene molecules to change shape to a strained configuration inside the MOF pores. This process stores the energy in a similar way to the potential energy of a bent spring. Importantly, the narrow MOF pores trap the azobenzene molecules in their strained shape, meaning that the potential energy can be stored for long periods of time at room temperature.

The energy is released again when external heat is applied as a trigger to 'switch' its state, and this release can be very quick—a bit like a spring snapping back straight. This provides a heat boost which could be used to warm other materials of devices.

Further tests showed the material was able to store the energy for at least four months. This is an exciting aspect of the discovery as many light-responsive materials switch back within hours or a few days. The long duration of the stored energy opens up possibilities for cross-seasonal storage.

via by Lancaster University: Kieran Griffiths et al, Long-Term Solar Energy Storage under Ambient Conditions in a MOF-Based Solid–Solid Phase-Change Material, Chemistry of Materials (2020). DOI: 10.1021/acs.chemmater.0c02708
Physicists create tunable superconductivity in twisted graphene 'nanosandwich'
Feb 2021, phys.org

Come on with that name though.

via Massachusetts Institute of Technology: Tunable strongly coupled superconductivity in magic-angle twisted trilayer graphene, Nature (2021). DOI: 10.1038/s41586-021-03192-0

Flash graphene rocks strategy for plastic waste
Oct 2020, phys.org
It's called flashing -- expose plastic waste to eight seconds of high-intensity alternating current, followed by the DC jolt. You'll get turbostratic graphene. Yes, graphene from garbage. $125 of electricity turns a ton of plastic into a ton of graphene.
via Rice University: Wala A. Algozeeb et al, Flash Graphene from Plastic Waste, ACS Nano (2020). DOI: 10.1021/acsnano.0c06328
Researchers use origami to solve space travel challenge
Dec 2020, phys.org

Origami bellow-bag fuel storage containers.

via Washington State University: Kjell Westra et al, Compliant Polymer Origami Bellows in Cryogenics, Cryogenics (2020). DOI: 10.1016/j.cryogenics.2020.103226

DNA origami enables fabricating superconducting nanowires
Jan 2021, phys.org
 
via the American Institute of Physics: "DNA origami-based superconducting nanowires" AIP Advances, aip.scitation.org/doi/10.1063/5.0029781

Researchers turn coal powder into graphite in microwave oven
Jan 2021, phys.org
Using copper foil, glass containers and a conventional household microwave oven, University of Wyoming researchers have demonstrated that pulverized coal powder can be converted into higher-value nano-graphite.

"By cutting the copper foil into a fork shape, the sparks were induced by the microwave radiation, generating an extremely high temperature of more than 1,800 degrees Fahrenheit within a few seconds," says Masi, lead author of the paper. "This is why you shouldn't place a metal fork inside a microwave oven."

via University of Wyoming: Christoffer A. Masi et al, Converting raw coal powder into polycrystalline nano-graphite by metal-assisted microwave treatment. Nano-Structures & Nano-Objects Volume 25, 2021, 100660, ISSN 2352-507X, doi.org/10.1016/j.nanoso.2020.100660
'Magnetic graphene' forms a new kind of magnetism
Feb 2021, phys.org

via University of Cambridge: Matthew J. Coak et al. 'Emergent Magnetic Phases in Pressure-Tuned van der Waals Antiferromagnet FePS3.' Physical Review X (2021). DOI: 10.1103/PhysRevX.11.011024

A new way to make wood transparent, stronger and lighter than glass
Feb 2021, phys.org
The conventional method for making wood transparent involves using chemicals to remove the lignin—a process that takes a long time, produces a lot of liquid waste and results in weaker wood. In this new effort, the researchers have found a way to make wood transparent without having to remove the lignin.

The process involved changing the lignin rather than removing it. The researchers removed lignin molecules that are involved in producing wood color. First, they applied hydrogen peroxide to the wood surface and then exposed the treated wood to UV light (or natural sunlight). The wood was then soaked in ethanol to further clean it. Next, they filled in the pores with clear epoxy to make the wood smooth.

via University of Maryland: Qinqin Xia et al. Solar-assisted fabrication of large-scale, patternable transparent wood, Science Advances (2021). DOI: 10.1126/sciadv.abd7342
Japan developing wooden satellites to cut space junk
Dec 2020, BBC News

Wednesday, July 21, 2021

Just Lévy Things

Lévy patterns are one of the craziest things there is; proof that free will is an illusion, and one of those typically invisible patterns that can be used to predict our behavior (and to mimic our behavior, for those of us making artificial humans).

It happens all over the place, from the way animals forage, to the way our eyes move across a computer screen. It's one of those universal laws that happens in biology and in physics too (called Brownian walk, or Brownian motion). But you might remember it more easily by calling it simply "foraging behavior", a mixture of small random movements with less frequent larger movements.

It's no secret that we do this; our eyes get mapped when we look at websites to figure out how to make us click-buy uncontrollably. Hidden cameras in retail shops do the same thing. Pedestrian traffic, vehicle traffic, pandemics even, you name it. 

What we don't know is the full "why" of Lévy walks. Why use such a chaotic approach; wouldn't a more rational approach get better results? Researchers at RIKEN made a simulation that found Lévy patterns popping up spontaneously at critical moments such as the edge between Exploitation vs Exploration -- for example when an animal has to decide whether to exploit areas that are already known to be beneficial, versus exploring for new areas.

You know exploit/explore, it's how you decide where to eat dinner -- on those nights when Old Trusty just isn't cutting it, then it's time to explore. But at the same time, you can't "explore" every night, or going out to eat would be exhausting, and less rewarding in general. So the next time you're at that critical juncture, just let the chaos take over. Or, soon enough, let the Lévy algorithm do it for you.
 
Chaotic Lévy walks are a good strategy for animals
Sep 2020, phys.org

via the RIKEN Center: Masato S. Abe. Functional advantages of Lévy walks emerging near a critical point, Proceedings of the National Academy of Sciences (2020). DOI: 10.1073/pnas.2001548117

See Also:
Pedestrians at crosswalks found to follow the Lévy walk process
Apr 2019, phys.org

Musical melodies obey same laws as foraging animals
Jan 2016, phys.org

Post Script:
When you see RIKEN Center being involved, you know you're in for some cool stuff. 

Sunday, December 8, 2019

People, Particles and Social Science

aka Sociothermodynamics


Let's not forget that we do live in the era of Big Data, and it's only getting Bigger.

Big data requires new methods of analysis. As we get more and more info about the world around us, we need more basic, underlying frameworks to organize and interpret that data. And that is where physics comes to the rescue. Physicists are used to looking at complex systems with millions, billions and trillions of interactions, and being able to make predictions about their behaviors.

You would think it would show up in the news way more often, because it sure sounds like magic to me. But alas, it's not an everyday headline, so I thought I would spit a few terms up here, just to help stay familiar. This is in relation to urban design and economics.

Inness - the tendency for people to gravitate to the socioeconomic center of a city; this can be correlated to socioeconomic factors, infrastructure factors, and even mortality rates, and an example would be how well-developed cities with multiple socioeconomic centers would have a low inness value.

Betweenness Centrality - a measure of how many things you are in the between of; an example would be how some locations are at the intersection of more than two streets.

These examples are pretty straightforward because they're based on physical objects or locations. Things get a bit more abstract when we start to talk about the spread of disease through a population, or better yet, memetic propagation, which is the spread of ideas.

The practical applications of using network science to predict complex systems are much needed -- the way people move throughout a city is increasingly important when more than half the world's population is now living in cities. But I'd rather hear about how we can predict your chances of adopting a new slang term based on the gesture recognition of your 5 best friends, for example. 

Post Script:
Urban Planning and Big Data
Study finds online restaurant information can closely predict key neighborhood indicators
July 2019, phys.org

What can Wikipedia tell us about human interaction?
June 2019, phys.org

"...if we look at Wikipedia pages about the 2015 Paris terrorist attacks, we can see that the page about the attack is directly connected to the page about Charlie Hebdo magazine, and also to a cluster of pages representing terrorist organizations," Miz explains.

Benzi and Miz call this kind of information-seeking "collective memory," as it can reveal how current events trigger memories of the past.

Hyphens in paper titles harm citation counts and journal impact factors
June 2019, phys.org

Notes:
Can the laws of physics untangle traffic jams, stock markets, and other complex systems?
Mar 2019, phys.org

Here's some other topics at the intersection of science and society:
The hipster effect - Why anti-conformists always end up looking the same
Mar 2019, phys.org

Social media can predict what youíll say, even if you donít participate
Jan 2019, Ars Technica

The 2008 recession associated with greater decline in mortality in Europe
Feb 2019, phys.org

"Periods of macroeconomic recession are associated with lower levels of pollution and fewer accidents in the workplace and on the roads. These are the factors most likely to have the greatest influence on accelerating the decline in mortality. Alcohol and tobacco consumption also fall during periods of greater austerity, as do the prevalences of sedentary lifestyles and obesity. While the underlying mechanisms are still not well established, the findings of some studies also point to the influence of other factors, such as work stress and the fact that healthy habits demand time, something less available to a person working in a full-time job."

And finally, totally unrelated wordporn:
No longer qubits but qutrits!
Complex quantum teleportation achieved for the first time - qutrits