I read Samuel Arbesman’s “The Half-life of Facts” yesterday.
Good book, great even. I’ll be reading more by Arbesman.
One section got me thinking about LLMs, chapter 6 titled “Hidden Knowledge”.
It is about how there are breakthroughs sitting in plain sight, in public hidden knowledge.
For example, disparate facts spread across fields that need to be unified.
“Hidden knowledge takes many forms. At its most basic level hidden knowledge can consist of pieces of information that are unknown, or are known only to a few, and, for all practical purposes, still need to be revealed. Other times hidden knowledge includes facts that are part of undiscovered public knowledge, when bits of knowledge need to be connected to other pieces of information in order to yield new facts. Knowledge can be hidden in all sorts of ways, and new facts can only be created if this knowledge is recognized and exploited.”
...