We are witnessing an era of information compression, spearheaded by large language models (LLMs) that proficiently process web text. These LLMs handle an inconceivably vast array of word combinations, reducing them to a mere trillion parameters. Embedding models, like text-embedding-ada-002, further condense this into 1536 dimensions. Reflect on this when using Retrieval-Augmented Generation (RAG): the essence of the web's information, distilled into 1536 coordinates.

Think of your organisation as a living entity—its survival depends on a well-defined information boundary, which functions like a semi-permeable membrane. Karl Friston's Free Energy Principle (FEP) models this boundary as a Markov Blanket and says that to sustain itself, a system must minimise its free energy.