Tag: information-theory

3 articles tagged information-theory. See all tags or all posts.

Digital Communication: Getting a Thought Out of One Head and Into Another

August 21, 2026 electronics embedded information-theory education

Communication has one job: move the internal state of one system into another. This is a walk from a thought in your head to a wave on a wire, through the four sides of a message, a water canal, a push-pull driver, Shannon's channel, and the eye diagram that measures it all.

From the UAT to the Modern Neural Network

July 3, 2026 ai information-theory history education

We have the bit. Now the question is what we can compute with it, and whether a machine can learn to compute things nobody explicitly programmed. The answer runs from Hilbert through Turing to a theorem most engineers have never heard of.

From Aristotle to the Bit

July 3, 2026 information-theory philosophy history education

The bit did not fall from the sky in 1948. It is the last step in a chain that starts with a Greek philosopher arguing about sea battles and ends with Claude Shannon measuring surprise.