Information

Claude Shannon on information: Entropy and surprise

What signals can you leave out without distorting content?
More surprise = more information (random data has maximum information content)

Cybernetics: Feedback is information about the past

Formative aspect often based on performative nature of certain speech acts