Welcome to European Tribune. It's gone a bit quiet around here these days, but it's still going.
Display:
In Shannon's Information Theory entropy is the smallest message that can carry a give unit of information.

See the wikipedia entry.

She believed in nothing; only her skepticism kept her from being an atheist. -- Jean-Paul Sartre

by ATinNM on Mon Mar 24th, 2008 at 12:19:44 AM EST
[ Parent ]
Ah yes, terrible (for me!) equations:



Don't fight forces, use them R. Buckminster Fuller.

by rg (leopold dot lepster at google mail dot com) on Mon Mar 24th, 2008 at 07:47:41 AM EST
[ Parent ]
That's a definition, not an equation.

It'd be nice if the battle were only against the right wingers, not half of the left on top of that — François in Paris
by Migeru (migeru at eurotrib dot com) on Mon Mar 24th, 2008 at 12:27:22 PM EST
[ Parent ]
The definition is an equation

Don't fight forces, use them R. Buckminster Fuller.
by rg (leopold dot lepster at google mail dot com) on Mon Mar 24th, 2008 at 03:22:55 PM EST
[ Parent ]
But the equation has no information on the left hand side, and there is nothing to solve for.

That it's an equation is not your problem, your problem is it's a formula.

It'd be nice if the battle were only against the right wingers, not half of the left on top of that — François in Paris

by Migeru (migeru at eurotrib dot com) on Mon Mar 24th, 2008 at 03:31:29 PM EST
[ Parent ]
My problem is I don't understand it, except that it has an equals sign in it (I thought equation came from to equal so if there's an equals sign....heh...my lack of knowledge!)

Also, it says "Shannon's Entropy Equation" just above it.

Don't fight forces, use them R. Buckminster Fuller.

by rg (leopold dot lepster at google mail dot com) on Mon Mar 24th, 2008 at 03:58:56 PM EST
[ Parent ]
Did you stop as soon as you hit the first formula?Information entropy - Wikipedia, the free encyclopedia
Information entropy is characterised by these desiderata:
If you like, every time you see a formula read it aloud as "wowowowowowow" and say to yourself "oh my god, that sounds like a golden retriever". And move on. Don't let the fact that you don't understand one formula stop you fron reading what comes after.

Example: in

Maximum
The measure should be maximal if all the outcomes are equally likely (uncertainty is highest when all possible events are equiprobable).

Hn(p1, ..., pn) ≤ Hn(1/n, ..., 1/n)

the formula Hn(p1, ..., pn) ≤ Hn(1/n, ..., 1/n) is shorthand for The measure should be maximal if all the outcomes are equally likely (uncertainty is highest when all possible events are equiprobable). So there is no information lost by not reading the formula.

There is only loss of information when the formulas are strung together in a derivation where each formula implies the next. there is nothing of the sort in this particular wikipedia article (which is rather bad, IMHO).

It'd be nice if the battle were only against the right wingers, not half of the left on top of that — François in Paris

by Migeru (migeru at eurotrib dot com) on Tue Mar 25th, 2008 at 06:10:30 AM EST
[ Parent ]

Display:

Top Diaries

Herd Immunity .. Filling the Gaps

by Oui - Jul 24
23 comments

LQD - Long Term Covid: The Brain

by ATinNM - Jul 13
29 comments

Say No to Racism

by Oui - Jul 12
26 comments

England surrenders to Covid

by IdiotSavant - Jul 9
27 comments

Occasional Series