Skip to content

The Informational Turn

Including Philosophy and/of Information, Logic and Epistemology

Month: September 2011

Entropy and information divergence

The Kullback–Leibler (KL) divergence is a non-symmetric measure of the difference between two probability distributions P and Q:


KL divergence: D_{KL}(P || Q) = \Sigma_{i}P(O_{i}) log \frac{P(O_{i}}{P(Q_{i})}

In this piece [page 133] a neat example is given, showing how this measure can be used to quantify the `truthlikeness’ of a probability measure.

Author SimonPosted on September 29, 2011Categories Philosophy and/of InformationLeave a comment on Entropy and information divergence

Information Flow: Logics for the (r)age of information

http://www.iam.unibe.ch/til/publications/pubitems/kel02

Author SimonPosted on September 22, 2011Categories Philosophy and/of InformationLeave a comment on Information Flow: Logics for the (r)age of information

Information is what information does

Information is what information does

Author SimonPosted on September 14, 2011Categories Philosophy and/of InformationLeave a comment on Information is what information does
Follow @sjdalf

Pages

  • About
  • Contact
  • Publications

Categories

  • Epistemology
  • Logic
  • Miscellaneous
  • Philosophy and/of Information

Recent Comments

  • Ruth Shrensky on The Meaning and Etymology of ‘Information’
  • john doe on Probability, Truthlikeness and the Cenk Uygur versus Sam Harris Debate
  • Simon on Probability, Truthlikeness and the Cenk Uygur versus Sam Harris Debate
  • Edgar K. on Probability, Truthlikeness and the Cenk Uygur versus Sam Harris Debate
  • Damian on Spinoza, Newton and Feynman

Archives

  • February 2020
  • October 2018
  • September 2017
  • August 2017
  • June 2017
  • April 2017
  • February 2017
  • November 2016
  • August 2016
  • July 2016
  • June 2016
  • February 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • January 2015
  • December 2014
  • September 2014
  • August 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • October 2013
  • August 2013
  • July 2013
  • May 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • July 2012
  • May 2012
  • April 2012
  • March 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
The Informational Turn Proudly powered by WordPress