Probability Theory: The Logic of Science

Category: Mathematics
Author: E. T. Jaynes, G. Larry Bretthorst
All Hacker News 11
This Month Hacker News 1


by shp0ngle   2022-11-17
I didn’t understand probability, until I read E T Jaynes Probability Theory: Logic of Science

It defines the base blocks of probability very, very slow. And never hand-waves anything. But it’s the “bayesian” view of probability; but it’s honestly the easier one to understand.

by flubert   2020-10-17
Ack. I can't believe I messed that up. He wrote an awesome book: "Probability Theory: The Logic of Science".

And there is a website with more information and a collection of his papers:

by solar_perplexus   2020-05-04
I took a course on Applied Bayesian Statistics taught by David Draper in grad school and we covered Bayesian Data Analysis (Gelman et Al.)

The former is a much recommended book since it's very comprehensive and builds everything from the ground up and was the basis for the entire course. The latter is a beast of it's own and we simply covered what was effectively the first chapter as part of the course.

by logicchains   2019-07-12 is pretty decent.
by revorad   2017-08-19
Probability Theory: The Logic of Science by E. T. Jaynes

by BenoitEssiambre   2017-08-19
I might add that what made me understand these concepts is the writings of physicist and probability theorist E.T. Jaynes, especially his unpublished manuscripts:

I think if he would have been alive at the right time these would have been blog posts. Before reading them, I had taken an intro class in thermodynamics which at left me completely confused.

Read THE EVOLUTION OF CARNOT'S PRINCIPLE ( ) for incredible insights on how Carnot pioneered thermodynamics by trying to optimize steam engines.

Also if you think you dislike statistics and probabilities but you like math in general his book might change your mind: Probability Theory: The Logic of Science. Free draft:


In fact understanding his stance on probabilities, the mind projection fallacy in particular might be prerequisite to understand thermodynamics, the fundamental point being that entropy is not really directly a property of matter but more of a meta property that is about knowledge or information which is taken to mean correlations across aggregate matter.

by aaronblohowiak   2017-08-19
I can't find the book with that title, do you have a link or ISBN? is the closest match but it does not seem to match your description.