Distributed Solar: The Democratizaton of Energy
Category Archives: Bayes
David Spiegelhalter on `how to spot a dodgy statistic’
In this political season, it’s useful to brush up on rhetorical skills, particularly ones involving numbers and statistics, or what John Allen Paulos called numeracy. Professor David Spiegelhalter has written a guide to some of these tricks. Read the whole … Continue reading
Posted in abstraction, anemic data, Bayes, Bayesian, chance, citizenship, civilization, corruption, Daniel Kahneman, disingenuity, Donald Trump, education, games of chance, ignorance, maths, moral leadership, obfuscating data, open data, perceptions, politics, rationality, reason, reasonableness, rhetoric, risk, sampling, science, sociology, statistics, the right to know
Leave a comment
Newt Gingrich and Van Jones. Right on.
It’s the thing. And it addresses how media and people forget about the actual statistics, and focus on the White Hot Bright Light. A study by Gelman, Fagan, and Kiss A study by Freyer A counterpoint to the Freyer study … Continue reading
Posted in American Statistical Association, Bayes, Bayesian, citizen science, criminal justice, Daniel Kahneman, ethics, evidence, fear uncertainty and doubt, humanism, Lives Matter, logistic regression, Markov Chain Monte Carlo, MCMC, organizational failures, population biology, rationality, reasonableness, risk, statistics, Susan Jacoby, the right to know
Leave a comment
On Smart Data
One of the things I find surprising, if not astonishing, is that in the rush to embrace Big Data, a lot of learning and statistical technique has been left apparently discarded along the way. I’m hardly the first to point … Continue reading
Posted in Akaike Information Criterion, Bayes, Bayesian, Bayesian inversion, big data, bigmemory package for R, changepoint detection, data science, data streams, dlm package, dynamic generalized linear models, dynamic linear models, dynamical systems, Generalize Additive Models, generalized linear models, information theoretic statistics, Kalman filter, linear algebra, logistic regression, machine learning, Markov Chain Monte Carlo, mathematics, mathematics education, maths, maximum likelihood, MCMC, Monte Carlo Statistical Methods, multivariate statistics, numerical analysis, numerical software, numerics, quantitative biology, quantitative ecology, rationality, reasonableness, sampling, smart data, state-space models, statistical dependence, statistics, the right to know, time series
Leave a comment
Cory Lesmeister’s treatment of Simson’s Paradox (at “Fear and Loathing in Data Science”)
(Updated 2016-05-08, to provide reference for plateaus of ML functions in vicinity of MLE.) Simpson’s Paradox is one of those phenomena of data which really give Statistics a substance and a role, beyond the roles it inherits from, say, theoretical … Continue reading
Posted in Akaike Information Criterion, approximate Bayesian computation, Bayes, Bayesian, evidence, Frequentist, games of chance, information theoretic statistics, Kalman filter, likelihood-free, mathematics, maths, maximum likelihood, Monte Carlo Statistical Methods, probabilistic programming, rationality, Rauch-Tung-Striebel, Simpson's Paradox, state-space models, statistical dependence, statistics, stochastics
Leave a comment
“Lucky d20” (by Tamino, with my reblogging comments)
Originally posted on Open Mind:
What with talk of killer heat waves, droughts, floods, etc. etc., this blog tends to get pretty serious. When it does, we don’t deal with happy prospects, but with the danger of worldwide catastrophe. But…
p-values and hypothesis tests: the Bayesian(s) rule
The American Statistical Association of which I am a longtime member issued an important statement today which will hopefully move statistical practice in engineering and especially in the sciences away from the misleading practice of using p-values and hypothesis tests. … Continue reading
Posted in approximate Bayesian computation, arXiv, Bayes, Bayesian, Bayesian inversion, bollocks, Christian Robert, climate, complex systems, data science, Frequentist, information theoretic statistics, likelihood-free, Markov Chain Monte Carlo, MCMC, Monte Carlo Statistical Methods, population biology, rationality, reasonableness, science, scientific publishing, statistical dependence, statistics, stochastics, Student t distribution
Leave a comment
high dimension Metropolis-Hastings algorithms
If attempting to simulate from a multivariate standard normal distribution in a large dimension, when starting from the mode of the target, i.e., its mean γ, leaving the mode γis extremely unlikely, given the huge drop between the value of the density at the mode γ and at likely realisations Continue reading
Posted in Bayes, Bayesian, Bayesian inversion, boosting, chance, Christian Robert, computation, ensembles, Gibbs Sampling, James Spall, Jerome Friedman, Markov Chain Monte Carlo, mathematics, maths, MCMC, Monte Carlo Statistical Methods, multivariate statistics, numerical software, numerics, optimization, reasonableness, Robert Schapire, SPSA, state-space models, statistics, stochastic algorithms, stochastic search, stochastics, Yoav Freund
Leave a comment
Generating supports for classification rules in black box regression models
Inspired by the extensive and excellent work in approximate Bayesian computation (see also), especially that done by Professors Christian Robert and colleagues (see also), and Professor Simon Wood (see also), it occurred to me that the complaints regarding lack of … Continue reading
Posted in approximate Bayesian computation, Bayes, Bayesian, Bayesian inversion, generalized linear models, machine learning, numerical analysis, numerical software, probabilistic programming, rationality, reasonableness, state-space models, statistics, stochastic algorithms, stochastic search, stochastics, support of black boxes
Leave a comment
R and “big data”
On 2nd November 2015, Wes McKinney, the developer of the highly useful Python pandas module (and other things, including books), wrote an amusing blog post, “The problem with the data science language wars“. I by no means disagree with him. … Continue reading
On differential localization of tumors using relative concentrations of ctDNA. Part 2.
Part 1 of this series introduced the idea of ctDNA and its use for detecting cancers or their resurgence, and proposed a scheme whereby relative concentrations of ctDNA at two or more sites after controlled disturbance might be used to … Continue reading
Deep Recurrent Learning Networks
(Also known to statisticians as deep exponential families.) Large scale deep learning Four easy lessons on Deep Learning from Google
Posted in Bayes, Bayesian, neural networks, optimization
Leave a comment
Comprehensive and compact tutorial on Petris’ DLM package in R; with an update about Helske’s KFAS
A blogger named Lalas produced on Quantitative Thoughts a very comprehensive and compact tutorial on the R package dlm by Petris. I use dlm a lot. Unfortunately, Lalas does not give details on how the SVD is used. They do … Continue reading
Posted in Bayes, Bayesian, dynamic linear models, dynamical systems, forecasting, Kalman filter, mathematics, maths, multivariate statistics, numerical software, open source scientific software, prediction, R, Rauch-Tung-Striebel, state-space models, statistics, stochastic algorithms, SVD, time series
Leave a comment
“Cauchy Distribution: Evil or Angel?” (from Xian)
Cauchy Distribution: Evil or Angel?. From Professor Christian Robert.
“… the most patronizing start to an answer I have ever received …”
Professor Christian Robert tries to help out a student of MCMC on Cross Validated and earns the comment that his help had “the most patronizing start to an answer I have ever received“. I learned a new term: primitivus petitor.
“A vignette on Metropolis” (Christian Robert)
Originally posted on Xi'an's Og:
Over the past week, I wrote a short introduction to the Metropolis-Hastings algorithm, mostly in the style of our Introduction to Monte Carlo with R book, that is, with very little theory and…
“Unbiased Bayes for Big Data: Path of partial posteriors” (Christian Robert)
Unbiased Bayes for Big Data: Path of partial posteriors.
Markov Chain Monte Carlo methods and logistic regression
This post could also be subtitled “Residual deviance isn’t the whole story.” My favorite book on logistic regression is by Dr Joseph Hilbe, Logistic Regression Models, CRC Press, 2009, Chapman & Hill. It is a solidly frequentist text, but its … Continue reading
Posted in Bayes, Bayesian, logistic regression, MCMC, notes, R, statistics, stochastic algorithms, stochastic search
2 Comments
Bayesian change-point analysis for global temperatures, 1850-2010
Professor Peter Congdon reports on two Bayesian models for global temperature shifts in his textbook, Applied Bayesian Modelling, as “Example 6.12: Global temperatures, 1850-2010”, on pages 252-253. A direct link is available online. The first is apparently original with Congdon, … Continue reading
“Big Data is the new Phrenology”
From mathbabe: Big Data is the new phrenology. Excerpt: Here’s the thing. What we’ve got is a new kind of awful pseudo-science, which replaces measurements of skulls with big data. There’s no reason to think this stuff is any less … Continue reading
Posted in anemic data, Bayes, Bayesian, bridge to nowhere, mathematics, maths, rationality, reasonableness, statistics
Leave a comment
R vs Python: Practical Data Analysis
R vs Python: Practical Data Analysis (Nonlinear Regression).
Posted in Bayes, Bayesian, biology, climate change, ecology, environment, Python 3, R, statistics, Wordpress
Leave a comment
Christian Robert on the amazing Gibbs sampler
Professor Christian Robert remarks on the amazing Gibbs sampler. Implicitly he’s also underscoring the power of properly done Bayesian computational analysis. For here we have a problem with a posterior distribution having two strong modes, so a point estimate, like … Continue reading
Christian Robert on Alan Turing
Alan Turing Institute. See Professor Robert’s earlier post on Turing, too.
Posted in Bayes, Bayesian, citizenship, education, ethics, history, humanism, mathematics, maths, politics, rationality, reasonableness, statistics, stochastic algorithms, stochastic search, the right to know, Wordpress
Tagged Alan Turing
Leave a comment
Richard Muller: “I Was Wrong On Global Warming, But It Didn’t Convince The ‘Sceptics'”
Update. 26th February 2015 This is not directly related to the BEST project described in the YouTube video above, but the Berkeley National Laboratory has experimentally linked increases in radiative forcing with increases in atmospheric concentrations of CO2 due to … Continue reading
Posted in astrophysics, Bayes, carbon dioxide, citizenship, civilization, climate, climate change, climate education, differential equations, ecology, environment, geoengineering, geophysics, IPCC, mathematics, maths, meteorology, model comparison, NASA, NCAR, NOAA, oceanography, physics, population biology, rationality, Ray Pierrehumbert, reasonableness, reproducible research, risk, science, science education, sea level rise, the right to know
Leave a comment
Naomi Oreskes and significance testing
Naomi Oreskes has an op-ed in The New York Times today, which intends to defend the severe standards of evidence scientists employ, with special applicability to climate science and their explanation of causation (greenhouse gases produce radiative forcing), attribution (most … Continue reading
On nested equivalence classes of climate models, ordered by computational complexity
I’m digging into the internals of ABC, for professional and scientific reasons. I’ve linked a great tutorial elsewhere, and argued that this framework, advanced by Wood, and Wilkinson (Robert), and Wilkinson (Darren), and Hartig and colleagues, and Robert and colleagues, … Continue reading
Posted in approximate Bayesian computation, Bayes, Bayesian, biology, ecology, environment, forecasting, geophysics, IPCC, mathematics, maths, MCMC, meteorology, NCAR, NOAA, oceanography, optimization, population biology, Principles of Planetary Climate, probabilistic programming, R, science, stochastic algorithms, stochastic search
Leave a comment
“[W]e want to model the process as we would simulate it.”
Professor Darren Wilkinson offers a pithy insight on how to go about constructing statistical models, notably hierarchical ones: “… we want to model the process as we would simulate it ….” This appears in his blog post One-way ANOVA with … Continue reading
Posted in approximate Bayesian computation, Bayes, Bayesian, biology, ecology, engineering, forecasting, mathematics, mathematics education, maths, model comparison, optimization, population biology, probabilistic programming, rationality, reasonableness, risk, science, science education, sociology, statistics, stochastic algorithms
Tagged ANOVA
Leave a comment
struggling with problems already partly solved by others
Climate modelers and models see as their frontier the problem of dealing with spontaneous dynamics in systems such as atmosphere or ocean which are not directly forced by boundary conditions such as radiative forcing due to increased greenhouse gas (“GHG”) … Continue reading
Posted in approximate Bayesian computation, Bayes, Bayesian, biology, climate, climate education, differential equations, ecology, engineering, environment, geophysics, IPCC, mathematics, mathematics education, meteorology, model comparison, NCAR, NOAA, oceanography, physics, population biology, probabilistic programming, rationality, reasonableness, risk, science, science education, statistics, stochastic algorithms, stochastic search
1 Comment
illustrating particle filters and Bayesian fusion using successive location estimates on the unit circle
Introduction Modern treatments of Bayesian integration to obtain posterior densities often use some form of Markov Chain Monte Carlo (“MCMC”), typically Gibbs sampling. Gibbs works well with many Bayesian hierarchical models. The standard problem-solving situation with these is that a … Continue reading
