Distributed Solar: The Democratizaton of Energy
Blogroll
- "Perpetual Ocean" from NASA GSFC
- All about models
- Hermann Scheer Hermann Scheer was a visionary, a major guy, who thought deep thoughts about energy, and its implications for humanity’s relationship with physical reality
- Mertonian norms
- Mike Bloomberg, 2020 He can get progress on climate done, has the means and experts to counter the Trump and Republican digital disinformation machine, and has the experience, knowledge, and depth of experience to achieve and unify.
- Los Alamos Center for Bayesian Methods
- South Shore Recycling Cooperative Materials management, technical assistance and networking, town advocacy, public outreach
- The Keeling Curve: its history History of the Keeling Curve and Charles David Keeling
- Mark Berliner's video lecture "Bayesian mechanistic-statistical modeling with examples in geophysical settings"
- "Consider a Flat Pond" Invited talk introducing systems thinking, by Jan Galkowski, at First Parish in Needham, UU, via Zoom
- John Kruschke's "Dong Bayesian data analysis" blog Expanding and enhancing John’s book of same title (now in second edition!)
- distributed solar and matching location to need
- All about Sankey diagrams
- All about ENSO, and lunar tides (Paul Pukite) Historically, ENSO has been explained in terms of winds. But recently — and Dr Paul Pukite has insisted upon this for a long time — the oscillation of ENSO has been explained as a large-scale slosh due to lunar tidal forcing.
- Why "naive Bayes" is not Bayesian Explains why the so-called “naive Bayes” classifier is not Bayesian. The setup is okay, but estimating probabilities by doing relative frequencies instead of using Dirichlet conjugate priors or integration strays from The Path.
- In Monte Carlo We Trust The statistics blog of Matt Asher, actually called the “Probability and Statistics Blog”, but his subtitle is much more appealing. Asher has a Manifesto at http://www.statisticsblog.com/manifesto/.
- Why It’s So Freaking Hard To Make A Good COVID-19 Model Five Thirty Eight’s take on why pandemic modeling is so difficult
- Quotes by Nikola Tesla Quotes by Nikola Tesla, including some of others he greatly liked.
- Gabriel's staircase
- Earth Family Beta MIchael Osborne’s blog on Science and the like
- Mrooijer's Numbers R 4Us
- Comprehensive Guide to Bayes Rule
- Beautiful Weeds of New York City
- Dominic Cummings blog Chief advisor to the PM, United Kingdom
- Risk and Well-Being
- John Cook's reasons to use Bayesian inference
- ggplot2 and ggfortify Plotting State Space Time Series with ggplot2 and ggfortify
- "Impacts of Green New Deal energy plans on grid stability, costs, jobs, health, and climate in 143 countries" (Jacobson, Delucchi, Cameron, et al) Global warming, air pollution, and energy insecurity are three of the greatest problems facing humanity. To address these problems, we develop Green New Deal energy roadmaps for 143 countries.
- Number Cruncher Politics
- OOI Data Nuggets OOI Ocean Data Lab: The Data Nuggets
- Woods Hole Oceanographic Institution (WHOI)
- AP Statistics: Sampling, by Michael Porinchak Twin City Schools
- James' Empty Blog
- Logistic curves in market disruption From DollarsPerBBL, about logistic or S-curves as models of product take-up rather than exponentials, with notes on EVs
- Leverhulme Centre for Climate Change Mitigation
- Rasmus Bååth's Research Blog Bayesian statistics and data analysis
- Higgs from AIR describing NAO and EA Stephanie Higgs from AIR Worldwide gives a nice description of NAO and EA in the context of discussing “The Geographic Impact of Climate Signals on European Winter Storms”
- "The Expert"
- Carl Safina's blog One of the wisest on Earth
- Karl Broman
- Peter Congdon's Bayesian statistical modeling Peter Congdon’s collection of links pertaining to his several books on Bayesian modeling
- What If
- Ives and Dakos techniques for regime changes in series
- Lenny Smith's CHAOS: A VERY SHORT INTRODUCTION This is a PDF version of Lenny Smith’s book of the same title, also available from Amazon.com
- Flettner Rotor Bruce Yeany introduces the Flettner Rotor and related science
- Charlie Kufs' "Stats With Cats" blog “You took Statistics 101. Now what?”
- Slice Sampling
- Busting Myths About Heat Pumps Heat pumps are perhaps the most efficient heating and cooling systems available. Recent literature distributed by utilities hawking natural gas and other sources use performance figures from heat pumps as they were available 15 years ago. See today’s.
- SASB Sustainability Accounting Standards Board
- Team Andrew Weinberg Walking September 8th for the Jimmy Fund!
climate change
- Interview with Wally Broecker Interview with Wally Broecker
- "Warming Slowdown?" (part 1 of 2) The idea of a global warming slowdown or hiatus is critically examined, emphasizing the literature, the datasets, and means and methods for telling such. In two parts.
- Thriving on Low Carbon
- Climate at a glance Current state of the climate, from NOAA
- weather blocking patterns
- Updating the Climate Science: What path is the real world following? From Professors Makiko Sato & James Hansen of Columbia University
- ATTP summarizes all that stuff about Committed Warming from AND THEN THERE’S PHYSICS
- Earth System Models
- "Lessons of the Little Ice Age" (Farber) From Dan Farber, at LEGAL PLANET
- NOAA Annual Greenhouse Gas Index report The annual assessment by the National Oceanic and Atmospheric Administration of the radiative forcing from constituent atmospheric greenhouse gases
- Ray Pierrehumbert's site related to "Principles of Planetary Climate" THE book on climate science
- HotWhopper: It's excellent. Global warming and climate change. Eavesdropping on the deniosphere, its weird pseudo-science and crazy conspiracy whoppers.
- “The Irrelevance of Saturation: Why Carbon Dioxide Matters'' (Bart Levenson)
- Skeptical Science
- Non-linear feedbacks in climate (discussion of Bloch-Johnson, Pierrehumbert, Abbot paper) Discussion of http://onlinelibrary.wiley.com/wol1/doi/10.1002/2015GL064240/abstract
- Tamino's Open Mind Open Mind: A statistical look at climate, its science, and at science denial
- The Carbon Cycle The Carbon Cycle, monitored by The Carbon Project
- Transitioning to fully renewable energy Professor Saul Griffiths talks to transitioning the customer journey, from a dependency upon fossil fuels to an electrified future
- Anti—Anti-#ClimateEmergency Whether to declare a climate emergency is debatable. But some critics have gone way overboard.
- MIT's Climate Primer
- Exxon-Mobil statement on UNFCCC COP21
- Professor Robert Strom's compendium of resources on climate change Truly excellent
- Climate Change Reports By John and Mel Harte
- Sea Change Boston
- All Models Are Wrong Dr Tamsin Edwards blog about uncertainty in science, and climate science
- Nick Bower's "Scared Scientists"
- The great Michael Osborne's latest opinions Michael Osborne is a genius operative and champion of solar energy. I have learned never to disregard ANYTHING he says. He is mentor of Karl Ragabo, and the genius instigator of the Texas renewable energy miracle.
- RealClimate
- Bloomberg interactive graph on “What's warming the world''
- Climate Communication Hassol, Somerville, Melillo, and Hussin site communicating climate to the public
- Jacobson WWS literature index
- The Green Plate Effect Eli Rabett’s “The Green Plate Effect”
- Climate Change: A health emergency … New England Journal of Medicine Caren G. Solomon, M.D., M.P.H., and Regina C. LaRocque, M.D., M.P.H., January 17, 2019 N Engl J Med 2019; 380:209-211 DOI: 10.1056/NEJMp1817067
- Eli on the spectroscopic basis of atmospheric radiation physical chemistry
- "Mighty Microgrids" Webinar This is a Webinar on YouTube about Microgrids from the Institute for Local Self-Reliance (ILSR), featuring New York State and Minnesota
- US$165/tonne CO2: Sweden Sweden has a Carbon Dioxide tax of US$165 per tonne at present. CO2 tax was imposed in 1991. GDP has grown 60%.
- David Appell's early climate science
- "Betting strategies on fluctuations in the transient response of greenhouse warming" By Risbey, Lewandowsky, Hunter, Monselesan: Betting against climate change on durations of 15+ years is no longer a rational proposition.
- SolarLove
- The Sunlight Economy
- Reanalyses.org
- "Climate science is setttled enough"
- Paul Beckwith Professor Beckwith is, in my book, one of the most insightful and analytical observers on climate I know. I highly recommend his blog, and his other informational products.
- Simple box models and climate forcing IMO one of Tamino’s best posts illustrating climate forcing using simple box models
- The Keeling Curve The first, and one of the best programs for creating a spatially significant long term time series of atmospheric concentrations of CO2. Started amongst great obstacles by one, smart determined guy, Charles David Keeling.
- Ellenbogen: There is no Such Thing as Wind Turbine Syndrome
- Klaus Lackner (ASU), Silicon Kingdom Holdings (SKH) Capturing CO2 from air at scale
- Social Cost of Carbon
- Tell Utilities Solar Won't Be Killed Barry Goldwater, Jr’s campaign to push for solar expansion against monopolistic utilities, as a Republican
- The HUMAN-caused greenhouse effect, in under 5 minutes, by Bill Nye
Archives
Jan Galkowski
Category Archives: numerical software
JIGSAW-GEO v1.0
See: D. Engwirda, 2017: JIGSAW-GEO (1.0): Locally orthogonal staggered unstructured grid generation for general circulation modelling on the sphere, Geosci. Model Dev., 10, 2117-2140, doi:10.5194/gmd-10-2117-2017 and a general description at NASA. The figure below is copied from there.
A look at an electricity consumption series using SNCDs for clustering
(Slightly amended with code and data link, 12th January 2019.) Prediction of electrical load demand or, in other words, electrical energy consumption is important for the proper operation of electrical grids, at all scales. RTOs and ISOs forecast demand based … Continue reading
Posted in American Statistical Association, consumption, data streams, decentralized electric power generation, dendrogram, divergence measures, efficiency, electricity, electricity markets, energy efficiency, energy utilities, ensembles, evidence, forecasting, grid defection, hierarchical clustering, hydrology, ILSR, information theoretic statistics, local self reliance, Massachusetts, microgrids, NCD, normalized compression divergence, numerical software, open data, prediction, rate of return regulation, Sankey diagram, SNCD, statistical dependence, statistical series, statistics, sustainability, symmetric normalized compression divergence, time series
2 Comments
Sampling: Rejection, Reservoir, and Slice
An article by Suilou Huang for catatrophe modeler AIR-WorldWide of Boston about rejection sampling in CAT modeling got me thinking about pulling together some notes about sampling algorithms of various kinds. There are, of course, books written about this subject, … Continue reading
Posted in accept-reject methods, American Statistical Association, Bayesian computational methods, catastrophe modeling, data science, diffusion processes, empirical likelihood, Gibbs Sampling, insurance, Markov Chain Monte Carlo, mathematics, Mathematics and Climate Research Network, maths, Monte Carlo Statistical Methods, multivariate statistics, numerical algorithms, numerical analysis, numerical software, numerics, percolation theory, Python 3 programming language, R statistical programming language, Radford Neal, sampling, slice sampling, spatial statistics, statistics, stochastic algorithms, stochastic search
Leave a comment
A quick note on modeling operational risk from count data
The blog statcompute recently featured a proposal encouraging the use of ordinal models for difficult risk regressions involving count data. This is actually a second installment of a two-part post on this problem, the first dealing with flexibility in count … Continue reading
Posted in American Statistical Association, Bayesian, Bayesian computational methods, count data regression, dichotomising continuous variables, dynamic generalized linear models, Frank Harrell, Frequentist, Generalize Additive Models, generalized linear mixed models, generalized linear models, GLMMs, GLMs, John Kruschke, maximum likelihood, model comparison, Monte Carlo Statistical Methods, multivariate statistics, nonlinear, numerical software, numerics, premature categorization, probit regression, statistical regression, statistics
Tagged dichotomising continuous variables, dichotomizing continuous variables, premature categorization, splines
Leave a comment
Fast means, fast moments (originally devised 1984)
(Updated 4th December 2018.) There are many devices available for making numerical calculations fast. Modern datasets and computational problems apply stylized architectures, and use approaches to problems including special algorithms for just calculating dominant eigenvectors or using non-classical statistical mechanisms … Continue reading
Cathy O’Neil’s WEAPONS OF MATH DESTRUCTION: A Review
(Revised and updated Monday, 24th October 2016.) Weapons of Math Destruction, Cathy O’Neil, published by Crown Random House, 2016. This is a thoughtful and very approachable introduction and review to the societal and personal consequences of data mining, data science, … Continue reading
Posted in citizen data, citizen science, citizenship, civilization, compassion, complex systems, criminal justice, Daniel Kahneman, data science, deep recurrent neural networks, destructive economic development, economics, education, engineering, ethics, Google, ignorance, Joseph Schumpeter, life purpose, machine learning, Mathbabe, mathematics, mathematics education, maths, model comparison, model-free forecasting, numerical analysis, numerical software, open data, optimization, organizational failures, planning, politics, prediction, prediction markets, privacy, rationality, reason, reasonableness, risk, silly tech devices, smart data, sociology, Techno Utopias, testing, the value of financial assets, transparency
Leave a comment
Repaired R code for Markov spatial simulation of hurricane tracks from historical trajectories
(Slight update, 28th June 2020.) I’m currently studying random walk and diffusion processes and their connections with random fields. I’m interested in this because at the core of dynamic linear models, Kalman filters, and state-space methods there is a random … Continue reading
Posted in American Meteorological Association, American Statistical Association, AMETSOC, Arthur Charpentier, atmosphere, diffusion, diffusion processes, dynamic linear models, dynamical systems, environment, geophysics, hurricanes, Kalman filter, Kerry Emanuel, Lévy flights, Lorenz, Markov chain random fields, mathematics, mathematics education, maths, MCMC, mesh models, meteorological models, meteorology, model-free forecasting, Monte Carlo Statistical Methods, numerical analysis, numerical software, oceanography, open data, open source scientific software, physics, random walk processes, random walks, science, spatial statistics, state-space models, statistical dependence, statistics, stochastic algorithms, stochastics, time series
1 Comment
“Holy crap – an actual book!”
Originally posted on mathbabe:
Yo, everyone! The final version of my book now exists, and I have exactly one copy! Here’s my editor, Amanda Cook, holding it yesterday when we met for beers: Here’s my son holding it: He’s offered…
Posted in American Association for the Advancement of Science, Buckminster Fuller, business, citizen science, citizenship, civilization, complex systems, confirmation bias, data science, data streams, deep recurrent neural networks, denial, economics, education, engineering, ethics, evidence, Internet, investing, life purpose, machine learning, mathematical publishing, mathematics, mathematics education, maths, moral leadership, multivariate statistics, numerical software, numerics, obfuscating data, organizational failures, politics, population biology, prediction, prediction markets, privacy, quantitative biology, quantitative ecology, rationality, reason, reasonableness, rhetoric, risk, Schnabel census, smart data, sociology, statistical dependence, statistics, the right to be and act stupid, the right to know, the value of financial assets, transparency, UU Humanists
Leave a comment
Bayesian blocks via PELT in R
Notice of Update I have made some changes to the Bayesian Blocks code linked from here, on 24th November 2021. Also I note the coming and going of a “BayesianBlocks” package on CRAN which contained an optinterval function also based upon … Continue reading
Posted in American Statistical Association, AMETSOC, anomaly detection, astrophysics, Cauchy distribution, changepoint detection, engineering, geophysics, multivariate statistics, numerical analysis, numerical software, numerics, oceanography, population biology, population dynamics, Python 3, quantitative biology, quantitative ecology, R, Scargle, spatial statistics, square wave approximation, statistics, stepwise approximation, time series, Woods Hole Oceanographic Institution
3 Comments
JASA demands code and data be supplied as a condition of publication
The Journal of the American Statistical Association (“JASA”) has announced in this month’s Amstat News that effective 1st September 2016 “… will require code and data as a minimum standard for reproducibility of statistical scientific research.” Trends were heading this … Continue reading
Posted in American Association for the Advancement of Science, American Statistical Association, citizen science, engineering, ethics, evidence, new forms of scientific peer review, numerical software, planning, rationality, reasonableness, resiliency, science, statistics, stochastic algorithms, testing, the right to know
Leave a comment
data.table
R provides a helpful data structure called the “data frame” that gives the user an intuitive way to organize, view, and access data. Many of the functions that you would us… Source: Intro to The data.table Package
On Smart Data
One of the things I find surprising, if not astonishing, is that in the rush to embrace Big Data, a lot of learning and statistical technique has been left apparently discarded along the way. I’m hardly the first to point … Continue reading
Posted in Akaike Information Criterion, Bayes, Bayesian, Bayesian inversion, big data, bigmemory package for R, changepoint detection, data science, data streams, dlm package, dynamic generalized linear models, dynamic linear models, dynamical systems, Generalize Additive Models, generalized linear models, information theoretic statistics, Kalman filter, linear algebra, logistic regression, machine learning, Markov Chain Monte Carlo, mathematics, mathematics education, maths, maximum likelihood, MCMC, Monte Carlo Statistical Methods, multivariate statistics, numerical analysis, numerical software, numerics, quantitative biology, quantitative ecology, rationality, reasonableness, sampling, smart data, state-space models, statistical dependence, statistics, the right to know, time series
Leave a comment
Six cases of models
The previous post included an attempt to explain land surface temperatures as estimated by the BEST project using a dynamic linear model including regressions on both quarterly CO2 concentrations and ocean heat content. The idea was to check the explanatory … Continue reading
Posted in AMETSOC, anemic data, Anthropocene, astrophysics, Bayesian, Berkeley Earth Surface Temperature project, BEST, carbon dioxide, climate, climate change, climate data, climate disruption, climate models, dlm package, dynamic linear models, dynamical systems, environment, fossil fuels, geophysics, Giovanni Petris, global warming, greenhouse gases, Hyper Anthropocene, information theoretic statistics, maths, maximum likelihood, meteorology, model comparison, numerical software, Patrizia Campagnoli, Rauch-Tung-Striebel, Sonia Petrone, state-space models, stochastic algorithms, stochastic search, SVD, time series
1 Comment
Phytoplankton-delineated oceanic eddies near Antarctica
Excerpt, from NASA: Phytoplankton are the grass of the sea. They are floating, drifting, plant-like organisms that harness the energy of the Sun, mix it with carbon dioxide that they take from the atmosphere, and turn it into carbohydrates and … Continue reading
Posted in AMETSOC, Antarctica, Arctic, bacteria, Carbon Cycle, complex systems, differential equations, diffusion, diffusion processes, dynamic linear models, dynamical systems, Emily Shuckburgh, environment, fluid dynamics, geophysics, GLMs, John Marshall, marine biology, Mathematics and Climate Research Network, NASA, numerical analysis, numerical software, oceanic eddies, oceanography, physics, phytoplankton, science, thermohaline circulation, WHOI, Woods Hole Oceanographic Institution
Leave a comment
high dimension Metropolis-Hastings algorithms
If attempting to simulate from a multivariate standard normal distribution in a large dimension, when starting from the mode of the target, i.e., its mean γ, leaving the mode γis extremely unlikely, given the huge drop between the value of the density at the mode γ and at likely realisations Continue reading
Posted in Bayes, Bayesian, Bayesian inversion, boosting, chance, Christian Robert, computation, ensembles, Gibbs Sampling, James Spall, Jerome Friedman, Markov Chain Monte Carlo, mathematics, maths, MCMC, Monte Carlo Statistical Methods, multivariate statistics, numerical software, numerics, optimization, reasonableness, Robert Schapire, SPSA, state-space models, statistics, stochastic algorithms, stochastic search, stochastics, Yoav Freund
Leave a comment
Generating supports for classification rules in black box regression models
Inspired by the extensive and excellent work in approximate Bayesian computation (see also), especially that done by Professors Christian Robert and colleagues (see also), and Professor Simon Wood (see also), it occurred to me that the complaints regarding lack of … Continue reading
Posted in approximate Bayesian computation, Bayes, Bayesian, Bayesian inversion, generalized linear models, machine learning, numerical analysis, numerical software, probabilistic programming, rationality, reasonableness, state-space models, statistics, stochastic algorithms, stochastic search, stochastics, support of black boxes
Leave a comment
November Hottest Ever, and Christmas Likely To bring Record Warmth in The East (Dan’s Wild Wild Science Journal; AGU Blogosphere)
The long-range guidance is showing strong indications that the incredible December warmth in the Eastern U.S. will continue to the end of the month. A blast of cold air will arrive later this week,… (Click on image for larger map, … Continue reading
Posted in AMETSOC, capricious gods, climate, climate models, Dan Satterfield, differential equations, diffusion processes, dynamical systems, ensembles, ENSO, environment, forecasting, geophysics, Hyper Anthropocene, meteorology, NCAR, NOAA, numerical software, physics, science, the right to know, wave equations
Leave a comment
“1D Wave with Delta Potential and Triangle Initial Position” (Jeff Galkowski, Stanford)
The latest calculations from Jeff Galkowski, of Stanford.
Posted in computation, engineering, Jeff Galkowski, mathematics, maths, McGill University, numerical analysis, numerical software, physics, proud dad, quantum, scattering, science, Stanford University, the right to know, University of California Berkeley, University of Rochester, wave equations, waves
Leave a comment
Southern Oscillation (SOI) correlated with Outgoing Longwave Radiation (OLR)
To the climate community this is nothing at all new, but I spotted these time series today and thought they would make a nice exhibit on how something people have direct control over, greenhouse gas emissions, affect a “teleconnection mechanism” … Continue reading
Posted in AMETSOC, bifurcations, carbon dioxide, climate, climate change, climate disruption, climate models, Dan Satterfield, differential equations, dynamic linear models, dynamical systems, ENSO, environment, forecasting, generalized linear models, geophysics, global warming, greenhouse gases, IPCC, Mathematica, mathematics, maths, meteorology, NCAR, NOAA, numerical software, oceanography, open data, physics, population biology, Principles of Planetary Climate, rationality, reasonableness, science, Spaceship Earth, state-space models, thermodynamics, time series
Leave a comment
Solar array with cloud predicting technology launched in WA
Australia’s first grid-connected solar power project with cloud predicting technology launched at Karratha Airport, WA, in bid to smooth solar supply. Source: Solar array with cloud predicting technology launched in WA
Posted in adaptation, Anthropocene, carbon dioxide, citizenship, civilization, clean disruption, climate, climate change, climate disruption, conservation, consumption, decentralized electric power generation, decentralized energy, demand-side solutions, dynamic linear models, efficiency, energy, energy reduction, energy utilities, engineering, environment, ethics, forecasting, geophysics, global warming, Hyper Anthropocene, investment in wind and solar energy, Kalman filter, mathematics, maths, meteorology, microgrids, mitigation, NCAR, numerical software, optimization, physics, prediction, probabilistic programming, rationality, reasonableness, risk, science, solar power, stochastics, sustainability, time series
Leave a comment
Your future: Antarctica, in detail
Climate and geophysical accuracy demands fine modeling grids, and very large supercomputers. The best and biggest supercomputers have not been available for climate work, until recently. Watch how results differ if fine meshes and big supercomputers are used. Why haven’t … Continue reading
Posted in Antarctica, Anthropocene, bridge to nowhere, climate, climate change, climate disruption, climate zombies, disingenuity, ecology, ensembles, forecasting, geophysics, global warming, Hyper Anthropocene, ignorance, IPCC, Lawrence Berkeley National Laboratory, LBNL, living shorelines, mathematics, mathematics education, maths, mesh models, meteorology, multivariate statistics, numerical software, optimization, physics, rationality, reasonableness, risk, science, science education, sea level rise, spatial statistics, state-space models, statistics, stochastic algorithms, stochastics, supercomputers, temporal myopia, the right to know, thermodynamics, time series, University of California Berkeley, WAIS
Leave a comment
Comprehensive and compact tutorial on Petris’ DLM package in R; with an update about Helske’s KFAS
A blogger named Lalas produced on Quantitative Thoughts a very comprehensive and compact tutorial on the R package dlm by Petris. I use dlm a lot. Unfortunately, Lalas does not give details on how the SVD is used. They do … Continue reading
Posted in Bayes, Bayesian, dynamic linear models, dynamical systems, forecasting, Kalman filter, mathematics, maths, multivariate statistics, numerical software, open source scientific software, prediction, R, Rauch-Tung-Striebel, state-space models, statistics, stochastic algorithms, SVD, time series
1 Comment
ecoquant
667 per centimeter : climate science, quantitative biology, statistics, and energy policy 