667 per centimeter
"Whether we and our politicians know it or not, Nature is party to all our deals and decisions, and she has more votes, a longer memory, and a sterner sense of justice than we do." — Wendell Berry
Skip to content
  • Home
  • About

Category Archives: dendrogram

A look at an electricity consumption series using SNCDs for clustering

Posted on 11 January 2019 by ecoquant

(Slightly amended with code and data link, 12th January 2019.) Prediction of electrical load demand or, in other words, electrical energy consumption is important for the proper operation of electrical grids, at all scales. RTOs and ISOs forecast demand based … Continue reading →

Posted in American Statistical Association, consumption, data streams, decentralized electric power generation, dendrogram, divergence measures, efficiency, electricity, electricity markets, energy efficiency, energy utilities, ensembles, evidence, forecasting, grid defection, hierarchical clustering, hydrology, ILSR, information theoretic statistics, local self reliance, Massachusetts, microgrids, NCD, normalized compression divergence, numerical software, open data, prediction, rate of return regulation, Sankey diagram, SNCD, statistical dependence, statistical series, statistics, sustainability, symmetric normalized compression divergence, time series | 2 Comments
  • Distributed Solar: The Democratizaton of Energy

  • Blogroll

    • All about Sankey diagrams
    • Earth Family Alpha Michael Osborne’s blog (former Executive at Austin Energy, now Chairman of the Electric Utility Commission for Austin, Texas)
    • American Statistical Association
    • "Impacts of Green New Deal energy plans on grid stability, costs, jobs, health, and climate in 143 countries" (Jacobson, Delucchi, Cameron, et al) Global warming, air pollution, and energy insecurity are three of the greatest problems facing humanity. To address these problems, we develop Green New Deal energy roadmaps for 143 countries.
    • Leverhulme Centre for Climate Change Mitigation
    • Lenny Smith's CHAOS: A VERY SHORT INTRODUCTION This is a PDF version of Lenny Smith’s book of the same title, also available from Amazon.com
    • Hermann Scheer Hermann Scheer was a visionary, a major guy, who thought deep thoughts about energy, and its implications for humanity’s relationship with physical reality
    • Why "naive Bayes" is not Bayesian Explains why the so-called “naive Bayes” classifier is not Bayesian. The setup is okay, but estimating probabilities by doing relative frequencies instead of using Dirichlet conjugate priors or integration strays from The Path.
    • The Alliance for Securing Democracy dashboard
    • Simon Wood's must-read paper on dynamic modeling of complex systems I highlighted Professor Wood’s paper in https://hypergeometric.wordpress.com/2014/12/26/struggling-with-problems-already-attacked/
    • AP Statistics: Sampling, by Michael Porinchak Twin City Schools
    • "The Expert"
    • International Society for Bayesian Analysis (ISBA)
    • WEAPONS OF MATH DESTRUCTION Cathy O’Neil’s WEAPONS OF MATH DESTRUCTION,
    • SASB Sustainability Accounting Standards Board
    • Pat's blog While it is described as “The mathematical (and other) thoughts of a (now retired) math teacher”, this is false humility, as it chronicles the present and past life and times of mathematicians in their context. Recommended.
    • Comprehensive Guide to Bayes Rule
    • NCAR AtmosNews
    • Earth Family Beta MIchael Osborne’s blog on Science and the like
    • GeoEnergy Math Prof Paul Pukite’s Web site devoted to energy derived from geological and geophysical processes and categorized according to its originating source.
    • Mark Berliner's video lecture "Bayesian mechanistic-statistical modeling with examples in geophysical settings"
    • Bob Altemeyer on authoritarianism (via Dan Satterfield) The science behind the GOP civil war
    • Higgs from AIR describing NAO and EA Stephanie Higgs from AIR Worldwide gives a nice description of NAO and EA in the context of discussing “The Geographic Impact of Climate Signals on European Winter Storms”
    • In Monte Carlo We Trust The statistics blog of Matt Asher, actually called the “Probability and Statistics Blog”, but his subtitle is much more appealing. Asher has a Manifesto at http://www.statisticsblog.com/manifesto/.
    • Giant vertical monopolies for energy have stopped making sense
    • Professor David Draper
    • "Perpetual Ocean" from NASA GSFC
    • Dollars per BBL: Energy in Transition
    • Healthy Home Healthy Planet
    • Carl Safina's blog One of the wisest on Earth
    • BioPython A collection of Python tools for quantitative Biology
    • John Cook's reasons to use Bayesian inference
    • Quotes by Nikola Tesla Quotes by Nikola Tesla, including some of others he greatly liked.
    • Flettner Rotor Bruce Yeany introduces the Flettner Rotor and related science
    • Risk and Well-Being
    • Fear and Loathing in Data Science Cory Lesmeister’s savage journey to the heart of Big Data
    • Awkward Botany
    • John Kruschke's "Dong Bayesian data analysis" blog Expanding and enhancing John’s book of same title (now in second edition!)
    • Why It’s So Freaking Hard To Make A Good COVID-19 Model Five Thirty Eight’s take on why pandemic modeling is so difficult
    • Label Noise
    • All about models
    • Busting Myths About Heat Pumps Heat pumps are perhaps the most efficient heating and cooling systems available. Recent literature distributed by utilities hawking natural gas and other sources use performance figures from heat pumps as they were available 15 years ago. See today’s.
    • Earle Wilson
    • Brendon Brewer on Overfitting Important and insightful presentation by Brendon Brewer on overfitting
    • Charlie Kufs' "Stats With Cats" blog “You took Statistics 101. Now what?”
    • "Consider a Flat Pond" Invited talk introducing systems thinking, by Jan Galkowski, at First Parish in Needham, UU, via Zoom
    • The Keeling Curve: its history History of the Keeling Curve and Charles David Keeling
    • Brian McGill's Dynamic Ecology blog Quantitative biology with pithy insights regarding applications of statistical methods
    • Mike Bloomberg, 2020 He can get progress on climate done, has the means and experts to counter the Trump and Republican digital disinformation machine, and has the experience, knowledge, and depth of experience to achieve and unify.
    • Thaddeus Stevens quotes As I get older, I admire this guy more and more
  • climate change

    • "Lessons of the Little Ice Age" (Farber) From Dan Farber, at LEGAL PLANET
    • NOAA Annual Greenhouse Gas Index report The annual assessment by the National Oceanic and Atmospheric Administration of the radiative forcing from constituent atmospheric greenhouse gases
    • History of discovering Global Warming From the American Institute of Physics.
    • Steve Easterbrook's excellent climate blog: See his "The Internet: Saving Civilization or Trashing the Planet?" for example Heavy on data and computation, Easterbrook is a CS prof at UToronto, but is clearly familiar with climate science. I like his “The Internet: Saving Civilization or Trashing the Planet” very much.
    • Paul Beckwith Professor Beckwith is, in my book, one of the most insightful and analytical observers on climate I know. I highly recommend his blog, and his other informational products.
    • ATTP summarizes all that stuff about Committed Warming from AND THEN THERE’S PHYSICS
    • weather blocking patterns
    • Ellenbogen: There is no Such Thing as Wind Turbine Syndrome
    • The HUMAN-caused greenhouse effect, in under 5 minutes, by Bill Nye
    • The net average effect of a warming climate is increased aridity (Professor Steven Sherwood)
    • Agendaists Eli Rabett’s coining of a phrase
    • Interview with Wally Broecker Interview with Wally Broecker
    • Eli on the spectroscopic basis of atmospheric radiation physical chemistry
    • Climate model projections versus observations
    • The Carbon Cycle The Carbon Cycle, monitored by The Carbon Project
    • SOLAR PRODUCTION at Westwood Statistical Studios Generation charts for our home in Westwood, MA
    • Transitioning to fully renewable energy Professor Saul Griffiths talks to transitioning the customer journey, from a dependency upon fossil fuels to an electrified future
    • Simple models of climate change
    • Non-linear feedbacks in climate (discussion of Bloch-Johnson, Pierrehumbert, Abbot paper) Discussion of http://onlinelibrary.wiley.com/wol1/doi/10.1002/2015GL064240/abstract
    • Climate Communication Hassol, Somerville, Melillo, and Hussin site communicating climate to the public
    • Anti—Anti-#ClimateEmergency Whether to declare a climate emergency is debatable. But some critics have gone way overboard.
    • `Who to believe on climate change': Simple checks By Bart Verheggen
    • The Scientific Case for Modern Human-caused Global Warming
    • All Models Are Wrong Dr Tamsin Edwards blog about uncertainty in science, and climate science
    • Jacobson WWS literature index
    • “The discovery of global warming'' (American Institute of Physics)
    • Solar Gardens Community Power
    • On Thomas Edison and Solar Electric Power
    • Andy Zucker's "Climate Change and Psychology"
    • “The Irrelevance of Saturation: Why Carbon Dioxide Matters'' (Bart Levenson)
    • Simple box models and climate forcing IMO one of Tamino’s best posts illustrating climate forcing using simple box models
    • US$165/tonne CO2: Sweden Sweden has a Carbon Dioxide tax of US$165 per tonne at present. CO2 tax was imposed in 1991. GDP has grown 60%.
    • Social Cost of Carbon
    • "Climate science is setttled enough"
    • The Green Plate Effect Eli Rabett’s “The Green Plate Effect”
    • Jacobson WWS literature index
    • Sea Change Boston
    • "A field guide to the climate clowns"
    • Professor Robert Strom's compendium of resources on climate change Truly excellent
    • "Impacts of Green New Deal energy plans on grid stability, costs, jobs, health, and climate in 143 countries" (Jacobson, Delucchi, Cameron, et al) Global warming, air pollution, and energy insecurity are three of the greatest problems facing humanity. To address these problems, we develop Green New Deal energy roadmaps for 143 countries.
    • Updating the Climate Science: What path is the real world following? From Professors Makiko Sato & James Hansen of Columbia University
    • "Betting strategies on fluctuations in the transient response of greenhouse warming" By Risbey, Lewandowsky, Hunter, Monselesan: Betting against climate change on durations of 15+ years is no longer a rational proposition.
    • Sir David King David King’s perspective on climate, and the next thousands of years for humanity
    • Documenting the Climate Deniarati at work
    • HotWhopper: It's excellent. Global warming and climate change. Eavesdropping on the deniosphere, its weird pseudo-science and crazy conspiracy whoppers.
    • World Weather Attribution
    • AIP's history of global warming science: impacts The American Institute of Physics has a fine history of the science of climate change. This link summarizes the history of impacts of climate change.
    • Mathematics and Climate Research Network The Mathematics and Climate Research Network (MCRN) engages mathematicians to collaborating on the cryosphere, conceptual model validation, data assimilation, the electric grid, food systems, nonsmooth systems, paleoclimate, resilience, tipping points.
    • And Then There's Physics
    • Climate Change: A health emergency … New England Journal of Medicine Caren G. Solomon, M.D., M.P.H., and Regina C. LaRocque, M.D., M.P.H., January 17, 2019 N Engl J Med 2019; 380:209-211 DOI: 10.1056/NEJMp1817067
  • Archives

  • Jan Galkowski

    • 1 ecoquant
  • Blog Stats

    • 118,867 hits
  • Recent Posts

    • “No, we’re not” 1 August 2026
    • That’s a silly idea, especially about a universe which is fundamentally stochastic. 30 July 2026
    • So much for U.S. leadership in Science and Engineering 30 July 2026
    • “record warm 2026” 27 July 2026
    • Professor Jeff Galkowski won a Whitehead Prize this year 3 July 2026
    • From TJ on the 250th 3 July 2026
    • Professor James Hansen 30 June 2026
    • Insight from Tamino 28 June 2026
    • Climate is Back … 24 June 2026
    • Some Solar in Westwood 22 June 2026
    • Importance of NSF’s Ocean Observatories Initiative 15 June 2026
    • More on RCP 8.5 from … 26 May 2026
    • The story of RCP 8.5 26 May 2026
    • “Estonia Warns European Allies Against Direct Talks With Russia” 17 May 2026
    • wind machine 10 May 2026
    • Dr Des Callaghan’s “Bryophytes around the world” 28 April 2026
    • Entire NSF National Science Board fired by Donald Trump 27 April 2026
    • DT is moving to control U.S. elections, one state at a time 27 April 2026
    • The Climate Brink 17 April 2026
    • Tamino, on Climate, Spring 2026 12 April 2026
    • from Canada PM Mark Carney 24 March 2026
    • Professor Katharine Hayhoe “Talking Climate” today 21 March 2026
    • thanks DT for making the case for solar and EVs and NOT oil 20 March 2026
    • 2026 March 14 [J 073.87] “Pi Day” 14 March 2026
    • Rare and hard to find 1937-1938 15 February 2026
    • EPA official actions on their “endangerment finding” 14 February 2026
    • RC: “a peek behind the curtain” 23 January 2026
    • Stark 18 January 2026
    • Could this be why DT wants Greenland? 16 January 2026
    • NAP update on Endangerment Finding 26 December 2025
    • Sporophyte capsules 16 October 2025
    • AI and GPT don’t manufacture results from nothing 18 September 2025
    • 16th September 2025, Westwood, MA 16 September 2025
    • Pohlia lescuriana 6 September 2025
    • Mckibben vs Nordhous 22 August 2025
    • NOAA climate assessment which has been taken off the federal site 13 August 2025
    • Fast-Track Review of Latest Evidence for Whether Greenhouse Gas Emissions Endanger Public Health and Welfare 7 August 2025
    • A New Phase in Trump’s War on Data 6 August 2025
    • Beaker Street 5 August 2025
    • Biofluorescent marsupial 5 August 2025
    • Steve Buchan, botanical photographer 28 July 2025
    • 2025 Jul 4-12 J(185-193) around yard 2 long lenses OM5 camera 12 July 2025
    • 25mm compact lens equivalent to 50mm 2 July 2025
    • Polytrichum macro photos, several of spore capsules 30 June 2025
    • “Macro Treasures” 12 June 2025
    • Flickr Account 24 May 2025
    • 2025 May 8 J 128 redbuds, etc, OM Systems 60mm lens 8 May 2025
    • 2025 April 19 J109 some close-ups of Polytrichum 19 April 2025
    • A New Lens 26 March 2025
    • 2025 March 23 J 82 23 March 2025
  • Follow Blog via Email

    Enter your email address to follow this blog and receive notifications of new posts by email.

    Join 130 other subscribers
  • Goodreads

  • Kalman filtering and smoothing; dynamic linear models



    Also, see datasets and R examples to accompany this excellent text.





    I have used dlm almost exclusively, except when extreme efficiency was required. Since Jouni Helske's KFAS was rewritten, though, I'm increasingly drawn to it, because the noise sources it supports are more diverse than dlm's. KFAS uses the notation and approaches of Durbin, Koopman, and Harvey.

    ``The real problem is that programmers have spent far too much time worrying about efficiency in the wrong places and at the wrong times; premature optimization is the root of all evil (or at least most of it) in programming.''
    Professor Donald Knuth, 1974
667 per centimeter Arctic Ice: The Saga Continues
Create a website or blog at WordPress.com
Loading Comments...