667 per centimeter
"Whether we and our politicians know it or not, Nature is party to all our deals and decisions, and she has more votes, a longer memory, and a sterner sense of justice than we do." — Wendell Berry
Skip to content
  • Home
  • About

Category Archives: symmetric normalized compression divergence

A look at an electricity consumption series using SNCDs for clustering

Posted on 11 January 2019 by ecoquant

(Slightly amended with code and data link, 12th January 2019.) Prediction of electrical load demand or, in other words, electrical energy consumption is important for the proper operation of electrical grids, at all scales. RTOs and ISOs forecast demand based … Continue reading →

Posted in American Statistical Association, consumption, data streams, decentralized electric power generation, dendrogram, divergence measures, efficiency, electricity, electricity markets, energy efficiency, energy utilities, ensembles, evidence, forecasting, grid defection, hierarchical clustering, hydrology, ILSR, information theoretic statistics, local self reliance, Massachusetts, microgrids, NCD, normalized compression divergence, numerical software, open data, prediction, rate of return regulation, Sankey diagram, SNCD, statistical dependence, statistical series, statistics, sustainability, symmetric normalized compression divergence, time series | 2 Comments
  • Distributed Solar: The Democratizaton of Energy

  • Blogroll

    • The Mermaid's Tale A conversation about biological complexity and evolution, and the societal aspects of science
    • Dr James Spall's SPSA
    • "Perpetual Ocean" from NASA GSFC
    • Higgs from AIR describing NAO and EA Stephanie Higgs from AIR Worldwide gives a nice description of NAO and EA in the context of discussing “The Geographic Impact of Climate Signals on European Winter Storms”
    • Professor David Draper
    • American Statistical Association
    • "Talking Politics" podcast David Runciman, Helen Thompson
    • Slice Sampling
    • John Cook's reasons to use Bayesian inference
    • Carl Safina's blog One of the wisest on Earth
    • Patagonia founder Yvon Chouinard on how businesses can help our collective environmental mess Patagonia’s Yvon Chouinard set the standard for how a business can mitigate the ravages of capitalism on earth’s environment. At 81 years old, he’s just getting started.
    • WEAPONS OF MATH DESTRUCTION Cathy O’Neil’s WEAPONS OF MATH DESTRUCTION,
    • Tim Harford's “More or Less'' Tim Harford explains – and sometimes debunks – the numbers and statistics used in political debate, the news and everyday life
    • Logistic curves in market disruption From DollarsPerBBL, about logistic or S-curves as models of product take-up rather than exponentials, with notes on EVs
    • Survey Methodology, Prof Ron Fricker http://faculty.nps.edu/rdfricke/
    • South Shore Recycling Cooperative Materials management, technical assistance and networking, town advocacy, public outreach
    • Beautiful Weeds of New York City
    • All about models
    • NCAR AtmosNews
    • Mertonian norms
    • "Impacts of Green New Deal energy plans on grid stability, costs, jobs, health, and climate in 143 countries" (Jacobson, Delucchi, Cameron, et al) Global warming, air pollution, and energy insecurity are three of the greatest problems facing humanity. To address these problems, we develop Green New Deal energy roadmaps for 143 countries.
    • In Monte Carlo We Trust The statistics blog of Matt Asher, actually called the “Probability and Statistics Blog”, but his subtitle is much more appealing. Asher has a Manifesto at http://www.statisticsblog.com/manifesto/.
    • Flettner Rotor Bruce Yeany introduces the Flettner Rotor and related science
    • Why It’s So Freaking Hard To Make A Good COVID-19 Model Five Thirty Eight’s take on why pandemic modeling is so difficult
    • Harvard's Project Implicit
    • Pat's blog While it is described as “The mathematical (and other) thoughts of a (now retired) math teacher”, this is false humility, as it chronicles the present and past life and times of mathematicians in their context. Recommended.
    • Prediction vs Forecasting: Knaub “Unfortunately, ‘prediction,’ such as used in model-based survey estimation, is a term that is often subsumed under the term ‘forecasting,’ but here we show why it is important not to confuse these two terms.”
    • Leadership lessons from Lao Tzu
    • SASB Sustainability Accounting Standards Board
    • Number Cruncher Politics
    • Risk and Well-Being
    • James' Empty Blog
    • Thaddeus Stevens quotes As I get older, I admire this guy more and more
    • The Plastic Pick-Up: Discovering new sources of marine plastic pollution
    • WEAPONS OF MATH DESTRUCTION, reviews Reviews of Cathy O’Neil’s new book
    • Giant vertical monopolies for energy have stopped making sense
    • Brendon Brewer on Overfitting Important and insightful presentation by Brendon Brewer on overfitting
    • BioPython A collection of Python tools for quantitative Biology
    • Awkward Botany
    • Darren Wilkinson's introduction to ABC Darren Wilkinson’s introduction to approximate Bayesian computation (“ABC”). See also his post about summary statistics for ABC https://darrenjw.wordpress.com/2013/09/01/summary-stats-for-abc/
    • Rasmus Bååth's Research Blog Bayesian statistics and data analysis
    • Gabriel's staircase
    • Mrooijer's Numbers R 4Us
    • Hermann Scheer Hermann Scheer was a visionary, a major guy, who thought deep thoughts about energy, and its implications for humanity’s relationship with physical reality
    • Earle Wilson
    • The Keeling Curve: its history History of the Keeling Curve and Charles David Keeling
    • Karl Broman
    • Mark Berliner's video lecture "Bayesian mechanistic-statistical modeling with examples in geophysical settings"
    • American Association for the Advancement of Science (AAAS)
    • Subsidies for wind and solar versus subsidies for fossil fuels
  • climate change

    • Solar Gardens Community Power
    • Thriving on Low Carbon
    • “Ways to [try to] slow the Solar Century''
    • Social Cost of Carbon
    • ATTP summarizes all that stuff about Committed Warming from AND THEN THERE’S PHYSICS
    • Anti—Anti-#ClimateEmergency Whether to declare a climate emergency is debatable. But some critics have gone way overboard.
    • "Warming Slowdown?" (part 1 of 2) The idea of a global warming slowdown or hiatus is critically examined, emphasizing the literature, the datasets, and means and methods for telling such. In two parts.
    • CLIMATE ADAM Previously from the Science news staff at the podcast of Nature (“Nature Podcast”), the journal, now on YouTube, encouraging climate action through climate comedy.
    • Berkeley Earth Surface Temperature
    • Exxon-Mobil statement on UNFCCC COP21
    • SolarLove
    • Équiterre Equiterre helps build a social movement by encouraging individuals, organizations and governments to make ecological and equitable choices, in a spirit of solidarity.
    • Energy payback period for solar panels Considering everything, how long do solar panels have to operate to offset the energy used to produce them?
    • Professor Robert Strom's compendium of resources on climate change Truly excellent
    • "Lessons of the Little Ice Age" (Farber) From Dan Farber, at LEGAL PLANET
    • Klaus Lackner (ASU), Silicon Kingdom Holdings (SKH) Capturing CO2 from air at scale
    • AIP's history of global warming science: impacts The American Institute of Physics has a fine history of the science of climate change. This link summarizes the history of impacts of climate change.
    • On Thomas Edison and Solar Electric Power
    • Isaac Held's blog In the spirit of Ray Pierrehumbert’s “big ideas come from small models” in his textbook, PRINCIPLES OF PLANETARY CLIMATE, Dr Held presents quantitative essays regarding one feature or another of the Earth’s climate and weather system.
    • Climate model projections versus observations
    • Mathematics and Climate Research Network The Mathematics and Climate Research Network (MCRN) engages mathematicians to collaborating on the cryosphere, conceptual model validation, data assimilation, the electric grid, food systems, nonsmooth systems, paleoclimate, resilience, tipping points.
    • The HUMAN-caused greenhouse effect, in under 5 minutes, by Bill Nye
    • An open letter to Steve Levitt
    • Dessler's 6 minute Greenhouse Effect video
    • And Then There's Physics
    • David Appell's early climate science
    • Reanalyses.org
    • Ellenbogen: There is no Such Thing as Wind Turbine Syndrome
    • "Climate science is setttled enough"
    • Spectra Energy exposed
    • Documenting the Climate Deniarati at work
    • RealClimate
    • "Impacts of Green New Deal energy plans on grid stability, costs, jobs, health, and climate in 143 countries" (Jacobson, Delucchi, Cameron, et al) Global warming, air pollution, and energy insecurity are three of the greatest problems facing humanity. To address these problems, we develop Green New Deal energy roadmaps for 143 countries.
    • The Keeling Curve The first, and one of the best programs for creating a spatially significant long term time series of atmospheric concentrations of CO2. Started amongst great obstacles by one, smart determined guy, Charles David Keeling.
    • The Carbon Cycle The Carbon Cycle, monitored by The Carbon Project
    • The Green Plate Effect Eli Rabett’s “The Green Plate Effect”
    • Simple models of climate change
    • The Scientific Case for Modern Human-caused Global Warming
    • Paul Beckwith Professor Beckwith is, in my book, one of the most insightful and analytical observers on climate I know. I highly recommend his blog, and his other informational products.
    • Climate Change: A health emergency … New England Journal of Medicine Caren G. Solomon, M.D., M.P.H., and Regina C. LaRocque, M.D., M.P.H., January 17, 2019 N Engl J Med 2019; 380:209-211 DOI: 10.1056/NEJMp1817067
    • `The unchained goddess' 1958 Bell Telephone Science Hour broadcast regarding, among other things, climate change.
    • Nick Bower's "Scared Scientists"
    • Interview with Wally Broecker Interview with Wally Broecker
    • Steve Easterbrook's excellent climate blog: See his "The Internet: Saving Civilization or Trashing the Planet?" for example Heavy on data and computation, Easterbrook is a CS prof at UToronto, but is clearly familiar with climate science. I like his “The Internet: Saving Civilization or Trashing the Planet” very much.
    • Climate Change Denying Organizations
    • Mrooijer's Global Temperature Explorer
    • Jacobson WWS literature index
    • World Weather Attribution
    • The beach boondoggle Prof Rob Young on how owners of beach property are socializing their risks at costs to all of us, not the least being it seems coastal damage is less than it actually is
    • Climate Communication Hassol, Somerville, Melillo, and Hussin site communicating climate to the public
  • Archives

  • Jan Galkowski

    • 1 ecoquant
  • Blog Stats

    • 117,810 hits
  • Recent Posts

    • Professor Jeff Galkowski won a Whitehead Prize this year 3 July 2026
    • From TJ on the 250th 3 July 2026
    • Professor James Hansen 30 June 2026
    • Insight from Tamino 28 June 2026
    • Climate is Back … 24 June 2026
    • Some Solar in Westwood 22 June 2026
    • Importance of NSF’s Ocean Observatories Initiative 15 June 2026
    • More on RCP 8.5 from … 26 May 2026
    • The story of RCP 8.5 26 May 2026
    • “Estonia Warns European Allies Against Direct Talks With Russia” 17 May 2026
    • wind machine 10 May 2026
    • Dr Des Callaghan’s “Bryophytes around the world” 28 April 2026
    • Entire NSF National Science Board fired by Donald Trump 27 April 2026
    • DT is moving to control U.S. elections, one state at a time 27 April 2026
    • The Climate Brink 17 April 2026
    • Tamino, on Climate, Spring 2026 12 April 2026
    • from Canada PM Mark Carney 24 March 2026
    • Professor Katharine Hayhoe “Talking Climate” today 21 March 2026
    • thanks DT for making the case for solar and EVs and NOT oil 20 March 2026
    • 2026 March 14 [J 073.87] “Pi Day” 14 March 2026
    • Rare and hard to find 1937-1938 15 February 2026
    • EPA official actions on their “endangerment finding” 14 February 2026
    • RC: “a peek behind the curtain” 23 January 2026
    • Stark 18 January 2026
    • Could this be why DT wants Greenland? 16 January 2026
    • NAP update on Endangerment Finding 26 December 2025
    • Sporophyte capsules 16 October 2025
    • AI and GPT don’t manufacture results from nothing 18 September 2025
    • 16th September 2025, Westwood, MA 16 September 2025
    • Pohlia lescuriana 6 September 2025
    • Mckibben vs Nordhous 22 August 2025
    • NOAA climate assessment which has been taken off the federal site 13 August 2025
    • Fast-Track Review of Latest Evidence for Whether Greenhouse Gas Emissions Endanger Public Health and Welfare 7 August 2025
    • A New Phase in Trump’s War on Data 6 August 2025
    • Beaker Street 5 August 2025
    • Biofluorescent marsupial 5 August 2025
    • Steve Buchan, botanical photographer 28 July 2025
    • 2025 Jul 4-12 J(185-193) around yard 2 long lenses OM5 camera 12 July 2025
    • 25mm compact lens equivalent to 50mm 2 July 2025
    • Polytrichum macro photos, several of spore capsules 30 June 2025
    • “Macro Treasures” 12 June 2025
    • Flickr Account 24 May 2025
    • 2025 May 8 J 128 redbuds, etc, OM Systems 60mm lens 8 May 2025
    • 2025 April 19 J109 some close-ups of Polytrichum 19 April 2025
    • A New Lens 26 March 2025
    • 2025 March 23 J 82 23 March 2025
    • Climacium in Lawns 20 March 2025
    • 2025 March 16 J 75 Westwood, MA 16 March 2025
    • “Is the AMOC headed for a tipping point? Interview with Henk Dijkstra” 15 March 2025
    • 2025-03-10 J 69 10 March 2025
  • Follow Blog via Email

    Enter your email address to follow this blog and receive notifications of new posts by email.

    Join 130 other subscribers
  • Goodreads

  • Kalman filtering and smoothing; dynamic linear models



    Also, see datasets and R examples to accompany this excellent text.





    I have used dlm almost exclusively, except when extreme efficiency was required. Since Jouni Helske's KFAS was rewritten, though, I'm increasingly drawn to it, because the noise sources it supports are more diverse than dlm's. KFAS uses the notation and approaches of Durbin, Koopman, and Harvey.

    ``The real problem is that programmers have spent far too much time worrying about efficiency in the wrong places and at the wrong times; premature optimization is the root of all evil (or at least most of it) in programming.''
    Professor Donald Knuth, 1974
667 per centimeter Arctic Ice: The Saga Continues
Create a website or blog at WordPress.com

Loading Comments...