667 per centimeter : climate science, quantitative biology, statistics, and energy policy
"Whether we and our politicians know it or not, Nature is party to all our deals and decisions, and she has more votes, a longer memory, and a sterner sense of justice than we do." — Wendell Berry
Skip to content
  • Home
  • About

Category Archives: NCD

A look at an electricity consumption series using SNCDs for clustering

Posted on 11 January 2019 by ecoquant

(Slightly amended with code and data link, 12th January 2019.) Prediction of electrical load demand or, in other words, electrical energy consumption is important for the proper operation of electrical grids, at all scales. RTOs and ISOs forecast demand based … Continue reading →

Posted in American Statistical Association, consumption, data streams, decentralized electric power generation, dendrogram, divergence measures, efficiency, electricity, electricity markets, energy efficiency, energy utilities, ensembles, evidence, forecasting, grid defection, hierarchical clustering, hydrology, ILSR, information theoretic statistics, local self reliance, Massachusetts, microgrids, NCD, normalized compression divergence, numerical software, open data, prediction, rate of return regulation, Sankey diagram, SNCD, statistical dependence, statistical series, statistics, sustainability, symmetric normalized compression divergence, time series | 2 Comments
  • Distributed Solar: The Democratizaton of Energy

  • Blogroll

    • Peter Congdon's Bayesian statistical modeling Peter Congdon’s collection of links pertaining to his several books on Bayesian modeling
    • John Kruschke's "Dong Bayesian data analysis" blog Expanding and enhancing John’s book of same title (now in second edition!)
    • Professor David Draper
    • Carl Safina's blog One of the wisest on Earth
    • Dollars per BBL: Energy in Transition
    • James' Empty Blog
    • American Statistical Association
    • Brian McGill's Dynamic Ecology blog Quantitative biology with pithy insights regarding applications of statistical methods
    • Dominic Cummings blog Chief advisor to the PM, United Kingdom
    • "Talking Politics" podcast David Runciman, Helen Thompson
    • AP Statistics: Sampling, by Michael Porinchak Twin City Schools
    • Slice Sampling
    • John Cook's reasons to use Bayesian inference
    • South Shore Recycling Cooperative Materials management, technical assistance and networking, town advocacy, public outreach
    • Survey Methodology, Prof Ron Fricker http://faculty.nps.edu/rdfricke/
    • Mark Berliner's video lecture "Bayesian mechanistic-statistical modeling with examples in geophysical settings"
    • Thaddeus Stevens quotes As I get older, I admire this guy more and more
    • ggplot2 and ggfortify Plotting State Space Time Series with ggplot2 and ggfortify
    • Hermann Scheer Hermann Scheer was a visionary, a major guy, who thought deep thoughts about energy, and its implications for humanity’s relationship with physical reality
    • Gavin Simpson
    • Brendon Brewer on Overfitting Important and insightful presentation by Brendon Brewer on overfitting
    • Darren Wilkinson's introduction to ABC Darren Wilkinson’s introduction to approximate Bayesian computation (“ABC”). See also his post about summary statistics for ABC https://darrenjw.wordpress.com/2013/09/01/summary-stats-for-abc/
    • Harvard's Project Implicit
    • Mrooijer's Numbers R 4Us
    • What If
    • Beautiful Weeds of New York City
    • All about Sankey diagrams
    • Why It’s So Freaking Hard To Make A Good COVID-19 Model Five Thirty Eight’s take on why pandemic modeling is so difficult
    • Patagonia founder Yvon Chouinard on how businesses can help our collective environmental mess Patagonia’s Yvon Chouinard set the standard for how a business can mitigate the ravages of capitalism on earth’s environment. At 81 years old, he’s just getting started.
    • Mike Bloomberg, 2020 He can get progress on climate done, has the means and experts to counter the Trump and Republican digital disinformation machine, and has the experience, knowledge, and depth of experience to achieve and unify.
    • Team Andrew Weinberg Walking September 8th for the Jimmy Fund!
    • Los Alamos Center for Bayesian Methods
    • Woods Hole Oceanographic Institution (WHOI)
    • Dr James Spall's SPSA
    • BioPython A collection of Python tools for quantitative Biology
    • SASB Sustainability Accounting Standards Board
    • Tim Harford's “More or Less'' Tim Harford explains – and sometimes debunks – the numbers and statistics used in political debate, the news and everyday life
    • Mertonian norms
    • Comprehensive Guide to Bayes Rule
    • Giant vertical monopolies for energy have stopped making sense
    • GeoEnergy Math Prof Paul Pukite’s Web site devoted to energy derived from geological and geophysical processes and categorized according to its originating source.
    • The Mermaid's Tale A conversation about biological complexity and evolution, and the societal aspects of science
    • Risk and Well-Being
    • Why "naive Bayes" is not Bayesian Explains why the so-called “naive Bayes” classifier is not Bayesian. The setup is okay, but estimating probabilities by doing relative frequencies instead of using Dirichlet conjugate priors or integration strays from The Path.
    • Earle Wilson
    • All about ENSO, and lunar tides (Paul Pukite) Historically, ENSO has been explained in terms of winds. But recently — and Dr Paul Pukite has insisted upon this for a long time — the oscillation of ENSO has been explained as a large-scale slosh due to lunar tidal forcing.
    • International Society for Bayesian Analysis (ISBA)
    • Musings on Quantitative Paleoecology Quantitative methods and palaeoenvironments.
    • "Impacts of Green New Deal energy plans on grid stability, costs, jobs, health, and climate in 143 countries" (Jacobson, Delucchi, Cameron, et al) Global warming, air pollution, and energy insecurity are three of the greatest problems facing humanity. To address these problems, we develop Green New Deal energy roadmaps for 143 countries.
    • Leadership lessons from Lao Tzu
  • climate change

    • "Mighty Microgrids" Webinar This is a Webinar on YouTube about Microgrids from the Institute for Local Self-Reliance (ILSR), featuring New York State and Minnesota
    • Dessler's 6 minute Greenhouse Effect video
    • Eli on the spectroscopic basis of atmospheric radiation physical chemistry
    • Équiterre Equiterre helps build a social movement by encouraging individuals, organizations and governments to make ecological and equitable choices, in a spirit of solidarity.
    • Klaus Lackner (ASU), Silicon Kingdom Holdings (SKH) Capturing CO2 from air at scale
    • The beach boondoggle Prof Rob Young on how owners of beach property are socializing their risks at costs to all of us, not the least being it seems coastal damage is less than it actually is
    • Andy Zucker's "Climate Change and Psychology"
    • Paul Beckwith Professor Beckwith is, in my book, one of the most insightful and analytical observers on climate I know. I highly recommend his blog, and his other informational products.
    • Energy payback period for solar panels Considering everything, how long do solar panels have to operate to offset the energy used to produce them?
    • "Lessons of the Little Ice Age" (Farber) From Dan Farber, at LEGAL PLANET
    • SolarLove
    • Ray Pierrehumbert's site related to "Principles of Planetary Climate" THE book on climate science
    • HotWhopper: It's excellent. Global warming and climate change. Eavesdropping on the deniosphere, its weird pseudo-science and crazy conspiracy whoppers.
    • James Hansen and granddaughter Sophie on moving forward with progress on climate
    • Documenting the Climate Deniarati at work
    • Ellenbogen: There is no Such Thing as Wind Turbine Syndrome
    • Climate Communication Hassol, Somerville, Melillo, and Hussin site communicating climate to the public
    • Wind sled Wind sled: A zero carbon way of exploring ice sheets
    • Updating the Climate Science: What path is the real world following? From Professors Makiko Sato & James Hansen of Columbia University
    • The Keeling Curve The first, and one of the best programs for creating a spatially significant long term time series of atmospheric concentrations of CO2. Started amongst great obstacles by one, smart determined guy, Charles David Keeling.
    • Rabett Run Incisive analysis of climate science versus deliberate distraction
    • Steve Easterbrook's excellent climate blog: See his "The Internet: Saving Civilization or Trashing the Planet?" for example Heavy on data and computation, Easterbrook is a CS prof at UToronto, but is clearly familiar with climate science. I like his “The Internet: Saving Civilization or Trashing the Planet” very much.
    • Mrooijer's Global Temperature Explorer
    • Tamino's Open Mind Open Mind: A statistical look at climate, its science, and at science denial
    • "Impacts of Green New Deal energy plans on grid stability, costs, jobs, health, and climate in 143 countries" (Jacobson, Delucchi, Cameron, et al) Global warming, air pollution, and energy insecurity are three of the greatest problems facing humanity. To address these problems, we develop Green New Deal energy roadmaps for 143 countries.
    • "Climate science is setttled enough"
    • Non-linear feedbacks in climate (discussion of Bloch-Johnson, Pierrehumbert, Abbot paper) Discussion of http://onlinelibrary.wiley.com/wol1/doi/10.1002/2015GL064240/abstract
    • ATTP summarizes all that stuff about Committed Warming from AND THEN THERE’S PHYSICS
    • All Models Are Wrong Dr Tamsin Edwards blog about uncertainty in science, and climate science
    • World Weather Attribution
    • David Appell's early climate science
    • Exxon-Mobil statement on UNFCCC COP21
    • Reanalyses.org
    • Climate Change Denying Organizations
    • Berkeley Earth Surface Temperature
    • The Sunlight Economy
    • "Warming Slowdown?" (part 2 of 2) The idea of a global warming slowdown or hiatus is critically examined, emphasizing the literature, the datasets, and means and methods for telling such. The second part.
    • Social Cost of Carbon
    • Agendaists Eli Rabett’s coining of a phrase
    • Risk and Well-Being
    • Simple box models and climate forcing IMO one of Tamino’s best posts illustrating climate forcing using simple box models
    • Mathematics and Climate Research Network The Mathematics and Climate Research Network (MCRN) engages mathematicians to collaborating on the cryosphere, conceptual model validation, data assimilation, the electric grid, food systems, nonsmooth systems, paleoclimate, resilience, tipping points.
    • MIT's Climate Primer
    • Solar Gardens Community Power
    • The Carbon Cycle The Carbon Cycle, monitored by The Carbon Project
    • Climate Change: A health emergency … New England Journal of Medicine Caren G. Solomon, M.D., M.P.H., and Regina C. LaRocque, M.D., M.P.H., January 17, 2019 N Engl J Med 2019; 380:209-211 DOI: 10.1056/NEJMp1817067
    • “Ways to [try to] slow the Solar Century''
    • And Then There's Physics
    • Model state level energy policy for New Englad Bob Massie’s proposed energy policy for Massachusetts, an admirable model for energy policy anywhere in New England
    • James Powell on sampling the climate consensus
  • Archives

  • Jan Galkowski

    • ecoquant
  • Blog Stats

    • 92,524 hits
  • Recent Posts

    • Adobe Lightroom for scientific photos 1 December 2021
    • Stranded Assets Nightmare 29 November 2021
    • Botkin’s Discordant Harmonies, a comment 28 November 2021
    • ‘Keystone Pipeline Developers Seek $15 Billion From U.S. for Cancellation’ 23 November 2021
    • My favorite presentation on climate disruption these days 23 November 2021
    • Photo of the week: Repeatedly distressed Mnium hornum 19 November 2021
    • Gee, if all maths classes were like this, they’d be exhausting … 18 November 2021
    • “Aggregating the harms of fossil fuels” 17 November 2021
    • Awesome. 17 November 2021
    • Price the Roads 16 November 2021
    • Fecklessness 15 November 2021
    • COP26, rest in agony 14 November 2021
    • David Wallace Wells …The Uninhabitable Earth and its implications 13 November 2021
    • Climate Music Break : Signs of Life 13 November 2021
    • Don’t like high or volatile petrol prices? Get an EV to replace your gas-guzzling thang 13 November 2021
    • Clearly not consumption based … but, well … 12 November 2021
    • We are living through the closing door of climate targets 12 November 2021
    • Sunday’s Storms Made Gas More Expensive, Thanks To Yet More East Bay Refinery Flare-Ups 11 November 2021
    • All about net ZERO 10 November 2021
    • Words from Mother Jones 9 November 2021
    • Well, brevity in argument is not something to be expected from training at new, Palantir-supported University of Austin 8 November 2021
    • ‘Will Ford do away with the dealer model?’ 8 November 2021
    • Hydrogen production from curtailed generation 8 November 2021
    • Losing sight of the big picture 8 November 2021
    • Stuart Stevens: Covid a Stress Test, and So Far We’re Failing 7 November 2021
    • The Truth about Sea Level Rise 2 November 2021
    • Climate Music Break: Pink Floyd, David Bowie, Comfortably Numb 2 November 2021
    • Welcome to your future 1 November 2021
    • “They are liars … You can have the best capitalism in the world, but if people are dead, they’re dead. It’s over.” 1 November 2021
    • “I have given up. I am here to talk about the science.” 1 November 2021
    • “How should children learn about climate change?” 30 October 2021
    • Future liability for fossil fuel energy producers and conveyors 29 October 2021
    • Comment on “Federal policy can drive the solar industry… but still may fall short” 28 October 2021
    • Yeah, like many aspects of the biosphere, forests and their contribution to sequestering Carbon is complicated 21 October 2021
    • Dr Gilbz 20 October 2021
    • In the field 19 October 2021
    • Climate Facts from James Hansen and Makiko Sato Ahead of COP26 14 October 2021
    • An Open Letter from U.S. Scientists Imploring President Biden to End the Fossil Fuel Era 9 October 2021
    • “It’s the exact opposite.” 7 October 2021
    • Rationale for XR, short term 5 October 2021
    • “I don’t want my grandchildren to suffer” XR 5 October 2021
    • Stopping climate disruption and eating cookies 5 October 2021
    • Myths 5 October 2021
    • Stephen Fry on XR 5 October 2021
    • A very recent Bill McKibben on Where We Are 1 October 2021
    • “A political dynamic …” 1 October 2021
    • Meet Solkjøring 28 September 2021
    • Greta, YouthCOP, 2021 28 September 2021
    • First Contact, and the Long Now Foundation 26 September 2021
    • Vineyard Sound, Rhode Island Sound, August, 2021 17 September 2021
  • Enter your email address to follow this blog and receive notifications of new posts by email.

    Join 132 other subscribers
  • Goodreads

  • Kalman filtering and smoothing; dynamic linear models



    Also, see datasets and R examples to accompany this excellent text.





    I have used dlm almost exclusively, except when extreme efficiency was required. Since Jouni Helske's KFAS was rewritten, though, I'm increasingly drawn to it, because the noise sources it supports are more diverse than dlm's. KFAS uses the notation and approaches of Durbin, Koopman, and Harvey.

    ``The real problem is that programmers have spent far too much time worrying about efficiency in the wrong places and at the wrong times; premature optimization is the root of all evil (or at least most of it) in programming.''
    Professor Donald Knuth, 1974
667 per centimeter : climate science, quantitative biology, statistics, and energy policy
Create a website or blog at WordPress.com
  • Follow Following
    • 667 per centimeter : climate science, quantitative biology, statistics, and energy policy
    • Join 132 other followers
    • Already have a WordPress.com account? Log in now.
    • 667 per centimeter : climate science, quantitative biology, statistics, and energy policy
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...