Tuesday, February 9, 2010

Open Mind: Combining Stations

February 8th, 2010
On a non-climate note, I congratulate the New Orleans Saints for their victory in Super Bowl XLIV. It was a well-deserved victory for the underdogs, and is a source of pride for a city which still shows massive scars from the ravages of Hurricane Katrina.

We’ve already looked at a way to combine data from different locations to obtain a grid-wide average of station anomalies. In that post, I computed anomalies for each location then combined the anomalies. It’s also possible to combine raw temperature data, then compute anomalies for the grid averages. I also combined station records in a simple way, by starting with a “reference station” then adding one new location at a time, computing an offset to align it with existing data and then incorporating it into the average. But I’ve noted that this is not the “optimal” way, that optimally (in a least-squares sense) one would compute the offsets which give the minimum sum of squared differences between all stations.
Read the rest of the post at the source…

Open Mind's Comment Policy
If you've attempted to post a comment at Open Mind under this story, and had it, in your opinion, unreasonably rejected or snipped, please repost it and any additional commentary below in the comments. Please take a look at Guidelines for Comments if you haven’t yet.

2 comments:

  1. This comment was posted on Tamino's ironically named blog on February 13, 2010:


    =======

    You don’t seem to get a lot of technical observations from your regular commenters in a thread such as this so I thought I might offer some comments about the method you are using to estimate the “offsets” for each station.

    I don’t know if you are aware of it, but the “optimal” method appears to be a disguised two factor weighted analysis of variance. One factor is the stations (whose coefficients are the “offsets”) and the second is time (in this case months) treated as a numeric variable. This is not immediately obvious from the form in which you formulated the sum of squares that you are minimizing, but some fairly simple algebra can re-express that SS in a way which is more obviously consistent with an anova. The weights for a given temperature measurement are proportional to the number of stations which have available data for that month. I would have run some comparisons for your example in R, but your aversion to posting data and code makes that more difficult. However, I wrote a simple R program for calculating the offsets as well as some scripts for the anova and ran them on randomly generated data with identical results for both methods.

    The side benefit of this is that the estimated monthly grid values are calculated simultaneously with the offsets rather than as (possibly sub-optimal averages) of the offset adjusted temperature series. Variability estimates can also be computed more easily as well.

    =======

    One might expect that a technical comment about a technical post might actually not be inconvenient, but then, you never know...

    I have some discussion on this at my blog here:

    http://statpad.wordpress.com/2010/02/13/rejected-again-open-mind-isn’t/

    ReplyDelete
  2. hermes are stylish in their own sense and are definite to draw shrieks from envious women who would give anything just to hold it. A hermes watch that has been gaining much attention is the Hermes Jewellery .
    daidaihua are better than others. With such a vast selection of lida slimming , supplements and slimming aids all promising to offer you that slimming capsule to your weight woes, it is very hard to distinguish which ones will help you and which ones will hinder you. slimming capsules overshadows its competition by being exactly what lida states. Most importantly of all, the ingredients in lida daidaihua are 100% pure and natural.
    Chanel handbag is the consummate alternative for a young, timeless and modern purse as Chanel is famous for offering the best prime product. These Bulks chanel watches have a trendier look but doubtless can be worn-out with any old-fashioned clothes that will emphatically give more advanced and pusher look.
    While buying Tiffany and co , how can we identify what Tiffany sets are genuine or fake? Here I will introduce five steps for you to refer. Become familiar with the characteristics of authenticity included in every silver sets releases new silver jewelry designs. These Tiffany charms may include modifications of past designs.

    ReplyDelete