Bryan's Blog
(Only the last ten entries are here, earlier entries can be found by using the Summary, Archive or Categories pages, or by using the calendar to go to previous months and/or years).
Quotation of the day
Today we find remarkable agreement on expectations for vastly improved ocean data management a decade from now -- capabilities that will help to bring significant benefits to ocean research and to society. Advancing data management to such a degree, however, will require cultural and policy changes that are slow to effect. The technological foundations upon which data management systems are built are certain to continue advancing rapidly in parallel. These considerations argue for adopting attitudes of pragmatism and realism when planning data management strategies.
Take out the word "ocean" and the rest is true for us all: cultural and policy changes, pragmatism etc ... the technology is the easy part.
by Bryan Lawrence : 2010/03/16 : Categories metadata : 0 trackbacks : 0 comments (permalink)
The rise and rise of browse metadata
If you look carefully at ESA's gmes portal, you see a wee "browse datasets widget". Looks like this:
 |
It appears to be a faceted browse: for example, if you choose a specific mission, the list of instruments that you could choose in the drop down immediately changes. I have no idea what technology is sitting under the hood(clearly it's ajax for the user interface, I'm on about the querying), and I don't much care. If it's RDF based, well and good, but lots of other tried and trusted technology work in this space (no pun intended), and they all do a job.
The key point is that it is interesting to browse on these attributes of data: and they correspond rather nicely to the big picture items in MOLES: where project, instrument, platform etc have a big role to play alongside dataset. GMES has the exta concept service, which is really just about the domain of interest (and MOLES has that too).
In our own small way, we have implemented this in MOLES version 2 (forgive the user interface, it's had no loving, it's the back end that counts). One can navigate seemlessly between activity, observation stations, data production tools and data in our system.
The challenge is to get beyond doing it within our various walled gardens (ESA's, ours, whoevers), so we can browse from one site to another using some well known "facets" (or in my language, first order moles entities).
by Bryan Lawrence : 2010/03/15 : 0 trackbacks : 0 comments (permalink)
hollow world and svngate revisited
For a number of projects I'm having to revisit some domain modelling, exploiting both HollowWorld and the upcoming ISO19156 Observations and Measurements standard.
Of course I'm still on a linux platform, so to do that end, I've updated my cross over office installation to 9.0, and my Enterprise Architect to 7.5.
This note is by way of updating my older posts on using subversion in EA. Now, as then, one needs to follow the svngate instructions. I was surprised I still had to replace my 9.0 cmd.exe.so with a new one (ok actually an old one modified at cross over office version 6.2), but happy still to exploit svngate. There appears to be no need now for any shenanigans with flipping argument order, svngate just works.
So, you can follow the instructions for hollow word installation exactly, once you've got svngate installed ...
by Bryan Lawrence : 2010/03/15 : Categories metadata computing : 0 trackbacks : 0 comments (permalink)
The end of the drought might be nigh
And so the longest drought on my blog since I started blogging ends. Not because the workload is any less, but because the things I'm doing having subtly changed into things for which blogging about is both easier to do and positively contributes towards the success thereof.
For the record, most of the last three months have been work associated with the metafor project and gearing ourselves up to CMIP5, and I hope I'll get to blogging details about those at some later date (but don't hold your breath).
by Bryan Lawrence : 2010/03/15 : 0 trackbacks : 0 comments (permalink)
Oh no I can't keep up ..
As you have all noticed, I'm a tad busy at the moment, and blogging has been the obvious thing missing out. The other thing missing out is new technology:
Google Wave I hear you say? No ...
Google Fusion Tables API... oh no not another thing I can't pay attention to.
However, in finding out that I have to ignore another thing, I did follow the link to the NYT in Joe's post, to find a quote from Tony Hey that is SO RIGHT ON:
Tony Hey, a veteran British computer scientist now at Microsoft, said ... "In the U.K I saw many generations of graduates students really sacrificed to doing the low-level IT."
Except it wasn't, and isn't, just the UK!
So timely. I gave a talk today about the pressure of big data, from models and earth observation ... and having to take it all seriously from a national infrastructure point of view ... I'll eventually stick the talk up on my publications page (it's too big to upload from home), but the slides alone won't tell the story ...
Actually there is a lot of other timely stuff going on. I'd like to be talking about the live blogging from AGU ... but I have time to skim the content, but not take it and comment here ...
by Bryan Lawrence : 2009/12/16 : 0 trackbacks : 1 comment (permalink)
Clouds Revisited
I've just been reading "How well do we understand and evaluate climate change feedback processes", by Bony et.al. (2006) which appears in the Journal of Climate.) While I've delved into GCM cloud physics in the past, I've never really taken the trouble (beyond this) to get into cloud feedbacks in the climate sense, I've been happy to accept the received wisdom that cloud feedbacks are the dominant uncertainty in climate sensitivity, but that most folks (Lindzen apart) believe that despite their uncertainty, the sign at least is very probably positive, that is to enhance the affect of increasing CO2 on surface temperature.
This post is by way of notes from half a day following my nose down the rabbit hole, because for various reasons, I need to educate myself on the issue.
Storm intensity and Frequency
(Nothing to do with why I wanted to read the paper, but something I've been interested in for a while.)
Bony et al have an interesting figure which is actually a figure from an earlier paper by Carnell and Senior (1998), which got a mention in the TAR.
 |
As far as I can tell, this paper is close to the basis (see something like 90 citations) of the oft repeated statement that we expect storms to be less frequent but more intense in a future climate.
There have obviously been many follow up papers with other models, including for example, Leckebush and Ulbrich 2004) who in an analysis of GCMS and RCMs found (according to their abstract):
Although the overall number of modelled tracks is underestimated in the control period of the global model's simulation with present-day greenhouse gas forcing, compared to reanalysis data, realistic patterns of the track density over the investigation area are simulated.
Changes occur in particular with respect to the A2 scenario for extreme cyclone systems, while for B2 the changes are less pronounced. Especially over western parts of Central Europe, the track density of extreme cyclones increases for A2, accompanied by a tendency towards more intense systems. With respect to the A2 scenario, a tendency towards more extreme wind events caused by deepening cyclones is identified for several regions of Western Europe such as Spain, France, United Kingdom or Germany.
Additionally, the climate change signal in the regional climate model (RCM) HadRM3H is analysed. In accordance with the signal of the wind speed changes in the GCM simulation, the RCM reveals an increase of the 95th percentile of the daily maximum wind speed over extended parts of Western Europe related to the areas of increased track density of extreme cyclones under the A2 scenario. Changes with respect to the SRES B2 scenario are similar in their structure, but less pronounced in their amplitude.
A bit of googling resulted in an interesting powerpoint by Ruth McDonald which reviews a lot of similar studies ... and then I managed to get hold of Lambert and Fyfe, 2006, which has an analysis making the same point using a CMIP3 multi-model ensemble:
 |
Key changes in clouds in a future climate
(This is what I was after):
Several analyses show no consensus in the global response to clouds and cloud radiative forcing to a given climatic perturbation.
Two analyses showed that the global cloud feedback is positive in all models, but there are large intermodel differences in the magnitude of the feedback.
The frequencies of occurrence of different cloud types (both observed and moeled) are highly unequal and so the behaviour of certain clouds may matter more than that of others in explaining the range of feedbacks.
Several studies show that the responses of deep convective clouds and of low level clouds differ among GCMs.
Changes in the water content of different types of clouds also differ among GCMs ...
Differences in cloud feedbacks in areas dominated by low-top cloud responses make the largest contribution to the variance in the global feedbacks, with
in the tropics, the response differs most between models in subsidence regions (which is consistent with low cloud anyway)
the large fraction of the earth covered with this type of cloud being an important contributor ...
At the same time however, we have reference to Zhang et al, 2005 which took me off on another riff, but that's a topic for another day.
Cloud Physics Parameterisations
(this is what I remain most interested in, science-wise, should I ever get any time to do any science myself ever again ....)
One of the things I'm looking forward to getting out out of metafor is a decent summary of what the current state of play in cloud parameterisations is in GCMs ... I've been out of it for just long enough that it's hard to get back in ... a souped up version of the following table (for just three models, from Wyant. et.al.2006) for all the CMIP5 models should be just the ticket:
 |
Papers I now want to read
For these I could only read the abstracts, due to the paucity of support for climate science in my institutional library (which is great for high energy physics, apparently, but crap for climate) ... I'm glad that I could get to most of the others via self-archived pdfs (yes, I could get to some via our library subscription!)
Uncertainty in Projections of UK Climate Change Resulting from Regional Model Formulation, Rowell, 2006
Changes in mid-latitude variability due to increasing greenhouse gases and sulphate aerosols, Carnell and Senior, 1998
(Note that the figures and table have been downgraded in quality by removal of information, consistent with my fair use policy.)
by Bryan Lawrence : 2009/12/14 (permalink)
The Back of the Envelope and the Removal of Guilt
Some of the most important things one learns in a physics degree are:
Dimensional Analysis (have I stuffed up anything obvious?)
Scale Analysis (what terms in this equation actually matter for this problem?), and
Start with an Envelope (know what your answer is roughly, before further calculation).
The last is pretty fundamental. I used to teach a course called "Nursing Mathematics" at my local polytechnic, for, you'll not be surprised to know, nurses. The entire point of the course was to give nurses the mental arithmetic tools (supplemented on occasion by an envelope and a pen) to know what the answers to most of their day-to-day calculations are, before using a calculator to get things right. You may or may not be surprised to know how important this is, folk have died because of incorrect factors of ten in IV flow rates ... Scale problems happen often with calculators, but less often when individuals have a grip on the scale of answers before attempting the "real" calculation (either from experience, or explicit "pre-calculation").
Which is a long winded way of introducing a post which both validates my original decision to buy an electric lawn mower instead of a petrol mower, and removes my guilt over not buying a push-mower.
I spend a lot of time thinking about this sort of issue, but never get down to writing it out. Well done "King of the Road". My current suspicion is that it would be a good thing to get an electric garden shredder, rather than pile the stuff on a regular basis in a car and drive to the dump ... one day, I will do that calculation ...
Meanwhile, along David MacKay's fabulous book, I feel I now have two "back to basics" places to go to find some numbers about practical ways of dealing with our energy futures.
by Bryan Lawrence : 2009/12/13 : Categories environment : 0 trackbacks : 2 comments (permalink)
Drawn into climategate
It's a long time since I bothered to write a letter to the editor, but the cru email controversy pushed me over the edge. Or to be more precise, Anne McElvoy's opinion piece did. Of course I would never have known anything about it, not normally having access to London Evening Standard , but their letters editor actually approached me to solict an intervention in the next edition (by which I assume that a) he was desperate, and/or b) he figured I might say something silly, or both).
In the event, I must say I was pretty inpressed with the way he elicted the following from me:
Anne McElvoy's opinion piece (25 November) strikes an unrealistic view of what has occurred in the University of East Anglia hacked emails controversy. Extended scientific conversations occur in parallel through various channels, and it's completely unreasonable to expect these conversations to be comprehensible based on a small subset without all the previous baggage. The point of scientific record and peer review is for scientists to stand up their claims and have them evaluated. Of course scientists have a prior view of what data could be telling them but the difference between scientists and most "sceptics" is scientists change their hypotheses when necessary. Most practising scientists will go out of their way to have an honest discussion about issues in their work. Among the sceptics are those who frame their questions in terms which can be addressed; but there aren't enough climate scientists or hours in the day to educate those who believe in the climate physics equivalent of a flat Earth.
with Most practising scientists will go out of their way to have an honest discussion about issues in their work being bit that they chose to highlight.
Of course I never had time to write anything that brief, the following is what I actually wrote (in a tiny amount of time, obviously while doing other things):
The Original
(decorated with a link to my favourite parody)Anne's opinion piece strikes a harsh and unrealistic view of what has occurred in this recent controversy.
My personal opinion is that extended scientific conversations occur in parallel using multiple mechanisms (phone, email, actual meetings etc), and we are only seeing a part of conversations where the correspondents have sensibly used shorthand like "trick" ... and it's completely unreasonable to expect these sort of conversations to be comprehensible in their entirety based on just the email subset without all the other baggage from prior and parallel conversations that's not explicitly included. Indeed, we can construct versions of reality from these subsets of actuality which are completely bogus, and that's what we are seeing happen ... (and the fatuousness of doing so is what some of the parodys that Anne is so dismissive of are trying to demonstrate, for example this).
Further, the entire point of the scientific record and peer review is for folk to be able to stand up their claims and have them evaluated (and to put effort into defending if that's appropriate). The process of doing science, however, involves the construction of hypotheses and their evaluation without documenting every blind alley to a publishable level for the benefit of other folk who steal notes or emails. Of course scientists have a prior view of what the data is or could be telling them, but the difference between scientists and sceptics is that scientists evaluate the evidence and change their hypotheses when necessary. There seems to be no evidence that the sceptics are doing this ... and there is no evidence that I'm aware of in these emails that Phil Jones or any of the other key participants are not.
Finally, most practising scientists will go out of their way to have an honest discussion about the facts and issues of their work, and it's my opinion that that is particularly true of those working in climate sciences. However, what we can't do is make the time for every argument from a community which does indeed seem to "deny" basic physics. Of course, amongst the sceptics are those who can and do frame their questions in terms which can and are addressed, but there aren't enough climate scientists or hours in the day, to educate those who believe in the climate physics equivalent of "a flat earth".
A few days later
I had clearly realised by writing something so long, I had made a hostage to editorial fortune, so I have to say, all kudos to their editorial team; their abstraction is a fair reflection of what I was trying to say (and by virtue of its brevity, probably a lot more effective).
However, despite thinking brevity is a good thing, I can't quite leave it alone because I think some things still need to be said. But, I can't do justice to what I want to say either, because I don't have time ...
In the best of possible worlds I'd like to spend time stressing and explaining how unreasonable this deconstruction of the CRU email is, but Gavin has already done that (context and original), and Anne didn't buy that.
I'd like to spend some time explaining just how time consuming debating the issue is when one has to spend most of the time dealing with basic scientific issues rather than the issue of global warming. Frankly, I don't think that's a good use of tax payers money, I'm paid to do climate science, not teach high school and/or undergraduate physics. Which is not to say I don't think more communication should happen, just that I'm not the best person to do it, and neither are most of my colleagues. But she'd probably think I was in my ivory tower, rather than just trying to be practical ...
I'd like to spend some time explaining what we know, and what we think, what we mean by probability and uncertainty, and give her that rigour, but like all communication, it takes two to party, and given that she appears not to have actually herself talked to a climate scientist about the import of these emails, I'm not sure she'd listen.
I'd like to explain why "deniers" is exactly the right word for some of the "sceptic" community, and why it's not sloppy to use slang and abbreviations when the other party to your communication knows what you mean, and you have no expectation that anyone else is ever going to see what you have written. If I really thought posterity was going to judge everything I wrote, I would be much less efficient ... is that lack of efficiency worth the price? Is it really? Of course, when I do try to communicate to a wider audience, then of course it's reasonable to expect a professional effort ...
And there is much much more.
However, it's not the best of possible worlds, because I haven't the time to take on all thse conversations and simultaneously do what I'm paid to do ... this week alone, I have no time that is not already committed to meetings and actions, and it's a rather typical week.
Quality communication and education takes time, lots of it, and that's why I wish for more quality journalism ... and, if society wants it, more professional scientifically educated communicators to work in the interface between the scientific coal face and the public and their policy engine of state.
by Bryan Lawrence : 2009/11/29 : 0 trackbacks : 3 comments (permalink)
erase to transparency
The easy way (with The GIMP): somehow select an area (choose by fuzzy selector contiguous colour is one good option), then, if your image hasn't got an alpha channel, add one (right click, choose transparency, add an alpha channel) ... then color to alpha (right click, choose transparency, color to alpha).
by Bryan Lawrence : 2009/11/09 : Categories gimp : 1 comment (permalink)
Still here
I'm still here ... but my day job is all consuming at the moment. Blame CMIP5.
by Bryan Lawrence : 2009/11/09 (permalink)