{"id":2137,"date":"2016-09-07T20:59:32","date_gmt":"2016-09-07T19:59:32","guid":{"rendered":"http:\/\/www.psyctc.org\/pelerinage2016\/?p=2137"},"modified":"2016-09-07T20:59:32","modified_gmt":"2016-09-07T19:59:32","slug":"moving-onward-uncertainty-and-using-data-coherently","status":"publish","type":"post","link":"https:\/\/www.psyctc.org\/pelerinage2016\/moving-onward-uncertainty-and-using-data-coherently\/","title":{"rendered":"Moving onward: Uncertainty and using data coherently"},"content":{"rendered":"<p>Wow, finishing cycling early has given a lot of time on the computer.\u00a0 Earlier, I linked <a href=\"http:\/\/www.psyctc.org\/pelerinage2016\/i-woke-at-about-02-15-last-night-and-couldnt-sleep\/\">a bad night to fears<\/a> that some of my academic\/research work on &#8220;outcome measurement&#8221; actually, it&#8217;s change measurement and the first bit of overegging in our field is that we all give in to social and political pressure and talk about &#8220;Outcomes&#8221; with a big &#8220;O&#8221; as if that&#8217;s what they are.\u00a0 Well, sometimes they really are: death is an outcome, it&#8217;s an outcome that awaits all of us, but if you&#8217;re in the mortality game (and we all are, not just the oncologists, surgeons, politicians and actuariess) the timing of that outcome does matter and oncology wouldn&#8217;t have made much of the progress it has without recording times of death, without good statistical methods for analysing it.\u00a0 It&#8217;s not as simple as it sounds because we can die for many reasons, though all of those are deaths, and because it may matter how old we are when we become at risk, and because not all people known to be at risk and treated one way or another are yet dead, for one reason or another, at the point you analyse your data, and because some are &#8220;lost to follow up&#8221;.<\/p>\n<p>Millions and millions of pounds has, mostly rightly I think, been spent collecting datasets about survival after diagnoses of cancer (and pre-cancerous states, and known risks of cancer) and a fair bit of money and real mathematical\/statistical genius, and huge amounts of computer storage and time, have all been thrown at this.\u00a0 I say &#8220;mostly rightly&#8221; as the only danger of all of this is that can, and in the past did, problematically, sidestep the question of the quality of life with the risk that treatments that lengthened survival a little, but devastated quality of life, were perhaps seen too positively.\u00a0 How to factor Quality of Life (QoL) in alongside mortality remains a huge issue.\u00a0 In some, small but at times useful ways, I think my work and the work of the huge numbers of people who have helped us on the CORE project (www.coresystemtrust.org.uk) touches on the QoL issue, particularly the work of Iphigenia\u00a0Mavranezouli on the CORE-6D scoring.<\/p>\n<p>However, what worries me is that the political pressures, and the human and societal pressures for much greater certainty, much avoidance of Fear, much intolerance of Doubt (you knew FUD wasn&#8217;t going away didn&#8217;t you?!), these all mean that data is now collected, and analysed, incoherently.<\/p>\n<p>Ah, damn, I don&#8217;t really have the &#8216;photo I want, of the crossing in the cathedral in\u00a0Le\u00f3n, I guess it was one where my effort was really too bad to keep.\u00a0 However, this is Le\u00f3n cathedral, with scaffolding.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-1813\" src=\"http:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160905_191420-169x300.jpg\" alt=\"20160905_191420\" width=\"169\" height=\"300\" srcset=\"https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160905_191420-169x300.jpg 169w, https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160905_191420-84x150.jpg 84w, https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160905_191420.jpg 337w\" sizes=\"auto, (max-width: 169px) 100vw, 169px\" \/><\/p>\n<p>You pay up your entry fee and get a huge colour A4 booklet about the cathedral, but if you&#8217;re cycling onwards, you ditch that (in Rabanal when I had time to scan read it enough) as, beautiful though it is, and in Spanish and English, it&#8217;s too heavy to come all the way home.\u00a0 However, I loved a quote from Mariano Diez S\u00e1enz de Miera &#8220;co-author of the Cathedral&#8217;s Master Plan&#8221; (capitals in the original):<\/p>\n<p>&#8220;The day that the Cathedral&#8217;s scaffolding disappear it will be a bad sign because Le\u00f3n&#8217;s Cathedral is like a\u00a0 sick person who is stable but needs constant care&#8221;.\u00a0 I thought that was genius.\u00a0 In the (?) 18th Century the lovely Gothic crossing was replaced with a Baroque octagon, by the 19th Century that, and other changes, and the fact that the stone is beautiful but prone to flaws, and the fact that it was all put on top of a Roman baths (with lots of hypocaust hollows still there by the sound of it) and a Romanesque church on top of that, all meant the cathedral was starting to collapse, pretty literally with stones falling.\u00a0 The whole had to be shored up and the Baroque crossing taken out and the simpler, structurally far more sound, crossing put back in.<\/p>\n<p>I think something similar is going to have to happen to health care.\u00a0 At the moment we have fantastic sums being spent on\u00a0 some things like new anti-cancer drugs, but we&#8217;re pricing ordinary people out of a &#8220;free to all at the point of delivery&#8221;\u00a0 health care system and many people are to my mind clearly very happy to do that, they&#8217;re sort of putting in Baroque altars that obscure simpler truths and simpler things that make people happy and healthy and always claiming the data shows that things are as good as the can be and better than the previous government etc. etc.<\/p>\n<p>It&#8217;s all pretty mad to my mind: a cult of sales and advertising rather than critical thinking and sharing the sadness of things.\u00a0 Don&#8217;t get me wrong: I still think the NHS, I still think much in the idea of health care and even hospital based systems for that, have much in them that is brilliant.\u00a0 Visiting my now deceased father-in-law in hospital some years back when the NHS was, as it did repeatedly, unequivocally extending his life and his quality of life, I said to my mother-in-law that I thought hospitals were grim, sad places, full of death and suffering, touched with a sort of odd quiet like temples that are really about those things (death and suffering).\u00a0 (Yes, I&#8217;m a real joy to have with you on hospital visits.\u00a0 Actually, I think she would say that on balance I&#8217;m useful and supportive but I look back and can&#8217;t see that as one of my better moments.)\u00a0 Anyway, she was astonished and said, briliantly, &#8220;I see them as exactly the opposite: temples of hope&#8221;. I think we&#8217;re both right.<\/p>\n<p>What&#8217;s this got to do with data and uncertainty and using data coherently?\u00a0\u00a0\u00a0 You don&#8217;t help overstretched services though with the kind of spin and &#8220;friends and family&#8221; tests and the constant farming out of some positive statistic or other to reassure everyone that the junior doctors are wrong, that the NHS is getting better when it&#8217;s one of the least well funded services in the Western world and when you&#8217;re actually attacking the glue systems that held it together to replace them with &#8220;market values&#8221;.<\/p>\n<p>I can&#8217;t prove anything of this at the moment, in fact I think such systems are so complex we shouldn&#8217;t be thinking of &#8220;proving&#8221; much within them but of how to nurse them thoughtfully.\u00a0 That needs data, open data, openess to think about it.<\/p>\n<p>Here&#8217;s another graphic:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-2138\" src=\"http:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160907-300x151.jpg\" alt=\"20160907\" width=\"300\" height=\"151\" srcset=\"https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160907-300x151.jpg 300w, https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160907-768x388.jpg 768w, https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160907-1024x517.jpg 1024w, https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160907-150x76.jpg 150w, https:\/\/www.psyctc.org\/pelerinage2016\/wp-content\/uploads\/2016\/09\/20160907.jpg 1280w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>Hm.\u00a0 I probably needed that a bit bigger but it&#8217;ll have to do for now.\u00a0 What the heck is that?\u00a0 &#8220;We want more beauty, more travel, not nasty data!&#8221; some might be saying and I sympathise and I would like to be putting up more &#8216;photos of Le\u00f3n including its glorious, stably ailing, cathedral; of Astorga and a superb church I nearly missed here in Villafranca del Bierzo but bear with me.<\/p>\n<p>That&#8217;s a graph of my altitude on the bike today with metres above sea level on the y axis (i.e., and highly appropriately, vertically) and time on the x axis.\u00a0 You see that hard slog up from Rabanal to Crux de Ferro and the later true summit and then that 15km descent.\u00a0 The grey line is warming up my then frozen hands in Ponferrada and the second grey line is visiting the tourist information office here in Villafranca (lovely helpful lady) and the tiny last bit of black is from her to the hotel.<\/p>\n<p>OK so far.\u00a0 But there&#8217;s something wrong isn&#8217;t there?\u00a0 The two grey bits should surely be pretty much level.\u00a0 OK, I didn&#8217;t restart the Garmin with the bike exactly where it was when I stopped it and I think both the drop in Ponferrada and the rise here are too big for the short distances moved between stopping and restarting the Garmin.\u00a0 So we learn that something is imperfect in the data.\u00a0 That&#8217;s fine, you can argue that no measurements are perfect, we just have to be thoughtful about the imperfection, perhaps we need to explore it.<\/p>\n<p>That&#8217;s trivial by comparison with NHS data and healthcare and psychology data generally, but oh, so much of it is not being criticised contstructively, not being made stronger and more helpful, it&#8217;s just being used to paper over problems.<\/p>\n<p>Now that takes me to a\u00a0 lot of other things but this is more than enough for now.<\/p>\n<p>By the way, the plot was generated with the completely free <a href=\"https:\/\/www.r-project.org\/\">R software system<\/a> using packages that people wrote to handle GPS data.\u00a0 Just trivial use of it so far, much more fun to be had from that in the future, including drilling into the elevation data and how it&#8217;s generated.\u00a0 (I now suspect it&#8217;s atmospheric pressure, not GPS, but that does sound weird.)\u00a0 But why oh why do Garmin avoid open data standards and open source computer systems as far as they can?\u00a0 Why do they make it impossible to upload your data unless you&#8217;re running Windoze or a Mac?\u00a0 (That&#8217;s a huge part of why I have a Windoze machine with me: without it, or a Mac, literally no data from the Garmin.)<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Wow, finishing cycling early has given a lot of time on the computer.\u00a0 Earlier, I linked a bad night to fears that some of my academic\/research work on &#8220;outcome measurement&#8221; actually, it&#8217;s change measurement and the first bit of overegging in our field is that we all give in to social and political pressure and &hellip; <a href=\"https:\/\/www.psyctc.org\/pelerinage2016\/moving-onward-uncertainty-and-using-data-coherently\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Moving onward: Uncertainty and using data coherently<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2137","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"_links":{"self":[{"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/posts\/2137","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/comments?post=2137"}],"version-history":[{"count":2,"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/posts\/2137\/revisions"}],"predecessor-version":[{"id":2140,"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/posts\/2137\/revisions\/2140"}],"wp:attachment":[{"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/media?parent=2137"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/categories?post=2137"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.psyctc.org\/pelerinage2016\/wp-json\/wp\/v2\/tags?post=2137"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}