Keeping a side project alive with t-shirts and cash


A selection of hats, t-shirts, mugs, and waterbottles with our logo.

My wife and I run a side project called OpenBenches.org - it is a fun little crowd-sourced memorial bench site. It's mostly fun, except when the bills come due! Most hobby sites and side projects don't cost a lot to run. Lots of services have generous free tiers to (ab)use, and they can pay well in "exposure". But OpenBenches is reaching a tipping point where it is slowly overwhelming us. We've now got nearly 300GB of photos - which means our storage and bandwidth costs are on the high side. …

Continue reading →

3 years of domestic solar stats in the UK


Solar panels on our roof.

After 3 full years of having solar panels on our London roof, they've generated 11,950kWh of electricity. Nice! Here's how those three years look, according to our smart meter. kWh Solar Generation 11,950 Solar Export 7,346 Grid Import 7,521 Quick maths! The difference between the generation and the export is our solar consumption: 4,604kWh over 3 years. So we directly use about 38% of the solar we generate. The remaining 62% gets sold back to the grid. I…

Continue reading →

Didn't your mother ever tell you to share your toys?


Sharing Is Caring.

Many years ago, I was involved in student politics. It was a great way to understand the fundamental disconnect between the ways different people see the world. I remember having a blazing row high-spirited discussion with someone about the way I thought about society. In a fit of rage an attempt to provide clarity, I tried using a metaphor: "Didn't your mother ever tell you to share your toys?" I asked. He looked at me, baffled. "No..." he said, cautiously. "We each had enough toys." That …

Continue reading →

The return of the "armchair auditor"


a cartoon robot saying equal pay now.

About a million years ago, the then Coalition Government in the UK announced a slew of Open Data projects. They wanted - in their words - to "mobilise an army of Armchair Auditors". That is, ordinary people would be able to look through the data and find interesting errors. I'm a civil servant (this is a personal blog) so I can't comment on the politics behind the idea. But I think it is fair to say that, over the years, it fell out of fashion. Open Data kept being published but very few…

Continue reading →

Force Directed Graph of the London Tube Map - including CrossRail!


A multi-coloured force-directed graph.

Force Directed Graphs of the London Underground have been done many times before - but I think I'm the first person to add the new Elizabeth Line (CrossRail). I've also created a JSON graph of all of London's rail services - including DLR, Trams, C2C, ThamesLink etc. Demo Play with it yourself Grab the code from GitLab I've also created a version with every London station and train line. Limitations This is a quick weekend hack - don't expect polished code or performance!…

Continue reading →

Open Data - but not *too* open


If this address is correct and relates to your enquiry, please confirm that you are entitled to view the gas supply details.

I'm an advocate for open data - both in my professional role and in a personal capacity. One of the hard things is succinctly explaining that "open data" means "non-personally identifiable data at a sufficient granularity to be useful without proving a risk to any individual's (or group's) reasonable expectations of privacy while still being useful to researchers and civic society." What a mouthful! So, the NHS releasing the number of times a doctors' surgery has prescribed…

Continue reading →

How popular are "And Daughters" businesses?


Shop sign - Marlow and Daughers. Via https://flic.kr/p/a6S2rR

It's quite popular to see high street shops names "Somesuch and Sons". Indeed, my grandparents ran "Eden & Sons" for many year. Much rarer is seeing "... & daughters". But, of course, the plural of anecdote is not data! The UK register of businesses - Companies House - has a pretty good search engine. Doing a search for AND SON returns 220,000 results. We use the singular because that should also match the plural. Instinctively, how many "AND DAUGHTER" businesses do you think they are? …

Continue reading →

1,800 days of minute-by-minute solar generation as Open Data


Solar panels on a roof.

Back in 2014, I released a year's worth of solar generation data. I was enormously proud to recently discover that the data were cited in a couple of academic papers: Colantuono, Giuseppe & Kor, Ah-Lian & Pattinson, Colin & Gorse, Christopher PV with multiple storage as function of geolocation (2018) page: 217-232. Elsevier BV. Solar Energy. https://doi.org/10.1016/j.solener.2018.03.020 Shukhobodskiy, Alexander Alexandrovich & Colantuono, Giuseppe RED WoLF: Combining a battery and thermal…

Continue reading →

Two years of home heating data


A complicated graph.

I have a Tado smart thermostat - part of my smarthome project. As well as letting me set the temperature from my phone, it records environmental data, and provides a handy API for me to retrieve it. This blog post will show you why I've gathered the data, let you download the full dataset, and explain what I learned from it. Why do this? There's a long-standing plan to use waste-heat from a nearby supermarket to provide communal heat to our neighbourhood. A low temperature heat main…

Continue reading →

Open Glasgow's Moral Maze


The Glasgow Open Government Licence. Highlighted is a passage saying the data cannot be used for illegal or immoral purposes.

Glasgow City Council has released a treasure-trove of open data. Nearly one-hundred datasets ranging from Live Traffic Information - to historic climate data. A fantastic boon for researches and open government enthusiasts. But there's a sting in the tail. The majority of the datasets are under the Open Government Licence (OGL). That's basically Creative Commons Attribution (CC-BY 4.0). Eight of the datasets are licenced under the slightly different Glasgow Open Government Licence (GOGL). …

Continue reading →

OpenBenches - some stats


UK map covered in thousands of markers.

For the last year-and-a-bit, Liz and I have been running OpenBenches.org. An open data website dedicated to memorial benches. Here are some rough and ready numbers about how it has gone so far. 9,870 Benches At the time of writing, we're a little shy of 10,000 benches. As you can see, we have photos from all around the world. 9,000 UK Benches The majority of our benches are in the UK. Memorial benches seems like a peculiarly Anglosphere habit. I've spoken to people from all sorts of…

Continue reading →

A love-letter to OpenDataCamp #odcamp


Terence and Liz at a laptop. Terence is wearing wrist braces.

Last week I took an all-too-short visit to Aberdeen for Open Data Camp 6. A two-day unconference looking at Open Data from an international perspective. What works, what doesn't, how we can do better, and what exciting things are coming up. I was mostly there for work - but managed to spend some time talking about our personal project OpenBenches. Here's a brief run down of what I loved, and what could have gone slightly better. Love Scotland! It is so nice to attend an event outside of…

Continue reading →