List of building energy databases

We have found and reviewed existing databases relating to building energy consumption and building stock in London.

There are many database catalogues already that allows searches for datasets. We focus on the following search tools listed below:

We compiled a list of relevant “primary” datasets, e.g. at its source without secondary analysis. The datasets we are mainly focused on for the purpose of our project are highlighted in yellow.

Any open datasets we clean are uploaded to our GitHub repository as the project progresses.

TitlePublished bydata YearsTypeSectorsmallest geographyColumns descriptionCommentsupdate frequencypublicly available?
Sub-national electricity consumption dataBEIS2010 to 2016Consumptiondomestic, non-domesticLSOAtotal domestic, non-domestic electricity consumption, number of meters, mean and median consumption for LSOAs in the UKNOT weather corrected, aggregated data for boroughs availableannuallyYes
Sub-national gas consumption dataBEIS2010 to 2016Consumptiondomestic, non-domesticLSOAtotal domestic, non-domestic gas consumption, number of meters, mean and median consumption for LSOAs in the UKWeather corrected, aggregated data for boroughs availableannuallyYes
Sub-national residual fuel consumption dataBEIS2005 to 2016Consumptionmixed/otherLocal authorityestimates of non-gas, non-electricity and non-road transport fuels (petroleum, coal, manufactured solid fuels, bioenergy & waste) for local authorities in the UKAggregated data for boroughs available discontinuedYes
Sub-national total final energy consumption dataBEIS2005 to 2016Consumptionmixed/otherLocal authoritytotal energy consumption of coal, manufactured fuels, petroleum products, gas, electricity, bioenergy & wastes and consuming sector for local authorities in the UKAggregated data for boroughs availableannuallyYes
Postcode level electricity estimates (experimental)BEIS2013, 2015ConsumptiondomesticPostcodetotal domestic electricity consumption, number of meters, mean and median consumption for postcodes in the UKNOT weather correctedannuallyYes
Postcode level gas estimates (experimental)BEIS2013, 2015ConsumptiondomesticPostcodetotal domestic gas consumption, number of meters, mean and median consumption for postcodes in the UKWeather correctedannuallyYes
Domestic EPCsMHCLG2005 to 2016Consumption, Building stockdomesticindividual buildingthe address, building reference number, energy rating, property type and form, inspection date, local authority, environmental impact rating, energy consumption, carbon emissions, costs for lighting, heating, hot water, total floor area, energy tariff, mains gas, floor level, glazing type and area, extension, number of rooms, energy efficiency for floor, hot water, windows, walls, main heating, secondary heating, lighting, main fuel type, storey height for the registered building. See details in https://epc.opendatacommunities.org/docs/guidance#glossary_domesticAggregated data available as Live table, or aggregated data available for London only ?Yes
Non-domestic EPCsMHCLG2005 to 2016Consumption, Building stocknon-domesticindividual buildingthe address, building reference number, asset rating, property type, inspection date, local authority, transaction type, new/existing build benchmark, building level, main heating fuel, total floor area, fuel usage for heating, electricity and renewables, standard and target emissions, building and typical emissions, air-conditioning rating, ventilation strategy for the registered building. See details in https://epc.opendatacommunities.org/docs/guidance#glossary_non_domesticAggregated data available as Live table?Yes
Display Energy CertificatesMHCLG2005 to 2016Consumption, Building stocknon-domesticindividual buildingthe address, building reference number, operational rating, carbon emissions from electricity, heating and renewables, property type, inspection date, local authority, main benchmark, main heating fuel, total floor area, fuel usage for heating, electricity and renewables, air-conditioning rating, ventilation strategy for the registered building. See details in https://epc.opendatacommunities.org/docs/guidance#glossary_displayAggregated data available as Live table, or aggregated data available for London only?Yes
SmartMeter Energy Consumption Data in London HouseholdsUK Power Networks2011 to 2014Consumptiondomesticindividual metertariff, datetime, electricity consumption per half hour, acorn group for approximately 1100 customers on dynamic time of use tariff and 4500 customers on standard tariff.Analysis carried out by the GLAone-offYes
Solid wall and off gas network properties, (LSOA)GLA2003Building stockdomesticLSOAfuel poverty indicator, number of solid wall properties and not on gas network, total households and residents in 2001 for LSOA areas across UK.useful for estimating solid walls %one-offYes
Dwellings by Property Build Period and Type, LSOA and MSOAVOA2014, 2015Building stockdomesticLSOAperiod property built, property type and bedroom counts for LSOA and MSOA areas in the UK.annuallyYes
Empty HomesThe empty homes agency2007 to 2012Building stockdomesticLocal authoritytotal dwellings, empty homes according to short/long term, local councils, housing associations, other public bodies, private owners for London boroughs.one-offYes
London Empty Homes AuditGLA2010Building stockdoemsticindividual buildingnumber of bedrooms, listed building, conservation area, empty period and priority rating for individual properties that were vacant for 12 months or more on 31/10/2010 in London.This data relates to private sector empty homes in London that have been vacant for 12 months or more at 31 October 2010. This data was collected by the GLA from all London Boroughs.one-offYes
Commercial and Industrial Property Vacancy Statistics, BoroughDCLG1998 to 1005Building stocknon-domesticLocal authoritytotal number of vacant properties recorded each year in each borough in London.based on NNDR3discontinuedYes
Live tables on dwelling stock (including vacants)MHCLG2009 to 2017Building stockdomesticLocal authoritynumber of dwellings by tenure, total dwelling by year, net additional dwellings, vacant dwellings for each borough in the UK.Secondary tables: Vacant Dwellings (GLA), Total Number of Dwellings and Net Additional Dwellings, Borough (GLA), Number and Density of Dwellings by Borough (GLA)annuallyYes
Postcodes not on the gas networkXoserve2017Building stockdomestic, non-domesticpostcodelist of postcodes not on the gas grid in the UKOriginal dataset from Xoserve, GLA produced an additional dataset in 2013one-offYes
National Energy Efficiency Data-Framework (NEED): anonymised data 2014DECC2005 to 2012Consumption, Building stockdomesticindividual buildingmultiple deprivation index, annual gas consumption, annual electricity consumption, property age band, property type, floor area band, main heating fuel type, economy 7 meters, energy efficiency band, loft insulation depth, loft insulation year of installation, cavity wall, cavity wall insulation year of installation, boiler year of installationone-offYes
English housing surveyMHCLG2009 to 2016Building stockdomesticaggregated categorydata on Amenities, services and local environments; Attitudes and satisfaction; Dwelling condition and safety; Energy inefficient dwellings; Energy performance; New households and recent movers; Owner occupiers, recent first time buyers and second homes; Social and private renters; Stock profile
Tenure trends and cross tenure analysis
annuallyYes
Live tables on housing supply: net additional dwellingsMHCLG2001 to 2018Building stockdomesticLocal authoritynet additions to dwelling stock for each year in boroughsSecondary table: Total Number of Dwellings and Net Additional Dwellings, Borough (GLA)annuallyYes
Estimates of the population for the UK, England and Wales, Scotland and Northern IrelandONS1991 to 2017Occupancy-Local authorityestimated population, migration flows, births, deaths in each local authority in the UKSecondary table: Persons per dwelling (GLA)annuallyYes
Age of Commercial and Industrial Stock, BoroughDCLG2004Building stocknon-domesticLocal authoritynumber of factory, office, retail, warehouse according to age bands in each borough in Londonone-offYes
Live tables on commercial and industrial floorspace and rateable value statisticsMHCLG1998 to 2008Building stocknon-domesticRegionaltotal number of factory, office, retail, warehouse in each government region in the UK.one-offYes
Dwelling Stock by Tenure and Condition, BoroughONS2001 to 2011Building stockdomesticLocal authoritydwelling stock according to owner occupied/private rented, local authority, registered social landlord, other public sector, average SAP rating and below decent home standard in London boroughs and UK government regions.one-offYes
Fuel Poverty statisticsBEIS2010 to 2016Building stockdomesticaggregated categoryfuel poverty by energy efficiency and dwelling characteristics, household characteristics, household income, fuel payment type, eligibilityannuallyYes
Overvrowded Households by BoroughONS2010Building stockdomesticLocal authoritypercentage of households which are overcrowded (severly or basic), 95% confidence level and sample size in each London borough.one-offYes
Council Tax statisticsVOA2015 to 2018Building stockdomesticLSOAnumber of properties according to council tax bands (A to I), property type, period build for LSOA areas in the UK.annuallyYes
Non-domestic rating: business floorspaceVOA2001-2016Building stocknon-domesticLocal authoritytotal number of rateable properties, rateable value, total floorspace by retail, office, industrial, other and excluded sectors in local authorities in the UKannuallyYes
2011 Census HousingCensus Information scheme2001, 2011Building stockdomesticaggregated categorystatistics on overcrowding, tenure, housing characteristics, socio-economic classification, economic activities in the UKone-offYes
Census 2001 Key Statistics 19: Rooms and AmenitiesONS2001Building stockdomesticLocal authoritynumber of rooms per household, occupency rating, with/without central heating, lowest floor levels in London boroughs.one-offYes
CIBSE benchmarking tool (beta version) CIBSE & UCL-Consumption, Building stockdomestic, non-domesticindividual building--No
London Building Stock Model GLA & UCL-Consumption, Building stockdomestic, non-domesticindividual building--No
Low Energy Building database LEB-Consumption, Building stockdomestic, non-domesticindividual building--No
K2n iSERV K2N-Consumption, Building stockdomestic, non-domesticindividual building--No
Carbon Buzz RIBA & CIBSE-Consumption, Building stockdomestic, non-domesticindividual building--No
Real Estate Enbironmental Benchmark BBP-Consumption, Building stocknon-domesticindividual building--No
Global Real Estate Sustainability Benchmark GRESB-Consumption, Building stockdomestic, non-domesticindividual building--No
BREEAM In Use BRE-Consumption, Building stocknon-domesticindividual building--No
Non-gas map BEIS-Building stock-postcode--May be avaiable upon request
RE:FIT database GLA-Consumption, Building stockdomestic, non-domesticindividual building--No
National Energy Efficiency Data-Framework (NEED)BEIS2012 to 2018Consumption, Building stockdomesticindividual building-annuallyNo