Opening up the Ministry for the Environment data and webscrape the 2015 free allocation of emission units

Let's look at the latest data on the very generous free give-aways of emissions units to emitters made by the New Zealand Ministry for the Environment
N.B. Update on 10 December 2016. The allocation decisions have moved to the web page of the Environmental Protection Authority.

The Environmental Protection Authority now hosts the 2015 Industrial Allocation Decisions that show the final free allocation of emission units to emitters for 2015 under the New Zealand Emissions Trading Scheme.

The New Zealand Ministry for the Environment no longer hosts the unit allocation data and the old link returns an Acess Denied page.

I looked at the 2010 to 2014 data in my post Opening up the data on emissions units in the NZ emissions trading scheme. So in this post I am will repeat my steps in web-scraping the freebie emissions unit data into a sensible open-data format (but with the links updated to the EPA).

The url of the old Ministry for the Environment web page is http://www.mfe.govt.nz/climate-change/reducing-greenhouse-gas-emissions/new-zealand-emissions-trading-scheme/participatin-4

The url of the EPA web page is http://www.epa.govt.nz/e-m-t/taking-part/Industrial-allocations/allocations-decisions/Pages/decisions-2010.aspx. And unfortunately, the Google sheet 'scrape the table' script does not seem to work with the EPA page.

Go to Google and open a new Google sheet.

Following the tip from the School of Data Liberating HTML Data Tables, enter this text in cell A1 of the Google sheet.

=importHTML("","table",1)

Add the url of the Ministry for the Environment's free allocation web-page between the double speech marks so you have this exact text in cell A1.

=importHTML("http://www.mfe.govt.nz/climate-change/reducing-greenhouse-gas-emissions/new-zealand-emissions-trading-scheme/participatin-4","table",1)

It was good thing that I kept a screen shot to show that it worked perfectly! We now have a Google sheet of the 2015 free unit allocation to NZ emissions trading scheme emitters.

I have saved it as NZETS-2015-final-allocations-for-eligible-activities.

However, the data does not have a "tidy" structure, where each variable is a column and each observation is a row (Wickham, Hadley . "Tidy Data" Journal of Statistical Software [Online], Volume 59, Issue 10 (12 September 2014)).

The first column includes both industry names and types of industries classified by the type of emissions the industry produces. And lots of asterisks. A tidy format would have these attributes (or variables) as separate columns so that each company/emitter would have a row each.

I used a programme called Open Refine (which is also at Github) to data-wrangle the data into tidy format and to save it as a comma-separated values file which is this Google sheet NZETS-2015-final-allocations-for-eligible-activities. Its a bit fiddly using Open Refine, and I have not documented the steps. I won't describe how I did it. Yes, I know, from the point of view of reproducing the tidied data I should have done the tidying with a script or code. Next time I will.

As usual, the big emitters get the most emission units! Of 4.417 million units allocated to industries, 90% went to 11 large companies. New Zealand Steel Development Limited, of arbitrage profits fame, gets 1,067,501 free units. New Zealand Aluminium Smelters Limited gets 772,706 free units.

This is the updated free emission unit allocation data from 2010 to 2015.

I did a bit of data visualising with the 2015 data and created this pie-chart in R programming language.

The R script for that is:

	# read in data downloaded from Google Sheets as a dataframe
	nzu2015 <- read.csv("nzu-allocation-2015.csv",skip=0,header=TRUE, sep = ",",dec=".",na.strings ='na')
	# examine the dataframe
	str(nzu2015)
	'data.frame': 108 obs. of 4 variables:
	$ Year : int 2015 2015 2015 2015 2015 2015 2015 2015 2015 2015 ...
	$ Applicants.Name : Factor w/ 97 levels "ACI Operations NZ Limited",..: 53 31 94 9 59 96 58 23 36 15 ...
	$ Activity : Factor w/ 26 levels "Aluminium Smelting",..: 1 2 2 3 4 5 6 7 7 8 ...
	$ Final.Unit.Entitlement: int 772706 152951 3089 173906 13271 79585 9927 325532 184794 1563 ...
	# How many emission units were given to emitter industries in 2015?
	sum(nzu2015[["Final.Unit.Entitlement"]] )
	[1] 4329248
	# How many units given to the top 12 emitters?
	sum(nzu2015[["Final.Unit.Entitlement"]][1:12])
	[1] 3960716
	# call that number 'therest'
	therest<-sum(nzu2015[["Final.Unit.Entitlement"]][1:12])
	therest
	[1] 3960716
	total <-sum(nzu2015[["Final.Unit.Entitlement"]])
	# look at the top 12 allocations
	nzu2015[["Final.Unit.Entitlement"]][1:12]
	[1] 1067501 772706 655851 325532 184794 173906 152951 148311 143262
	[10] 122825 121292 91785
	# who received the biggest 12 free allocations?
	nzu2015[["Applicants.Name"]][1:12]
	[1] New Zealand Steel Development Limited
	[2] New Zealand Aluminium Smelters Limited
	[3] Methanex New Zealand Limited
	[4] Fletcher Concrete and Infrastructure Limited
	[5] Holcim (New Zealand) Limited
	[6] Ballance Agri-Nutrients (Kapuni) Limited
	[7] Graymont (NZ) Limited (formerly McDonalds Lime Limited)
	[8] Oji Fibre Solutions (NZ) Limited (formerly Carter Holt Harvey Pulp & Paper Limited)
	[9] Oji Fibre Solutions (NZ) Limited (formerly Carter Holt Harvey Pulp & Paper Limited)
	[10] Norske Skog Tasman Limited
	[11] Pan Pac Forest Products Limited
	[12] Winstone Pulp International Limited
	97 Levels: ACI Operations NZ Limited ... Winstone Pulp International Limited
	# we have 2 allocations to Oji Fibre formerly known as Carter Holt Harvey Pulp and Paper Ltd
	[8] [9]
	148311 + 143262
	[1] 291573
	# How many units were given to all the other emitters?
	total - therest
	[1] 368532
	# set up the vector of the top 12 and the names
	units<-c(1067501, 772706, 655851, 325532, 291573, 184794, 173906, 152951, 122825, 121292, 91785,368532)
	names<-c("New Zealand Steel Development Ltd","NZ Aluminium Smelters Ltd","Methanex New Zealand Ltd", "Fletcher Concrete Ltd","Oji Fibre Solutions (ex CHH)","Holcim (NZ) Ltd","Ballance Agri-Nutrients","Graymont (ex McDonalds Lime)", "Norske Skog Tasman Ltd","Pan Pac Forest Products Ltd", "Winstone Pulp International Ltd","All others")
	png("nzu-allocations-pie-2015-680.png", width=680, height=510, pointsize = 14)
	pie(units,labels=c(names),radius = 0.95,clockwise = FALSE,init.angle=90, col = rainbow(13),cex.lab=1.1,cex.main=1.5,main="NZETS free allocation of emission units to industry 2015")
	mtext(side=1,cex=0.9,line=1.5, "Source: http://www.mfe.govt.nz/climate-change/reducing-greenhouse-gas-emissions/\nnew-zealand-emissions-trading-scheme/participatin-4")
	mtext(side=3,cex=0.9,line=-0.1,"Of 4.417 million units allocated to industry 90% went to 11 companies")
	dev.off()

view raw NZETS free allocation of emission units.r hosted with ❤ by GitHub

Did I not get the End the Rainbow memo? So I picked a better colour scale from Colour Brewer.

The R script for this non-rainbow pie chart is:

	mypalette<-brewer.pal(12, "Paired")
	png("nzu-allocations-pie2-2015-680.png", width=680, height=510, pointsize = 14)
	pie(units,labels=c(names),radius = 0.95,clockwise = FALSE,init.angle=90,col = mypalette, cex.lab=1.1,cex.main=1.5,main="NZETS free allocation of emission units to industry 2015")
	mtext(side=1,cex=0.9,line=1.5,"Source: http://www.mfe.govt.nz/climate-change/reducing-greenhouse-gas-emissions/\nnew-zealand-emissions-trading-scheme/participatin-4")
	mtext(side=3,cex=0.9,line=-0.1,"Of 4.417 million units allocated to industry 90% went to 11 companies")
	dev.off()

view raw NZETS-free-allocation-emission-units-industry-2015.r hosted with ❤ by GitHub

What are we waiting for? the fantasy of carbon neutral growth of aviation emissions

In this guest post, the 'stop flying' Wellington lawyer Tom Bennion writes about the International Civil Aviation Organization (ICAO) proposals for 'carbon-neutral' growth of greenhouse gas emissions from the fast-growing aviation industry.

New Zealand parents often tell their children not to eat too many sweets. Our primary schools spend a lot of time talking about suitable diets. We do this because we have the long term interests of our children at heart.

I find the contrast between that and how we currently approach climate change disheartening and distressing and especially when I consider all the families I know who are now taking flying holidays with their children.

This is a really uncomfortable topic. But we have to talk about it, and do so urgently.

We should, by now, all know the math. There isn't any personal activity we or our children can engage in that is even remotely close to air travel in terms of the sheer volume of greenhouse gas emissions it produces.

Google tells me that a Boeing 747 burns roughly 12 litres of aviation gas per kilometer. That is pretty good economy for carrying 500 people a short distance. But not if you are flying 18,819 km, the distance from Wellington to London and back. In that case, every person on the flight is responsible for consuming 450 litres of fuel. To put that in perspective, imagine if, instead of taking that trip, you revved up an average family car in your driveway to 100km/hr and at 6 litres per 100 kilometers you would need to leave it running for 75 hours or 3 days. Then repeat that for each family member that took the trip.

If you did that in your neighbourhood, you would be called a crass and thoughtless person, and people might wonder what sort of children you were raising.

In addition, these figures don't address the fact that the warming effect of aviation gas burned at altitude is around 2-3 times the impact when burned at sea level. So make that 6-9 days of car revving for each family member.

We also know that the emissions from our plane trips this year and this decade will continue to heat the planet for hundreds of years.

It isn't necessary to bang on about how bad things will get if we keep doing this. We already have an inkling from worldwide weather trends in the last 12 months. The thing to bear in mind is that the emissions we are contributing so hugely to through air travel are a severe threat to the future lives of our children, a much greater threat than a bad diet.

In the face of all of this, we have to accept, I think, that at the moment we are responding essentially with the instincts of small children:

• We can see that we should stop this behaviour but wont because it would inconvenience us, be 'too hard' and 'everyone else is doing it'.
• We don't like to talk about it. We mumble an excuse and move away if it comes up.
• If we have to confront it, conversations quickly get tense as we get defensive about our reasons for keeping on with this clearly inappropriate behaviour.
• We avoid mentioning the issue with our own children because we know they would instantly spot our hypocrisy.

In addition, and maybe this is the worst of it, by taking them on a flying holiday with us, we implicate them in our bad behaviour.

In uncomfortable situations like this we are anxious for good news. Here it is. All the members of the International Civil Aviation Organisation (ICAO), that is, essentially all United Nation member states, five years ago adopted a goal of carbon neutral growth after 2020.

You may wonder how or why the ICAO picked on 2020 as a benchmark in the first place. I don't know. No one does. It has no bearing on reality, no bearing on trying to avoid dangerous climate change by keeping within the global average temperature rise within 1.5 of 2 degrees, and isn't intended to.

It's the best that can be politically extracted from 190 odd nation states who know that their home populations are acting like children and wont forgive them if they try to have a serious conversation about reducing airline emissions.

Here are some of the problems with the ICAO goal:

• the ICAO has been promising action for ages. It got the mandate to work on reducing aviation greenhouse gases in the 1997 Kyoto Protocol.
• The ICAO plan does not cover domestic aviation - that's about 30% of aviation emissions.
• By 2020, annual emissions will be around 1000 megatonnes. And there is no plan to reduce them at all, just to hold the annual level to about 1000 megatonnes.
• Even after making heroic assumptions about how much new aeroplane design developments can cut back on some emissions, the ICAO has calculated that it can only meet its target with offsets.

That's right, the emissions from our holiday flights in 2020 will be fine because someone else somewhere else (the details don't need to concern us) is going to promise to grow some trees and keep them growing until around 2400 or so. I don't think hubris really captures it. Its the sort of fantasy that only children could indulge in.

And lastly, and here is the real kicker, the ICAO isn't going to do pretty much any of this. It has just announced that it is about to reset the start date of the proposal so it wont be compulsory for any nations until 2027, and will allow for whole sectors of aviation to aggregate their emissions. So there will be lots of delay and massaging of numbers. We all know what happened with the fraudulent carbon credits under New Zealand's emissions trading scheme, and, with the fantasy thinking of offsets thrown in, I expect you can see where all of this is heading.

No surprises that the New Zealand Government has announced that its happy with the scheme, provided everyone else signs on with them of course.

This also means, obviously, that when your local airline tells you it supports the ICAO approach, has purchased some electric cars or is putting solar panels on the roof of the airport, or planting some trees for you to fly over in their planes, but has not yet switched its entire air fleet to bio-fuels or done something as blindingly obvious as stopping its air-points programme, you can just politely ignore them.

There is a technical term for this refusal to face reality. Its called cognitive dissonance. That is, juxtaposing two contradictory ideas and finding ways to manage the mental chasm between them. In this case its not just the contradiction between our personal carbon emissions from air travel and stated concern about climate change, its the fact that as parents we care for our kids while managing the secret knowledge that we risk literally shortening their lives and most certainly the lives of their own children.

I am selfish. My worry is that future children will look at our thousands of travel photos alongside the news headlines about record-setting heat, storms, floods etc, and wont just label us childish. Sociopaths is the terms we use for people with a sense of entitlement so strong that they would prefer mass death over personal discomfort and unease. But maybe they will just call us cowards. Then again, they might get inventive and call us child abusers.

I think we need to be uncomfortable for a little bit. We are adults. Adults can examine the situation rationally, and tell our kids that the hyper-mobile life of flying holidays we have been creating for ourselves and them is going to put us all in danger and has to go on hold. We all have a habitable planet to save right now.

So get out your air points statement. Explain to the kids you are donating all of them to forest planting. Tell them that holidays from now on will be a bit closer to home, and that overseas flights are special, rare things, that we will reserve for them when they are older, when they are adults and we have made sure the world is safe again.

Is it in the spirit of the Paris Agreement to ratify it with more emissions and more creative accounting?

Is the New Zealand Government's plan to ratify the Paris Agreement in 2016 consistent with a two degrees Celsius (2C) carbon budget? Now also posted at Hot Topic

Since the December 2015 Paris Agreement, the British climate scientist Kevin Anderson has given a couple of talks with the title Beyond Dangerous Climate Change: Does Paris Lock-out 2 Degrees?

Anderson's message is that although the Paris Agreement was a diplomatic triumph, it relies on speculative utopian technological fixes (bio-energy carbon capture and storage) in the future in order to reconcile the now extremely limited carbon budgets consistent with the desired 2C (and 1.5C) temperature limits with business-as-usual economics and politics. In other words, the Paris Agreement locks out the 2C target.

Why do I mention that? Because I want to run a 'Kevin Anderson' ruler over the New Zealand Government's recently announced ratification of the Paris Agreement. To conduct a bare assessment of New Zealand's emissions taking account that it is the cumulative emissions that determine warming. I want to ask the question 'does the New Zealand ratification also lock out any policies for emissions reductions consistent with a fair share of a 2 degrees Celsius carbon budget?'

To set the context, I'll set out some of the mechanics of what ratification of the Paris Agreement will require in New Zealand. Then in true Kevin Anderson style there will be a look at projected emissions and some graphs.

As we know, last month, on 17 August 2016, Minister for Climate Change Issues Paula Bennett announced that New Zealand would ratify the Paris Agreement this year.

Bennett's announcement represented a change in position as in April she had told Stuff's Tracy Watkins that she was not rushing to ratify the agreement in the next couple of months

A cabinet paper from Paula Bennett "Paris Climate Change Agreement - Report back to Cabinet and Approval for Signature" has been on the Ministry for the Environment website since April 2016.

We also know from the Ministry of Foreign Affairs and Trade (MFAT) that ratification of the Paris Agreement will involve:

"..presenting the agreement and a national interest analysis to Parliament for examination by a select committee, after which the select committee tables a report in the House. After this, legislation may be passed and then New Zealand may ratify the Agreement".

The "Paris Agreement National Interest Analysis" was very briefly open for submissions on the New Zealand Parliament website until 2 September 2016.

The Ministry of the Environment has a Paris Agreement webpage. This confirms that once Parliament agrees to ratification (and enacts legislation), the Government will deposit the ‘instrument of ratification’ with the UN Secretary General before the next international UNFCCC climate change meeting in Morocco (COP22) in November 2016.

Therefore, some stepping stones are apparent. There will be a Parliamentary Select Committee considering the National Interest Analysis and submissions. That Parliamentary process has its shadow process, the Ministry for the Environment driven, and therefore more Government-controlled, review of the New Zealand Emissions Trading Scheme. Some amending legislation will probably be presented as the outcome of both processes.

A crucial point will of course be the detail of this amending legislation.

Paula Bennett has stated that the Government has "absolutely no intention of changing our target" (the New Zealand 2030 climate change target), and that the required 'Paris' legislation will be nothing major. Therefore, as she stated to Radio New Zealand, the New Zealand Emissions Trading Scheme will only need to be tweaked to meet the commitments under the Paris Agreement.

So the amendments will be to the Climate Change Response Act 2002 which is the statute that incorporates the United Nations Framework Convention on Climate Change (UNFCCC) and the Kyoto Protocol into New Zealand law. The UNFCCC is included as the first schedule to the act and the Kyoto Protocol is included as the second schedule.

The amendments will probably affect the provisions describing the operation of the New Zealand Emissions Trading Scheme (which has been under review all of 2016). Perhaps the Paris Agreement will be incorporated as a further schedule.

The current highly conditional New Zealand INDC (Intended National Determined Contribution), otherwise known as the 2030 climate change target, will become a NDC National Determined Contribution. Professor Ralph Sims notes that the NDCs "will need to be based largely on domestic mitigation actions" but "they are not legally binding".

Ralph Sims, who was writing back in February, was hopeful that the New Zealand NDC would be strengthened to be more ambitious, given that the sum of the 2015 INDCs "collectively would lead to an untenable 2.7 – 3 degrees Celsius future, rather than restrict global warming below the internationally agreed 2 degrees Celsius above pre-industrial levels" He seemed to have some hope that the then yet-to-be published Royal Society climate mitigation report would contribute to that.

So does that mean the Government will actually do something to reduce domestic emissions? Perhaps toughen up the emissions trading scheme, so that it uses only New Zealand units and has a fixed cap (as in 'cap and trade'), and auctioning units instead of free generous allocation of units to industry? No, of course not!

The National Interest Analysis continues on paragraph 104 on page 30:

"We have assumed that New Zealand will be able to purchase sufficient international emissions reductions in the 2020s".

So instead of domestic emissions reductions, we are betting the farm on the magic of the market, more speculative emissions trading, open access to and availability of international emission units from international carbon markets. However, this is no sure thing. Table 5 on page 15 states (my emphasis):

"The (Paris) Agreement provides for a centralised market mechanism and also allows other approaches to be developed by Parties. When and how the centralised market mechanism will be operationalised is unclear, and it may not provide a timely and sufficient supply of emission reductions to be economically practical for New Zealand’s use.".

So no pressure, New Zealand! The analysis then lists the many steps/obstacles on and in the way of New Zealand having access to functioning international carbon markets.

"This means that New Zealand will likely need to build future international markets from the bottom up in cooperation with other willing participants. New Zealand must: find willing trading partners, develop standards (including working with others) to ensure international carbon markets can function effectively (eg, on environmental integrity and unit registries), ensure that its trading activities are consistent with any future accounting requirements".

Paragraph 64 on page 19 of the Paris Agreement National Interest Analysis then states:

"New Zealand’s first nationally determined contribution (i.e. the 2030 target) was developed on the basis that New Zealand will achieve the 2030 target through a combination of domestic emission reductions, forestry growth and participation in international carbon markets."

Where have we heard that before? Back when I looked at the creative accounting for the 2020 emissions reduction target.

Surely, if the Government says it intends to adopt a mix of policies, one of which is domestic emission reductions, then some domestic emission reductions will actually happen?

Well perhaps we could look for the reductions in domestic emissions in the Ministry for the Environment's projections of future emissions "with measures" and "without measures" out to 2030. These are in the report New Zealand’s Second Biennial Report under the United Nations Framework Convention on Climate Change released in December 2015. This is the report where the only substantive differences between the with and without energy sector projections were the closure of the Huntly Thermal Power Station which then got reversed. Thus cancelling the projected decline.

At the time of their release in late December 2015, Radio New Zealand reported the complete inconsistency with the freshly-signed Paris Agreement; Emissions set to far outstrip Paris target. And they quoted an expert.

"Suzi Kerr, a senior fellow at economic research institute Motu, said the projections were completely incompatible with the target New Zealand took to the Paris climate change talks"

Here is a chart of these incompatible projected emissions from 2013 to 2030 by sector. The emissions for all sectors are all expected to increase. For the land-use, land-use change and forests (LULUCF) sector, the net carbon absorbed (or sequestered) is displayed as negative emissions and is projected to decline.

Here is another chart of the projected gross emissions (without LULUCF) and the LULUCF carbon sequestration (shown as negative emissions). The LULUCF 'credits' are subtracted from the gross emissions to get net emissions (the red line and dots) which is the real measure of what gets into the atmosphere. Note that the forestry sequestration is declining towards zero through the 2020s, but is still a net 'sink' of emissions.

However, wasn't there meant to be a 'wall of wood' in the 2020s? Of wholescale harvesting or land-use change of the 1990s pine forests that would tip the net carbon sequestration from the forests into being a net source of deforestation emissions in the 2020s.

Paul Young of the Morgan Foundation has looked at the issue and has concluded that the Government is pushing to change the rules used for accounting for forest carbon.

"They intend to switch to an 'averaging' approach, which will completely remove the planting and harvest cycle once a plantation forest reaches maturity. This change actually seems sensible; the problem is that we are changing the rules halfway through the game, in a way that directly favours us. If we had used the proposed rules from the beginning, New Zealand would receive far fewer forestry credits up to 2020"

We can look at this issue by comparing the current (December 2015) projections for the forests/LULUCF sector with the previous projections that were in the 2013 Sixth National Communication.

It seems very obvious that the Ministry for the Environment have used a very different definition of sequestered forest carbon in 2015 from the definition used in 2013. By my calculation they have found an extra 248 million tonnes of carbon in the decade from 2020 to 2030. That change in accounting treatment has changed the 'sign' of the signal. A decade of net deforestation has changed into a decade of net storage. That is inspite of the fact that the wall of wood of harvesting is still expected in the 2020s.

Paul Young is also still concerned the the Government has not ruled out using the surplus emissions units to comply with the 2030 target. Its not mentioned in either the Cabinet paper or the National Interest Analysis, so I asked Minister Bennett's office that question and I am waiting for a response.

Time for a conclusion. Is the New Zealand ratification of the Paris Agreement going to help or hinder the agreement's ambitious goals?

The ratification reveals that New Zealand will be doing what it's always done under the UNFCCC. New Zealand's greenhouse gas emissions are expected to rise and our policy response is more creative accounting and forest fudging. Our speculative utopian techno-fix is emissions trading. The New Zealand Government simply has no policies for reducing domestic emissions, let alone in a way consistent with a fair share of a 2 degrees Celsius carbon budget.

The Ministry for the Environment's disavowed orphan carbon budget

Did you know that the Ministry for the Environment prepared a 'two degrees' carbon budget in 2014?

The relevant report "Potential long-term pathways to a low carbon economy for New Zealand", Wellington, Ministry for the Environment, August 2014, is not available from the Ministry's web page. However, I requested it from the Ministry via the 'For Your Information' website.

Incredibly, Idiot Savant had a blog post about it up at No Right Turn on Friday titled Climate change: No path to lower emissions under National before I had even updated the status of my Official Information Act request on FYI.

The paper explicitly sets out to explore a New Zealand carbon dioxide budget consistent with limiting eventual global warming to two degrees Celsius, using the contraction and convergence method.

Presumably because of that aim, the paper appears to have been completely disavowed by the Ministry for the Environment. The cover letter replying to my request at FYI states that the report is neither formal advice to the Government nor is it Ministry policy. The report has a header stating that it is 'sensitive' and 'Not Government or Ministry policy'. There is an italicised inserted 'Note' saying that Treasury does not agree that contraction and convergence is an appropriate measure of a 'fair share'.

The guts of the report are three carbon budgets (a 10th percentile, a median and a 90th percentile) based on applying contraction and convergence to one of the IPCC two degrees-consistent carbon budgets. Oddly, the working calculations and the actual budget amounts are omitted. I guess I can just make another request for them. The budgets are only presented in this graph.