{
"cells": [
{
"attachments": {},
"cell_type": "markdown",
"metadata": {
"mystnb": {
"nb_execution_mode": "off"
}
},
"source": [
"# Emissions Trends\n",
"**A snapshot of emissions trends for both marginal and total with respect to regional prices**
\n"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"### Data Extraction\n",
"#### Import Packages"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"tags": [
"hide-cell"
]
},
"outputs": [],
"source": [
"import nemed\n",
"import nemosis\n",
"\n",
"# To generate plots shown\n",
"import pandas as pd\n",
"import numpy as np\n",
"import plotly.graph_objects as go\n",
"import plotly.express as px\n",
"from plotly.subplots import make_subplots\n",
"\n",
"# Open plot in browser (optional)\n",
"import plotly.io as pio\n",
"pio.renderers.default = \"browser\"\n",
"\n",
"# Hide Logging output\n",
"import logging\n",
"logging.getLogger(\"nemosis\").setLevel(logging.WARNING)\n",
"logging.getLogger(\"nemed\").setLevel(logging.WARNING)\n"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {
"tags": []
},
"source": [
"#### Processing Emissions Data\n",
"This example serves as a snapshot of trends rather than a detailled tutorial. We recommend you first explore the [total emissions example](https://nemed.readthedocs.io/en/latest/examples/total_emissions.html) and [marginal emissions example](https://nemed.readthedocs.io/en/latest/examples/marginal_emissions.html) for understanding on how `NEMED` extracts and processes emissions.\n"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [],
"source": [
"start_time = \"2019/01/01 00:00\"\n",
"end_time = \"2020/01/01 00:00\"\n",
"cache = \"E:\\TEMPCACHE_nemed_demo\""
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"Download market prices using NEMOSIS"
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {},
"outputs": [],
"source": [
"prices = nemosis.dynamic_data_compiler(start_time=start_time+\":00\", \n",
" end_time=end_time+\":00\", \n",
" table_name='DISPATCHPRICE', \n",
" raw_data_location=cache,\n",
" fformat='feather',\n",
" select_columns=['SETTLEMENTDATE','REGIONID','RRP','INTERVENTION'],\n",
" keep_csv=False)\n",
"prices = prices.rename(columns = {'SETTLEMENTDATE': 'Time', 'REGIONID': 'Region', 'RRP': 'Prices'})\n",
"prices = prices[prices['INTERVENTION']==0]"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"Download Total Emissions"
]
},
{
"cell_type": "code",
"execution_count": 5,
"metadata": {
"tags": [
"hide-output"
]
},
"outputs": [],
"source": [
"total = nemed.get_total_emissions(start_time=start_time,\n",
" end_time=end_time,\n",
" cache=cache,\n",
" by=None)"
]
},
{
"cell_type": "code",
"execution_count": 7,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"
| \n", " | TimeEnding | \n", "Region | \n", "Energy | \n", "Total_Emissions | \n", "Intensity_Index | \n", "
|---|---|---|---|---|---|
| 0 | \n", "2019-01-01 00:05:00 | \n", "NEM | \n", "0.000000 | \n", "0.000000 | \n", "0.000000 | \n", "
| 1 | \n", "2019-01-01 00:05:00 | \n", "NSW1 | \n", "0.000000 | \n", "0.000000 | \n", "0.000000 | \n", "
| 2 | \n", "2019-01-01 00:05:00 | \n", "QLD1 | \n", "0.000000 | \n", "0.000000 | \n", "0.000000 | \n", "
| 3 | \n", "2019-01-01 00:05:00 | \n", "SA1 | \n", "0.000000 | \n", "0.000000 | \n", "0.000000 | \n", "
| 4 | \n", "2019-01-01 00:05:00 | \n", "TAS1 | \n", "0.000000 | \n", "0.000000 | \n", "0.000000 | \n", "
| ... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
| 630715 | \n", "2020-01-01 00:00:00 | \n", "NSW1 | \n", "676.491550 | \n", "536.609209 | \n", "0.793224 | \n", "
| 630716 | \n", "2020-01-01 00:00:00 | \n", "QLD1 | \n", "513.112938 | \n", "411.923700 | \n", "0.802793 | \n", "
| 630717 | \n", "2020-01-01 00:00:00 | \n", "SA1 | \n", "117.760043 | \n", "49.024213 | \n", "0.416306 | \n", "
| 630718 | \n", "2020-01-01 00:00:00 | \n", "TAS1 | \n", "52.408370 | \n", "0.000000 | \n", "0.000000 | \n", "
| 630719 | \n", "2020-01-01 00:00:00 | \n", "VIC1 | \n", "358.095808 | \n", "353.548618 | \n", "0.987302 | \n", "
630720 rows × 5 columns
\n", "| \n", " | Time | \n", "Region | \n", "Intensity_Index | \n", "DUID | \n", "CO2E_ENERGY_SOURCE | \n", "
|---|---|---|---|---|---|
| 0 | \n", "2019-01-01 00:05:00 | \n", "NSW1 | \n", "0.421647 | \n", "PPCCGT | \n", "Natural Gas (Pipeline) | \n", "
| 1 | \n", "2019-01-01 00:05:00 | \n", "QLD1 | \n", "0.401443 | \n", "PPCCGT | \n", "Natural Gas (Pipeline) | \n", "
| 2 | \n", "2019-01-01 00:05:00 | \n", "SA1 | \n", "0.473708 | \n", "PPCCGT | \n", "Natural Gas (Pipeline) | \n", "
| 3 | \n", "2019-01-01 00:05:00 | \n", "TAS1 | \n", "0.477227 | \n", "PPCCGT | \n", "Natural Gas (Pipeline) | \n", "
| 4 | \n", "2019-01-01 00:05:00 | \n", "VIC1 | \n", "0.453253 | \n", "PPCCGT | \n", "Natural Gas (Pipeline) | \n", "
| ... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
| 519069 | \n", "2020-01-01 00:00:00 | \n", "NSW1 | \n", "0.908305 | \n", "VP5 | \n", "Black coal | \n", "
| 519070 | \n", "2020-01-01 00:00:00 | \n", "QLD1 | \n", "0.942021 | \n", "VP6 | \n", "Black coal | \n", "
| 519071 | \n", "2020-01-01 00:00:00 | \n", "SA1 | \n", "0.681150 | \n", "TORRB3 | \n", "Natural Gas (Pipeline) | \n", "
| 519072 | \n", "2020-01-01 00:00:00 | \n", "TAS1 | \n", "0.000000 | \n", "GORDON | \n", "Hydro | \n", "
| 519073 | \n", "2020-01-01 00:00:00 | \n", "VIC1 | \n", "0.672636 | \n", "TORRB3 | \n", "Natural Gas (Pipeline) | \n", "
519074 rows × 5 columns
\n", "| \n", " | Time | \n", "Region | \n", "INTERVENTION | \n", "Prices | \n", "
|---|---|---|---|---|
| 0 | \n", "2019-01-01 00:05:00 | \n", "NSW1 | \n", "0 | \n", "68.09260 | \n", "
| 1 | \n", "2019-01-01 00:05:00 | \n", "QLD1 | \n", "0 | \n", "64.82955 | \n", "
| 2 | \n", "2019-01-01 00:05:00 | \n", "SA1 | \n", "0 | \n", "76.50000 | \n", "
| 3 | \n", "2019-01-01 00:05:00 | \n", "TAS1 | \n", "0 | \n", "77.06842 | \n", "
| 4 | \n", "2019-01-01 00:05:00 | \n", "VIC1 | \n", "0 | \n", "73.19672 | \n", "
| ... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
| 53725 | \n", "2020-01-01 00:00:00 | \n", "NSW1 | \n", "0 | \n", "48.50000 | \n", "
| 53726 | \n", "2020-01-01 00:00:00 | \n", "QLD1 | \n", "0 | \n", "50.30038 | \n", "
| 53727 | \n", "2020-01-01 00:00:00 | \n", "SA1 | \n", "0 | \n", "69.00000 | \n", "
| 53728 | \n", "2020-01-01 00:00:00 | \n", "TAS1 | \n", "0 | \n", "81.95000 | \n", "
| 53729 | \n", "2020-01-01 00:00:00 | \n", "VIC1 | \n", "0 | \n", "68.13710 | \n", "
525600 rows × 4 columns
\n", "| \n", " | hour | \n", "Region | \n", "INTERVENTION | \n", "Prices | \n", "Energy | \n", "Total_Emissions | \n", "Average_EI | \n", "Marginal_EI | \n", "
|---|---|---|---|---|---|---|---|---|
| 0 | \n", "0 | \n", "NSW1 | \n", "0.0 | \n", "71.563565 | \n", "597.993603 | \n", "468.158659 | \n", "0.780488 | \n", "0.746162 | \n", "
| 1 | \n", "0 | \n", "QLD1 | \n", "0.0 | \n", "64.302266 | \n", "517.315615 | \n", "401.527264 | \n", "0.774328 | \n", "0.767774 | \n", "
| 2 | \n", "0 | \n", "SA1 | \n", "0.0 | \n", "87.138166 | \n", "127.779344 | \n", "37.774871 | \n", "0.302747 | \n", "0.514765 | \n", "
| 3 | \n", "0 | \n", "TAS1 | \n", "0.0 | \n", "86.857243 | \n", "87.187231 | \n", "0.545751 | \n", "0.007020 | \n", "0.291249 | \n", "
| 4 | \n", "0 | \n", "VIC1 | \n", "0.0 | \n", "88.493301 | \n", "386.696932 | \n", "354.732110 | \n", "0.916301 | \n", "0.497278 | \n", "
| ... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
| 115 | \n", "23 | \n", "NSW1 | \n", "0.0 | \n", "77.933472 | \n", "628.251938 | \n", "489.995185 | \n", "0.779599 | \n", "0.702943 | \n", "
| 116 | \n", "23 | \n", "QLD1 | \n", "0.0 | \n", "68.372989 | \n", "547.849366 | \n", "423.348145 | \n", "0.773068 | \n", "0.744226 | \n", "
| 117 | \n", "23 | \n", "SA1 | \n", "0.0 | \n", "97.778069 | \n", "132.848236 | \n", "41.143097 | \n", "0.315965 | \n", "0.413469 | \n", "
| 118 | \n", "23 | \n", "TAS1 | \n", "0.0 | \n", "93.027470 | \n", "92.245026 | \n", "0.716384 | \n", "0.008509 | \n", "0.262014 | \n", "
| 119 | \n", "23 | \n", "VIC1 | \n", "0.0 | \n", "103.507738 | \n", "396.581260 | \n", "357.824731 | \n", "0.903870 | \n", "0.389096 | \n", "
120 rows × 8 columns
\n", "