Data Model¶
Data fed into aneris
is assumed to be so-called wide-style panel
data. Within the code base, standard Pandas :code:`DataFrame`s are used. When
using the CLI, Excel spreadsheets or csvs are supported.
Variable Names¶
The most important data underlying harmonizations are timeseries. Timeseries are defined by a Variable and a number of Data columns for each timestep in the timeseries. Variable names are assumed to follow the IAMC style and have the form:
<prefix>|Emissions|<gas>|<sector>|<suffix>
- prefix: a designation for the current study (e.g., “CEDS”)
- gas: the emissions species (e.g., “BC”)
- sector: the emissions sector (e.g., “Transportation”)
- suffix: a designation for raw-model data (e.g., “Unharmonized”)
Importantly, model data variable names must match historical data variable names exactly.
Unharmonized IAM Data¶
Data from IAMs is expected to be in the following format with a sheetname “data”.
Model | Scenario | Region | Variable | Unit | 2005 | 2010 | 2020 | 2030 |
---|---|---|---|---|---|---|---|---|
model |
sspn |
regionc |
prefix|Emissions|BC|sector1|suffix |
Mt BC/yr |
10 |
11 |
12 |
13 |
model |
sspn |
regionc |
prefix|Emissions|BC|sector2|suffix |
Mt BC/yr |
11 |
12 |
13 |
14 |
model |
sspn |
regionc |
prefix|Emissions|BC|suffix |
Mt BC/yr |
21 |
23 |
25 |
27 |
If overrides are provided, they are expected to be in the following formay with a sheetname “harmonization”.
Model |
Scenario |
Region |
Variable |
Unit |
Method |
model |
sspn |
regionc |
prefix|Emissions|BC|sector1|suffix |
Mt BC/yr |
reduce_ratio_2100 |
model |
sspn |
regionc |
prefix|Emissions|BC|sector2|suffix |
Mt BC/yr |
reduce_ratio_2100 |
Additionally, configuration parameters (described in Run Control and Configuration) can be set by two columns titled “Configuration” and “Value” in the harmonization sheet.
Historical Data¶
Historical data is expected to be in the following format
Model | Scenario | Region | Variable | Unit | 2000 | 2001 | 2002 | 2003 |
---|---|---|---|---|---|---|---|---|
History |
scen |
regiona |
prefix|Emissions|BC|sector1|suffix |
Mt BC/yr |
1 |
2 |
3 |
4 |
History |
scen |
regiona |
prefix|Emissions|BC|sector2|suffix |
Mt BC/yr |
2 |
3 |
4 |
5 |
History |
scen |
regiona |
prefix|Emissions|BC|suffix |
Mt BC/yr |
3 |
5 |
7 |
9 |