Evaporative Demand Drought Index (EDDI)

About

This page is intended for members of the FEWS NET science community. The goal here is to document NOAA's ongoing progress toward the following:

1. Development of the multi-generational global Reference Evapotranspiration (ET0) dataset, including: <link>

  • a) development of ET0 from MERRA2 (native, coarse-resolution data), <link>
  • b) verification of native-resolution ET0 data, <link>
  • c) downscaling to 0.125° (fine-resolution data), and <link>
  • d) potential improvements to downscaling procedure. <link>

2. Distribution of the multi-generational global Reference Evapotranspiration (ET0) dataset, at multiple resolutions: <link>

  • fine scale (0.125°),
  • coarse-scale (0.5° x 0.625°).

3. Distribution of the experimental global Evaporative Demand Drought Index (EDDI), in two formats: <link>

  • raw data in flat ascii files,
  • context-enhanced maps,

and at various timescales:

  • dekadal (10-day) at the end of each dekad, and
  • 1- to 12-monthly at the end of each month.

 

 


1. Developing the multi-generational global reference evapotranspiration (ET0) dataset:

1.a. Development of coarse-resolution ET0 from MERRA2:

The data set currently employed by FEWS NET for their ET0 estimations – based on GDAS drivers – was verified by Senay et.al. (2008), using weather station data from the California Irrigation Management Information System (CIMIS). In order to facilitate inter-study comparisons with FEWS NET’s current ET0 estimates, by Senay et al. (2008) using GDAS in the ASCE hourly version of the Penman-Monteith equation, we use the daily version of ASCE’s formula, taking the form:

Eqn 1: reference ET [mm/day] 

We assume G = 0 in Eqn 1. The constant values 900 [K.mm.s3/Mg/day] and 0.34 [s/m] reflect the ASCE values assuming the short reference crop (0.12-m grass), and 0.23 is the albedo [dimensionless].

Eqn 2: slope of the saturation vapor pressure-temperature curve [kPa/°C] 

 

Eqn 3: psychrometric constant [kPa/°C] 

Eqn 4: saturation vapor pressure [kPa] 

 

Eqn 5: actual vapor pressure [kPa] 

 

Eqns 1 - 5 are driven by the following five variables, all provided by MERRA2: 

  • T, 2-m air temperature [°C; from MERRA2 variable T2M],
  • q, 2-m specific humidity [kg/kg; from QV2M],
  • Rs, surface downward short wave radiation [W/m2; from SWGDN],
  • U2, 2-m wind speed at 2 m height [m/s; from 10-m orthogonal wind vectors U2M and V2M], and
  • P, surface atmospheric pressure [kPa; from PS].

The equation for es deviates from ASCE convention, where it takes the form:

Eqn 6: ASCE convention for estimating es from Tmin and Tmax [kPa].

where Tmax and Tmin are the daily maximum and minimum temperatures, respectively. Since the MERRA2 data set only provides daily mean temperature T, we use the form in Eqn 4. On the other hand, our verification dataset (GSOD) provides daily Tmax and Tmin, so instead of using the ASCE (2005) convention, for consistency we estimated the daily average T by calculating the average of the two values:

Eqn 7: For verification, we estimate mean daily temperature [°C] from Tmin and Tmax and then apply that in Eqn 4.

and subsequently used Eqn 4.

The MERRA2 reanalysis provides all five required variables at a 0.5° lat x 0.625° long resolution.

 

1.b. Verification of native resolution ET0 data:

So far, we have conducted a preliminary verification of the ET0 reanalysis against station-based ET0 "observations" across Africa. These are not true observations of ET0; rather they are synthesized using the equations above (section 1a) driven by observations of T, U2, and q from Global Summary of the Data (GSOD) stations and Rs from the Global Land Data Assimilation System v 2.1 at a 1° lat/long resolution but linearly interpolated to the GSOD station locations. Spatially distributed and downscaled ET0 estimates derived from MERRA2 are compared with these (mostly) station-based ET0 estimates (hereafter referred to as GSOD) to test the performance of MERRA2 both regionally and seasonally. MERRA2 ET0 values are extracted by linear interpolation to the daily GSOD station coordinates. The comparison uses moving-mean plots of spatially averaged daily ET0 versus time, and scatter plots, the latter allowing for determination of r2-values and linear fitting parameters.

Although GSOD provides daily mean station pressure, we follow the ASCE (2005) method of estimating the atmospheric pressure P using station elevation z according to:

Eqn 8: estimating surface atmospheric pressure P [kPa] from station elevation z [m].

Furthermore, as q is not included in the GSOD dataset we derive it from the dew-point temperature Tdew, a quantity provided by the dataset, and surface atmospheric pressure P, using:

Eqn 9: estimating specific humidity q [kg/kg] from actual vapor pressure ea [kPa] and surface atmospheric pressure P [kPa].

where ea is from:

Eqn 10: estimating actual vapor pressure ea [kPa] from dew-point temperature Tdew [°C].

Using GLDASv2.1 limits our verification of MERRA2 ET0 to the period 1980-2000.

Eqn 1 requires wind speeds at 2 m above the surface, U2. Measurements performed at a different heights can be converted to approximate a 2-m wind speed using the following equation from ASCE (2005):

Eqn 11: estimating 2-m wind speed U2 [m/sec] from wind speed Uz [m/sec] at height z [m].

GSOD, however, does not specify any anemometer height, introducing an uncertainty in the value for our U2 input to GSOD-derived ET0. In order to constrain this uncertainty, we contacted the meteorological institutes of many African countries to try to ascertain anemometer heights used at their weather stations. Contact information is, however, very limited for many countries, and many times we did not get a response. The four countries that did respond--South Africa, Algeria, Kenya and Tanzania--all informed us that they use a 10-m anemometer height pursuant to WMO specifications. It seems therefore a fair assumption that most other countries also use the same convention. For stations not located in one of the four countries with known anemometer height, we calculate ET0 twice: once with the assumption that wind speeds are measured at 2 m (i.e., we use the GSOD value as is), and another time with the assumption of 10-m anemometer heights. From Eqn 11, we know that U≈ 0.75 U10.

Figure 1 shows the spatial and temporal characteristics of the number of GSOD weather stations in Africa. It can be seen that, although the number of reporting stations can vary strongly from one day to another, the number of stations has significantly increased since the beginning of the year 2000. Globally (not shown in the figure), the total amount of station is over 9000. For reasons unknown to the authors, the GSOD data set contains some days where the number of stations suddenly drops dramatically, with a lowest station count of 25 on September 9, 2013. The spatial map shows that South Africa and Algeria have the highest density of stations, whereas most of the Sahel region, Central Africa and the Horn of Africa are poorly represented. Throughout this work, Africa is divided into five regions, as shown in Figure 1, in order to compare the performance of MERRA2 on a regional basis.

Figure 1: (top) Map of GSOD stations in Africa, indicating station reliability. Color bar indicates number of reporting days as a percentage of total number of days in the period of January, 2000 to June, 2016. Fill colors denote five regions of Africa: Northern, Eastern, Central, Western and Southern Africa. Countries with known anemometer height are highlighted by increased opacity (Algeria, Tanzania. Kenya, South Africa). (bottom) Daily number of reporting stations per day throughout the period (January, 2000 to June, 2016).
Figure 2: Example verification results: 10-day moving mean graphs for (left) all of Africa and (right) Southern Africa for the period January, 2000 to December, 2001.

 

1.c. Downscaling to fine-resolution (0.125°) ET0 data:

Daily ET0 surfaces are spatially downscaled to 0.125° x 0.125°, using climatological monthly potential evaporation (PET) estimates from the International Water Management Institute (IWMI). Fine-scale IWMI pixels are averaged spatially to the extent of the encompassing MERRA2-derived ET0 pixel (a block of 4 x 5 0.125-degree IWMI pixels to each 0.5 x 0.625-degree MERRA2 pixel) to derive a coarse-scale IWMI estimate at the same spatial resolution of the MERRA2-derived ET0. The ratio of the fine-scale :: coarse-scale IWMI PET is applied at the fine-scale 0.125-deg resolution to the MERRA2-derived ET0 to provide a fine-scale (0.125-degree) MERRA2-derived ET0.

This simple downscaling procedure is dissatisfying: it introduces no fine-scale temporal variability and so does nothing to enhance the performance of EDDI even going to finer scales.

 

1.d. Potential improvements to downscaling procedure:

As an improvement to the IWMI-based downscaling outlined above, an upcoming alternative is to downscale each driver in anomaly space, and then reconstruct the fine-scale ET0 from the fine-scale drivers.

First, we define anomalies for each response or driver variable, i.e., X = {ET0, T, q, U2, Rd}, as:

Eqn 12: Defining anomalies as a variable's fine-scale value less its coarse-scale value.

where Xf is the value of variable X at the fine scale, and Xc is the value of X at the coarse scale. Clearly, each parent pixel at Xc will have multiple child pixels with a range of Xf values.

The anomaly in ET0 is also defined as the sum of the four drivers' contributions, themselves the product of the sensitivity of ET0 to the driver (∂ET0/∂X) and the anomaly in the driver, or:

Eqn 13: Defining the anomaly in ET0 as the sum of contributions due to anomalies in each driver. 

What we seek is fine-scale ET0 (ET0f), so we need to solve:

Eqn 14: estimating fine-scale ET0 (i.e., ET0f) from coarse-scale ET0 (i.e., ET0c) and anomaly in ET0.

or, in more detail:

Eqn 15: composition of fine-scale ET0 (i.e., ET0f) from coarse-scale ET0 (i.e., ET0c) and contributions from each of the drivers.

where every term on the right-hand side of Eqn 15 is known, as follows:

  • ET0c is derived from Penman-Monteith driven by {Tc, qc, U2c, Rdc} from MERRA2.
  • Tf, qf, U2f, Rdf are derived by downscaling, as follows:
    • Tf is derived by applying a lapse rate (γ) to Tc according to the anomaly in elevation (z) from the coarse- and fine-scale grids:
Eqn 16: Estimating fine-scale T (Tf) from coarse-scale T (Tc) and a lapse rate (γ) applied to the inter-scale elevation difference (zf-zc).   
    • qf, U2f, Rdf are derived by budget downscaling of qc, U2c, Rdc
  • Sensitivity expressions (∂ET0/∂X) are derived from partial differentiation of the Penman-Montieth equation with respect to each variable X, and are provided in Hobbins (2016). They can be evaluated for each day of the year from climatological means of either the fine-scale Xf or coarse-scale Xc.

Needs:

  • elevation grid (from MERRA2) for zc
  • elevation grid (from a fine-scale source) for zf
  • budget downscaling software / access to LIS
  • GSOD assimilation (pre or post-downscaling?)

Advantages:

  • conservative
  • temporal variability gained at fine scale
  • physically based
  • no latency introduced (beyond that of MERRA2)

Disadvantages:

  • processing time?
  • disk space?

 

 


2. Access to the multi-generational global ET0 dataset:

The archive of NOAA-Physical Science Division's global reference evapotranspiration (ET0) reanalysis is freely available to all from here: https://downloads.psl.noaa.gov/Projects/RefET/global/. This directory structure contains ET0 data and imagery for multiple generations of the reanalysis, from January 1, 1980 to the near-present across the globe. Data are daily depths of reference evapotranspiration (ET0; mm) for the indicated date.

Generation-0 ET0 reanalysis: this generation has been created as outline above in steps 1(a) through 1(c), and is located here: https://downloads.psl.noaa.gov/Projects/RefET/global/Gen-0/. This directory structure contains the following two subdirectories:

  • /coarse_resolution/ for the coarse-resolution daily ET0 data. Contains two subdirectories /data_v1/ and /data_v2/, each divided into annual subdirectories /1980/ … /2018/, each containing a year (complete prior to 2018) of daily, coarse-resolution ET0 data for short and long reference crops, estimated using the ASCE Standardized Reference Evapotranspiration Equation forced by MERRA2 drivers. Briefly the reanalysis specs are as follows:
    • File format: NetCDF,
    • Filenames indicate date: e.g., ETos_19801215.nc contains ETos data for December 15, 1980,
    • Units: mm,
    • Temporal resolution: daily,
    • Spatial resolution: 0.5° lat X 0.625° long,
    • ETrs: long-crop ET0, i.e., for 0.5-m alfalfa,
    • ETos: short-crop ET0, i.e., for 0.12-m grass.
  • The difference between the data in /data_v1/ and /data_v2/ is an improved daily wind speed estimation in v2.
  • /fine_resolution/ for the fine-resolution daily ET0 data--downscaled from the coarse-resolution data and masked to land areas. The reanalysis specs are similar to those listed above for the coarse-resolution data, except: 
    • Filenames indicate fine resolution and date: e.g., ETos_fine_19801215.nc contains fine-scale ETos data for December 15, 1980,
    • Spatial resolution: 0.125° lat X 0.125° long.

Generation-1 ET0 reanalysis: this generation will have the GSOD/GLDASv2.1 station data (currently used as verification in step 1(b) above) assimilated into it, and have an improved downscaling procedure. It is yet to come.

 

 


3. Access to the experimental global Evaporative Demand Drought Index (EDDI):

The archive of the global Evaporative Demand Drought Index (EDDI; Hobbins et al. 2016McEvoy et al. 2016) service is freely available to all from here: https://downloads.psl.noaa.gov/Projects/EDDI/global_archive/. This directory structure contains EDDI imagery (/images/) and data (/data/) from January 1, 1980 to the near-present across the globe, based on the fine-scale (0.125°), Generation-0, tall-crop reference evapotranspiration (ETrs) reanalysis listed above. Data are EDDI values (and images are mapped EDDI values) for the timescale prior to the indicated date.

  • All files--data and images--are arranged in annual subdirectories /1980/ ... /2018/.
  • Available timescales are as follows:
    • dekadal (~10-day) EDDI at the end of each dekad (1st dekad = 10th day of month, 2nd = 20th, 3rd = last day),
    • 1- to 12-monthly EDDI at the end of each month.
  • Filenames indicate timescale and date: e.g., EDDI_ETrs_02dk_19801220.asc is the dekadal EDDI data file for the 10-day period ending December 20, 1980.
  • Data files are currently stored in ascii format, starting in the northwest corner, reading west to east (left to right across each row), and then southwards (downwards). The coordinated system is geographic. With the addition of the following six header lines preceding the data, these files would be directly importable into ArcGIS:

ncols 2880
nrows 1440
xllcorner -90 – this line is not correct
yllcorner -90
cellsize 0.125
nodata_value -9.

  • Soon, all data files will be converted to NetCDF format.

 

 


References:

Status

Check here for the latest developments regarding the status of the global ETo reanalysis and derived EDDI service.

December 7, 2018

The two latest advances to report are that the improved version (v2) of the Generation-0 global ET0 reanalysis mentioned below (October 26) has been automated and has a "leading edge" of data driven by MERRA-2 data that has yet to be released on the NASA GES DISC (early access to which has been granted by NASA), and that significantly cuts down the latency of data.

This version has corrected wind speed inputs (mentioned in earlier posts) and has also corrected the issues outlines in the October 26 post (i.e., it now starts on January 1, 1980 and contains February 29s). Further, this dataset now:

  • updates automatically whenever further drivers are released on the NASA GES DISC (latest data are for October 31, 2018, at time of writing),
  • has attached at the leading edge (i.e., partially filling the latency gap between today and when the latest MERRA-2 drivers were released) data derived from pre-release MERRA-2 drivers. These data are denoted by the suffix "_pre", as in "ETos_20181119_pre.nc" for leading-edge data for November 19, 2018. The addition of these data at the leading edge cuts the latency gap down to about 12 days.
  • has been downscaled to 0.125º lat and long,
  • the coarse-resolution data (at the MERRA-2 native resolution of 0.5º lat X 0.625º long) are available here: /data_v2/ .
  • the fine-resolution data are available here: /data_v2/.

The "leading-edge" data will automatically be over-written as and when new MERRA-2 drivers are officially released on the NASA GES DISC; they ("leading-edge" data) will not be archived.

The previous version of the ET0 reanalysis now resides in /data_v1/, and will no longer be updated.

These latest advances are liable to teething issues. Please bear with me and report any problems.

 

October 26, 2018

An improved version (v2) of the Generation-0 global ET0 reanalysis has been generated and hosted here: /data_v2/. This version has the corrected wind speed inputs. Issues with this new reanalysis relate to:

  • started on January 1, 1981 (v1 started on January 1, 1980),
  • it contains no February 29s,
  • it is only available up to August 31, 2018.

These issues will be resolved after November 4, 2018.

The previous version of the ET0 reanalysis now resides in /data_v1/, and will no longer be updated.

The new version (v2) has not yet been downscaled. This should start after November 4, 2018.

October 10, 2018

The global ET0 reanalysis has completed running for the period for which the corrected wind speed data are available, i.e., January 1, 1981 to August 6, 2018. They are not yet posted to the ftp site.

October 4, 2018

I am re-running the global ETo reanalysis to account for the error in the wind fields described in the previous blog entry.

Amy McNally and Daniel Sarmiento of NASA GSFC are providing corrected daily wind vectors, and I've been regenerating the reanalysis using these corrections. The new, wind-corrected data are not yet available, but I plan on replacing all the ETo reanalysis stored here (https://downloads.psl.noaa.gov/Projects/RefET/global/) with the new data over the next few days.

I will post here when these new data are in place. The old wind-incorrect reanalysis will still be available for those who desire it, but they won't be hosted on the ftp site.

September, 2018

There is an error in the wind fields as downloaded from MERRA-2. Briefly, NASA stores the wind data for MERRA-2 as orthogonal U and V vectors of 10-m wind velocity (U10M and V10M). In aggregating up to daily data prior to download from the NASA GES DISC, each of these vector components is summed across a day, with the potential of wind reversals within a day "canceling each other out," thereby underestimating daily U10M and V10M. Converting these underestimated daily net U10M and V10M to daily wind speeds [speed = sqrt(U10M^2 + V10M^2)] leads to daily wind speeds being underestimated, ultimately leading to an underestimate of ETo.

September 20, 2018

ETo reanalysis updated to August 12, 2018.

September 5, 2018

ETo reanalysis updated to July 31, 2018.

August, 2018

This blog will track the latest and ongoing developments on both the global reference ET (ETo) reanalysis and the global Evaporative Demand Drought Index (EDDI) service developed from it.

Figure: Global 1-month EDDI for July 31, 2017.  

 

February 7, 2018

Entire ETo reanalysis re-run to correct for net longwave radiation, to January 31, 2017.