NL-169-Banner-image

IFS upgrade improves moist physics and use of satellite observations

Richard Forbes, Patrick Laloyaux, Mark Rodwell

 

On 12 October, ECMWF implemented the second upgrade of its Integrated Forecasting System (IFS) in 2021. IFS Cycle 47r3 includes numerous changes to the forecast model, observation usage and data assimilation system, with contributions from many teams across the Centre. There are major developments to the representation of moist physics in the model and increased observation usage in cloudy regions in the assimilation. The upgrade improves the largescale atmospheric circulation and reduces tropical cyclone track errors in both high-resolution (HRES) and ensemble (ENS) forecasts. Several forecast products are modified, such as visibility and wind gusts, and new products are introduced, including clear-air turbulence.

Data assimilation and observation usage

AMSU-A microwave temperature sounding observations in clear-sky conditions have been some of the most powerful observations assimilated into the IFS. Continuing our successful long-term strategy of an all-sky exploitation of satellite radiance observations, AMSU-A data are now assimilated in all-sky conditions (in clear, cloudy, and rainy situations). The increased data usage in cloudy regions leads to an improved fit to independent satellite and conventional observations, and an improvement in forecast scores. The filling of data gaps in cloudy regions is very clear in the case of tropical cyclone Humberto (Figure 1). Not only is coverage improved in the immediate vicinity of Humberto (indicated by the white circle) but also in the surrounding region, which is likely to be important for influencing its subsequent track (indicated by black crosses). Including AMSU-A in the all-sky assimilation is a major step towards an all-sky use of all passive microwave observations. With 47r3, the only passive microwave instrument assimilated in just clear-sky conditions will be ATMS, which is expected to be moved to all-sky assimilation shortly.

FIGURE 1
%3Cstrong%3EFIGURE%201%3C/strong%3E%20First-guess%20departures%20for%20(a)%20all-sky%20and%20(b)%20clear-sky%20channel%205%20observations%20assimilated%20during%20the%2012-hour%20long%20window%20starting%20at%2000%20UTC%20on%2015%20September%202019.%20The%20National%20Hurricane%20Center%20(NHC)%20best%20track%20locations%20at%2000%20UTC%20over%20the%20life%20of%20Humberto%20are%20given%20by%20a%20black%20X,%20with%20a%20white%20circle%20showing%20the%20hurricane%20location%20at%2000%20UTC%20on%2015%20September%202019,%20just%20east%20of%20Florida.%20Data%20from%20all%20AMSU-A%20platforms%20are%20shown%20together.%20Departures%20are%20normalised%20by%20the%20assigned%20observation%20errors.
FIGURE 1 First-guess departures for (a) all-sky and (b) clear-sky channel 5 observations assimilated during the 12-hour long window starting at 00 UTC on 15 September 2019. The National Hurricane Center (NHC) best track locations at 00 UTC over the life of Humberto are given by a black X, with a white circle showing the hurricane location at 00 UTC on 15 September 2019, just east of Florida. Data from all AMSU-A platforms are shown together. Departures are normalised by the assigned observation errors.

Radiative transfer ‘RTTOV’ calculations for hyperspectral infrared sounders now benefit from improved accuracy in the underlying line-by-line spectroscopy calculations, a finer vertical grid and more realistic CO2 concentrations. Assimilation experiments show that the new RTTOV (version 13.0) significantly improves the simulation of these observations and, as a result, the performance of the data assimilation system.

The assimilation of AIRS data now benefits from an updated observation error covariance matrix, including error correlations, bringing the use of AIRS in line with that of other hyperspectral infrared (IR) instruments.

Diagnostics highlighted a probable misassignment of the heights for some low-level Atmospheric Motion Vector (AMV) observations. In a new approach, low-level AMVs placed above model clouds are now reassigned to the level at the average pressure of the model cloud layer (Lean & Bormann, 2021). This has been found to give the best results compared to simply screening out affected AMVs or using the model cloud top or base when considering departure statistics and forecast skill. The change was also supported by independent wind profile observations from the Aeolus satellite. With this change, the AMV assimilation is expected to benefit from improvements in our cloud modelling, as well as from improvements in the height assignment provided by AMV producers.

Weak-constraint 4D-Var (WC-4DVar) has been implemented in the Ensemble of Data Assimilations (EDA) system, where the stratospheric temperature bias is corrected independently for each ensemble member. The reduction in the mean background and analysis errors is comparable to the impact obtained in the HRES analysis when WC-4DVar was introduced in Cycle 47r1, reducing the stratospheric temperature bias by up to 50%.

The European Space Agency’s Doppler Wind Lidar Earth Explorer mission, Aeolus, is an important source of wind observations in clear and cloudy skies from the molecular (Rayleigh) and particle (Mie) channels. The impact of the Mie-cloudy winds is improved in Cycle 47r3 using an updated observation error assignment model, which accounts for representativeness error.

A package of mainly observation-related changes in the assimilation code includes the important introduction of NO2 observations from the TROPOMI instrument on board the Copernicus Sentinel‑5P satellite, using new NOx code for the simplified chemistry in the tangentlinear and adjoint models.

Forecast model

The major revision to the physics in Cycle 47r3 (Figure 2) improves the physical and numerical basis for parametrized processes in the model associated with boundary layer turbulence, convection, subgrid saturation adjustment and cloud and precipitation microphysics. Their complicated interactions are described more simply, efficiently, consistently and scale-independently. The developments are a culmination of work spanning several years and are part of a long-term development of the moist physics in the IFS in preparation for the transition to higher horizontal resolutions (3–5 km) in future operations. The main changes are summarised here, and further details can be found in Bechtold et al. (2020).

FIGURE 2
%3Cstrong%3EFIGURE%202%3C/strong%3E%20Schematic%20highlighting%20many%20of%20the%20turbulence,%20cloud%20and%20convection%20processes%20that%20have%20been%20modified%20in%20the%20moist%20physics%20upgrade%20in%20IFS%20Cycle%2047r3.
FIGURE 2 Schematic highlighting many of the turbulence, cloud and convection processes that have been modified in the moist physics upgrade in IFS Cycle 47r3.

  • In the revised turbulence scheme, the methods of determining a clear or cloudy mixed layer and the heights of the mixed layer and cloud base are now consistent with those in the convection scheme. The calculation of the strength of the inversion at the top of the mixed layer has been revised, and the saturation adjustment process from the turbulent mixing that was previously treated with a separate statistical cloud scheme is now treated more consistently with the prognostic cloud scheme.
  • The formulation of the saturation adjustment (condensation/evaporation) process for partially cloudy grid boxes was revised and simplified with the removal of a first-guess adjustment before the convection scheme and more consistent assumptions for ice supersaturation in the clear-air part of the grid box. This affects cloud cover with a higher occurrence of fully cloudy grid boxes. The simplifications to the saturation adjustment facilitate future development of the moist physics processes and interactions.
  • A stronger coupling of the convection parametrization with the dynamics, through total advective moisture convergence in the convective instability calculations, helps to improve the representation of mesoscale convective systems and their propagation, on average, at both current and future operational resolutions (Becker et al.). There are other impacts on the precipitation that are discussed in the next section.
  • There are changes to the cloud vertical overlap parametrization used in the radiation scheme and total/high/medium/low cloud cover products. The overlap of two separated cloud layers was previously dependent on the exponential of separation distance but is now changed to random overlap, in agreement with observations. Overlap for model levels within a contiguous cloud are still treated with the exponential of separation approach. This generally acts to increase cloud cover, which is also modified by changes to the cloud edge turbulent erosion, subsidence evaporation and saturation adjustment.
  • The semi-Lagrangian departure point interpolation is changed from linear to cubic for the advection of the cloud liquid, cloud ice, rain and snow prognostic variables to be consistent with the humidity and cloud fraction variables. A 3D quasi-monotone limiter is activated to avoid overshoots and negative values. The higher order interpolation leads to less numerical smoothing and smaller-scale structure of cloud and precipitation fields in the forecast.
  • There are updates to the ensemble Stochastically Perturbed Parametrization Tendencies (SPPT) scheme to reduce the upper-tropospheric tropical temperature warm bias that arises from the addition of stochastic perturbations.
  • The simplified moist physics formulation for the tangent-linear and adjoint model is an important part of the 4D variational assimilation system and has been updated in 47r3 to be more consistent with the revised physics parametrizations in the forecast model.

FIGURE 3
%3Cstrong%3EFIGURE%203%3C/strong%3E%20HRES%20scorecard%20of%20IFS%20Cycle%2047r3%20versus%20IFS%20Cycle%2047r2,%20verified%20by%20the%20respective%20analyses%20and%20observations%20at%2000%20and%2012%20UTC,%20based%20on%20about%20650%20forecast%20runs%20for%20the%20period%20June%E2%80%93August%202020%20and%20December%202020%E2%80%93August%202021.%20The%20HRES%20is%20run%20at%20TCo1279%20resolution,%20corresponding%20to%20a%20horizontal%20grid%20spacing%20of%20about%209%20km,%20and%20with%20137%20levels.
FIGURE 3 HRES scorecard of IFS Cycle 47r3 versus IFS Cycle 47r2, verified by the respective analyses and observations at 00 and 12 UTC, based on about 650 forecast runs for the period June–August 2020 and December 2020–August 2021. The HRES is run at TCo1279 resolution, corresponding to a horizontal grid spacing of about 9 km, and with 137 levels.

Impact on medium- and extended-range forecasts

The changes in Cycle 47r3 have been extensively tested across the different resolutions and configurations of the IFS at medium-range, extended-range and seasonal timescales. The extended-range ensemble was evaluated with forecasts initialised at the start of each month for the period 1989–2016. Case studies at the higher horizontal resolution of 4 km were also conducted to assess the impacts on future operational upgrades.

Figures 3 and 4 show medium-range scorecards for Cycle 47r3 relative to own analysis and observations, for the HRES and ENS, respectively (interactive scorecards are available from the 47r3 implementation web page: https://confluence.ecmwf.int/display/FCST/Implementation+of+IFS+Cycle+47r3). There are many positive impacts of the Cycle, particularly on upper-air scores and tropical cyclone tracks. There are also some deteriorations, and both are discussed below.

FIGURE 4
%3Cstrong%3EFIGURE%204%3C/strong%3E%20ENS%20scorecard%20of%20IFS%20Cycle%2047r3%20versus%20IFS%20Cycle%2047r2%20for%20medium-range%20forecasts%20up%20to%20forecast%20day%2015,%20verified%20by%20the%20respective%20analyses%20and%20observations%20at%2000%20UTC%20based%20on%20about%20305%20ENS%20forecast%20runs%20for%20the%20period%20June%E2%80%93August%202020%20and%20December%202020%E2%80%93%20August%202021.%20The%20ENS%20is%20run%20at%20TCo639,%20corresponding%20to%20a%20horizontal%20grid%20spacing%20of%20about%2018%20km,%20and%20with%20137%20levels.
FIGURE 4 ENS scorecard of IFS Cycle 47r3 versus IFS Cycle 47r2 for medium-range forecasts up to forecast day 15, verified by the respective analyses and observations at 00 UTC based on about 305 ENS forecast runs for the period June–August 2020 and December 2020– August 2021. The ENS is run at TCo639, corresponding to a horizontal grid spacing of about 18 km, and with 137 levels.

Upper-air geopotential and wind in the first few days of the forecast are significantly improved (Figure 5), by up to a few per cent for the northern hemisphere 500 hPa geopotential anomaly correlation, reducing with lead time. Upper-air winds are particularly improved in the tropics throughout the medium range, by up to 7%, reducing with lead time. Tropical upper-air temperatures are improved in HRES but degraded in the ENS from a small (~0.2 K) increase in bias due to a warming by the stochastic perturbations (partly mitigated by the SPPT changes mentioned above). Low level temperatures (including 850 hPa and 2 m temperature) are approximately neutral versus observations but degraded versus analyses in the subsidence regions over subtropical oceans, where the temperature at 850 hPa is very sensitive to small changes in boundary layer height.

FIGURE 5
%3Cstrong%3EFIGURE%205%3C/strong%3E%20Zonal%20mean%20cross-sections%20of%20normalised%20difference%20in%20HRES%20between%20Cycle%2047r3%20and%2047r2%20of%20(a)%20geopotential%20anomaly%20correlation%20at%20forecast%20day%202,%20(b)%20the%20same%20at%20forecast%20day%205,%20(c)%20vector%20wind%20root-mean-square%20(RMS)%20error%20at%20forecast%20day%202%20and%20(d)%20the%20same%20at%20forecast%20day%205.%20Positive%20values%20in%20(a)%20and%20(b)%20show%20improved%20anomaly%20correlation%20and%20negative%20values%20in%20(c)%20and%20(d)%20show%20reduced%20RMS%20error.%20Results%20are%20based%20on%20the%20period%20from%20June%20to%20August%202020%20and%20December%202020%20to%20April%202021.%20Hatched%20regions%20indicate%20statistical%20significance.
FIGURE 5 Zonal mean cross-sections of normalised difference in HRES between Cycle 47r3 and 47r2 of (a) geopotential anomaly correlation at forecast day 2, (b) the same at forecast day 5, (c) vector wind root-mean-square (RMS) error at forecast day 2 and (d) the same at forecast day 5. Positive values in (a) and (b) show improved anomaly correlation and negative values in (c) and (d) show reduced RMS error. Results are based on the period from June to August 2020 and December 2020 to April 2021. Hatched regions indicate statistical significance.

For tropical cyclones, there is a 10% improvement in the track location errors in both HRES and in the ensemble mean of ENS (Figure 6) from forecast days 2 to 5, due to a combination of the additional observations assimilated in cloudy regions and model changes which improve the steering flow. With little change in spread, this results in an improvement in the statistical reliability of the tracks. The tropical cyclone central pressure is shallower on average by 2–3 hPa in Cycle 47r3. The difference can be greater than this in the rapidly deepening phase, with Cycle 47r2 closer to the ‘best-track’ central pressure data (reported by the official global monitoring centres), but of opposite sign in the later stages, where Cycle 47r3 is closer to the ‘best-track’ data. Tests at a higher resolution (4 km) show generally deeper tropical cyclones in both model versions, but Cycle 47r2 more frequently over-deepens, whereas Cycle 47r3 at 4 km resolution is in overall closer agreement with best-track central pressure values. The physics of Cycle 47r3 thus better prepares the IFS for future increases in horizontal resolution.

FIGURE 6
%3Cstrong%3EFIGURE%206%3C/strong%3E%20The%20charts%20show%20(a)%20root-mean-square%20(RMS)%20location%20errors%20(solid%20lines)%20in%20the%20ensemble%20mean%20of%20tropical%20cyclone%20positions%20in%20Cycle%2047r2%20(blue)%20and%2047r3%20(red),%20along%20with%20the%20standard%20deviation%20(%E2%80%98spread%E2%80%99,%20dashed%20lines)%20among%20ensemble%20members,%20and%20(b)%20the%20normalised%20difference%20in%20ensemble%20mean%20location%20error%20between%20Cycles%2047r2%20and%2047r3%20(positive%20values%20indicate%20improved%20position%20in%2047r3).%20Results%20are%20based%20on%20all%20TC%20basins%20for%20the%20period%20from%202%20December%202020%20to%2030%20August%202021.%20The%20dashed%20grey%20line%20in%20the%20left-hand%20panel%20and%20the%20right-hand%20side%20scale%20indicate%20the%20number%20of%20tropical%20cyclones%20which%20could%20be%20evaluated%20at%20each%20lead%20time.%20The%20bars%20indicate%2095%25%20confidence%20intervals.
FIGURE 6 The charts show (a) root-mean-square (RMS) location errors (solid lines) in the ensemble mean of tropical cyclone positions in Cycle 47r2 (blue) and 47r3 (red), along with the standard deviation (‘spread’, dashed lines) among ensemble members, and (b) the normalised difference in ensemble mean location error between Cycles 47r2 and 47r3 (positive values indicate improved position in 47r3). Results are based on all TC basins for the period from 2 December 2020 to 30 August 2021. The dashed grey line in the left-hand panel and the right-hand side scale indicate the number of tropical cyclones which could be evaluated at each lead time. The bars indicate 95% confidence intervals.

The impact on near-surface parameters is more mixed. There is a small improvement in 2 m temperature in the extratropics, but a small degradation in the tropics. Two-metre dew point and 10 m wind also show small deteriorations. A 3% increase in bias of total cloud cover as well as an increase in small scale variability and more binary (0/1) cloud cover leads to a degradation in the calculated scores. With such a major physics change, it is inevitable that there are some degradations, and these will be investigated further for later IFS cycles.

A key focus for the moist physics upgrade is precipitation. There are significant changes in the characteristics of precipitation, including enhanced fine-scale structures, reduced areal coverage and higher peak precipitation rates. The PDF (probability density function) of precipitation rate is improved, with reduced occurrence of light precipitation rates and increased occurrence of high precipitation rates in convective regimes, but similar precipitation accumulations overall. This is particularly evident over continental regions such as the USA and Africa, in better agreement with radar and satellite-based precipitation estimates. Along the intertropical convergence zone (ITCZ) there are reductions in the number of overactive quasi-stationary precipitation cells, which has been a longstanding problem in the IFS. The relative change in the 99th percentile for precipitation in the model climate at day 2 shows this reduction along the ITCZ (Figure 7). The figure also shows increased convective precipitation in semi-arid regions, for example reducing the dry bias around the Mediterranean in summer, but little change in the statistics of extreme precipitation accumulations in the rest of the extratropics.

FIGURE 7
%3Cstrong%3EFIGURE%207%3C/strong%3E%20Relative%20difference%20in%20the%2099th%20percentile%20of%20day-2%20precipitation%20between%20Cycle%2047r3%20and%20Cycle%2047r2%20model%20climates%20from%2011-member%20ensemble%20re-forecasts%20over%20the%20last%2020%20years,%20initialised%20at%2000%20UTC%20on%2029%20July,%20highlighting%20the%20changes%20in%20locally%20extreme%20precipitation.%20Regions%20where%20the%2099th%20percentile%20is%20zero%20in%20both%20model%20climates%20are%20shaded%20grey.
FIGURE 7 Relative difference in the 99th percentile of day-2 precipitation between Cycle 47r3 and Cycle 47r2 model climates from 11-member ensemble re-forecasts over the last 20 years, initialised at 00 UTC on 29 July, highlighting the changes in locally extreme precipitation. Regions where the 99th percentile is zero in both model climates are shaded grey.

The overall precipitation scores show some positive signals. For tropical precipitation, the HRES shows improvements of 1–2% in the deterministic SEEPS (stable equitable error in probability space) score, and the ENS shows improvements of about 0.6% in the fair CRPS (continuous ranked probability score). In the extratropics, the HRES impact is generally neutral while the ENS again shows improvements.

For the extended range, the impact of the physics changes on full-resolution ensemble re-forecasts includes a general increase in spread of a few per cent, particularly in the tropics. Although there are some increases in bias (for example 850 hPa temperature), consistent with the medium range, the impact on bias-corrected scores is approximately neutral (slightly positive in the tropics). The forecast skill of the Madden–Julian Oscillation (MJO) is slightly improved. The overall increase in spread of the MJO index leads to a slight over-dispersion, especially from the 850 hPa zonal wind component of the index. However, the MJO amplitude is increased for lead times greater than five days, reducing amplitude bias (e.g. from –15% to –10% at day 10) and eastward phase bias. There is no significant impact on the frequencies of Euro-Atlantic regimes.

New and revised products

Cycle 47r3 also includes a revision of several forecast products, including an improved calculation of (i) visibility, reducing biases in fog, rain and snow, (ii) wind gusts, reducing an overestimate, (iii) precipitation-type, improving the diagnosis of ice pellets and freezing rain, and (iv) the peak wave period for ocean waves when there are multiple peaks. There are also several new forecast products requested by Member States, including ‘MUCAPE’ (most-unstable convective available potential energy) now using virtual potential temperature, two new variants of mixed-layer CIN (convective inhibition) and CAPE, and a clear air turbulence (CAT) diagnostic (Bechtold et al., 2021).

Summary

Cycle 47r3 brings a major revision to the representation of moist physics in the IFS as well as improvements in the assimilation of observations and increased usage of satellite data in cloudy regions through the extension of the ‘all sky’ approach.

An important impact on the forecast is the improvement of the atmospheric circulation, as seen in the increase in skill of extratropical geopotential heights and winds, and with a reduction in wind errors in the tropics of several per cent. The ensemble-mean of error in tropical cyclone position is reduced by 10% between forecast days 2 and 5. There are changes to the character of precipitation, with improvements in the precipitation PDF and in strongly forced convective systems. As well as the many positive signals, a significant change in the physics inevitably leads to some deteriorations, for example in total cloud cover, and these will be addressed in future IFS cycles. There are several new forecast products, such as clear-air turbulence, and improvements to existing products, including visibility and wind gusts.

Overall, the package of changes in Cycle 47r3 is an important step in the development of the IFS, improving performance overall, extending our use of existing observations and providing a stronger foundation for further development of the model and data assimilation at current and higher resolutions.

 


Further reading

Bechtold, P., R. Forbes, I. Sandu, S. Lang & M. Ahlgrimm, 2020: A major moist physics upgrade for the IFS, ECMWF Newsletter No. 164, 24–32.

Bechtold, P., M. Bramberger, A. Dörnbrack, M. Leutbecher & L. Isaksen, 2021: Forecasting clear-air turbulence, ECMWF Newsletter No. 168, 32–37.

Becker, T., P. Bechtold & I. Sandu: Characteristics of convective precipitation over tropical Africa in storm-resolving global simulations, Quarterly Journal of the Royal Meteorological Society, accepted.

Duncan, D., N. Bormann, A. Geer, & P. Weston, 2021: Assimilation of AMSU-A in all-sky conditions. EUMETSAT/ ECMWF Fellowship Programme Research Report No. 57.

Lean, K. & N. Bormann, 2021: Using model cloud information to reassign low level AMVs for NWP. EUMETSAT/ECMWF Fellowship Programme Research Report No. 56.