ECMWF | Reading | 14-16 October 2019
Workshop description
ECMWF's research and operational activities are computationally expensive and constantly need to scale further with new requirements and challenges. There is a high demand for the use of new mechanisms for sharing code, data, environments and making the scientific workflow more reproducible and flexible to move to new platforms. For example, for the upcoming move to ECMWF's new data centre in Bologna, Italy, we would like to explore new and robust technologies to develop reproducible workflows and how cloud computing could benefit from them.
Presentations and recordings
Monday 14 October 2019
Welcome and introduction |
||
Reproducible workflows - Setting the scene |
||
Responding to reproducibility challenges from physics to social sciences |
||
The important role of versioning your code |
||
Reproducibility and workflows with the Integrated Forecasting System |
||
Versioning and tracking changes of vector data |
||
Leveraging OGC standards to boost reproducibility |
||
Challenges and needs of reproducible workflows of Open Big Weather and Climate data |
||
The Copernicus Climate Data Store: ECMWF’s approach to providing online access to climate data and tools |
||
Standardised data representation - power of reproducible work-flow |
||
ECMWF Data Governance |
Tuesday 15 October 2019
Recap from day 1 and remarks |
n/a |
|
Scaling Reproducible Research with Project Jupyter |
||
Automated production of high value air quality forecasts with Pangeo, Papermill and Krontab |
||
Jupyter for Reproducible Science at Photon and Neutron Facilities |
||
Design of a Generic Workflow Generator for the JEDI Data Assimilation System |
||
Building robust and reproducible workflows with Cylc and Rose |
||
Workflow in CESM2 |
||
Reproducible science at large scale within a continuous delivery pipeline: the BSC vision |
||
Space Situational Awareness - Virtual Search Environment |
||
CMIP6 post-processing workflow at the Met Office |
||
Reproducible workflows for big data with Python |
||
Using containers for reproducible results |