Differences between revisions 2 and 30 (spanning 28 versions)
Revision 2 as of 2014-01-09 18:44:33
Size: 2648
Editor: anonymous
Comment:
Revision 30 as of 2014-02-02 14:37:40
Size: 8276
Editor: anonymous
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
#acl AdminGroup:read,write,delete,revert EditorGroup:read,write StudentGroup:read,write #acl AdminGroup:read,write,delete,revert EditorGroup:read,write  All:read
Line 5: Line 5:
Line 8: Line 7:
= 63-953 Climate and Satellite Data Analysis  = = 63-953 Climate and Satellite Data Analysis =
Line 10: Line 9:
MS Integrated Climate System Sciences

Date: 3.2.2014-7.2.2014

Place: Geom 1536c 
'''Lars Kaleschke, Alexander Loew''' MS Integrated Climate System Sciences; Date: 3.2.2014-7.2.2014; Place: Geom 1536c
Line 18: Line 13:
The participants will learn to practically work with climate model, reanalysis, in-situ station and satellite data. Organized as a group project, the participants will further learn the principles of project management and shared software development.  The participants will learn to practically work with climate model, reanalysis, in-situ station and satellite data. Organized as a group project, the participants will further learn the principles of project management and shared software development.
Line 21: Line 16:
=== Monday ===
=== Monday, 10:00 ===
Line 25: Line 19:
 * [[/PM|Project management and documentation]]   * [[Climate_and_Satellite_Data_Analysis_2014/PM|Project management and documentation]]
Line 27: Line 21:
 * [[DataIO|Access to data sets]]
 * [[/Plotting|Plotting]] [[attachment:Seawater plot.ipynb]]
 * [[GenMaps|Data Visualization: Generating maps]]
 * [[http://ipython.org/ipython-doc/dev/interactive/htmlnotebook.html|IPython Notebooks]] [[https://github.com/ipython/ipython/wiki/A-gallery-of-interesting-IPython-Notebooks|Gallery of interesting IPython Notebooks]]
 * [[attachment:Stochastic analysis of time series.ipynb]] [[attachment:Monte carlo.ipynb]] [[attachment:GISSTEMP netcdf.ipynb]] [[attachment:datetimeobjects.ipynb]] [[attachment:Station data seasonal cycle.ipynb]]

[[/Projects2014 | Projects descriptions]]
 * [[DataIO|Access to data sets]]
 * [[GenMaps|Data Visualization: Generating maps]]
 
Line 42: Line 31:

Morning: Group presentations of project plan and preliminary analysis.

Afternoon: implementation and project work
Morning: Group presentations of project plan and preliminary analysis; Afternoon: implementation and project work
Line 48: Line 33:

Project work
Morning: Group presentations of methods and code implementations; Afternoon: Project work
Line 52: Line 36:

Presentation of results and discussion
Morning: Group presentations of preliminary results; Afternoon: Project work
Line 56: Line 39:
Morning: final presenation of results and discussion; Afternoon: evaluation and preparation of final report
Line 57: Line 41:
Further analysis and preparation of final report = Topics for group work =
Line 59: Line 43:
The major topic of this course will deal with data gaps in climate and satellite records and their implications for the calculation of global statistics. The overall objectives of the course are:
Line 60: Line 45:
 * raise awareness on the problem with data gaps in climate records
 * learn about methods for coping with data gaps
 * assess the effect of data gaps on statistics of climate related datasets
 * learn processing of data using a variety of methods
Line 61: Line 50:
== Topics for group work ==
  
= Project groups =
Another major objective of this course is to train the so called soft-skills in practice, like

 * project management (planning ... final report)
 * joint code development
 * reporting

== Has the Earth stopped warming? ==

=== Coverage bias in the HadCRUT4 temperature series and its impact on recent temperature trends ===
{{attachment:media_summary.png}}

Kevin Cowtan and Robert Way published [[http://onlinelibrary.wiley.com/doi/10.1002/qj.2297/abstract | a paper]] which was quite controverily discussed in the scientific community. They fill gaps of the HadCRUT temperature data set by using satellite data. By filleing this (well known) Arctic gap and compare their new reconstruction of surface temperature data to independent in-situ observations and reanalysis data they show that the global mean temperature hiatus is not observable any more.

Cowtan and Way (2013) methods and data are freely available and we will use them in the course:

 * http://onlinelibrary.wiley.com/doi/10.1002/qj.2297/abstract
 * http://www-users.york.ac.uk/~kdc3/papers/coverage2013/methods.html

In situ measurements of surface temperatures are available from the International Arctic Buoy Programme (IABP) website:

 * http://iabp.apl.washington.edu/data_satemp.html

=== Project A: Cowtan and Way (CW2013) reconstruction ===

 * Review methods of Cowtan and Way (2013) and give a summary of their approach
 * Analyse their reconstructed dataset of surface air temperature in terms of different parameters (global mean and stdv, seasonal cycle, anomalies, trends etc.)
  * is the dataset homogeneous in time or can you observe temporal inconsistencies?
  * how robust are trends estimated from this data record? What is the role of the length of the timeperiod?
 * do the same analysis for the original HadCRU temperature dataset (and possibly also for other datasets, like reanalysis (cross-check with Project C !))
  * are results different? are they significantly different?
 * Look at correlations with climate indices, e.g. ENSO, NAO, PDO
 * Present all results in proper form (maps, statistics ...)
Line 67: Line 85:
=== Project B: Spatial Correlations of Surface Air Temperature Observations in the Arctic ===

Main research question: over what distances are surface temperatures correlated?

 * Review methods of Rigor et al. (2000)
 * Analyse the surface air temperature (monthly mean gridded products) measured by the drift buoys
    * Calculate seasonal cycle, anomalies, and linear trends
    * Estimate the (radial) spatial (auto)correlation of surface temperature anomalies
 * Present all results in proper form (timeseries, maps, statistics ...)

[[http://iabp.apl.washington.edu/AirT/RigorEtal-SAT.pdf|Rigor, I., R. Colony, and S. Martin, 2000, Variations in Surface Air Temperature Observations in the Arctic, 1979 - 1997, J. Climate, Vol. 13, no 5, 896-914.]]
 
Line 68: Line 98:

=== Project C: Data Intercomparison ===

Comparison and validation - how do we know the ground truth?

 * Compare HADCRUT4, HADCRUT4 hybrid (CW2013), IABP Arctic surface air temperature measurements, and reanalysis data
 * Was the data gap in the Arctic filled in reasonably?
 * Are there relative biases or jumps in the data?
 * What is the air temperature over a melting sea ice surface during Summer?
 * Can you judge which data are most reliable? Discuss!
 * Present all results in proper form (timeseries, maps, statistics ...)

Lüpkes, C., Vihma, T., Jakobson, E., König-Langlo, G., and Tetzlaff, A.: Meteorological observations from ship cruises during summer to the Central Arctic: A comparison with reanalysis data, Geophys. Res. Lett., 27, L09810, doi:10.1029/2010GL042724, 2010.
Line 71: Line 115:
== Project D: HOAPS ocean flux sampling bias ==

The Meteorological Institute of the University of Hamburg and the Max-Planck-Institute for Meteorology have compiled a climate data record of ocean surface fluxes. This so called [[http://www.hoaps.org|HOAPS climatology]] has been sucessfully applied in numerous studies and is one of a very few global records on ocean surface fluxes. HOAPS is uniquely built based on satellite data.

Major references for HOAPS can be found on the [[http://www.hoaps.org | project website]]. Details of the algorithms and data processing are provided in [[http://www.earth-syst-sci-data.net/2/215/2010/ | Andersson et al. (2010)]] and [[http://journals.ametsoc.org/doi/abs/10.1175/2010JAMC2341.1 | Andersson et al (2011)]].

The HOAPS dataset is based on sampling twice a day, which is due to the overpass time of the satellites used to generate the product.

The project shall address the following research questions:

* What is the impact of undersampling the diurnal cycle?
 * are biases introduced in e.g. monthly means?
 * what is the impact of sea ice gaps on monthly means?
* What is the effec of different land/sea masks and spatial grids (resolution, projections) on total mean global fluxes?
 * do total mean global numbers change? If so, by how much?
 * how do global mean flux estimats from HOAPS compare to other datasets available?
* How are HOAPS surface fluxes related to climate indices like e.g. NAO, PDO, ENSO ... ?
 * as a starting point the paper from [[http://tellusa.net/index.php/tellusa/article/view/15710 | Andersson et al (2010) ]] might be usefull
 * develop appropriate metrices (e.g. different correlation approaches, EOF) for comparing HOAPS surface fluxes with climate indices


[[/ProjectD]]
Line 74: Line 140:

 * prepare [[ftp://ftp.ifremer.fr/ifremer/cersat/products/gridded/psi-concentration/data/|sea ice data]] (Lars) :-) (CMIP5 data available)
 * prepare CMIP5 data (Alex) :-)
 * CW2013 :-)
Line 79: Line 143:
 * Stations :-)  * Bouy data :-)
 * HOAPS data :-)
Line 82: Line 147:
Line 87: Line 151:
 * Methods and data   * Methods and data
Line 90: Line 154:
 * Conlcusion  * Conclusion
Line 93: Line 157:
Line 96: Line 159:

= Examples from the past =

== How significant are observations of Arctic temperature trends? ==

 * https://wiki.zmaw.de/lehre/Climate_and_Satellite_Data_Analysis_2013/ProjectA

63-953 Climate and Satellite Data Analysis

Lars Kaleschke, Alexander Loew MS Integrated Climate System Sciences; Date: 3.2.2014-7.2.2014; Place: Geom 1536c

Course objectives

The participants will learn to practically work with climate model, reanalysis, in-situ station and satellite data. Organized as a group project, the participants will further learn the principles of project management and shared software development.

Schedule

Monday, 10:00

General Introduction

Group work: develop a project plan and write a short technical proposal for your project.

Final report due by 15. March 2014

Obtain data and do preliminary analysis (e.g. data coverage).

Tuesday

Morning: Group presentations of project plan and preliminary analysis; Afternoon: implementation and project work

Wednesday

Morning: Group presentations of methods and code implementations; Afternoon: Project work

Thursday

Morning: Group presentations of preliminary results; Afternoon: Project work

Friday

Morning: final presenation of results and discussion; Afternoon: evaluation and preparation of final report

Topics for group work

The major topic of this course will deal with data gaps in climate and satellite records and their implications for the calculation of global statistics. The overall objectives of the course are:

  • raise awareness on the problem with data gaps in climate records
  • learn about methods for coping with data gaps
  • assess the effect of data gaps on statistics of climate related datasets
  • learn processing of data using a variety of methods

Another major objective of this course is to train the so called soft-skills in practice, like

  • project management (planning ... final report)
  • joint code development
  • reporting

Has the Earth stopped warming?

media_summary.png

Kevin Cowtan and Robert Way published a paper which was quite controverily discussed in the scientific community. They fill gaps of the HadCRUT temperature data set by using satellite data. By filleing this (well known) Arctic gap and compare their new reconstruction of surface temperature data to independent in-situ observations and reanalysis data they show that the global mean temperature hiatus is not observable any more.

Cowtan and Way (2013) methods and data are freely available and we will use them in the course:

In situ measurements of surface temperatures are available from the International Arctic Buoy Programme (IABP) website:

Project A: Cowtan and Way (CW2013) reconstruction

  • Review methods of Cowtan and Way (2013) and give a summary of their approach
  • Analyse their reconstructed dataset of surface air temperature in terms of different parameters (global mean and stdv, seasonal cycle, anomalies, trends etc.)
    • is the dataset homogeneous in time or can you observe temporal inconsistencies?
    • how robust are trends estimated from this data record? What is the role of the length of the timeperiod?
  • do the same analysis for the original HadCRU temperature dataset (and possibly also for other datasets, like reanalysis (cross-check with Project C !))
    • are results different? are they significantly different?
  • Look at correlations with climate indices, e.g. ENSO, NAO, PDO
  • Present all results in proper form (maps, statistics ...)

/ProjectA

Project B: Spatial Correlations of Surface Air Temperature Observations in the Arctic

Main research question: over what distances are surface temperatures correlated?

  • Review methods of Rigor et al. (2000)
  • Analyse the surface air temperature (monthly mean gridded products) measured by the drift buoys
    • Calculate seasonal cycle, anomalies, and linear trends
    • Estimate the (radial) spatial (auto)correlation of surface temperature anomalies
  • Present all results in proper form (timeseries, maps, statistics ...)

Rigor, I., R. Colony, and S. Martin, 2000, Variations in Surface Air Temperature Observations in the Arctic, 1979 - 1997, J. Climate, Vol. 13, no 5, 896-914.

/ProjectB

Project C: Data Intercomparison

Comparison and validation - how do we know the ground truth?

  • Compare HADCRUT4, HADCRUT4 hybrid (CW2013), IABP Arctic surface air temperature measurements, and reanalysis data
  • Was the data gap in the Arctic filled in reasonably?
  • Are there relative biases or jumps in the data?
  • What is the air temperature over a melting sea ice surface during Summer?
  • Can you judge which data are most reliable? Discuss!
  • Present all results in proper form (timeseries, maps, statistics ...)

Lüpkes, C., Vihma, T., Jakobson, E., König-Langlo, G., and Tetzlaff, A.: Meteorological observations from ship cruises during summer to the Central Arctic: A comparison with reanalysis data, Geophys. Res. Lett., 27, L09810, doi:10.1029/2010GL042724, 2010.

/ProjectC

Project D: HOAPS ocean flux sampling bias

The Meteorological Institute of the University of Hamburg and the Max-Planck-Institute for Meteorology have compiled a climate data record of ocean surface fluxes. This so called HOAPS climatology has been sucessfully applied in numerous studies and is one of a very few global records on ocean surface fluxes. HOAPS is uniquely built based on satellite data.

Major references for HOAPS can be found on the project website. Details of the algorithms and data processing are provided in Andersson et al. (2010) and Andersson et al (2011).

The HOAPS dataset is based on sampling twice a day, which is due to the overpass time of the satellites used to generate the product.

The project shall address the following research questions:

* What is the impact of undersampling the diurnal cycle?

  • are biases introduced in e.g. monthly means?
  • what is the impact of sea ice gaps on monthly means?

* What is the effec of different land/sea masks and spatial grids (resolution, projections) on total mean global fluxes?

  • do total mean global numbers change? If so, by how much?
  • how do global mean flux estimats from HOAPS compare to other datasets available?

* How are HOAPS surface fluxes related to climate indices like e.g. NAO, PDO, ENSO ... ?

  • as a starting point the paper from Andersson et al (2010) might be usefull

  • develop appropriate metrices (e.g. different correlation approaches, EOF) for comparing HOAPS surface fluxes with climate indices

/ProjectD

TODOs

Data

  • CW2013 :-)

  • ERA-Interim :-)

  • NCEP :-)

  • Bouy data :-)

  • HOAPS data :-)

Final report

Template structure:

  • Abstract
  • Introduction: state of the art (literature), statement of the problem
  • Methods and data
  • Results
  • Discussion
  • Conclusion

References

  • Python at KlimaCampus

  • Python Scripting for Computational Science, Hans Petter Langtangen, Springer (available in the ZMAW library)

Examples from the past

How significant are observations of Arctic temperature trends?

LehreWiki: Climate_and_Satellite_Data_Analysis_2014 (last edited 2014-02-05 09:14:16 by anonymous)