Differences between revisions 4 and 43 (spanning 39 versions)
Revision 4 as of 2014-01-09 18:57:18
Size: 2937
Editor: anonymous
Comment:
Revision 43 as of 2014-02-05 09:12:41
Size: 8894
Editor: anonymous
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
#acl AdminGroup:read,write,delete,revert EditorGroup:read,write StudentGroup:read,write #acl AdminGroup:read,write,delete,revert EditorGroup:read,write  All:read
Line 5: Line 5:
Line 8: Line 7:
= 63-953 Climate and Satellite Data Analysis  = = 63-953 Climate and Satellite Data Analysis =
Line 10: Line 9:
MS Integrated Climate System Sciences

Date: 3.2.2014-7.2.2014

Place: Geom 1536c 
'''Lars Kaleschke, Alexander Loew''' MS Integrated Climate System Sciences; Date: 3.2.2014-7.2.2014; Place: Geom 1536c
Line 18: Line 13:
The participants will learn to practically work with climate model, reanalysis, in-situ station and satellite data. Organized as a group project, the participants will further learn the principles of project management and shared software development.  The participants will learn to practically work with climate model, reanalysis, in-situ station and satellite data. Organized as a group project, the participants will further learn the principles of project management and shared software development.
Line 21: Line 16:
=== Monday ===
=== Monday, 10:00 ===
Line 25: Line 19:
 * [[/PM|Project management and documentation]]   * [[Climate_and_Satellite_Data_Analysis_2014/PM|Project management and documentation]]
Line 27: Line 21:
 * [[DataIO|Access to data sets]]
 * [[/Plotting|Plotting]] [[attachment:Seawater plot.ipynb]]
 * [[GenMaps|Data Visualization: Generating maps]]
 * [[http://ipython.org/ipython-doc/dev/interactive/htmlnotebook.html|IPython Notebooks]] [[https://github.com/ipython/ipython/wiki/A-gallery-of-interesting-IPython-Notebooks|Gallery of interesting IPython Notebooks]]
 * [[attachment:Stochastic analysis of time series.ipynb]] [[attachment:Monte carlo.ipynb]] [[attachment:GISSTEMP netcdf.ipynb]] [[attachment:datetimeobjects.ipynb]] [[attachment:Station data seasonal cycle.ipynb]]

 * [[DataIO|Access to data sets]]
 * [[GenMaps|Data Visualization: Generating maps]]
 
Line 41: Line 31:

Morning: Group presentations of project plan and preliminary analysis.
Afternoon: implementation and project work
Morning: Group presentations of project plan and preliminary analysis; Afternoon: implementation and project work
Line 46: Line 33:

Morning: Group presentations of methods and code implementations
Afternoon: Project work
Morning: Group presentations of methods and code implementations; Afternoon: Project work
Line 51: Line 36:

Morning: Group presentations of preliminary results
Afternoon: Project work
Morning: Project work, preparation of presentation; '''14:00-16:00 final presentation (B, A, C)''' of results and discussion, evaluation
Line 56: Line 39:

Morning: final presenation of results and discussion
Afternoon: evaluation and
preparation of final report  
Morning: project work, preparation of final report
Line 62: Line 42:
   == Coverage bias in the HadCRUT4 temperature series and its impact on recent temperature trends ==
The major topic of this course will deal with data gaps in climate and satellite records and their implications for the calculation of global statistics. The overall objectives of the course are:

 * raise awareness on the problem with data gaps in climate records
 * learn about methods for coping with data gaps
 * assess the effect of data gaps on statistics of climate related datasets
 * learn processing of data using a variety of methods

Another major objective of this course is to train the so called soft-skills in practice, like

 * project management (planning ... final report)
 * joint code development
 * reporting

== Has the Earth stopped warming? ==

=== Coverage bias in the HadCRUT4 temperature series and its impact on recent temperature trends ===
{{attachment:media_summary.png}}

Kevin Cowtan and Robert Way published [[http://onlinelibrary.wiley.com/doi/10.1002/qj.2297/abstract | a paper]] which was quite controverily discussed in the scientific community. They fill gaps of the HadCRUT temperature data set by using satellite data. By filling this (well known) Arctic gap and compare their new reconstruction of surface temperature data to independent in-situ observations and reanalysis data they show that the global mean temperature hiatus is not observable any more.

Cowtan and Way (2013) methods and data are freely available and we will use them in the course:
Line 66: Line 66:
 * http://www-users.york.ac.uk/~kdc3/papers/coverage2013/methods.html

Some further reading ...

 * [[http://www.nature.com/ngeo/journal/v7/n2/full/ngeo2078.html | Uncertain temperature trend]]
 * [[http://www.scilogs.de/klimalounge/erwaermung-unterschaetzt/?utm_source=rss&utm_medium=rss&utm_campaign=erwaermung-unterschaetzt | Erderwaermung unterschaetzt]]

In situ measurements of surface temperatures are available from the International Arctic Buoy Programme (IABP) website:

 * http://iabp.apl.washington.edu/data_satemp.html

=== Project A: Cowtan and Way (CW2013) reconstruction ===

 * Review methods of Cowtan and Way (2013) and give a summary of their approach
 * Analyse their reconstructed dataset of surface air temperature in terms of different parameters (global mean and stdv, seasonal cycle, anomalies, trends etc.)
  * is the dataset homogeneous in time or can you observe temporal inconsistencies?
  * how robust are trends estimated from this data record? What is the role of the length and starting point of the timeperiod?
 * [do the same analysis for the original HadCRU temperature dataset (and possibly also for other datasets, like reanalysis (cross-check with Project C !))]; this is optional and of lower priority
  * are results different? are they significantly different?
 * Look at correlations with climate indices, e.g. ENSO, NAO, PDO
 * Present all results in proper form (maps, statistics ...)
Line 69: Line 90:
== == === Project B: Spatial Correlations of Surface Air Temperature Observations in the Arctic ===
Line 71: Line 92:
Main research question: over what distances are surface temperatures correlated?

 * Review methods of Rigor et al. (2000)
 * Analyse the surface air temperature (monthly mean gridded products) measured by the drift buoys
    * Calculate seasonal cycle, anomalies, and linear trends
    * Estimate the (radial) spatial (auto)correlation of surface temperature anomalies
 * Present all results in proper form (timeseries, maps, statistics ...)

[[http://iabp.apl.washington.edu/AirT/RigorEtal-SAT.pdf|Rigor, I., R. Colony, and S. Martin, 2000, Variations in Surface Air Temperature Observations in the Arctic, 1979 - 1997, J. Climate, Vol. 13, no 5, 896-914.]]
 
Line 73: Line 104:
== == === Project C: Data Intercomparison ===

Comparison and validation - how do we know the ground truth?

 * Compare HADCRUT4, HADCRUT4 hybrid (CW2013), IABP Arctic surface air temperature measurements, and reanalysis data
 * Was the data gap in the Arctic filled in reasonably?
 * Are there relative biases or jumps in the data?
 * What is the air temperature over a melting sea ice surface during Summer?
 * Can you judge which data are most reliable? Discuss!
 * Present all results in proper form (timeseries, maps, statistics ...)

Lüpkes, C., Vihma, T., Jakobson, E., König-Langlo, G., and Tetzlaff, A.: Meteorological observations from ship cruises during summer to the Central Arctic: A comparison with reanalysis data, Geophys. Res. Lett., 27, L09810, doi:10.1029/2010GL042724, 2010.
Line 77: Line 120:
== Project D: HOAPS ocean flux sampling bias ==
Line 78: Line 122:
= TODOs =
== Data ==
The Meteorological Institute of the University of Hamburg and the Max-Planck-Institute for Meteorology have compiled a climate data record of ocean surface fluxes. This so called [[http://www.hoaps.org|HOAPS climatology]] has been sucessfully applied in numerous studies and is one of a very few global records on ocean surface fluxes. HOAPS is uniquely built based on satellite data.
Line 81: Line 124:
 * prepare [[ftp://ftp.ifremer.fr/ifremer/cersat/products/gridded/psi-concentration/data/|sea ice data]] (Lars) :-) (CMIP5 data available)
 * prepare CMIP5 data (Alex) :-)
 * ERA-Interim :-)
 * NCEP :-)
 * Stations :-)
Major references for HOAPS can be found on the [[http://www.hoaps.org | project website]]. Details of the algorithms and data processing are provided in [[http://www.earth-syst-sci-data.net/2/215/2010/ | Andersson et al. (2010)]] and [[http://journals.ametsoc.org/doi/abs/10.1175/2010JAMC2341.1 | Andersson et al (2011)]].
Line 87: Line 126:
== Final report == The HOAPS dataset is based on sampling twice a day, which is due to the overpass time of the satellites used to generate the product.

The project shall address the following research questions:

* What is the impact of undersampling the diurnal cycle?
 * are biases introduced in e.g. monthly means?
 * what is the impact of sea ice gaps on monthly means?
* What is the effec of different land/sea masks and spatial grids (resolution, projections) on total mean global fluxes?
 * do total mean global numbers change? If so, by how much?
 * how do global mean flux estimats from HOAPS compare to other datasets available?
* How are HOAPS surface fluxes related to climate indices like e.g. NAO, PDO, ENSO ... ?
 * as a starting point the paper from [[http://tellusa.net/index.php/tellusa/article/view/15710 | Andersson et al (2010) ]] might be usefull
 * develop appropriate metrices (e.g. different correlation approaches, EOF) for comparing HOAPS surface fluxes with climate indices


[[/ProjectD]]

= Extra support =

[[/IABP_Buoy_Data]]

= Final report =

== Group Report ==
Line 93: Line 155:
 * Methods and data   * Methods and data
Line 96: Line 158:
 * Conlcusion  * Conclusion
 * Disclaimer (individual contributions)
Line 98: Line 161:
== References == Please indicate the responsible authors for the different sections within the report!
Line 100: Line 163:
== Individual Reports ==

(1 page)

 * What have you learned during the course?
 * What was your individual contribution to the project and to the group report?

= Examples from the past =

== How significant are observations of Arctic temperature trends? ==

 * https://wiki.zmaw.de/lehre/Climate_and_Satellite_Data_Analysis_2013/ProjectA

= Python References =

63-953 Climate and Satellite Data Analysis

Lars Kaleschke, Alexander Loew MS Integrated Climate System Sciences; Date: 3.2.2014-7.2.2014; Place: Geom 1536c

Course objectives

The participants will learn to practically work with climate model, reanalysis, in-situ station and satellite data. Organized as a group project, the participants will further learn the principles of project management and shared software development.

Schedule

Monday, 10:00

General Introduction

Group work: develop a project plan and write a short technical proposal for your project.

Final report due by 15. March 2014

Obtain data and do preliminary analysis (e.g. data coverage).

Tuesday

Morning: Group presentations of project plan and preliminary analysis; Afternoon: implementation and project work

Wednesday

Morning: Group presentations of methods and code implementations; Afternoon: Project work

Thursday

Morning: Project work, preparation of presentation; 14:00-16:00 final presentation (B, A, C) of results and discussion, evaluation

Friday

Morning: project work, preparation of final report

Topics for group work

The major topic of this course will deal with data gaps in climate and satellite records and their implications for the calculation of global statistics. The overall objectives of the course are:

  • raise awareness on the problem with data gaps in climate records
  • learn about methods for coping with data gaps
  • assess the effect of data gaps on statistics of climate related datasets
  • learn processing of data using a variety of methods

Another major objective of this course is to train the so called soft-skills in practice, like

  • project management (planning ... final report)
  • joint code development
  • reporting

Has the Earth stopped warming?

media_summary.png

Kevin Cowtan and Robert Way published a paper which was quite controverily discussed in the scientific community. They fill gaps of the HadCRUT temperature data set by using satellite data. By filling this (well known) Arctic gap and compare their new reconstruction of surface temperature data to independent in-situ observations and reanalysis data they show that the global mean temperature hiatus is not observable any more.

Cowtan and Way (2013) methods and data are freely available and we will use them in the course:

Some further reading ...

In situ measurements of surface temperatures are available from the International Arctic Buoy Programme (IABP) website:

Project A: Cowtan and Way (CW2013) reconstruction

  • Review methods of Cowtan and Way (2013) and give a summary of their approach
  • Analyse their reconstructed dataset of surface air temperature in terms of different parameters (global mean and stdv, seasonal cycle, anomalies, trends etc.)
    • is the dataset homogeneous in time or can you observe temporal inconsistencies?
    • how robust are trends estimated from this data record? What is the role of the length and starting point of the timeperiod?
  • [do the same analysis for the original HadCRU temperature dataset (and possibly also for other datasets, like reanalysis (cross-check with Project C !))]; this is optional and of lower priority
    • are results different? are they significantly different?
  • Look at correlations with climate indices, e.g. ENSO, NAO, PDO
  • Present all results in proper form (maps, statistics ...)

/ProjectA

Project B: Spatial Correlations of Surface Air Temperature Observations in the Arctic

Main research question: over what distances are surface temperatures correlated?

  • Review methods of Rigor et al. (2000)
  • Analyse the surface air temperature (monthly mean gridded products) measured by the drift buoys
    • Calculate seasonal cycle, anomalies, and linear trends
    • Estimate the (radial) spatial (auto)correlation of surface temperature anomalies
  • Present all results in proper form (timeseries, maps, statistics ...)

Rigor, I., R. Colony, and S. Martin, 2000, Variations in Surface Air Temperature Observations in the Arctic, 1979 - 1997, J. Climate, Vol. 13, no 5, 896-914.

/ProjectB

Project C: Data Intercomparison

Comparison and validation - how do we know the ground truth?

  • Compare HADCRUT4, HADCRUT4 hybrid (CW2013), IABP Arctic surface air temperature measurements, and reanalysis data
  • Was the data gap in the Arctic filled in reasonably?
  • Are there relative biases or jumps in the data?
  • What is the air temperature over a melting sea ice surface during Summer?
  • Can you judge which data are most reliable? Discuss!
  • Present all results in proper form (timeseries, maps, statistics ...)

Lüpkes, C., Vihma, T., Jakobson, E., König-Langlo, G., and Tetzlaff, A.: Meteorological observations from ship cruises during summer to the Central Arctic: A comparison with reanalysis data, Geophys. Res. Lett., 27, L09810, doi:10.1029/2010GL042724, 2010.

/ProjectC

Project D: HOAPS ocean flux sampling bias

The Meteorological Institute of the University of Hamburg and the Max-Planck-Institute for Meteorology have compiled a climate data record of ocean surface fluxes. This so called HOAPS climatology has been sucessfully applied in numerous studies and is one of a very few global records on ocean surface fluxes. HOAPS is uniquely built based on satellite data.

Major references for HOAPS can be found on the project website. Details of the algorithms and data processing are provided in Andersson et al. (2010) and Andersson et al (2011).

The HOAPS dataset is based on sampling twice a day, which is due to the overpass time of the satellites used to generate the product.

The project shall address the following research questions:

* What is the impact of undersampling the diurnal cycle?

  • are biases introduced in e.g. monthly means?
  • what is the impact of sea ice gaps on monthly means?

* What is the effec of different land/sea masks and spatial grids (resolution, projections) on total mean global fluxes?

  • do total mean global numbers change? If so, by how much?
  • how do global mean flux estimats from HOAPS compare to other datasets available?

* How are HOAPS surface fluxes related to climate indices like e.g. NAO, PDO, ENSO ... ?

  • as a starting point the paper from Andersson et al (2010) might be usefull

  • develop appropriate metrices (e.g. different correlation approaches, EOF) for comparing HOAPS surface fluxes with climate indices

/ProjectD

Extra support

/IABP_Buoy_Data

Final report

Group Report

Template structure:

  • Abstract
  • Introduction: state of the art (literature), statement of the problem
  • Methods and data
  • Results
  • Discussion
  • Conclusion
  • Disclaimer (individual contributions)

Please indicate the responsible authors for the different sections within the report!

Individual Reports

(1 page)

  • What have you learned during the course?
  • What was your individual contribution to the project and to the group report?

Examples from the past

How significant are observations of Arctic temperature trends?

Python References

  • Python at KlimaCampus

  • Python Scripting for Computational Science, Hans Petter Langtangen, Springer (available in the ZMAW library)

LehreWiki: Climate_and_Satellite_Data_Analysis_2014 (last edited 2014-02-05 09:14:16 by anonymous)