{"id":87,"date":"2014-11-16T00:45:42","date_gmt":"2014-11-15T21:45:42","guid":{"rendered":"http:\/\/home.dgrechka.net\/blog\/?p=87"},"modified":"2014-11-16T01:10:10","modified_gmt":"2014-11-15T22:10:10","slug":"ghcn-v3-sql","status":"publish","type":"post","link":"https:\/\/grechka.family\/dmitry\/blog\/2014\/11\/ghcn-v3-sql\/","title":{"rendered":"GHCN v3 in SQL"},"content":{"rendered":"

The Global Historical Climatology Network-Monthly (GHCN-M)<\/a> dataset by NCDC\u00a0<\/a>is particularly important data set if your research\u00a0deals with climate data. It is widely accepted. Its major advantage is quality control and a variety\u00a0of data sources combined together. I\u00a0used\u00a0it several times as reference data for\u00a0validation\u00a0of calculated climate surfaces. It is also great for uncertainty\u00a0assessment of climate interpolation methods.<\/p>\n

But it is distributed as text files of specific format only. And you will have\u00a0to write a parser to fetch the data.<\/p>\n

This week I decided to load the GHCNv3 into MySQL to make it flexible for fetching.\u00a0I can fetch different subsets of the data into CSV files just with composing a proper select query. That made a significant speed up in experiments with interpolation techniques.<\/p>\n

I share these SQL scripts to enable others researchers to load GHCN v3 into their own\u00a0SQL servers. You can restore GHCN at your server and perform requests to it. Just download the script, execute it. And you are able to get the data you need. Fast :)<\/p>\n