Export NetAtmo weather station data to CSV / Excel

I’m a proud owner of a NetAtmo weather station for a couple of months and I think it’s the best wheater station with a great user experience you can get:

Some days ago I noticed the option in the web dashboard to export all my weather data into a comma-separated (CSV) or Microsoft Excel file. That’s a great feature for archiving your measured data….but wait – how could this be done in an automated way?

The short answer is: yes – but unfortunately not out-of-the-box. NetAtmo offers a great RESTful API for accessing the weather station data, so I started to do some coding with their web API. But I had no luck – there isn’t a method available for exporting the data. So I did a manual download and created some http/https traces to see what’s going on there. I simply put together the required http-calls and made a shell script that will do the job for me:

#!/bin/bash

getmeasurecsv() {
	# ------------------------------------------------------
	# Help
	# ------------------------------------------------------
	# usage: getmeasurecsv <USER> <PASSWORD> <DEVICE_ID> <MODULE_ID> <TYPE> <STARTDATE> <ENDDATE> <FORMAT>
	#
	# USER + PASSWORD -> your NetAtmo Website login
	# DEVICE_ID -> Base Station ID
	# MODULE_ID -> Module ID
	# TYPE -> Comma-separated list of sensors (Temperature,Humidity,etc.)
	# STARTDATE -> Begin export date in format YYYY-mm-dd HH:MM
	# ENDDATE -> End export date in format YYYY-mm-dd HH:MM
	# FORMAT -> csv or xls

	# ------------------------------------------------------
	# Parsing Arguments
	# ------------------------------------------------------
	USER=$1
	PASS=$2

	DEVICE_ID=$3
	MODULE_ID=$4
	TYPE=$5
	DATETIMEBEGIN=$6
	DATETIMEEND=$7
	FORMAT=$8

	# ------------------------------------------------------
	# Define some constants
	# ------------------------------------------------------
	URL_LOGIN="https://auth.netatmo.com/de-DE/access/login"
	API_GETMEASURECSV="https://api.netatmo.com/api/getmeasurecsv"
	SESSION_COOKIE="cookie_sess.txt"
	AUTH_COOKIE="cookie_auth.txt"


	# ------------------------------------------------------
	# Convert start and end date to timestamp
	# ------------------------------------------------------
	DATEBEGIN="$(date --date="$DATETIMEBEGIN" "+%d.%m.%Y")"
	TIMEBEGIN="$(date --date="$DATETIMEBEGIN" "+%H:%M")"
	DATE_BEGIN="$(date --date="$DATETIMEBEGIN" "+%s")"
	DATEEND="$(date --date="$DATETIMEEND" "+%d.%m.%Y")"
	TIMEEND="$(date --date="$DATETIMEEND" "+%H:%M")"
	DATE_END="$(date --date="$DATETIMEEND" "+%s")"


	# ------------------------------------------------------
	# URL encode the user entered parameters
	# ------------------------------------------------------
	USER="$(urlencode $USER)"
	PASS="$(urlencode $PASS)"
	DEVICE_ID="$(urlencode $DEVICE_ID)"
	MODULE_ID="$(urlencode $MODULE_ID)"
	TYPE="$(urlencode $TYPE)"
	DATEBEGIN="$(urlencode $DATEBEGIN)"
	TIMEBEGIN="$(urlencode $TIMEBEGIN)"
	DATEEND="$(urlencode $DATEEND)"
	TIMEEND="$(urlencode $TIMEEND)"
	FORMAT="$(urlencode $FORMAT)"


	# ------------------------------------------------------
	# Now let's fetch the data
	# ------------------------------------------------------

	# first we need to get a valid session cookie
	curl --silent -c $AUTH_COOKIE $URL_LOGIN  > /dev/null

	# then extract the ID from the authentication cookie
	SESS_ID="$(cat $AUTH_COOKIE | grep netatmocomci_csrf_cookie_na | cut -f7)"

	# and now we can login using cookie, id, user and password
	curl --silent -d "ci_csrf_netatmo=$SESS_ID&mail=$USER&pass=$PASS&log_submit=LOGIN" -b $AUTH_COOKIE -c $SESSION_COOKIE  $URL_LOGIN > /dev/null

	# next we extract the access_token from the session cookie
	ACCESS_TOKEN="$(cat $SESSION_COOKIE | grep netatmocomaccess_token | cut -f7)"

	# build the POST data
	PARAM="access_token=$ACCESS_TOKEN&device_id=$DEVICE_ID&type=$TYPE&module_id=$MODULE_ID&scale=max&format=$FORMAT&datebegin=$DATEBEGIN&timebegin=$TIMEBEGIN&dateend=$DATEEND&timeend=$TIMEEND&date_begin=$DATE_BEGIN&date_end=$DATE_END"

	# now download data as csv
	curl -d $PARAM $API_GETMEASURECSV

	# clean up
	rm $SESSION_COOKIE
	rm $AUTH_COOKIE
}

#____________________________________________________________________________________________________________________________________

urlencode() {
	# ------------------------------------------------------
	# urlencode function from mrubin
	# https://gist.github.com/mrubin
	#
	# usage: urlencode <string>
	# ------------------------------------------------------
	local length="${#1}"

	for (( i = 0; i < length; i++ )); do
		local c="${1:i:1}"

		case $c in [a-zA-Z0-9.~_-])
			printf "$c" ;;
			*) printf '%%%02X' "'$c"
			esac
	done
}

#____________________________________________________________________________________________________________________________________

getmeasurecsv "user@email.com" "mySecretPassword" "12:23:45:56:78:33" "02:00:00:12:23:45" "Temperature,Humidity" "2015-05-17 10:00:00" "2015-05-18 12:00:00" "csv"

You just need to modify the last line to fit your environment. Here are some detailed information regarding the DEVICE_ID and the MODULE_ID. Both IDs can be found in your NetAtmo Dashboard settings. The DEVICE_ID will be the MAC-Address of your NetAtmo Base Station. The MODULE_ID is based on the serial number of your additional NetAtmo Modules:

When querying the base station the DEVICE_ID and MODULE_ID value must be the same – the MAC-Address of the base station. The Output in the CSV file will look like this:

I duplicated the last line for each of my NetAtmo modules and configured the script to run on my Synology DiskStation NAS for an automatic backup.

See my recent blog post Netatmo Weather Station Shell Script