For some reason, after installing php-fpm /etc/nginx/snippets/fastcgi-php.conf was missing which usually isn't the case. dpkg-reconfigure didn't seem to solve the issue, so off to the offiical nginx source on github!

You can get it here https://github.com/nginx/nginx/blob/master/conf/fastcgi.conf