He married Jane Johnstone, and had a number of children, one of which was Andrew Hardy, the naval lieutenant (not the famous naval Hardy).