The trouble with going back further is that there wasn't global coverage of people keeping accurate records of temperatures in times past. So they have to look at things like tree rings and make comparisons with historical records. Obviously it gets a little fuzzy going back more than a century. But here's an xkcd that gives a summary of what we know about historical (and pre-historical) global temperatures.