What about the Doomsday Book, by Connie Willis? It won a hugo, so it's pretty famous, and the protagonists are on the border between historians and archeologists - I think described as historians, but definitely excavating graves and old buildings etc. It's timetravel, so maybe that breaks your No Magic criteria, but it's not Magic in that the stuff they find out is Definitely Just As History Was, it's just Magic in the way they find it out...

Oh, good example. Come to think of it there must be other time-travel stories which fulfil the spirit of "finding out about the past" even if there's 'magic' involved. Asimov's Ugly Little Boy. And surely I can think of others though I can't right now.

ETA: And I guess there's the reverse, like Da Vinci Code, where what's uncovered may or may not be magic, but is a matter of "ancient secrets which we need to re-learn"...

Cowl (Neal Asher) arguably includes some very-distant-past paleontology by means of time travel, although that's incidental to the plot really.

I haven't read it – perhaps another one to go on my list!

I read it as part of my 'read books by people I will hear at Worldcon' project, and I enjoyed it, but it didn't rock my socks.