Coming from a different angle (I design and build frames, so handling becomes paramount before the details are dialed in), determine this first -- do you want something that leans more toward road race bike responsiveness, or longer-range stability? It makes a big difference.

You'll be encountering things off pavement that you'd never see on pavement, and they're going to want to throw you off your line. If you're comfortable battling that on road-neutral geometry, then go for it. I've found that maximizing front center and upping trail towards the MTB-like range makes all the difference in the world for ease of descents, staying steady on rougher terrain, etc., and saving endurance on long and potentially abusive rides. The caveat is that you have to balance it with wheel flop.