Blake's Lotaburger is a must for me when I am in New Mexico. It's still fast food, but my orders are always cooked to order and they have good green chili. The Habit Burger Grill is a step above fast food quality and they also do a good job. I also like Fuddruckers when I am near one.
My opinions only...
Try the elk burger at Fuddruckers. It's pretty tasty.
The Habit is a chain that originated in Santa Barbara California. I am not sure how far it has spread, but it is quickly expanding in Southern California.
Some of the best burgers are pub burgers. One of the best burgers I have eaten was at a pub near the sand in Manhattan Beach. We used to stop there at night after playing beach volleyball.
When I am just looking for a good, easy burger meal, I go for In 'N Out. Because, that's what a hamburger's all about.