Brian - if you're anything like me you may find a compromise putting work ahead of things you'd love to do harder to justify, and yet harder to break with every year that passes. That said, you might end up loving the job, and I still haven't broken my addiction to my salary.
I've occasionally wondered if I could do something like living in a motorhome and keep doing my job. It would provide a huge boost in income, enabling some serious saving and be a cool way to live. I could park near work during the week (killing my 2 hours a day commuting) then drive back to where I live now to enjoy the weekends. I can't help thinking that the company I work for would have a problem with it, though I'm not quite sure what that would be.