The first home we bought was a HUD home. The most important thing to remember is you're buying the home "as is". The cosmetic things are easy to spot. I'm not very handy so I didn't really know what to look for in the things that really count. The plumbing, electrical, ac, heat, structural and other home repairs that can be very expensive. That's why I hired a home inspector and it was some of the best money I ever spent. The only real problem he found was a cracked heat exchanger that had to be replaced before the gas company would even turn the gas on. I got some estimates and it would be about $600 if I got the house.
Other than that, the guy who did the very thorough inspection said the house was in pretty good shape. We put in a bid and got the house. It needed a lot of cleaning and a lot of painting. We did that and a landscaper I knew liked to give his guys some side work on Sundays. I had them rip out the front yard and they laid down some sod that was cut that morning. That was $500. I figure we spent another $1200 on paint, cleaning stuff and other things. So for around $2300 we had a pretty nice four bedroom house. People in the neighborhood were really pleased because that was kind of the eyesore house of the street.
Just always remember this. It's about location. You can change the house but you really can't do much to change the neighborhood. I think where to choose to live is even more important than what you choose to live in.