Bman,
I am a bit concerned about this actually. You say that on preliminary calculations you can afford/service an additional ~$300,000 debt. To actually build a house on the land could prove to be a very expensive exercise - plus if you get a construction loan you would be paying interest for...