I moved to Pittsburgh from DC and can confirm it is indeed a great place to start something for all the reasons you mentioned. There is a pretty active startup scene in Pittsburgh, as others have mentioned, the main negative is getting VC funding. There are lots of incubators, accelerators and seed funds here, but if you are looking for raise many millions you'll probably have to go to the valley. I was not looking for this so it's been great for me!