Kaza is an awesome and very comfortable place to stay in Spiti Valley. it is apparently only town all the way from Kullu to Shimla on the Lahul Spiti route.
It has worlds highest ATM, Worlds highest retail petrol pump, and Asia's highest inhabitable village not is far away from here.
Kaza is situated at the height over 12500 ft ASL, Near may june time (the time I was there) the weather is generally very comfortable, very nice sun and cozy cold nights. although if you start enjoying sun too much, you can also get sunburned.
I stayed in a small cute and lovely family run lodge called Kaycee lodge just in front of the Kaza monastery. This is the view from the balcony where we use to sit basking in the sun for hours (got sunburned as well). the Valley is overlooked by high mountains on all the sides, some are snowcapped and some are not. in all its an amazing site to see.
A travel tip - somehow the cost of lodging vary way too much even for same kind of lodges in kaza. it is good to explore a little bit. Taking lodge in the market might be costly and may not be that peaceful as well, get it on the periphery of the town from where you can overlook it, the balcony view is just too good to miss.