Great news, thanks Penny! All you'd need is proper calibration on one star, and in theory you could highlight any other object in the sky. HoloLens would "know" the environment of the sky map as some sphere based around that point. I suppose this is just fancier VR since it's not totally immersive and interactive with your immediate environment like other HoloLens apps. You're right that this would be better for a future version HoloLens, especially one with a larger FOV. I hope it's done eventually! Bringing sky maps to cell phones was such a big deal and an often-advertised use case, and as far as getting astronomy out to more devices and users, I think this is an ideal application (if it can be done!).

Ideally outdoors. Indoors wouldn't be very exciting. Seeing labels and targets on the objects themselves in the sky seems like the better use case to me. This makes environment tracking more difficult, of course. I'm not sure what the capabilities of the sensors are.