Accessibility alone has not been enough to allow visually impaired people (VIPs) to experience the world with the same level of independence and richness as others can. Audio-based assistive technologies such as navigation aids and audio games (audio-only video games) succeed in making navigating and playing games *accessible* to VIPs, but they come far from providing an experience equivalent to what sighted people enjoy. These technologies often act as guides that tell VIPs what to do, but our goal should be to give VIPs the ability to make decisions themselves. In this talk, I will show how to design assistive technologies to foster agency rather than merely acting as a guide. I will show two examples from my new lab, which both to blind-accessible video games: the racing auditory display (RAD), which makes racing video games equivalently accessible to VIPs; and NavStick, which gives users the ability to “look around” within virtual worlds. I will also discuss the implications that these systems have on real-world navigation.