I can see this working in a glass house, which aren't that uncommon...some new buildings really go on maximizing window space on a skyscraper so that you don't really have a wall on the exterior (more common in China than the USA for sure). See for example: