Here you can see video of self-driving cars handling Lombard Street, as well as dirt roads, off-road driving, pedestrians and bicyclists and other obstacles in the road, plus tons of information about how they work:
One thing that strikes me is how much more these robots can potentially see than a human driver. Imagine how much better you could drive if you could see in all directions at once with multiple range-finding sensors and cameras, track dozens of moving objects simultaneously, never get sleepy or look away from the road at the wrong time, react to events in milliseconds, and learn from hundreds of thousands of miles of training data as your driving "experience".
