You could use DSR (Direct Server Return) so that the pi only handles the initial connection. All the video traffic goes directly from the server to you without passing through the pi.