I use Jellyfin and it defaults to direct play unless you need transcoding (e.g: the client device doesn't support the chosen format, Firefox with h265 for example, due to licensing) and it will just remux if the container is the only issue. The desktop client just uses mpv so it supports basically everything directly.