Just make sure to mount your volumes with the :z or :Z flags. I have disabled SELinux on servers in the past, but never when I’ve just used podman containers, since “it just works” with SELinux. Literally never had any problems with containers and SELinux.
I haven’t used Jellyfin with docker before, just with podman and as a pod in k3s. Both work great and are easy to maintain. If you’re more familiar with podman then docker, then I’d recommend using podman.