Hm, I noticed now that when I uncheck UV Overlay and save the layout as the startup layout, that viewport filter option is not saved.
After restarting Cinema 4D, UV Overlay is still on, and I have to uncheck it manually.
It turns out that viewport settings are saved in the default C4D scene. Resaving the default scene with UV Overlay unchecked solves the problem.