I do actually have some news…
It is the WiFi. No problems since I connected a Router configured as bridge on it through ethernet. Also the IR issue vanished - Check this thread: Vero IR Remote Issues - #33 by sarah
I suspect that slow WiFi and slow data-strains cause high CPU load and latency which is seen as sometimes the black-outs and mostly the IR stutters/repeats etc.