I started a thread with the same problem: Sound delay after pause
Although for me it is 2-3 seconds but only when audio is set to passthrough. If set to PCM there is a very small delay but nothing to complain about.
Unfortunately now I have a new TV and am using ARC, which doesn’t pass multichannel PCM so I have gone back to passthrough.