The dual architecture of the V4K continues to produce similar problems from time to time, eg Whats it 'like'?
Sundtek DVB-S USB dongle armhf vs. arm64 Tvheadend incompatibility
As you’ve found, the userland packages and libraries are 32-bit, so the way forward is usually to build for armhf.