Update to 17.6 Fails

I posted about this on the News post, but I seem to be failing to update to the new version.

I ran:
apt-get clean
apt-get update
apt-get dist-upgrade --fix-missing

The last command runs but fails with this:
Unable to correct missing packages.
E: Failed to fetch http://ftp.debian.org/debian/pool/main/i/init-system-helpers/init-system-helpers_1.48_all.deb Hash Sum mismatch

E: Failed to fetch http://ftp.debian.org/debian/pool/main/l/lvm2/liblvm2app2.2_2.02.168-2_armhf.deb Hash Sum mismatch

E: Failed to fetch http://ftp.debian.org/debian/pool/main/c/coreutils/coreutils_8.26-3_armhf.deb Hash Sum mismatch

E: Failed to fetch http://ftp.debian.org/debian/pool/main/g/glib2.0/libglib2.0-0_2.50.3-2_armhf.deb Hash Sum mismatch

E: Failed to fetch http://apt.osmc.tv/pool/main/v/vero2-mediacenter-osmc/vero2-mediacenter-osmc_17.6.0-15_armhf.deb Hash Sum mismatch

E: Failed to fetch http://apt.osmc.tv/pool/main/v/vero2-source-3.10.105-8-osmc/vero2-image-3.10.105-8-osmc_8_armhf.deb Hash Sum mismatch

E: Aborting install.

Sam mentioned that it should update in a few hours, but this is the next day and it is still a problem. I had this problem for 17.5, too, and eventually had to reinstall from scratch a few times to get that to work.

Any help?

If you’re using a proxy, this might occur. You might also be using a proxy but don’t know it - a transparent proxy somewhere in the network - that is monkeying with the data feed.

There is no proxy, I control the network from OSMC to switch, to the next switch, to the Firewall to the cable modem.

Have you tried today?

It might be that your device has a storage problem.

To check this possibility, I suggest you run sudo rm -f /var/cache/apt/archives/* then reboot.

Logon again and see if any files are still in /var/cache/apt/archives.

If it’s empty, try again with apt-get update / dist-upgrade.

I cleared the cache as you described, rebooted, and there were files in the cache again. A moment later, there were even more, so apparently it is attempting an auto update right after the reboot.

osmc@Oswin:~$ sudo -s
root@Oswin:/home/osmc# sudo rm -f /var/cache/apt/archives/*
rm: cannot remove ‘/var/cache/apt/archives/partial’: Is a directory
root@Oswin:/home/osmc# sudo rm -R -f /var/cache/apt/archives/*
root@Oswin:/home/osmc# ls /var/cache/apt/archives/           
root@Oswin:/home/osmc# reboot
Connection to oswin closed by remote host.
Connection to oswin closed.
alexius@Chance:~> ssh osmc@oswin
osmc@oswin's password: 

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Tue Jan 16 12:14:17 2018 from 192.168.23.5
osmc@Oswin:~$ sudo -s
root@Oswin:/home/osmc# ls /var/cache/apt/archives/
partial
root@Oswin:/home/osmc# ls -R /var/cache/apt/archives/                                                                                                                             
/var/cache/apt/archives/:                                                                                                                                                         
armv7-udisks-glue-osmc_1.3.5-9_armhf.deb  libaudit-common_1%3a2.6.7-2_all.deb  libpam0g_1.1.8-3.6_armhf.deb            libpcre3_2%3a8.39-3_armhf.deb   libsemanage-common_2.6-2_all.deb  libxml2_2.9.4+dfsg1-2.2+deb9u2_armhf.deb
debconf_1.5.61_all.deb                    libbz2-1.0_1.0.6-8.1_armhf.deb       libpam-modules_1.1.8-3.6_armhf.deb      libselinux1_2.6-3+b3_armhf.deb  libsepol1_2.6-2_armhf.deb         lock                                                                                  
libaudit1_1%3a2.6.7-2_armhf.deb           libcap-ng0_0.7.7-3+b1_armhf.deb      libpam-modules-bin_1.1.8-3.6_armhf.deb  libsemanage1_2.6-2_armhf.deb    libustr-1.0-1_1.0.4-6_armhf.deb   partial                                                                               
                                                                                                                                                                                                                                                                               
/var/cache/apt/archives/partial:                                                                                                                                                                                                                                               
passwd_1%3a4.4-4.1_armhf.deb  vero2-mediacenter-osmc_17.6.0-15_armhf.deb                                                                                                                                                                                                       
root@Oswin:/home/osmc# ls -R /var/cache/apt/archives/                                                                                                                                                                                                                          
/var/cache/apt/archives/:                                                                                                                                                                                                                                                      
acl_2.2.52-3+b1_armhf.deb                 kbd_2.0.3-2+b1_armhf.deb                           libgpgme11_1.8.0-3+b2_armhf.deb               libpython2.7-minimal_2.7.13-2+deb9u2_armhf.deb            ncurses-bin_6.0+20161126-1+deb9u1_armhf.deb                               
adduser_3.115_all.deb                     keyutils_1.5.9-9_armhf.deb                         libgssapi-krb5-2_1.15-1+deb9u1_armhf.deb      libpython2.7-stdlib_2.7.13-2+deb9u2_armhf.deb             partial                                                                   
apt_1.4.8_armhf.deb                       kmod_23-2_armhf.deb                                libhogweed4_3.3-1+b2_armhf.deb                libpython-stdlib_2.7.13-2_armhf.deb                       passwd_1%3a4.4-4.1_armhf.deb                                              
apt-utils_1.4.8_armhf.deb                 libacl1_2.2.52-3+b1_armhf.deb                      libidn11_1.33-1_armhf.deb                     libreadline7_7.0-3_armhf.deb                              pinentry-curses_1.0.0-2_armhf.deb                                         
armv7-bluez-osmc_5.43-3_armhf.deb         libapparmor1_2.11.0-3_armhf.deb                    libip4tc0_1.6.0+snapshot20161117-6_armhf.deb  libsasl2-2_2.1.27~101-g0780600+dfsg-3_armhf.deb           procps_2%3a3.3.12-3_armhf.deb                                             
armv7-connman-osmc_1.3.5-1_armhf.deb      libapt-inst2.0_1.4.8_armhf.deb                     libjpeg62-turbo_1%3a1.5.1-2_armhf.deb         libsasl2-modules-db_2.1.27~101-g0780600+dfsg-3_armhf.deb  python_2.7.13-2_armhf.deb                                                 
armv7-udisks-glue-osmc_1.3.5-9_armhf.deb  libassuan0_2.4.3-2_armhf.deb                       libk5crypto3_1.15-1+deb9u1_armhf.deb          libseccomp2_2.3.1-2.1_armhf.deb                           python2.7_2.7.13-2+deb9u2_armhf.deb                                       
base-files_9.9+deb9u3_armhf.deb           libattr1_1%3a2.4.47-2+b2_armhf.deb                 libkeyutils1_1.5.9-9_armhf.deb                libselinux1_2.6-3+b3_armhf.deb                            python-apt_1.4.0~beta3_armhf.deb                                          
base-passwd_3.5.43_armhf.deb              libaudit1_1%3a2.6.7-2_armhf.deb                    libkmod2_23-2_armhf.deb                       libsemanage1_2.6-2_armhf.deb                              python-apt-common_1.4.0~beta3_all.deb                                     
bash_4.4-5_armhf.deb                      libaudit-common_1%3a2.6.7-2_all.deb                libkrb5-3_1.15-1+deb9u1_armhf.deb             libsemanage-common_2.6-2_all.deb                          python-imaging_4.0.0-4_all.deb                                            
bsdutils_1%3a2.29.2-1_armhf.deb           libavahi-client3_0.6.32-2_armhf.deb                libkrb5support0_1.15-1+deb9u1_armhf.deb       libsepol1_2.6-2_armhf.deb                                 python-ldb_2%3a1.1.27-1+b1_armhf.deb                                      
coreutils_8.26-3_armhf.deb                libavahi-common3_0.6.32-2_armhf.deb                libksba8_1.3.5-2_armhf.deb                    libsmartcols1_2.29.2-1_armhf.deb                          python-minimal_2.7.13-2_armhf.deb                                         
cron_3.0pl1-128+b1_armhf.deb              libavahi-common-data_0.6.32-2_armhf.deb            liblcms2-2_2.8-4_armhf.deb                    libsmbclient_2%3a4.5.12+dfsg-2+deb9u1_armhf.deb           python-pil_4.0.0-4_armhf.deb                                              
dash_0.5.8-2.4_armhf.deb                  libblkid1_2.29.2-1_armhf.deb                       libldap-2.4-2_2.4.44+dfsg-5+deb9u1_armhf.deb  libsqlite3-0_3.16.2-5+deb9u1_armhf.deb                    python-tdb_1.3.11-2_armhf.deb                                             
dbus_1.10.24-0+deb9u1_armhf.deb           libbsd0_0.8.3-1_armhf.deb                          libldap-common_2.4.44+dfsg-5+deb9u1_all.deb   libssh-4_0.7.3-2_armhf.deb                                python-unidecode_0.04.19-1_all.deb                                        
debconf_1.5.61_all.deb                    libbz2-1.0_1.0.6-8.1_armhf.deb                     liblvm2app2.2_2.02.168-2_armhf.deb            libstdc++6_6.3.0-18_armhf.deb                             readline-common_7.0-3_all.deb                                             
debian-archive-keyring_2017.5_all.deb     libcap2_1%3a2.25-1_armhf.deb                       liblz4-1_0.0~r131-2+b1_armhf.deb              libsystemd0_232-25+deb9u1_armhf.deb                       rpcbind_0.2.3-0.6_armhf.deb                                               
debianutils_4.8.1.1_armhf.deb             libcap-ng0_0.7.7-3+b1_armhf.deb                    liblzma5_5.2.2-1.2+b1_armhf.deb               libtalloc2_2.1.8-1_armhf.deb                              samba-dsdb-modules_2%3a4.5.12+dfsg-2+deb9u1_armhf.deb                     
diffutils_1%3a3.5-3_armhf.deb             libcomerr2_1.43.4-2_armhf.deb                      libmount1_2.29.2-1_armhf.deb                  libtasn1-6_4.10-1.1_armhf.deb                             sed_4.4-1_armhf.deb
dirmngr_2.1.18-8~deb9u1_armhf.deb         libconfuse1_3.0+dfsg-2_armhf.deb                   libncurses5_6.0+20161126-1+deb9u1_armhf.deb   libtdb1_1.3.11-2_armhf.deb                                startpar_0.59-3.1_armhf.deb
dmsetup_2%3a1.02.137-2_armhf.deb          libconfuse-common_3.0+dfsg-2_all.deb               libncursesw5_6.0+20161126-1+deb9u1_armhf.deb  libtevent0_0.9.31-1_armhf.deb                             systemd_232-25+deb9u1_armhf.deb
dpkg_1.18.24_armhf.deb                    libcryptsetup4_2%3a1.7.3-4_armhf.deb               libnettle6_3.3-1+b2_armhf.deb                 libtinfo5_6.0+20161126-1+deb9u1_armhf.deb                 systemd-sysv_232-25+deb9u1_armhf.deb
e2fslibs_1.43.4-2_armhf.deb               libdb5.3_5.3.28-12+deb9u1_armhf.deb                libnfsidmap2_0.25-5.1_armhf.deb               libtirpc1_0.2.5-1.2_armhf.deb                             sysvinit-utils_2.88dsf-59.9_armhf.deb
e2fsprogs_1.43.4-2_armhf.deb              libdbus-1-3_1.10.24-0+deb9u1_armhf.deb             libnl-3-200_3.2.27-2_armhf.deb                libudev1_232-25+deb9u1_armhf.deb                          sysv-rc_2.88dsf-59.9_all.deb
findutils_4.6.0+git+20161106-2_armhf.deb  libdbus-glib-1-2_0.108-2_armhf.deb                 libnl-genl-3-200_3.2.27-2_armhf.deb           libustr-1.0-1_1.0.4-6_armhf.deb                           tar_1.29b-1.1_armhf.deb
gcc-6-base_6.3.0-18_armhf.deb             libdebconfclient0_0.227_armhf.deb                  libnpth0_1.3-1_armhf.deb                      libuuid1_2.29.2-1_armhf.deb                               ucf_3.0036_all.deb
gnupg_2.1.18-8~deb9u1_armhf.deb           libdevmapper1.02.1_2%3a1.02.137-2_armhf.deb        libp11-kit0_0.23.3-2_armhf.deb                libwebp6_0.5.2-1_armhf.deb                                udev_232-25+deb9u1_armhf.deb
gnupg-agent_2.1.18-8~deb9u1_armhf.deb     libdevmapper-event1.02.1_2%3a1.02.137-2_armhf.deb  libpam0g_1.1.8-3.6_armhf.deb                  libwebpdemux2_0.5.2-1_armhf.deb                           util-linux_2.29.2-1_armhf.deb
gpgv_2.1.18-8~deb9u1_armhf.deb            libevent-2.0-5_2.0.21-stable-3_armhf.deb           libpam-modules_1.1.8-3.6_armhf.deb            libwebpmux2_0.5.2-1_armhf.deb                             vero2-image-3.10.105-8-osmc_8_armhf.deb
grep_2.27-2_armhf.deb                     libfdisk1_2.29.2-1_armhf.deb                       libpam-modules-bin_1.1.8-3.6_armhf.deb        libwrap0_7.6.q-26_armhf.deb                               vero2-kernel-osmc_3.9.13_armhf.deb
gzip_1.6-5+b1_armhf.deb                   libffi6_3.2.1-6_armhf.deb                          libpam-runtime_1.1.8-3.6_all.deb              libxml2_2.9.4+dfsg1-2.2+deb9u2_armhf.deb                  wireless-firmware-osmc_1.1.4_all.deb
hdparm_9.51+ds-1_armhf.deb                libfreetype6_2.6.3-3.2_armhf.deb                   libpam-systemd_232-25+deb9u1_armhf.deb        lock                                                      wpasupplicant_2%3a2.4-1+deb9u1_armhf.deb
hostname_3.18+b1_armhf.deb                libgcc1_1%3a6.3.0-18_armhf.deb                     libpcre3_2%3a8.39-3_armhf.deb                 lsb-base_9.20161125_all.deb                               zlib1g_1%3a1.2.8.dfsg-5_armhf.deb
init_1.48_armhf.deb                       libglib2.0-0_2.50.3-2_armhf.deb                    libpcsclite1_1.8.20-1_armhf.deb               mediacenter-addon-osmc_3.0.654_all.deb
initscripts_2.88dsf-59.9_armhf.deb        libgmp10_2%3a6.1.2+dfsg-1_armhf.deb                libpng16-16_1.6.28-1_armhf.deb                mime-support_3.60_all.deb
init-system-helpers_1.48_all.deb          libgnutls30_3.5.8-5+deb9u3_armhf.deb               libprocps6_2%3a3.3.12-3_armhf.deb             mount_2.29.2-1_armhf.deb
insserv_1.14.0-5.4+b1_armhf.deb           libgpg-error0_1.26-2_armhf.deb                     libpython2.7_2.7.13-2+deb9u2_armhf.deb        ncurses-base_6.0+20161126-1+deb9u1_all.deb

/var/cache/apt/archives/partial:
armv7-splash-osmc_1.3.5_armhf.deb.FAILED  login_1%3a4.4-4.1_armhf.deb.FAILED             nfs-common_1%3a1.3.4-2.1_armhf.deb.FAILED           python-samba_2%3a4.5.12+dfsg-2+deb9u1_armhf.deb
libapt-pkg5.0_1.4.8_armhf.deb.FAILED      mediacenter-skin-osmc_17.0.2-6_all.deb.FAILED  python2.7-minimal_2.7.13-2+deb9u2_armhf.deb.FAILED  vero2-mediacenter-osmc_17.6.0-15_armhf.deb.FAILED
root@Oswin:/home/osmc#

Please run a grab-logs -A and post the URL it returns.

Sure: Logs available at https://paste.osmc.tv/okaniyuvaq

The immediate downloading of files is a separate issue that I’ll discuss with Sam.

The hash sum failure is either caused by a bad list of packages or the packages themselves are being corrupted (or both, I guess).

Try this:

sudo apt-get clean
sudo rm -r /var/lib/apt/lists/*
sudo apt-get update
sudo apt-get dist-upgrade --fix-missing

Inside the update:
Get:24 http://ftp.debian.org stretch/non-free Translation-en [79.2 kB]
Err http://ftp.debian.org stretch/main armhf Packages

Ign http://ftp.debian.org stretch/main Translation-en                                                                                                                                                                                                                         
Err http://ftp.debian.org stretch/main armhf Packages                                                                                                                                                                                                                         
  
Err http://ftp.debian.org stretch/main armhf Packages                                                                                                                                                                                                                         
  404  Not Found
Fetched 13.3 MB in 27s (485 kB/s)                                                                                                                                                                                                                                             
W: Failed to fetch http://ftp.debian.org/debian/dists/stretch/main/binary-armhf/Packages  404  Not Found

E: Some index files failed to download. They have been ignored, or old ones used instead.

And inside the dist-upgrade:
Get:6 http://apt.osmc.tv/ stretch/main wireless-firmware-osmc all 1.1.4 [2,657 kB]
Fetched 25.9 MB in 15s (1,721 kB/s)
Unescaped left brace in regex is deprecated, passed through in regex; marked by ← HERE in m/^(.?)(\)?${ ← HERE ([^{}]+)}(.)$/ at /usr/share/perl5/Debconf/Question.pm line 72.
Unescaped left brace in regex is deprecated, passed through in regex; marked by ← HERE in m/${ ← HERE ([^}]+)}/ at /usr/share/perl5/Debconf/Config.pm line 30.
Preconfiguring packages …
(Reading database … 23787 files and directories currently installed.)
Preparing to unpack …/tzdata_2017c-0+deb9u1_all.deb …
Unpacking tzdata (2017c-0+deb9u1) over (2017c-0+deb8u1) …
Setting up tzdata (2017c-0+deb9u1) …
Unescaped left brace in regex is deprecated, passed through in regex; marked by ← HERE in m/^(.?)(\)?${ ← HERE ([^{}]+)}(.)$/ at /usr/share/perl5/Debconf/Question.pm line 72.
Unescaped left brace in regex is deprecated, passed through in regex; marked by ← HERE in m/${ ← HERE ([^}]+)}/ at /usr/share/perl5/Debconf/Config.pm line 30.

Current default time zone: 'America/New_York'
Local time is now:      Tue Jan 16 15:49:08 EST 2018.
Universal Time is now:  Tue Jan 16 20:49:08 UTC 2018.
Run 'dpkg-reconfigure tzdata' if you wish to change it.

(Reading database ... 23789 files and directories currently installed.)
Preparing to unpack .../mediacenter-skin-osmc_17.0.2-6_all.deb ...
Unpacking mediacenter-skin-osmc (17.0.2-6) over (17.0.2-3) ...
Preparing to unpack .../wireless-firmware-osmc_1.1.4_all.deb ...
Unpacking wireless-firmware-osmc (1.1.4) over (1.1.3) ...
Setting up mediacenter-skin-osmc (17.0.2-6) ...
Setting up wireless-firmware-osmc (1.1.4) ...
E: Failed to fetch http://apt.osmc.tv/pool/main/v/vero2-source-3.10.105-8-osmc/vero2-image-3.10.105-8-osmc_8_armhf.deb  Hash Sum mismatch

E: Failed to fetch http://apt.osmc.tv/pool/main/m/mediacenter-addon-osmc/mediacenter-addon-osmc_3.0.654_all.deb  Hash Sum mismatch

There are so many things going wrong with your update(s) that I can only suggest a full reinstall. Back up your configuration first.

I just did that two month ago, and even that didn’t work until Sam did something.

/usr/bin/apt-get-real dist-upgrade --fix-missing looks odd to me.

Backup and reinstall is the first thing I’d recommend if possible.

Sam

So just to be clear, you did a full reinstall 2 months ago and had exactly the same problems during the first update?

It’s possible that @sam_nazarko was suggesting you wait a while on the assumption that the problem was probably just a temporary network glitch.

Perhaps your Vero2 is having a few hardware issues - or perhaps your ISP is messing with the data feed. Unfortunately, as things stand, the Debian and OSMC repos are on unencrypted http, so are potentially vulnerable to corruption by transparent proxies. If you can try updating with a VPN, that might narrow things down a bit.

Is there a way to check for hardware issues?

My ISP is Comcast, so it’s possible they are doing things like that, but I do not have a VPN to try.

Also, I just reinstalled everything, restored from backup, and now I get a “File Exists” error whenever I connect to some (not all) of my network shares.

New problem requires new logs.

The NAND spits out a warning to dmesg if you have bad blocks. This doesn’t seem to be the case here.

You could change the OSMC repo to use Index of /osmc/osmc/apt which is an HTTPS mirror.

I believe you can do the same for Debian, but beforehand you need to install apt-transport-https. This will stop Comcast meddling if they are doing so.

It’s not quite so simple. The great majority of Debian mirrors do not support TLS and there’s no official list that I’m aware of where the TLS mirrors are listed. There’s a python3 script here that pulls the full mirror list from Debian worldwide mirror sites and tries each one in turn. When I ran it only 76 out of a possible 379 mirrors supported TLS.

I believe there are no mirrors of security.debian.org - and AFAICT it is http-only.

@LexPendragon In additional to monkeying around with http traffic, I came across a thread here where people were discussing the alleged hijacking of DNS traffic. A piece of python code, namebench came up that is supposed to detect such nonsense. I tried it on my own network and, well, it complained that someone was hijacking my DNS. Yep, that would be me.

There are lots of clever ways to detect things like transparent proxies. Usually by breaking them

Just now, I got that same update error from my first comment, yet in apt-get there were no updates.

osmc@Oswin:/$ sudo apt-get dist-upgrade
Reading package lists… Done
Building dependency tree
Reading state information… Done
Calculating upgrade… Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

If you installed the latest version from Download - OSMC; there are no published updates to yet be installed.

Sam