MySQL column c08 length issue with MyVideos116?

Help and Support Vero 4K / Vero 4K +
1

I was using an Intel NUC for Kodi (Windows) and just got the Vero working. I seem to be running into an issue I previously fixed in MySQL, where table MyVideos116.tvshow, as well as table MyVideos116.movie is having an issue with column c08 because of the length of data pulled down for fanart purposes. This is detailed for tvshows here: Fields too small in MySQL Database (Solution included) · Issue #15768 · xbmc/xbmc · GitHub

…and the comment describing the fix is here: Fields too small in MySQL Database (Solution included) · Issue #15768 · xbmc/xbmc · GitHub

I detailed the movie table issue and fix here: Too many fanart images for scrapers: Data too long for MySQL tables (error 1406)

I have not had this issue on my Windows box since changing c08 from type “text” to a type “mediumtext”. However, the same movies are now showing the same error in the log file on the Vero. Is there something different with the OSMC build which might be impacting this?

Here’s a snippet from the log while it’s trying to import The Avengers movie:

2020-08-24 01:38:12.878 T:3262108384 WARNING: VideoInfoScanner: Error 1 occurred while retrievinginformation for smb://w7-server/Videos/Movies/Marvel Cinematic Universe/MCU 22 Avengers Endgame (2019)/Avengers Endgame (2019)/Avengers Endgame (2019) 3D SBS [Bluray-Disk].mk3d.

Query: UPDATE movie SET c00='The Avengers',c01='Nick Fury is the director of S.H.I.E.L.D., an international peace-keeping agency. The agency is a who\'s who of Marvel Super Heroes, with Iron Man, The Incredible Hulk, Thor, Captain America, Hawkeye and Black Widow. When global security is threatened by Loki and his cohorts, Nick Fury and his team will need all their powers to save the world from disaster which is formed by Loki and his team',c02='Earth\'s mightiest heroes must come together and learn to fight as a team if they are going to stop the mischievous Loki and his alien army from enslaving humanity.',c03='Avengers Assemble!',c05='11092',c06='Joss Whedon / Zak Penn',c08='<thumb aspect=\"set.poster\" preview=\"https://assets.fanart.tv/preview/movies/86311/movieposter/the-avengers-collection-55c68ed2c629b.jpg\">https://assets.fanart.tv/fanart/movies/86311/movieposter/the-avengers-collection-55c68ed2c629b.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://assets.fanart.tv/preview/movies/86311/movieposter/the-avengers-collection-53c9574c98d77.jpg\">https://assets.fanart.tv/fanart/movies/86311/movieposter/the-avengers-collection-53c9574c98d77.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://assets.fanart.tv/preview/movies/86311/movieposter/the-avengers-collection-57a8963044617.jpg\">https://assets.fanart.tv/fanart/movies/86311/movieposter/the-avengers-collection-57a8963044617.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://assets.fanart.tv/preview/movies/86311/movieposter/the-avengers-collection-55c68ed2c629b.jpg\">https://assets.fanart.tv/fanart/movies/86311/movieposter/the-avengers-collection-55c68ed2c629b.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://assets.fanart.tv/preview/movies/86311/movieposter/the-avengers-collection-53c9574c98d77.jpg\">https://assets.fanart.tv/fanart/movies/86311/movieposter/the-avengers-collection-53c9574c98d77.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://assets.fanart.tv/preview/movies/86311/movieposter/the-avengers-collection-57a8963044617.jpg\">https://assets.fanart.tv/fanart/movies/86311/movieposter/the-avengers-collection-57a8963044617.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-555648a1a691a.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-555648a1a691a.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-5cb61d86d1aa8.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-5cb61d86d1aa8.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-5cb4b00fa3b04.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-5cb4b00fa3b04.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-5393367870445.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-5393367870445.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-512952b5902b4.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-512952b5902b4.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-5393346e4cba9.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-5393346e4cba9.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-5606df109563f.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-5606df109563f.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-512952c25255e.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-512952c25255e.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-5bfbc95967087.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-5bfbc95967087.jpg</thumb><thumb aspect=\"set.fanart\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebackground/the-avengers-collection-57a896531fef9.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebackground/the-avengers-collection-57a896531fef9.jpg</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-53c953dbcb6cb.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-53c953dbcb6cb.png</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-5590a1de2f74b.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-5590a1de2f74b.png</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-51fa5f09a630c.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-51fa5f09a630c.png</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-51f8daf60ccb6.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-51f8daf60ccb6.png</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-53c953dbcb6cb.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-53c953dbcb6cb.png</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-5590a1de2f74b.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-5590a1de2f74b.png</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-51fa5f09a630c.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-51fa5f09a630c.png</thumb><thumb aspect=\"set.clearlogo\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovielogo/the-avengers-collection-51f8daf60ccb6.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovielogo/the-avengers-collection-51f8daf60ccb6.png</thumb><thumb aspect=\"set.clearart\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovieclearart/the-avengers-collection-57a8963c848ae.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovieclearart/the-avengers-collection-57a8963c848ae.png</thumb><thumb aspect=\"set.clearart\" preview=\"https://assets.fanart.tv/preview/movies/86311/hdmovieclearart/the-avengers-collection-57a8963c848ae.png\">https://assets.fanart.tv/fanart/movies/86311/hdmovieclearart/the-avengers-collection-57a8963c848ae.png</thumb><thumb aspect=\"set.banner\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebanner/the-avengers-collection-55efec713808a.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebanner/the-avengers-collection-55efec713808a.jpg</thumb><thumb aspect=\"set.banner\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebanner/the-avengers-collection-57a8993cee66d.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebanner/the-avengers-collection-57a8993cee66d.jpg</thumb><thumb aspect=\"set.banner\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebanner/the-avengers-collection-51fa5f1cd80b7.jpg\">https://assets.fanart.tv/fanart/movies/86311/moviebanner/the-avengers-collection-51fa5f1cd80b7.jpg</thumb><thumb aspect=\"set.banner\" preview=\"https://assets.fanart.tv/preview/movies/86311/moviebanner/the-avengers-collection-59142a6cb8d4d.jpg\">https://assets.fanart.tv/fana

Here’s what the error looks like:

2020-08-24 04:13:58.827 T:3872383712   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 400
2020-08-24 04:14:01.343 T:3872383712   ERROR: SQL: [mysql116] Undefined MySQL error: Code (1406)
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
                                            unix_err:'2' error : 'No such file or directory'
2

Not a fix so much as a workaround…

I had something similar (ironically also with something from the MCU) and while you can technically configure MySQL to just truncate the value that will lead to some unpredictable behaviours and probably make things worse.

I went down the route of using Tiny Media Manager to get things bundled up in the media folder via nfo files.

Depends how many films/shows you have with the issue as to whether you consider it viable - in my case it was only one.

1 Like
3

I think I have around 5 movies with this issue (Marvel and Star Wars). While I could use alternative means (and, thanks for providing one), I’ll wait to see what Sam and company have to say. Hopefully they’ll pop in here and reply. If there’s an issue with the OSMC build, I’m certain they’ll want to get it resolved. I don’t understand what could have been done differently in the builds to make one 18.7 build work while another does not, but I’m not a coder.

4

Are you sure you have the same extra media types in advancedsettings.xml and scraping settings on both machines? When I fixed the TV show issue on my system the error was on both platforms and when I edited my db to fix that it fixed it on both. I have not run into this issue so far with any movies but i’m also only pulling in artwork links from TMDB (zero extended artwork). You might want to try temporarily commenting out the db entries in your advancedsettings and see what happens if you try scraping these problem movies with the same settings. I think this would allow you find if it is a db issue or something else (scraper?) as from what I understand SQLite does not have the same issues with large fields.

That being said, if I run into this issue with only 5 movies I would just make NFO files for them as @eightiescalling and call it job done.

5

I’m pretty sure I did that when I first set it up because I hadn’t edited the advancedsettings file yet, but, it’s probably worth verifying as I wasn’t specifically looking for this issue at that point. I do think the scrapers are set up identically, but that’s also worth verifying.

The funny thing is, I could easily use my NUC running Kodi to scrape the movies and create the nfo file for the Vero to utilize, but I’m just not okay with that solution. It’s a bit of OCD, but I also want the issue to get resolved, wherever it may lie.

7

I ensured my scraper settings matched between my NUC w/Kodi and Vero and the movies still worked on the NUC, but failed on the Vero.

Then, I disabled mysql on the Vero and was able to scrape the movies again without issue. So, it’s definitely an issue with how Vero, specifically, is accessing the mysql database. Is there someplace else I need to report this or we just wait for someone from OSMC to chime in?

9

We need full debug logs demonstrating the problem.

You can learn more about how to submit a useful support request here.

Depending on the used skin you have to set the settings-level to standard or higher, in summary:

  • enable debug logging at settings->system->logging

  • reboot the OSMC device twice(!)

  • reproduce the issue

  • upload the log set (all configs and logs!) either using the Log Uploader method within the My OSMC menu in the GUI or the ssh method invoking command grab-logs -A

  • publish the provided URL from the log set upload, here

OSMC skin screenshot:

image
image957×540 224 KB

10

It’s probably due to the difference between running mysql server on a x86 platform vs an ARM platform. I bet if you used a shared mysql database on a x86 system that the problem would go away. But… The real problem is a poor database design. And that’s something that needs to be fixed in Kodi. Since they still consider mysql as ‘experimental’ they clearly have no desire to actually fix mysql problems. And just the fact that they still name database fields Cxx instead of a descriptive name tells a lot about what they think about a database!

11

Here’s the URL for the log set: https://paste.osmc.tv/utaxuyukan

@bmillham It’s probably due to the difference between running mysql server on a x86 platform vs an ARM platform. I bet if you used a shared mysql database on a x86 system that the problem would go away. But… The real problem is a poor database design. And that’s something that needs to be fixed in Kodi. Since they still consider mysql as ‘experimental’ they clearly have no desire to actually fix mysql problems. And just the fact that they still name database fields Cxx instead of a descriptive name tells a lot about what they think about a database!

Interesting notion. You’d think a DB would be a DB, regardless of what platform is hosting it; it should just be tables and data. Just for kicks, I’m going to upgrade my Lubuntu install and see if my Kodi installation on there is having this issue. I don’t recall this issue in the past, but I may not have had these particular movies the last time I ran Kodi there.

12

MySQL, MariaDB and SQLite all have differences on how they handle the ‘same’ data types. To me, it’s a poor database design that Kodi needs to fix.

13

I was referencing this part:

What I thought you meant by that was that if I was running the mysql DB on an ARM device, another ARM device might not have an issue accessing the DB. But, since I’m running the mysql DB on an x86 device, the ARM device was having an issue querying the DB. Again, that’s what I thought you were trying to say. Based on your reply, I think I misunderstood.

14

I didn’t know were you were running the database. Now knowing that it’s on a x86 device then it’s more apparent that the problem is with Kodi, since the SQL queries used to add to the database are not x86 or ARM specific.

15

Hehe… that was the surprise I was trying to convey when I said “you’d think a DB would be a DB”. :slight_smile: It wasn’t making sense. Ah, the joys of miscommunication through writing. Glad we’re on the same page now. :+1:

Is there anything else you think I might need to provide for the OSMC folks?

16

I think it’s possible that your database needs some manual adjustment and that the Kodi fix only applies to new databases. I haven’t looked in to the PR in detail.

19

Have you considered trying a newer version?

WARNING: MYSQL: Your database server version 5.5.42 is very old and might not be supported in future Kodi versions. Please consider upgrading to MySQL 5.7 or MariaDB 10.2.

I’m having some issues remembering details but I think there were some issues with Kodi 18 and the 5.5 and older. I stuck with 5.5.42 for a very long time as I got better performance on my setup and 5.7 caused some other issue that I forget off hand years ago when I tried it. I think there is still issues with newer versions of MySQL but i’ve not had any issues upgrading to a current MariaDB.

20

Hey, Sam. I already made the db change described on Github to my central mysql db for both TV shows and movies. That’s why my NUC running the Windows version of Kodi isn’t having an issue with these movies.

21

If Sam or someone else at OSMC believes an upgrade will fix it, I’ll give it a try. But, the fact that my NUC running Kodi for Windows isn’t having an issue with the mysql version I’m running makes me think that’s not likely the cause. Likewise, I’m hesitant to attempt switching to a different db entirely when it appears to be working fine everywhere else.

Again, if someone can provide any sort of evidence as to what’s causing OSMC to have an issue here and it points to mysql or the version of mysql being the culprit, I’ll be more willing to give that a try. Changing the db isn’t exactly a simple endeavour. Right now–absolutely no offense intended toward anyone trying to help, as I sincerely appreciate it, but–the solutions being suggested aren’t based on any sound theories.

22

The percentage of Kodi users on MySQL is pretty small and it just so happens that @bmillham and myself are in that group. We are both running MariaDB, he from *nix, me on Win, and neither of us have run across the issue your having with movies. We both hit the issue with Doctor Who and fixed it by finding that PR, but can you point to anyone who has posted anywhere with this issue? In my mind switching over from a very old, unsupported db version to something current makes sense even if it is a PITA. As I said I think they made some changes that are not entirely compatible with 5.5 anymore.

If you want to post what all your movie scraper settings are I will try to reproduce the issue on my system and let you know if I can reproduce. They are not part of the logs and i’m not sure where they are stored so I would only know to look and type them out.

23

I’m not sure what OS you’re running MySQL on but given MySQL 5.7 goes out of support in October this year and 5.5 went out of support in December 2015 I’d go for 8.0 if you stick with MySQL. Officially supported MySQL versions are at https://www.mysql.com/support/supportedplatforms/database.html.

For what it’s worth, I’m running a MySQL official (rather than distro packaged) install of MySQL8.0 as a shared server and beyond that one issue I mentioned (never got as far as seeing the column change you did) I’ve not had many issues. (Though the default deploy is un-tuned.)

Whatever you choose, I would recommend upgrading the DB - it’s going to be hard to get help (and people may make wrong assumptions) if running an old version compared to current standards.

24

MySQL in the past and a few years a MariaDB user and I never had any issues actually