Please help debug NFS share (long description sorry)

rjalex · 8 October 2018 18:29

Dear friends,
my Vero2 has a 192.168.174.4 address. My Rpi2 has a 192.168.174.9 address.

The RPI2 has a 1TB disk attached to it on which amongst other things I keep my movies files.
The movie files are all in a large miscellaneous directory along with many other document types in /home/bob/WD1TB/document/docs.

The RPI2 also has an /home/bob/WD1TB/movies directory with one directory per each movie and inside this second directory I have a symlink to the corresponding movie file in document/docs plus all of the usual .nfo .jpg .png descriptor files.

All of these files and directories are owned by a 1001.1001 user and are all mod 777 (or d777 for directories).

This is the result of the df command from Vero:

192.168.174.9:/home/bob/WD1TB 1922726704 1664519864 160514888 92% /mnt/WD1TB

this is the result of mount command
192.168.174.9:/home/bob/WD1TB on /mnt/WD1TB type nfs (rw,noatime,vers=3,rsize=8192,wsize=8192,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.174.9,mountvers=3,mountport=45835,mountproto=tcp,local_lock=none,addr=192.168.174.9)

The problem is that I am missing several files I’m sharing in the Movies menu (while they are visible in the Files-Videos menus).

The content is set to Movies, scraper is local info only and each movie in its own folder scan recursively.

Here is one of the movies I am not able to see in the Movies menu, as seen from OSMC command line:

osmc@osmc:/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng$ ls -la
total 3824
drwxrwxrwx 3 1001 1001 4096 Oct 7 15:44 .
drwxrwxrwx 407 1001 1001 32768 Oct 7 16:28 …
drwxrwxrwx 2 1001 1001 4096 Oct 7 15:44 .AppleDouble
-rwxrwxrwx 1 1001 1001 110093 Sep 28 20:49 Solo-banner.jpg
-rwxrwxrwx 1 1001 1001 1303554 Sep 28 20:49 Solo-fanart.jpg
-rwxrwxrwx 1 1001 1001 179341 Sep 28 20:49 Solo-landscape.jpg
-rwxrwxrwx 1 1001 1001 946571 Sep 28 20:49 Solo-poster.jpg
lrwxrwxrwx 1 1001 1001 84 Sep 28 20:45 Solo.mkv -> …/…/document/docs/Solo.A.Star.Wars.Story.2018.1080p.mkv
-rwxrwxrwx 1 1001 1001 36869 Sep 28 20:49 Solo.nfo
-rwxrwxrwx 1 1001 1001 790369 Sep 28 20:49 clearart.png
-rwxrwxrwx 1 1001 1001 416438 Sep 28 20:49 disc.png
-rwxrwxrwx 1 1001 1001 67416 Sep 28 20:49 logo.png

osmc@osmc:/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng$ file Solo.mkv
Solo.mkv: symbolic link to …/…/document/docs/Solo.A.Star.Wars.Story.2018.1080p.mkv

osmc@osmc:/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng$ file
…/…/document/docs/Solo.A.Star.Wars.Story.2018.1080p.mkv: Matroska data

Any ideas on why the Movies entry is not created like so many others correctly? Apparently all file flags are just the same.

Thank you

dillthedog · 8 October 2018 18:56

Is it documents

or document?

rjalex · 9 October 2018 13:24

Oooop sorry just a typo in the post. I could not cut & paste but retyped all

The directories, symlinks, flags all appear correct …

bmillham · 9 October 2018 14:03

I see the problem I think, the scraper is going to see the filename as solo.mkv and will probably fail finding it on TheMovieDB. Try recreating the link and name it something like:

Solo.2018.bluray.mkv

or

Solo(2018).bluray.mkv

JimKnopf · 9 October 2018 14:39

To get a better understanding of the problem you are experiencing we need more information from you. The best way to get this information is for you to upload logs that demonstrate your problem. You can learn more about how to submit a useful support request here.

So, in summary:

activate the logging
reboot the OSMC device
reproduce the issue
upload the log set either using the Log Uploader method within the My OSMC menu in the GUI or the ssh method invoking command grab-logs -A
publish the provided URL from the log set upload, here

Also, some more information about the video file Solo.mkv would be helpful:
Please see the mediainfo section in How to submit a useful support request - General - OSMC.

You can also create the mediainfo-output of the affected media file on the OSMC device:

login via SSH, user osmc, password osmc
if not already installed: sudo apt-get update && sudo apt-get install mediainfo
cdto the directory containing the video/audio material in question
since mediainfoonly needs to read the header information of the file data, copy the first 4 Mbytes of the media file to a new file:
dd if="<media file>" of=purgeme.bin bs=1024 count=4096
upload the decoded media information using
mediainfo -f purgeme.bin|paste-log
publish the returned URL here in this topic
remove the created media file snippet
rm purgeme.bin

Thx for your help.

rjalex · 14 October 2018 08:44

Thank you.
Here is the medianfo of the example missing file as mounted on Vero:
https://paste.osmc.tv/uwuqujowog

cannot remember if I’ve mentioned it but the Solo file is played without any problems on the Vero via the Files menu.

JimKnopf · 14 October 2018 10:36

Could you also upload the content of the related nfo file? I guess it’s the file Solo.nfo:

paste-log <nfo file> and provide the URL, here?

Thx

rjalex · 14 October 2018 10:55

There you go Sir! Thanks a bunch for trying to help.

https://paste.osmc.tv/hiqunodaso
osmc@osmc:/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng$

JimKnopf · 14 October 2018 11:00

Thx, and now the kodi log from a try to update the video library, see first part of response #10.
Perhaps, one can see what kodi is really trying to get from what location.

rjalex · 14 October 2018 15:07

Struggled a bit to find my way in OSMC menu system (used to Confluence) but should have accomplished what you instructed to do. As soon as the update begins I get a blue “Using local info only” message which is expected.

Hope there’s not too much garbage from myself not finding the export logs command

https://paste.osmc.tv/sozerizobo

From what I seem to understand from the log file, the local scraper is looking for a NFO file whose name is not the symlink as it should but the linked filename (which is not what I have as a setup).

To clarify here is the content of the directory as mounted on the Vero:

osmc@osmc:/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng$ ls -l
total 3780
-rwxrwxrwx 1 1001 1001 110093 Sep 28 20:49 Solo-banner.jpg
-rwxrwxrwx 1 1001 1001 1303554 Sep 28 20:49 Solo-fanart.jpg
-rwxrwxrwx 1 1001 1001 179341 Sep 28 20:49 Solo-landscape.jpg
-rwxrwxrwx 1 1001 1001 946571 Sep 28 20:49 Solo-poster.jpg
lrwxrwxrwx 1 1001 1001 84 Sep 28 20:45 Solo.mkv → …/…/rtorrent/download/Solo.A.Star.Wars.Story.2018.1080p.BluRay.DDP7.1.x264-BMF.mkv
-rwxrwxrwx 1 1001 1001 36869 Sep 28 20:49 Solo.nfo
-rwxrwxrwx 1 1001 1001 790369 Sep 28 20:49 clearart.png
-rwxrwxrwx 1 1001 1001 416438 Sep 28 20:49 disc.png
-rwxrwxrwx 1 1001 1001 67416 Sep 28 20:49 logo.png

Well I have a clue looking at other “missing” movies: when the original movie name has lots of dots in place of spaces for some reason they are not picked up …

Thank you

dillthedog · 14 October 2018 16:07

The dots in place of spaces aren’t the problem.

I missed this in the original post:

lrwxrwxrwx 1 1001 1001 84 Sep 28 20:45 Solo.mkv -> …/…/document/docs/Solo.A.Star.Wars.Story.2018.1080p.mkv

Look carefully. It has three dots in the symbolic link.

rjalex · 14 October 2018 16:19

Hats off for your eagle eyes Sir, but I wish it was that simple

In that post I retyped stuff since I could not copy and paste so it’s just a silly typo from yours humbly

Thank you nevertheless !!!

dillthedog · 14 October 2018 16:22

So what about this line?

lrwxrwxrwx 1 1001 1001 84 Sep 28 20:45 Solo.mkv -> …/…/rtorrent/download/Solo.A.Star.Wars.Story.2018.1080p.BluRay.DDP7.1.x264-BMF.mkv

Edit: From the log

16:58:43.877 T:2712400640 WARNING: No information found for item 'nfs://192.168.174.9:2049//home/bob/WD1TB//movies/Solo (2018) 1080p x264 Eng/../../rtorrent/download/Solo.A.Star.Wars.Story.2018.1080p.BluRay.DDP7.1.x264-BMF.mkv', it won't be added to the library.

so only two dots on the actual symlink.

So what’s the real output from running

ls -l "/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng/../../rtorrent/download/Solo.A.Star.Wars.Story.2018.1080p.BluRay.DDP7.1.x264-BMF.mkv"

fzinken · 14 October 2018 16:23

Wouldn’t it make troubleshooting easier to first fix this issue?

rjalex · 14 October 2018 16:38

the real output is what I pasted in the last post … as I stated I had a copy/paste problem in the first post ONLY. Here it is again to make sure I’m understading what you ask

osmc@osmc:/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng$ ls -l "/mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng/../../rtorrent/download/Solo.A.Star.Wars.Story.2018.1080p.BluRay.DDP7.1.x264-BMF.mkv"
-rwxrwxrwx 1 1001 1001 20025201887 Sep 27 21:30 /mnt/WD1TB/movies/Solo (2018) 1080p x264 Eng/../../rtorrent/download/Solo.A.Star.Wars.Story.2018.1080p.BluRay.DDP7.1.x264-BMF.mkv

no triple dots and yes the copy/paste problem was there only in the first post (which I’m going to edit now hoping it won’t confuse things further)

Thank you

rjalex · 14 October 2018 16:41

Now this is puzzling… went on the first post to edit out the “triple dots” but when I use the edit function and went down to correct those triple dots they are actually just two dots, as they should be.

Can you figure out what might be going on?

Thanks

JimKnopf · 14 October 2018 17:35

Looks to be a general kodi scraper issue using symbolic links

https://forum.kodi.tv/showthread.php?tid=211535

I think you cannot use hard links since nfo and original file are not in the same file system.
As test: What happens if you copy the nfo file to the location of the original file using the original file name?

rjalex · 14 October 2018 18:26

Hi Jim,
that old Kodi post was made by me

What you say is mostly true but if you symlink within the exported NFS tree you’re all set.

In my current setup I NFS export a whole tree which has both the download directory and the movies directory which is made of one subdirectory for each movie in the download, a symlink to it and the nfo and art files.

As a matter of fact I have most of my movies setup in the very same way and most of them are picked up in the Movies section just fine.

I am starting to think there’s something fishy with dotted names.

Thank you