Scraper Issues - OSMC Alpha 4

Help and Support
1

Hi,

I have a very strange issue with scraping movies. I used a Raspberry 1 with Raspbmc before and never had any issues. I now switched to a Raspberry 2 with OSMC (alpha 4) and having some strange issues with the scraper.

First I used the universal movie scraper. Compared to my Raspberry 1 it was very slow and after scraping around 600 movies within approx. 24 hrs I saw that the cover art and fanart for more than 200 movies was missing. After that I erased the whole library and tried to scrape it again with movie.db scraper. Unfortunately I got an error “unable to connect to remote server”. I tried it a few times and I was able to scrape 100 movies (it took only about 15 min) before the error message returned.

The strange thing is that i was able to scrape 3TB of TV series without an issue (it only took one hour).

Any ideas?

2

How is the rpi2 connected to the network?
Debug logs would be helpful.

3

The Raspberry 2 is connected through ethernet.
Installing Add-Ons, watching Youtube Videos etc. is no issue.
I will post a debug log as soon as I’m at home.

4

I had a similar issue, but, universal movie scraper gave me an error - “unable to connect to remote server” and movie.db scraper did not list all the movies (Showed about 4-5 of 10/12 movies) I had.
I uninstalled both the scrapers, and then re-installed them, which solved the problem.

I had copied these scrapers as from a diff osmc installation on RPi2, that might have been the problem, but worth trying in your case also.

5

Here is the link to the debug-log:

http://xbmclogs.com/pfwtlomhv

@rishibhatia

Thank you. I will try to reinstall both scrapers and will let you know if it worked for me.

UPDATE:
Just tried to uninstall the scrapers. Unfortunately I cannot disable them or uninstall them.

6

Check that your pi is actually connected to the internet.

You will need to unset the content on your movie and tv sources, or just remove all sources.
Clean the library.
uninstall the addons
reboot
add the addons again
add just 1 source, say movies, and set the content.
scan to library
see what happens

7

Thank You CaNsA! I will try this.

UPDATE: I removed all sources and uninstalled the universal movie scraper.
But i cannot remove the moviedb scraper and the TVdb scraper.

8

Have you specified a custom DNS?

21:51:48 T:2616194080   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
21:51:48 T:2616194080   ERROR: CCurlFile::FillBuffer - Reconnect failed!
21:51:48 T:2616194080   ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
21:51:48 T:2616194080   ERROR: Run: Unable to parse web site
21:51:48 T:2616194080   DEBUG: scraper: GetTMDBLangThumbsByIdChain returned <details><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url function="ParseTMDBLangThumbs" cache="tmdb-images-en-tt2245084.json">http://api.tmdb.org/3/movie/tt2245084/images?api_key=57983e31fb435df4df77afb854740ea9&amp;language=en</url></details>
21:51:48 T:2616194080   DEBUG: CurlFile::Open(0xb314d0e8) http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9
21:51:58 T:2616194080   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
21:51:58 T:2616194080  NOTICE: CCurlFile::FillBuffer - Reconnect, (re)try 1
21:51:59 T:2889458720   DEBUG: script.module.osmcsetting.updates :  - blurp 678 - MyVideoNav.xml
21:52:08 T:2616194080   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
21:52:08 T:2616194080  NOTICE: CCurlFile::FillBuffer - Reconnect, (re)try 2
21:52:18 T:2616194080   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
21:52:18 T:2616194080   ERROR: CCurlFile::FillBuffer - Reconnect failed!
21:52:18 T:2616194080   ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
21:52:18 T:2616194080   ERROR: Run: Unable to parse web site
21:52:18 T:2616194080   DEBUG: CurlFile::Open(0xb314d0e8) http://api.tmdb.org/3/movie/tt2245084/images?api_key=57983e31fb435df4df77afb854740ea9&language=en
21:52:29 T:2616194080   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
21:52:29 T:2616194080  NOTICE: CCurlFile::FillBuffer - Reconnect, (re)try 1
21:52:39 T:2616194080   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
21:52:39 T:2616194080  NOTICE: CCurlFile::FillBuffer - Reconnect, (re)try 2
21:52:49 T:2616194080   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
21:52:49 T:2616194080   ERROR: CCurlFile::FillBuffer - Reconnect failed!
21:52:49 T:2616194080   ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
21:52:49 T:2616194080   ERROR: Run: Unable to parse web site
9

I think you might have to unset the content before removing the sources :confused:

re-add your original sources, unset the content, remove the sources.

But if you havent got this setup yet it might be worth just reinstalling OSMC.

time vs effort…

10

@ ActionA: I didn’t specify a custom DNS. To be honest I don’t know what a custom DNS is.
I used the OSMC installer, checked wired Network and didn’t change any network settings.

@ CaNsA: I unset the content and removed the sources but was still unable to remove the addons. I’ll reinstall OSMC.

UPDATE: Just reinstalled OSMC and I’m still unable to uninstall the moviedb scraper.

UPDATE2: same error with moviedb scraper: cannot connect to remote server.
I will now try to install OSMC with Wireless Network.

11

Can you reach this website?

12

I can reach the website from my desktop PC which is connected to the same network as the Raspberry.

Just installed OSMC with the wireless network settings. Internet connection works fine, but i get the same message again: unable to connect to remote server.

Scraping my Tv series with the tvdb scraper works flawless and really fast.

So I don’t think it is a network issue.

13

install kodi on your pc and see if you can access movie info

14

I just tested my Raspberry 1 with RASPBMC:
moviedb-scraper: unable to connect to remote server
universal movie scraper: no problems at all, downloads all the covers and cover art

Then I tested Kodi on my desktop PC:
movie-db scraper: no issues, downloaded all covers and cover art

For some reason neither my Raspberry 1 or my Raspberry 2 are able to connect to moviedb.

15

On both the rpi’s can you get the full network info and post it here.
System>system info> network

Use your phone to take pics and upload them to imgur.com if thats easiest.

16

Raspberry 1:

Link: Connected
MAC address: B8:27:EB:7A:4B:66
IP address: 192.168.1.8
Subnet mask: 255.255.255.0
Gateway: 192.168.1.1
Primary DNS: 192.168.1.1
Secondary DNS:
Internet: Connected

Raspberry 2:

Link: Connected
MAC address: B8:27:EB:2F:B1:86
IP address: 192.168.1.16
Subnet mask: 255.255.255.0
Gateway: 192.168.1.1
Internet: Connected

17

in Rpi1 add the following as Secondary DNS.
8.8.4.4

18

How do I add a secondary DNS?

I will test it in a few hours then. It’s 3:15 AM in Germany. Have to sleep a little bit. :wink:

Thank you very much for your help CaNsA. Good Night!

19

@Sascha156 - Seems you might not have been able to uninstall. Did you try deleting all the scrapers xml files? I had deleted all the scraper related info using ssh.

20

In the meantime I did a little bit of testing and it is definitely an issue with my network in combination with the raspberry.

Right know I’m using the Wireless network of my neighbor and all the scrapers are working normally. It’s clearly no longterm solution and I will do more testing in the following days/weeks.

For now I’m glad it is working.

Thank you again CaNsA for your excellent support.

1 Like