TMDB scraper doesn`t work

RextheC · Post by **RextheC** » Mon Nov 30, 2015 2:13 pm

Hello everybody.

Unfortunaly the TMDB scraper doesnt work for me anymore.
I use the xbmc4xbox 3.5 revision.

A few month ago, I have to change the tmdb.xml file in the "common" folder with another modified one. That has fixed some problems with poster and fanart (thx again to Dom DXecutioner).

But now... nothing is happen when I try to scrape something with the TMDB scraper (IMDB scraper works fine).
Can someone confirm that problem?

I have tried to use the previous tmdb.xml file (the one in the common folder from rev. 3.5) - nothing
then I have tried to change the tmdb.xml files (the two from rev. 3.5) with those from the 3.5.1 build - nothing

Here is the log file: http://www.xbmclogs.com/pvrju2fkw

Any ideas? Hope there is a chance to fix that.
Greetz

tim619 · Post by **tim619** » Tue Dec 01, 2015 7:24 am

I think there was an update on kodi few days ago, but I am not sure, so possibly needs fix.

Post by **Dan Dar3** » Fri Dec 04, 2015 9:52 am

Log page doesn't seem to work (did you set the paste for less than 1 month?), can you produce another debug log please.

RextheC · Post by **RextheC** » Fri Dec 04, 2015 10:17 am

Okey, thx for the info. Something else... any ideas to fix that?

I`ve no idea what i can do furthermore to solve that problem. Don`t want to use media companion or something like that.

Really hope that there will be a fix anytime in the future.

Edit:
Hmm.... what the hell happend with my log file

When i have tested the link it worked... thx Dan Dar3 for the info.
I will produce a new log file and also will take a look at the time for paste.

Post by **Dan Dar3** » Fri Dec 04, 2015 11:50 am

Please make sure it's a debug log and to capture scraping one movie with it.
http://www.xbmc4xbox.org.uk/forum/viewt ... p?f=6&t=65

It will probably require a code change to the XML files, when we confirm the issue and possibly find the Kodi forum thread discussing it we can will open a bug ticket here and will follow that.

RextheC · Post by **RextheC** » Fri Dec 04, 2015 2:46 pm

Okey, new log coming soon.
Thx again, it seems there is some hope for tmdb...

Post by **Dom DXecutioner** » Fri Dec 04, 2015 4:51 pm

Sooo...

I've tested the scraper and indeed is broken. Although the link to search is properly formatted ( I tested various movie links ), it seems that, while tmdb provides the proper results, the scraper's GetSearchResults isn't returning any results as confirmed by the debug logs. I checked and compared it to Kodi's scrapper and made a couple of small changes, but still did not work. I'm sure I missed something, but as it stands right now, I'm unable to determine why xbmc is not getting the results.

RextheC · Post by **RextheC** » Sat Dec 05, 2015 9:55 pm

Heho

Here is the new log file: http://www.xbmclogs.com/pye4voaul

Post by **Dan Dar3** » Sun Dec 06, 2015 7:47 pm

Thanks, I believe this is the interesting part below. As Dom DXecutioner mentioned earlier GetSearchResults parsing logic might need to be adjusted - TMDb call does return a result (as you can see if you paste it in HTTP URL in a web browser).

Code: Select all

19:45:48 M: 32845824   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'dav://anonymous:obias311@192.168.2.146:5005/NAS/Filme/Pixels/Pixels.mkv'
...
19:45:48 M: 31322112   DEBUG: scraper: Searching for 'pixels' using themoviedb.org scraper (file: 'tmdb.xml', content: 'movies', language: 'en', date: '2010-02-24', framework: '1.1')
19:45:48 M: 31322112   DEBUG: CurlFile::Open(D009F2A8) http://api.tmdb.org/3/search/movie?api_key=57983e31fb435df4df77afb854740ea9&query=pixels&year=&language=de
19:45:48 M: 31248384    INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://api.tmdb.org
19:45:48 M: 31064064   DEBUG: scraper: GetSearchResults returned <results></results>

RextheC · Post by **RextheC** » Sun Dec 06, 2015 8:54 pm

Good to know that the problem has been located. Perhaps, someone will find a solution. That would be very nice.

Post by **BuZz** » Wed Dec 16, 2015 3:29 pm

fixed in svn:

https://svn.exotica.org.uk:8443/xbmc4xb ... o/tmdb.xml

Post by **Dom DXecutioner** » Wed Dec 16, 2015 6:06 pm

Wow... BuZz is still alive!!! Just joking... I'll take a look at the change as I'm curious what I missed!

Thank you for your work!

Post by **BuZz** » Wed Dec 16, 2015 8:27 pm

Barely

Post by **Dom DXecutioner** » Wed Dec 16, 2015 8:33 pm

I can confirm that this now works! Simply replace the file in the scrapers->video folder.

Again, thank you!

RextheC · Post by **RextheC** » Wed Dec 16, 2015 10:26 pm

Hey guys, thx a lot... that sounds very good. Can try that out tomorrow too. Yippi,

... just great BuZz.
Perhaps, that could be the best x-mas present this year...

RextheC · Post by **RextheC** » Thu Dec 17, 2015 4:43 pm

Great support here ! I`m really happy that the tmdb scraper is back again.

Everything is fine... nfo files, Posters, Fanart.
I have changed the xml file in scrapers/ videofolder (thx Dom DXecutioner) for that info.
... and it worked

Thanks so much BuZz for your awesome work to the xbmc4xbox project and of course for fixing the tmdb scraper... fantastic !

Also thx to Dan Dar3 and all the other supporters who have helped.

Greetz

tim619 · Post by **tim619** » Tue Dec 22, 2015 6:59 pm

Awesome thanks BuZz. Today I wanted to fix the scraper for scraping my HIMYM episodes then I saw this

leafstk · Post by **leafstk** » Thu Jan 07, 2016 10:38 pm

What is the best back up scraper to use when TMDB isn't working in the future.. IMDB? I can't seem to d/l the file update Buzz posted here

simperingstorm6 · Post by **simperingstorm6** » Tue Jan 19, 2016 7:47 am

I added your xml and I still cant get the scraper to work. is it because I got 3.5.1. and also my weather works but I cant change the state it freezes. your help would be greatly needed. thank you

Gandalph · Post by **Gandalph** » Wed Jul 12, 2017 2:46 pm

Well.... I guess it is broken, again.

At the beginning of this year it worked fine for me, then my "old lady" died. So I had to buy a new xbox classic, got it softmodded, stuffed it with xbmc4xbox 3.5.3 and .... everything fine but the tmdb - scraper replies in german:

"Informationen können nicht runtergeladen werden.
Höchstwahrscheinlich ist der Server nicht erreichbar.
Möchtest Du mit der Aktualisierung fortfahren?"

In english:
"Information can not be downloaded.
Most likely the server is unavailable.
Do you want to continue with the update? "

And YES - I have updated and replaced the tmdb.xml file from https://svn.exotica.org.uk:8443/xbmc4xb ... o/tmdb.xml
But it does not work (anymore).

Well, now my "new" lady ist working, but the IMDB - scraper does not make me happy to be honest.
A working scraper that understands german and that provides me with posters would be nice.

Anyone who might help me with this?