You are here

Long search time for one show

9 posts / 0 new
Last post
Lovefall
Offline
Joined: 11 years
Last seen: 5 years
Long search time for one show

Hi, 

Can anyone help me how to avoid certain shows taking over a minute to scrub? It looks like it looks for the same show in the whole bunch of different languages? See below, 81 second search for this show: 

[  Info  ] Serie: 2292/3636 ..  Law & order: Special victims unit
[  Info  ]           Episode Name: 
[  Info  ] "Law & order: Special victims unit" +  (2002) + "Christopher Meloni" .. found Show_id , 259376/all/en, 299141/all/en, 182981/all/en, 77692/all/en, 253982/all/en, 122281/all/en, 302100/all/en, 258035/all/en, 72368/all/en, 71489/all/en, 168161/all/en, 75692/all/en, 74191/all/en, 85228/all/en, 70458/all/en, 167601/all/en, 91651/all/en, 193601/all/en, 283923/all/en, 76981/all/en, 78445/all/en, 162251/all/en, 72494/all/en, 76257/all/en, 293952/all/en, 187791/all/en, 201691/all/en, 299233/all/en, 291564/all/en, 258455/all/en, 75911/all/en, 287073/all/en, 81435/all/en, 73736/all/en, 71816/all/en, 75183/all/en, 168191/all/en, 76031/all/en, 71240/all/de, 75692/all/de, 85228/all/de, 230021/all/de, 168161/all/de, 74191/all/de, 72368/all/de, 253982/all/fr, 75911/all/fr, 103681/all/nl, 85228/all/nl, 74191/all/nl, 75692/all/nl, 168161/all/nl, 71489/all/nl, 72368/all/nl, 253982/all/nl?
[  Info  ] Matching in thetvdb.com, showid = 75692/all/en
[  Debug ] EpisodeId = 4332619 SeasonId: 493228
[  Debug ] Episode = S1 E1.0
[  Debug ] Title = Law & Order: Special Victims Unit
[  Debug ] Actor = Mariska Hargitay
[  Debug ] Director = Liu Jiang
[  Debug ] Category = |Crime|Drama|
[  Info  ] Added to Local DB
[  Info  ] Done in 81.37 sec

/Niklas

Lovefall
Offline
Joined: 11 years
Last seen: 5 years

Much better, until I got an error like this: 

[  Info  ] Serie: 2268/3606 ..  Skenet bedrar
[  Info  ]           Episode Name: 
[  Info  ] "Skenet bedrar" +  (1995) + "Patricia Routledge" .. found Show_id , /all/sv, /all/en?
[  Debug ] Irregular showid "" skipped
[  Debug ] Irregular showid "" skipped
[  Debug ] --> /all/sv not a valid ShowId!
[Critical] Unhandled Exception
[Critical] 
Object reference not set to an instance of an object
[Critical] 
  at WGconsole.PostProcess+MdbScrub.GetMusthaveCompare (WGconsole.MdbIni mi, System.Xml.XmlNode show, System.String type) [0x00000] in <filename unknown>:0 
  at WGconsole.PostProcess.PostProcess_MDB () [0x00000] in <filename unknown>:0 
  at WGconsole.PostProcess..ctor (System.String[] processes) [0x00000] in <filename unknown>:0 
  at WGconsole.Program.ConsoleApplication (System.String[] args) [0x00000] in <filename unknown>:0 
  at WGconsole.Program.Main (System.String[] args) [0x00000] in <filename unknown>:0 

 

My tvdb.com.bing.ini:

mdb_temp_4.modify {addend|'mdb_temp_1'/all/sv####} * change this line to set your prefered language!!
mdb_temp_5.modify {addend|'mdb_temp_1'/all/en####} * leave this as it is!
end_loop

 

Lovefall
Offline
Joined: 11 years
Last seen: 5 years

It crashes all the time on that specific show, no matter what preferred language I have. 

Jan, help please?

/Niklas

WGMaker
Offline
WGMaker's picture
WG++ Team memberDonator
Joined: 11 years
Last seen: 1 hour
Is the support helpful?
support us

Hi Lovefall,

I want to do some tests with your setup. For that I need your logfile,  mdb.config.xml and a xmltv input file, or if its too big, the xmltv listing of shows with these long match time/ crash

Jan

Lovefall
Offline
Joined: 11 years
Last seen: 5 years

Hi Jan,

I am doing a grab right now, it has last for 4-5 hours and will still be working for a couple of hours with a totally fresh mdb.xml...

It is two problems: 1. the long searches for certain shows and 2. the crashes. I have learned that the crash doesnt happen with the version 56.15 so that´s the one I´m using right now. For starter, you can have my files to look in to the problem with the long search and then my grabbing is done I will use the latest version and force a crash to happen and send you the log-files for that, ok?

So here is my files for the 56.15 and the long searches: (The 3 examples I attached in the summarized files is all movies that the grab is searching for in tvdb.com, coincidence or not?)

/Niklas

WGMaker
Offline
WGMaker's picture
WG++ Team memberDonator
Joined: 11 years
Last seen: 1 hour
Is the support helpful?
support us

Hi Niklas,

because your problem is related to 'series' I will deal only with that. I think the movies part is OK

​The most important issue of your setup is that for series to match with tvdb or IMDb an episode title in the xmltv is a must!! (How else can it find the proper episode?) Trying to match a series title without an episode title is impossible and if a match is found, it is not the right one.  (Matching series titles without an episode title must be done in the movie section) The series section of the mdb postprocessor works different than the movie section. After matching the series title it collects all the episode titles of it available in the MDB site. It then inspects each of them one by one to see which matches the best with the episode title of the xmltv input. Obviously, this can't work without an episode title in the xmltv.

​For the mdb.config.xml this means that your setting :
<selectserie optional="productiondate,actor,director" musthave="title" minumum="3" duration="25" contains="serie,soap,thriller,comedy,drama"/>
and
<matchserie optional="productiondate,actor,director" mustmatch="title" minimum="2"/>
​are not suitable for series .

​The best values are:

<selectserie optional="productiondate,actor,director" musthave="title,subtitle" minumum="3" duration="25" contains="serie,soap,thriller,comedy,drama"/>​
​This ensures that no show is selected without a subtitle (=episode title)

<matchserie optional="productiondate,actor,director" mustmatch="subtitle" minimum="2"/>
​Adding title to mustmatch is not necessary because the primary search already takes care of that. You can play with the minimum values, I normally use 2 for selectserie and 1 for matchserie.

I recommend the latest tvdb.com.bing.ini ( http://webgrabplus.com/sites/default/files/download/ini/info/zip/MDB%20p...) because bing is a lot more efficient in selecting the correct series_id than the tvdb search engine. This will greatly reduce the number of 'candidates' to try and will thus speedup the processing a lot.
see also http://webgrabplus.com/content/new-versions-imdb-series-inis.

​The xmltv examples you provided were all without a subtitle, so not suitable for series matching. You are using svt.se and dagenstv.com , they do provide subtitles for series I hope?.
​You are correct with using 56.15, there is a bug fixed in the mdb postprocessor. Even better is the latest 56.22 with some more improvements in the mdb section.

Jan

 

Lovefall
Offline
Joined: 11 years
Last seen: 5 years

Hi,

Thanks for your input, I will change my setup and try again. As Blackbear has told me before there isn´t enough information from some of the swedish sources for series. I am afraid all of the sources provides the same information more or less and a subtitle for a serie's isn´t one of them, only episode nr and season. See below epg for a Navy CSI episode from 3 of 4 epg's:

svt.se:

00.00

Navy CIS

Amerikansk kriminalserie från 2008. Säsong 6. Del 24 av 25. En ICE-agent blir mördad efter ett säkerhetslarm på SecNav och NCIS-teamet tvingas samarbeta med FBI och ICE för att lösa mordet. I rollerna: Mark Harmon, Sean Murray, Michael Weatherly, Pauley Perrette och David McCallum. NCIS består av ett antal kriminaltekniker, med Jethro Gibbs i täten utreder de alla lagöverträdelser som berör flottans personal, oavsett rank. Gibbs får uppbackning av specialagenten Anthony DiNozzo, en före detta kriminaltekniker som är van vid att arbeta på torra land, men vars insikt i det kriminella medvetandet är en verklig tillgång.

dagenstv.com:

00:00 

Navy CIS

Amerikansk kriminalserie från 2008. En ICE-agent blir mördad efter ett säkerhetslarm på SecNav och NCIS-teamet tvingas samarbeta med FBI och ICE för att lösa mordet. Säsong 6. Del 24 av 25. Producerat år 2008. [235436]

 

tv.nu:

In the first screen for tv.nu/kanal/tv3, it only shows a short description, one sentence. In order to get som more details you need to click on the program and then there is some sort of java-script showning some more info with this url: http://www.tv.nu/p/1AVUv6-Y-HXT

 

ontv.se:

I´m not sure this site works anymore, can you take a look?

Please don´t tell me no swedish epg-sites is good enough for grabbing series? crying

 

/Niklas

 

 

 

Lovefall
Offline
Joined: 11 years
Last seen: 5 years
WGMaker wrote:

​The xmltv examples you provided were all without a subtitle, so not suitable for series matching. You are using svt.se and dagenstv.com , they do provide subtitles for series I hope?.

The result from your setup, as I was afraid of, 0 series found:
 <selectserie optional="productiondate,actor,director" musthave="title,subtitle" minumum="3" duration="25" contains="serie,soap,thriller,comedy,drama"/>​
 <matchserie optional="productiondate,actor,director" mustmatch="subtitle" minimum="2"/>

[  Debug ] 
[  Debug ]  -------------------------------
[  Debug ]      MDB Postprocessor result
[  Debug ]  -------------------------------
[  Debug ] Mdb data found for 1091 out of 2944 Movies-candidates
[  Debug ] Mdb data found for 0 out of 0 Series-candidates
[  Debug ] In 628.21 seconds  = 0.58 seconds/matched-show

Any ideas?

Also, how can I get more data for movies, 30% match must be low? I´m using 

  <site movies="imdb.com.bing" series="tvdb.com.bing"></site>

/Niklas

Jagad
Offline
Donator
Joined: 10 years
Last seen: 3 years

Use the swedish se.timefor.tv.ini. Its the only site having subtitles for series. Unfortunately a few broadcasters (channels) stopped putting out subtitles in their tablå used by se.timefor.tv, so it was cut in half (from 600 subtitles to 300 for my channel setup) a few years ago.  

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl