You are here

Need Help at config for klack.de (got errors / timeouts)

18 posts / 0 new
Last post
HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year
Need Help at config for klack.de (got errors / timeouts)

Hello

I want to check a guide.xml from only one site (klack.de) because, they got EPG for 30 days.
But unfortunatele I've got only timeout errors and I terminate the grabbing.
I changed the tomeout-time to 15 s and on some channels I've got data.
What could I change to grab all the infos - possible faster than after hours.

Second, I've became errors on index_title vs subpage_title. First I think it's because of the leading Space-Char, but this is on all entries at the klack.de website; than I think it's because of Special-Chars like ?, & vs & or double separator, but there also lines with normal Characters only the leading space chars are different.
Anybody to help me fix the problem?

thanks

regards

Use win 7 (future use on win 10)
WebGrab+Plus/w MDB & REX Postprocess -- version V3.1.0.0
Running on: Microsoft Windows NT 6.1.7601 Service Pack 1
Environment: 4.0.30319.42000
Files appended

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

Klack.de is pretty slow, so increase timeout. In general is good to set an high timeout so if there is a "slow" site for some reaason will still get the info, viceversa if it is fast will go fast anyway.
I did set a general config here
https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...

HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year

Thank you, I will test it tonight.

Wich website do you prefer with a high number of available days (min 14)?

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

Tell you the truth: I am not really interested what goes on next week...i barely look epg for the day, also i saw that many sites change schedule, so why get information that will be changed ? Anyway if you have this need, for germany there is tvtv.de with 28 days epg i think.
i did update with some changes klak.de speed is much better.

Attachments: 
HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year

Hello

the reason I need the epg for more than 1 day is, I recorded a lot. On channels without an epg-info I can only press record at live time.
Unfortunately the company I got the epg-info in the last years from closed because of corona and because a raising group didn't use linear tv, so they told.

I checked it with your config lines for mode and retry and I've didn't got timeout-errors anymore.

For Test I only got 54 channels for only 1 day, but look at the time. (and it's not because of my network: 1 GB or internet. down: 200 Mb/up: 100 Mb)
[ Debug ] 1265 shows in 54 channels
[ Debug ] 0 updated shows
[ Debug ] 1265 new shows added
[ ] Job finished at 02/10/2020 04:53:31 done in 2h 2m 54s

at a lot of channels I got
[Error ] no shows in indexpage!

and still the warnings/errors like this:

[ Debug ] skipped show without a title at
[ Debug ] suspicious title in index page
[ Debug ] Can't match any (sub)detail title(s) with any index title(s):
[ Debug ] index title(s):
[ Debug ] " Filmgorillas - Das Film- und Serienmagazin"
[ Debug ] (sub)detail title(s):
[ Debug ] "Filmgorillas"
[ Debug ] suspicious title in index page
[ Debug ] Can't match any (sub)detail title(s) with any index title(s):
[ Debug ] index title(s):
[ Debug ] " Volle Kanne - Service täglich"
[ Debug ] (sub)detail title(s):
[ Debug ] "Volle Kanne"
[ Debug ] suspicious title in index page
...
[ Debug ] Can't match any (sub)detail title(s) with any index title(s):
[ Debug ] index title(s):
[ Debug ] " aspekte - on tour - USA und Deutschland - sind wir noch Freunde?"
[ Debug ] (sub)detail title(s):
[ Debug ] "aspekte"
[ Debug ] skipped : last show, no next startime to use as stop
[ Info ] 0.23 sec/update

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

you are still using the old siteini, you should have klack.de.ini -- Revision 03 so run siteini update or download the new here:
https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...

HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year

Hello mat8861

thank you for this tip. :cookie: :coffee:

WOW! What a difference 5 min 54 s (single day 54 channels)
2 h 20 min 54 s (all 20 days 54 channels)

There are only a few warnings (No episode-num matching).
Every time the description contains the word "Folge" (german for episode), a second entry with the shortened description inserted in the guide.xml.

I want to add some other webpages (now I call it resources) for different channels. Is there a way to specify the glogal config lines to special resources?
I.E. a resource offer only 1 and an other one offer 28 days.
So I could grab the max days for PVR-channels and only 1 day for all the channels I never want to record a show. Or is this a problem at the xmltv standard?

If I found some channels not in the german resources. Is there a problem with the timezone of another countrys resources, or do the times changed, because the system got the timezone-data at the begin of the grabing?

Regards

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

1. Please tell me which channel are giving episode mismatch and which with problem in description.
2. For channels 1 or 28 days you can create a group (see webgrab config documented) in this way you can have a group of channels with timespan 0 (timespan is number of days,starting with zero aka 0=1 day) and a group of channels with 28 days, if this is what you are looking for. Viceversa you can set all to timespan 27 and it will grab whatever is available for those channels.
3.Adding other channels from other siteini/country is not a problem, wg++ calculate the difference between timezone from where you grab, and the timezone for the channel of that country. Some program do not consider the time offset and need adjustment, also that is not a problem (see faq)

HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year

Hello mat8861

Thank you again for your help. :cookie: :coffee:

1.) see appended log and shortened_guide.xml.

3.) thanks.

2.) Sounds like them what I search for. But I cant find any information about how to group channels?
I checked
http://webgrabplus.com/documentation/configuration/webgrabconfigxml (and howto)
and
http://webgrabplus.com/faq

Could you please give me a link?

Regards

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

update siteini rev.4 here: https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...
and attached also config documented.

HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year

Hello

So I only have to embrace the appropriated <channel>'s with a <channels>-tag and could specify special configs for this group into the <channels>-section. sounds easy.
I will test it later in the evening, and also update the siteini's.

Thank you very much. Lots of :cookie:'s

Regards

Hartmut

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

Hello mat8861

Everithing works with the config in terms of config groups.

EDIT no config with keys licence data PLEASE

Unfortunately some errors/warnings appears:

  • There are a lot of warnings caused of daylight-saving-time.
    Times are already in the past at the grabbing point in time and deleted. At first I thought about the start time before 6:00 a.m., because some channels still count this time to the day before.
    I started the grab later (past 6 am) again. (Because of the deleted shows from the entire grab of the previous day, I changed the timespan to 1 for secure at the second start and because my TVMosaic obviously only takes program for the following 14 days - plus the safety day - I set the other timespan to 14.)
  • In the secont try, I got far fewer warnings.
    But unfortunately, all epg data are shifted by 2 hours in TVMosaic (I have not checked the first guide.xml).
    So there must be a problem with daylight-saving-time. Even if +15 days have not yet reached 10/25/20 (day of the changeover).
  • tvtv.de.EK also causes episode-problems, if 'Folge' appears in text. Like klack.de above.
  • channel tagesschau24 only got one show (for two days?).
  • Regards

    Hartmut

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

Daylight warnings do not worry about. you have to leave with that, they will disappear 25 okt :). Next runs you shouldn't see them.
You should not change timezone.
For tvtv.de, will check title/episode

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

Updated to tvtv.de in github

HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year
mat8861 wrote:

Daylight warnings do not worry about. you have to leave with that, they will disappear 25 okt :). Next runs you shouldn't see them.
You should not change timezone.
For tvtv.de, will check title/episode

Hello mat8861

I don't have a problem with warnings. But ...

I'll put a screenshot in the attachment. Currently I borrowed a Fritz DVB-C repeater from a friend, that feeds its own epg data to the IPTV stream (stations without logo).
In the screenshot you can see when My IPTV signal (stations with logo) would be recorded by the xmltv-epg (red) and when the programs would actually have to be recorded (green) so that the recording matches the program.
This applies to all channels.

I definitely can't use the WebGrab+Plus generated xmltv epg like this.

I don't change any timezone, not that I am aware of it.
Nether on the win 7 PC I generate the epg (at this time), nor on my new win 10 PC I want to configure for future use currently. (screenshots)

How to fix this problem?

Thank you and Regards

HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year
mat8861 wrote:

Updated to tvtv.de in github

Hello

I have updatet my siteini.pack, and because of the date from dec 2019 is old.

I had searched a while and found:
https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...

I updated the tvtv.de.EK.ini-file in siteini.pack/Germany with them copy-pasted from github (incl. change name to 'tvtv.de.EK.ini').

Am I right?
So I start a new grabbing.

Now I got following:
[ Info ] found: C:\Users\HS\AppData\Local\WebGrab+Plus\siteini.pack\Germany\klack.de.ini -- Revision 03
[ Info ] encrypted in 'new (V3)' mode
[ Debug ]
[ Info ] found: C:\Users\HS\AppData\Local\WebGrab+Plus\siteini.pack\Germany\tvtv.de.EK.ini -- Revision 15
[ Info ] encrypted in 'new (V3)' mode
[Warning ] Unable to decrypt!!
[Error ] fatal decryption error: Zeichenabstände sind ungültig und können nicht entfernt werden.

Obviously, my encryption key is wrong.
Because of the Klack.de is also encrypted in V3 and does not use a <decryptkey> I remove the line.

But unfortunately at both attempts all tvtv.de-channels produce following:
[ Info ] ( 2/68 ) TVTV.DE.EK -- chan. (xmltv_id=Anixe HD) -- skipped --> encrypted SiteIni

In Home » Forums » SiteIni.Pack » Europe > Tvtv.de rev 14 I only could find your old key from Dec 2019.
Could you please update the key?

Thanks and regards

Hartmut

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 23 hours

here https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site... You cannot rename the siteini, it breakes encryption, you need to rename your channels in config from tvtv.de.EK to tvtv.de only and remove decrypt key, is no longer needed.

HSchoepke
Offline
Donator
Joined: 4 years
Last seen: 1 year
mat8861 wrote:

here https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site... You cannot rename the siteini, it breakes encryption, you need to rename your channels in config from tvtv.de.EK to tvtv.de only and remove decrypt key, is no longer needed.

Hello

- renamed back tvtv.de.EK.ini to tvtv.de.ini
- copy-paste content from link into tvtv.de.ini
- renamed tvtv.de.EK.channels.xml to tvtv.de.channels.xml
- replaced all 'tvtv.de.EK' with 'tvtv.de' in tvtv.de.channels.xml
- replaced all 'tvtv.de.EK' with 'tvtv.de' in WebGrab++.config.xml
- removed <decryptkey> in WebGrab++.config.xml

Same result.
[ Info ] ( 2/68 ) TVTV.DE -- chan. (xmltv_id=Anixe HD) -- skipped --> encrypted SiteIni
at all tvtv-channels.

Regards

Attachments: 
Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl