You are here

grab from enigma2 openwebif

52 posts / 0 new
Last post
alturismo
Offline
Joined: 6 years
Last seen: 1 year
grab from enigma2 openwebif

Hi,

as im looking for a epg for my tvheadend server wich is tuned by an enigma2 box, i would like to know if its possible to grab the epg from the enigma box instead from the web ... i couldnt find any way to export the epg.dat from enigma to an xml, so i though may thats possible with webgrab+ ;)

Thanks ahead.

alturismo
Offline
Joined: 6 years
Last seen: 1 year

;) well, i want to import to TVHeadend, but therefore i 1st need the data as xml ;)

here is a sample from epg.dat from enigma2, its always a full epg ~ 12 mb ... sorry.

https://1drv.ms/u/s!ApY1s9BRY-iSmWzeu2oP7bUS845o

 

alturismo
Offline
Joined: 6 years
Last seen: 1 year

too bad, already thought so, i also opened it and its some code in there ...

my intention, i also have a TVHeadend Server besides the enigma2 server, TVH now uses the enigma2 box as iptv source,

so then i dont have any OTA EPG anymore in TVH. WG+ i only used for the channels i am recording Series cause i like to have the season, episode infos,

on the enigma2 Box its already all there, EPG with series infos and so on ... so why double handling when its there already ;)

And, i couldnt find a decent source to add all channels with WG+ to TVH ... always some missing and not really reliable here, i need pretty much all german

HDTV and UHD epg´s, also including sports ... Kabel Deustchland (Vodafone, this grabber works ok), HD+ and Sky Satellite.

well, i ll try some more sites and see if i can find a good source for my channels epg´s ;)

thanks for taking a look

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

with http://decoder_IP/web/getallservices  you get services then you can use :

1. Enigma2webif

http://IP_of_your_box/web/epgservice?sRef=1:0:1:19A:136:70:1680000:0:0:0:

2.Openwebif

http://IP_of_your_box/ajax/epgpop?sref=1:0:1:19A:136:70:1680000:0:0:0:

 

as path for grab. Then use the site.ini Blackbear199 indicated in the post above. Basically you grab what you see in

http://IP_of_your_box/web/epgservice?sRef=1:0:19:5208:0:0:11AAB59:0:0:0:

Example:

<e2event>

<e2eventid>8965</e2eventid>

<e2eventstart>1518351660</e2eventstart>

<e2eventduration>540</e2eventduration>

<e2eventcurrenttime>1518351426</e2eventcurrenttime>

<e2eventtitle>French Connections</e2eventtitle>

<e2eventdescription>French Connections</e2eventdescription>

<e2eventdescriptionextended>

A quirky, insider's guide to understanding France and the French, from the sublime to the ridiculous.

</e2eventdescriptionextended>

<e2eventservicereference>1:0:1:328:3BC4:13E:820000:0:0:0:</e2eventservicereference>

<e2eventservicename>France 24 HD (in English)</e2eventservicename>

</e2event>

 

This is helpful if you need epg from satellite to use in other sources

PS

path may vary between Enigma2 DreamboxIOS and OpenSource

alturismo
Offline
Joined: 6 years
Last seen: 1 year

i also checked at the /web/epg.... interface, figured i had to replace all ":; ;..."

so a sample looks like this here

http://192.168.1.103/web/epgservice?sRef=1%3A0%3A19%3A6E%3AD%3A85%3AFFFF...

i take a look at the sample.ini to see if that works

edit

 

alturismo
Offline
Joined: 6 years
Last seen: 1 year

ok, 1st tests where not successful

.ini

site {url=openwebif|timezone=UTC+01:00|maxdays=6.1|cultureinfo=de-GB|charset=UTF-8|titlematchfactor=90|retry=<retry time-out="4">2</retry>}

urldate.format {daycounter|0}
url_index{url|http://root:password@192.168.1.103/web/epgservice?sRef=|channel|}

index_showsplit.scrub {multi (debug)|<table style=||</table>}
index_start.scrub {single (includeblock=2)|<td>||</td>|}
index_stop.scrub {single ()|<td valign="top">||</td>|}
index_title.scrub {single (includeblock=1)|<td>||</td>|}
index_subtitle.scrub {single (includeblock=4)|<td>||</td>|}
index_description.scrub {single ()|<td colspan="2" rowspan="2">||</td>|}

.xml

<settings>

    

  <filename>test.xml</filename>

<!--  

  <mode>m, n, f</mode>

 --> 

  <mode>m, n, #</mode> 

  <proxy>automatic</proxy> 

  <logging>on</logging>

  <retry>3</retry>

  <skip>13, 1</skip>

  <user-agent>random</user-agent>

  <timespan>5</timespan>

  

   <!-- update mode

  i or incremental     only updates of changes , gabs, repairs and new shows

  l or light           forces update of today and new shows, rest as incremental

  s or smart           forces udate of today and tomorrow and new shows, rest as light

  f or full or force   forces full update 

  If one of these values is entered here it will apply to all channels selected for update 

  (see channel).  This value overrules the value of 'update' for in the individual channels 

  If no value is entered here the individual 'update' values from the channellist are taken -->

  <update>f</update>

    

  <!--Polen-->

    <channel update="f" site="openwebif" site_id="1:0:19:30D7:413:1:C00000:0:0:0:" xmltv_id="Eurosport 2 HD Xtra">Eurosport 2 HD Xtra</channel>

<channel update="f" site="openwebif" site_id="1:0:19:7C:6:85:FFFF0000:0:0:0:" xmltv_id="Fox HD">Fox HD</channel>

 

</settings>

 

respond

--------------------------------------------------------------------------------

Job started at 11/02/2018 14:41:19
timezone=UTC+01:00 mapped with timezone_id "Europe/Paris"
found: C:\Users\mabenamara\AppData\Local\WebGrab+Plus\siteini.pack\Germany\openwebif.ini -- Revision 00

!! SiteIni openwebif.ini contains active debug arguments !!!
!! Expect slower processing!!

processing C:\Users\mabenamara\AppData\Local\WebGrab+Plus\test.xml ...
Found existing channel (xmltv_id=Eurosport 2 HD Xtra) in the config file
Found existing channel (xmltv_id=Fox HD) in the config file
....

      i=index  .=same  c=change  g=gab  r=replace  n=new

Group (0) :
update requested for - 2 - out of - 2 - channels for 6 day(s)
(   1/2   ) OPENWEBIF -- chan. (xmltv_id=Eurosport 2 HD Xtra) -- mode Force

no robots data found
skipped robots check
i
Unable to update channel Eurosport 2 HD Xtra
Generic syntax exception:
   message:
no index page data received from Eurosport 2 HD Xtra
unable to update channel, try again later
Existing guide data restored!
(   1/2   ) OPENWEBIF -- chan. (xmltv_id=Fox HD) -- mode Force

no robots data found
skipped robots check
i
Unable to update channel Fox HD
Generic syntax exception:
   message:
no index page data received from Fox HD
unable to update channel, try again later
Existing guide data restored!

Job finished at 11/02/2018 14:41:19 done in 0s

alturismo
Offline
Joined: 6 years
Last seen: 1 year

sure i did test, thats why i modified the ini

thats the original

**------------------------------------------------------------------------------------------------
* @header_start
* WebGrab+Plus ini for grabbing EPG data from TvGuide websites
* @Site: OpenWebIf - Enigma box
* @MinSWversion:
* @Revision 0 - [27/10/2014] Willy De Wilde
*   - creation
* @Remarks:
* @header_end
**------------------------------------------------------------------------------------------------

site {url=openwebif|timezone=UTC+01:00|maxdays=6.1|cultureinfo=en-GB|charset=UTF-8|titlematchfactor=90|retry=<retry time-out="4">2</retry>}

urldate.format {daycounter|0}
url_index{url|http://192.168.1.19/ajax/epgpop?sref=|channel|}

index_showsplit.scrub {multi ()|<table style=||</table>}
index_start.scrub {single (includeblock=2)|<td>||</td>|}
index_stop.scrub {single ()|<td valign="top">||</td>|}
index_title.scrub {single (includeblock=1)|<td>||</td>|}
index_subtitle.scrub {single (includeblock=4)|<td>||</td>|}
index_description.scrub {single ()|<td colspan="2" rowspan="2">||</td>|}

 

i have openwebif, but /ajax/epgpop.... doesnt respond at all, thats why i changed to that what gives me results

a sample result see attachment

Attachments: 
alturismo
Offline
Joined: 6 years
Last seen: 1 year

/ajax/epgpop?sref=.... doesnt work here at all

/web/epgservice?sRef=... working in browser

none working in webgrab

alturismo
Offline
Joined: 6 years
Last seen: 1 year

tetsing now

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

Like I said in my post above is your decoder running openwebif or regular enigma2 web interface ? What software do you use on your decoder ?The latest openwebif may have changed path, so you better indicate what version you are using

alturismo
Offline
Joined: 6 years
Last seen: 1 year

now, respond is

Job started at 11/02/2018 17:18:33
timezone=UTC+01:00 mapped with timezone_id "Europe/Paris"
found: C:\Users\mabenamara\AppData\Local\WebGrab+Plus\siteini.pack\Germany\openwebif.ini -- Revision 00

!! SiteIni openwebif.ini contains active debug arguments !!!
!! Expect slower processing!!

processing C:\Users\mabenamara\AppData\Local\WebGrab+Plus\test.xml ...
Found existing channel (xmltv_id=Eurosport 2 HD Xtra) in the config file
Found existing channel (xmltv_id=Fox HD) in the config file
....

      i=index  .=same  c=change  g=gab  r=replace  n=new

Group (0) :
update requested for - 2 - out of - 2 - channels for 6 day(s)
(   1/2   ) OPENWEBIF -- chan. (xmltv_id=Eurosport 2 HD Xtra) -- mode Force

no robots data found
skipped robots check
i
Unable to update channel Eurosport 2 HD Xtra
Generic syntax exception:
   message:
no index page data received from Eurosport 2 HD Xtra
unable to update channel, try again later
Existing guide data restored!
(   1/2   ) OPENWEBIF -- chan. (xmltv_id=Fox HD) -- mode Force

no robots data found
skipped robots check
i
Unable to update channel Fox HD
Generic syntax exception:
   message:
no index page data received from Fox HD
unable to update channel, try again later
Existing guide data restored!

Job finished at 11/02/2018 17:18:34 done in 0s

 

ini looks like this now

site {url=openwebif|timezone=UTC+01:00|maxdays=6.1|cultureinfo=de-GB|charset=UTF-8|titlematchfactor=90|retry=<retry time-out="4">2</retry>}

urldate.format {daycounter|0}
url_index{url|http://root:password@192.168.1.103/web/epgservice?sRef=|channel|}

index_showsplit.scrub {multi|<e2eventlist>|<e2event>|</e2event>|</e2eventlist>}
index_showsplit.modify {(debug)}
index_start.scrub {single|<e2eventstart>||</e2eventstart>|</e2eventstart>}
index_stop.scrub {single ()|<td valign="top">||</td>|}
index_subtitle.scrub {single (includeblock=4)|<td>||</td>|}
index_duration.scrub {single|<e2eventduration>||</e2eventduration>|</e2eventduration>}
index_title.scrub {single|<e2eventtitle>||</e2eventtitle>|</e2eventtitle>}
index_description.scrub {regex||<e2eventdescription[^>]*>(.*?)</e2eventdescription[^>]*>||}

 

im using a VU+ 4k, VTI 13, openweb interface

alturismo
Offline
Joined: 6 years
Last seen: 1 year

no AV, same mashine as where i am using browser ... so pretty sure its not blocked

also reachable through command line

C:\Users\mabenamara\AppData\Local\WebGrab+Plus>ping 192.168.1.103

Ping wird ausgeführt für 192.168.1.103 mit 32 Bytes Daten:
Antwort von 192.168.1.103: Bytes=32 Zeit<1ms TTL=64
Antwort von 192.168.1.103: Bytes=32 Zeit<1ms TTL=64
Antwort von 192.168.1.103: Bytes=32 Zeit<1ms TTL=64
Antwort von 192.168.1.103: Bytes=32 Zeit<1ms TTL=64

Ping-Statistik für 192.168.1.103:
    Pakete: Gesendet = 4, Empfangen = 4, Verloren = 0
    (0% Verlust),
Ca. Zeitangaben in Millisek.:
    Minimum = 0ms, Maximum = 0ms, Mittelwert = 0ms

alturismo
Offline
Joined: 6 years
Last seen: 1 year

nothing i can see ...

url_index{url(debug)|http://root:password@192.168.1.103/web/epgservice?sRef=|channel|}

may i ask if |channel| is the right argument ? i ant see anywhere that the siteid is used in any way ?

 

Job started at 11/02/2018 17:30:56
timezone=UTC+01:00 mapped with timezone_id "Europe/Paris"
found: C:\Users\mabenamara\AppData\Local\WebGrab+Plus\siteini.pack\Germany\openwebif.ini -- Revision 00

!! SiteIni openwebif.ini contains active debug arguments !!!
!! Expect slower processing!!

processing C:\Users\mabenamara\AppData\Local\WebGrab+Plus\test.xml ...
Found existing channel (xmltv_id=Fox HD) in the config file
Found existing channel (xmltv_id=Eurosport 2 HD Xtra) in the config file
....

      i=index  .=same  c=change  g=gab  r=replace  n=new

Group (0) :
update requested for - 2 - out of - 2 - channels for 6 day(s)
(   1/2   ) OPENWEBIF -- chan. (xmltv_id=Fox HD) -- mode Force

no robots data found
skipped robots check
i
Unable to update channel Fox HD
Generic syntax exception:
   message:
no index page data received from Fox HD
unable to update channel, try again later
Existing guide data restored!
(   1/2   ) OPENWEBIF -- chan. (xmltv_id=Eurosport 2 HD Xtra) -- mode Force

no robots data found
skipped robots check
i
Unable to update channel Eurosport 2 HD Xtra
Generic syntax exception:
   message:
no index page data received from Eurosport 2 HD Xtra
unable to update channel, try again later
Existing guide data restored!

Job finished at 11/02/2018 17:30:57 done in 0s

alturismo
Offline
Joined: 6 years
Last seen: 1 year

i already checked that, sadly no other one here ...

 

Attachments: 
alturismo
Offline
Joined: 6 years
Last seen: 1 year

<channel xmltv_id="Fox HD" site_id="1:0:19:7C:6:85:FFFF0000:0:0:0:" site="openwebif" update="i">Fox HD</channel>
<channel xmltv_id="Eurosport 2 HD Xtra" site_id="1:0:19:30D7:413:1:C00000:0:0:0:" site="openwebif" update="i">Eurosport 2 HD Xtra</channel>

alturismo
Offline
Joined: 6 years
Last seen: 1 year

here it is

Attachments: 
alturismo
Offline
Joined: 6 years
Last seen: 1 year

thanks again for pointing to an connection ;)

now, when i look at the results, doesnt look to good to me in terms of usability for tvheadend, when i check the inputs, can i return and may ask how to modify so it fits better ?

alturismo
Offline
Joined: 6 years
Last seen: 1 year

1st, there are alot missing in results, example, when i manually check via browser

<e2event>

<e2eventid>4474</e2eventid>

<e2eventstart>1518381000</e2eventstart>

<e2eventduration>3600</e2eventduration>

<e2eventcurrenttime>1518375209</e2eventcurrenttime>

<e2eventtitle>Fußball</e2eventtitle>

<e2eventdescription>Matchday Highlights</e2eventdescription>

<e2eventdescriptionextended>Alle Spiele des aktuellen Bundesliga-Spieltags</e2eventdescriptionextended>

<e2eventservicereference>1:0:19:30D7:413:1:C00000:0:0:0:</e2eventservicereference>

<e2eventservicename>Eurosport 2 HD Xtra</e2eventservicename>

</e2event>

<e2event>

<e2eventid>4475</e2eventid>

<e2eventstart>1518384600</e2eventstart>

<e2eventduration>6300</e2eventduration>

<e2eventcurrenttime>1518375209</e2eventcurrenttime>

<e2eventtitle>Fußball</e2eventtitle>

<e2eventdescription>Matchday</e2eventdescription>

<e2eventdescriptionextended>Bundesliga, 22. Spieltag: RB Leipzig - FC Augsburg</e2eventdescriptionextended>

<e2eventservicereference>1:0:19:30D7:413:1:C00000:0:0:0:</e2eventservicereference>

<e2eventservicename>Eurosport 2 HD Xtra</e2eventservicename>

</e2event>

<e2event>

<e2eventid>4476</e2eventid>

<e2eventstart>1518390900</e2eventstart>

<e2eventduration>1800</e2eventduration>

<e2eventcurrenttime>1518375209</e2eventcurrenttime>

<e2eventtitle>Fußball</e2eventtitle>

<e2eventdescription>Matchday</e2eventdescription>

<e2eventdescriptionextended>Analyse des Spiels RB Leipzig - FC Augsburg</e2eventdescriptionextended>

<e2eventservicereference>1:0:19:30D7:413:1:C00000:0:0:0:</e2eventservicereference>

<e2eventservicename>Eurosport 2 HD Xtra</e2eventservicename>

</e2event>

<e2event>

<e2eventid>4477</e2eventid>

<e2eventstart>1518392700</e2eventstart>

<e2eventduration>3600</e2eventduration>

<e2eventcurrenttime>1518375209</e2eventcurrenttime>

<e2eventtitle>Fußball</e2eventtitle>

<e2eventdescription>Matchday Highlights</e2eventdescription>

<e2eventdescriptionextended>Alle Spiele des aktuellen Bundesliga-Spieltags</e2eventdescriptionextended>

<e2eventservicereference>1:0:19:30D7:413:1:C00000:0:0:0:</e2eventservicereference>

<e2eventservicename>Eurosport 2 HD Xtra</e2eventservicename>

</e2event>

<e2event>

<e2eventid>4478</e2eventid>

<e2eventstart>1518396300</e2eventstart>

<e2eventduration>4500</e2eventduration>

<e2eventcurrenttime>1518375209</e2eventcurrenttime>

<e2eventtitle>Eishockey</e2eventtitle>

<e2eventdescription>Eishockey: Frauen, Vorrunde</e2eventdescription>

<e2eventdescriptionextended>Kanada - Olympic Athlete from Russia</e2eventdescriptionextended>

<e2eventservicereference>1:0:19:30D7:413:1:C00000:0:0:0:</e2eventservicereference>

<e2eventservicename>Eurosport 2 HD Xtra</e2eventservicename>

</e2event>

and result in xml there are missing events

    <desc lang="en">Matchday Highlights. Alle Spiele des aktuellen Bundesliga-Spieltags</desc>
  </programme>
  <programme start="20180211213000 +0100" stop="20180212043000 +0100" channel="Eurosport 2 HD Xtra">
    <title lang="en">Fußball</title>
    <desc lang="en">Matchday. Bundesliga, 22. Spieltag: RB Leipzig - FC Augsburg</desc>
  </programme>
  <programme start="20180212043000 +0100" stop="20180212073000 +0100" channel="Eurosport 2 HD Xtra">
    <title lang="en">Eishockey</title>
    <desc lang="en">Eishockey: Frauen, Vorrunde. Kanada - Olympic Athlete from Russia</desc>
  </programme>
  <programme start="20180212073000 +0100" stop="20180212120000 +0100" channel="Eurosport 2 HD Xtra">
    <title lang="en">Eishockey</title>
    <desc lang="en">Eishockey: Frauen, Vorrunde. Japan - Schweiz</desc>

 

log attached, as all events are catched but not written to xml

Attachments: 
alturismo
Offline
Joined: 6 years
Last seen: 1 year

i see its overlapping times ... strange, ahh well, enough for today ;) thanks again, i ll test more tom morning.

log attached just in case u see something, also the xml return from browser, may easier to check what happens.

 

alturismo
Offline
Joined: 6 years
Last seen: 1 year

Hi, looking ok now for my missing channels data here, majors i grab from german site cause for example the series and episode infos are not grabbed with the commands enigma2 offers, roughly the vu box has them all nice added ;) nevermind.

what would interest me, EPG length, the grabber doesnt add all data, cutting off affter 2 days, even the settings say 6 days ...

may an idea ?

thank again ;)

alturismo
Offline
Joined: 6 years
Last seen: 1 year

openwebinterface ?

alturismo
Offline
Joined: 6 years
Last seen: 1 year

ok, i extended it a little when editing the .ini

url_index{url|http://192.168.1.103/web/epgservice?sRef=|channel|&time=14400}

like this the web is grabbing further, i guess its not using the "days" settings in .ini

thanks for pointing direction ;)

alturismo
Offline
Joined: 6 years
Last seen: 1 year

understood, thanks for the explanation.

and yes, its minutes, so 10 days i just added there, even there aint that many available.

Why did i add this setting, example, a channel like eurosport 2 hd extra returns without my addition 61 entries (within 3 days),

when i add time=14400 it returns more 72 ... so i get some extra epg data in return, even its all lower then the 6 days ...

thanks again, im good now.

alturismo
Offline
Joined: 6 years
Last seen: 1 year

sorry to ask again, i see my impoted epg from openwebif has a offset for 1 hour.

even the timezones are setted same as the other ini i use (vodafone).

site {url=vodafone.de|timezone=Europe/Berlin|

site {url=openwebif|timezone=Europe/Berlin|m

is this the setting to change the exported time ? so i could just adjust here ? forexample, change to UTC+2 even im on UTC+1 ?

alturismo
Offline
Joined: 6 years
Last seen: 1 year

here is a example from guide.xml, the 1st one is from vodafone and correct, 2nd and third are from openenigma and offset by 1 hour in TVHeadend

  <programme start="20180216150000 +0100" stop="20180216163500 +0100" channel="Sky Cinema HD">
    <title lang="de">The Boss Baby</title>

  <programme start="20180215201500 +0100" stop="20180215215000 +0100" channel="Sky Cinema +1 HD">
    <title lang="en">The Boss Baby</title>

  <programme start="20180216191500 +0100" stop="20180216205000 +0100" channel="Sky Cinema +24 HD">
    <title lang="en">The Boss Baby</title>

 

Config is as described above, all on Europ/Berlin. checked all server settings, TVH, Webgrab+,VU+ box, all showing correct time on "date",

thats why i think i have to adjust manually even if its "wrong" then.

alturismo
Offline
Joined: 6 years
Last seen: 1 year

here we go and now it fits, thanks again

scammander
Offline
Joined: 6 years
Last seen: 6 years

Hi, can you please post the final working ini file? I'm trying to get this to work at the moment and still have some errors.

alturismo
Offline
Joined: 6 years
Last seen: 1 year

my .ini (change IP to fit your enigma box)

site {url=openwebif|timezone=UTC|maxdays=6.1|cultureinfo=en-GB|charset=UTF-8|titlematchfactor=90|retry=<retry time-out="4">2</retry>}

urldate.format {daycounter|0}
url_index{url|http://192.168.1.103/web/epgservice?sRef=|channel|&time=14400}
index_showsplit.scrub {multi|<e2eventlist>|<e2event>|</e2event>|</e2eventlist>}
index_start.scrub {single|<e2eventstart>||</e2eventstart>|</e2eventstart>}
index_duration.scrub {single|<e2eventduration>||</e2eventduration>|</e2eventduration>}
index_duration.modify {calculate(format=F0)|60 /}
index_title.scrub {single|<e2eventtitle>||</e2eventtitle>|</e2eventtitle>}
index_subtitle.scrub {single|<e2eventdescription>||</e2eventdescription>|</e2eventdescription>}
index_description.scrub {single|<e2eventdescriptionextended>||</e2eventdescriptionextended>|</e2eventdescriptionextended>}

a sample line from xml

<channel xmltv_id="Eurosport 2 HD Xtra" site_id="1:0:19:30D7:413:1:C00000:0:0:0:" site="openwebif" update="f">Eurosport 2 HD Xtra</channel>

 

scammander
Offline
Joined: 6 years
Last seen: 6 years

Thank you.

ess2k
Offline
Donator
Joined: 6 years
Last seen: 3 months

You guys are absolute geniuses! This is absolutely amazing! Thank you very very much, Amazing work.

jaffar
Offline
Joined: 5 years
Last seen: 4 days

Thank you so much, I've been searching for this for a long time yes

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

I dont get this to work :(

I think maybe there is something wrong in the webgrab config file.

config
<?xml version="1.0"?>

guide.xml

mdb
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0
on
4
0
f

dummy

***********************

openwebif.ini

I have removed the * on *index_site.***

**------------------------------------------------------------------------------------------------
* @header_start
* WebGrab+Plus ini for grabbing EPG data from TvGuide websites
* @Site: OpenWebIf - Enigma box
* @MinSWversion: V2.1
* @Revision 1 - [27/02/2018] Blackbear199
* - ini update
* - add channels.xml creation
* @Revision 0 - [27/10/2014] Willy De Wilde
* - creation
* @Remarks: - edit [dreambox ip] on url_index line
* - enable cridentials line and edit username and passsword if enabled on dreambox.
* @header_end
**------------------------------------------------------------------------------------------------
site {url=openwebif|timezone=UTC|maxdays=6.1|cultureinfo=en-GB|charset=UTF-8|titlematchfactor=90|retry=2}
*
url_index{url|http://192.168.0.30/web/epgservice?sRef=|channel|&time=14400}
*url_index.headers {credentials=username,password}
urldate.format {daycounter|0}
*
index_showsplit.scrub {multi||||}
*
index_start.scrub {single||||}
index_duration.scrub {single||||}
index_duration.modify {calculate(format=F0)|60 /}
index_title.scrub {single||||}
index_subtitle.scrub {single||||}
index_description.scrub {single||||}
** _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
** ##### CHANNEL FILE CREATION (only to create the xxx-channel.xml file)
**
** @auto_xml_channel_start
*index_site_id.scrub {multi||||}
*index_site_channel.scrub {multi||||}
*index_site_id.modify {cleanup(removeduplicates link="index_site_channel")}
** @auto_xml_channel_end

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

sorry, here you go :)

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

still dosent work :(

Job started at 25/07/2018 22:18:48
found: /Users/pettereikum/Downloads/web/wg++/./siteini.pack/Misc/openwebif.ini -- Revision 01
processing /Users/pettereikum/Downloads/web/wg++/guide.xml ...
Found existing channel (xmltv_id=dummy) in the config file
...

i=index .=same c=change g=gab r=replace n=new

Group (0) :
update requested for - 1 - out of - 1 - channels for 1 day(s)
( 1/1 ) OPENWEBIF -- chan. (xmltv_id=dummy) -- mode Force
i
Unable to update channel dummy
Generic syntax exception:
message:
no index page data received from dummy
unable to update channel, try again later
Existing guide data restored!

Job finished at 25/07/2018 22:18:49 done in 1s

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

no password :(

Dont get this! Is strange.. I use vu+ uno 4k and openPli, should work?

this the output when running the scrip

Found existing channel (xmltv_id=dummy) in the config file
...

i=index .=same c=change g=gab r=replace n=new

Group (0) :
update requested for - 1 - out of - 1 - channels for 1 day(s)
( 1/1 ) OPENWEBIF -- chan. (xmltv_id=dummy) -- mode Force
i
Unable to update channel dummy
Generic syntax exception:
message:
no index page data received from dummy
unable to update channel, try again later
Existing guide data restored!

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

yes, I do :-)

if this help, example of the m3u
#EXTINF:-1,NRK1 Østlandssendingen
#EXTVLCOPT:program=145
http://192.168.0.30:8001/1:0:19:91:65:A603:FFFF0000:0:0:0:
#EXTINF:-1,NRK2
#EXTVLCOPT:program=188
http://192.168.0.30:8001/1:0:19:BC:65:A603:FFFF0000:0:0:0:
#EXTINF:-1,NRK3 / Super
#EXTVLCOPT:program=189
http://192.168.0.30:8001/1:0:19:BD:65:A603:FFFF0000:0:0:0:

and if I try this url I get a lot of text in the browser :)

http://192.168.0.30/web/epgservice?sRef=1:0:19:91:65:A603:FFFF0000:0:0:0...

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

here is that file located? its only created guide.xml i think?

disable = add the * back again?

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

will try the script somewhere else, think maybe my mac is the reason.

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

I get info about discovery channel

Attachments: 
eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

It works with vg.no site, I get the info (on my mac)

:(

eikum
Offline
Has donated long time ago
Joined: 5 years
Last seen: 4 years

Got some progress, created my own channels list. Seems to work :-) Strange that the "script" cant create the channels xml file.

The only thing im missing is category from enigma to tvheadend :)

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

the ini works fine, create channel list and grab. If You have problems may find useful e-channelizer that can assign epg to channels and at same time creates a list in /etc/epgimport/

VenimK
Offline
Donator
Joined: 5 years
Last seen: 1 month

Any updates or improvements for openweb.ini

Slayer
Offline
Donator
Joined: 3 years
Last seen: 1 month
eikum wrote:

sorry, here you go :)

Anyone to upload working openwebif.ini file?
I'm using vu zero with latest openATV sw.
I get error:
Group (0) :
update requested for - 18 - out of - 18 - channels for 2 day(s)
( 1/18 ) OPENWEBIF -- chan. (xmltv_id=AXN Black) -- mode Force
i
error downloading page: The operation has timed out. (4sec)
Retry 1 of 2 times
error downloading page: The operation has timed out. (8sec)
Retry 2 of 2 times
Unable to update channel AXN Black
Generic syntax exception:
message:
no index page data received from AXN Black
unable to update channel, try again later
Existing guide data restored!

Anyne?

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

sounds like you could not connect, so verify ip and add user/password

jaffar
Offline
Joined: 5 years
Last seen: 4 days

Heh I need some help, I don't know if it's the right place but situation is similar.
I grab only locally from enigma, don't use external pages and now I want to create .ini to combine xml with DvbViewer Recording Service trough Api.

Started with
Found channels id's (pic one), craeted channels.xml

I started to create .ini but I stuck with time. Channel name, Event and description generated correctly.

Api answer from DvbViewer Recording server is on pic two.

If anyone want to help I would be grateful, tnx.

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

try attached

Attachments: 
jaffar
Offline
Joined: 5 years
Last seen: 4 days

Tnx for answer but doesn't work, here is sample output ...

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

Please post your input file

jaffar
Offline
Joined: 5 years
Last seen: 4 days

Sorry I don't get it, what is a input file? WebGrab++.config.xml or something ...

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

this file localhost:8089/api/epg.html?lvl=2&channel= ...the one you try to extract epg from

Pages

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl