You are here

tvtvus website has changed again I think

66 posts / 0 new
Last post
gdogg371
Offline
Donator
Joined: 4 years
Last seen: 2 years
tvtvus website has changed again I think

I think the tvtv.us site has changed again slightly. I wrote myself a little pre scraper to grab all the line up ID's using the below regex:

a_tags = divs.find_all("a", {"class": "MuiButtonBase-root MuiListItem-root MuiListItem-gutters MuiListItem-divider MuiListItem-button"})

...this no longer works and lineups that previously worked when in channel update mode no longer do. If the .ini is using the same regex that might be why.

Could someone please take a look? I've attached the WG+ log.

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

Please update wg++, then in the log seems is missing something
which area are you trying to get ?

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

yes I have problem too from tvtv.us

[ Info ] ( 1/244 ) TVTV.US -- chan. (xmltv_id=ESPN) -- mode Incremental
[Error ] Unable to update channel ESPN
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from ESPN
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Info ] ( 1/244 ) TVTV.US -- chan. (xmltv_id=ESPNEWS) -- mode Incremental
[Error ] Unable to update channel ESPNEWS
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from ESPNEWS
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

the site is changed with different TAB for Cable satellite INTERNET

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

new version in git

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

?
new siteini? where is it
the channel on the config file are all changed?

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

theres' also the tvtv.ca file ini ?

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

I think is it:
https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...

seem work with same config file but very slow

gdogg371
Offline
Donator
Joined: 4 years
Last seen: 2 years

For anyone confused by Mats response - if you follow the Github link, it takes you to the updated .ini file for tvtv.us ...you can just copy paste the text from there into your local .ini file. Last modified date at the time of me posting this comment is 15 hours ago. I have run again with the updated .ini and channel grab now works again (although I haven't tried grabbing any EPG data yet...

...for tvtv.ca, the last modified date of the .ini file in the Github repo was two months ago. If the same site change has occurred for tvtv.ca as has for tvtv.us, then the tvtv.ca .ini still needs updating...

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

Right i will update tvtv.ca asap

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

Couple things i noticed, tvtv.us and tvtv.ca use same server so they can handle same request, i mean if you grab a us channel using canada siteini it will work.
Why is slow ?
1. they split a basic data and details so to have enough information, we need to grab both. That take time as 2 request are sent to grab data.
2. They use cdn (Contenent Data Network) to speed up the process the CDN server keeps the info for xx time, to make it faster if the request of data was already registred. Infact if you grab a channel first run will be 50 seconds and if you run it right after you get a very short time 0.2 seconds because the data is stored for short time on the server.
That said hope you enjoy, of course this are provider settings and there is nothing we can do about, other then explain why is "slow".

Tvtv.ca updated

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

thanx... tvtv.ca seem have some trouble

[ Info ] ( 1/93 ) TVTV.CA -- chan. (xmltv_id=Leafs Nation Network) -- mode Incremental
[Error ] error downloading page: Operazione o metodo non implementato. (80sec)
[Error ] retry 1 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (160sec)
[Error ] retry 2 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (240sec)
[Error ] retry 3 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (320sec)
[Error ] retry 4 of 4 times
[Error ] Unable to update channel Leafs Nation Network
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from Leafs Nation Network
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Info ] ( 1/93 ) TVTV.CA -- chan. (xmltv_id=CBC Toronto) -- mode Incremental
[Error ] error downloading page: Operazione o metodo non implementato. (80sec)
[Error ] retry 1 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (160sec)
[Error ] retry 2 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (240sec)
[Error ] retry 3 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (320sec)
[Error ] retry 4 of 4 times
[Error ] Unable to update channel CBC Toronto
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from CBC Toronto
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

thanks for the explanation... so how long does the server keep the request stored as you ? how often should the request be run

gdogg371
Offline
Donator
Joined: 4 years
Last seen: 2 years

Ive tested the above re using Canadian line ups using the tvtv.us .ini btw and it works. I'd rather keep my processes separate though and I'm having issues again with the .robots file. I had the same issue with tvtv.us and in the end another user had to post their .robots file for it to work for me. This seems like a trivial thing, yet I'm clearly doing something wrong. Can someone please link me a working .robots file for tvtv.ca and also tell me what the correct process is for creating a working one myself? Setting files to read only and modifying the text of the file has not worked. Nor has copying and renaming the tvtv.us .robots file...

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months
gdogg371 wrote:

Ive tested the above re using Canadian line ups using the tvtv.us .ini btw and it works. I'd rather keep my processes separate though and I'm having issues again with the .robots file. I had the same issue with tvtv.us and in the end another user had to post their .robots file for it to work for me. This seems like a trivial thing, yet I'm clearly doing something wrong. Can someone please link me a working .robots file for tvtv.ca and also tell me what the correct process is for creating a working one myself? Setting files to read only and modifying the text of the file has not worked. Nor has copying and renaming the tvtv.us .robots file...

.robots file
User-agent: *
User-agent: WebGrab+Plus

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

how works for you tvtv.ca.ini?

i use the last tvtv.ca in github update 3h ago... but i have problem
i try to use the tvtvt.us ini file i change name of the file to tvtv.ca and the row inside url=tvtv.ca|timezone=UTC|maxdays=7|cultureinfo=en-US|charset=UTF-8|episodesystem=onscreen|ratingsystem=US
still dont work

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour
dariofol wrote:

how works for you tvtv.ca.ini?
i use the last tvtv.ca in github update 3h ago... but i have problem
i try to use the tvtvt.us ini file i change name of the file to tvtv.ca and the row inside url=tvtv.ca|timezone=UTC|maxdays=7|cultureinfo=en-US|charset=UTF-8|episodesystem=onscreen|ratingsystem=US
still dont work

can you post your channel list, ?

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

in attach... works until two days ago

for the US channel i change only the ini file

EDITED NO LICENSE DATA !!!

gdogg371
Offline
Donator
Joined: 4 years
Last seen: 2 years

the problem isnt knowing what text to copy paste into the file, it seems to be the file itself. do you have to do a write binary file create or similar? I seem to remember there was an issue with WG+ files that was along these lines.

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

i create on windows the file tvtv.ca.ini and paste the text from the raw file take from git.
same procedure with the tvtv.us

the underscore is not presente on the file

Attachments: 
dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

pics of the file ini

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

You cannot rename it it breaks encryption.
What i meant you can put in config channel lines from canada, but you need to rename the site="tvtv.ca" to site="tvtv.us"
Anyway tvtv.ca is uploaded, tested with some channels and works fine

Attachments: 
dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

its very strange because for the us file i dont make this...
so i download the file and unzip... i regenerate the robot file with line:
User-agent: *
User-agent: WebGrab+Plus withe only read
same error:

[Error ] error downloading page: Operazione o metodo non implementato. (80sec)
[Error ] retry 1 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (160sec)
[Error ] retry 2 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (240sec)
[Error ] retry 3 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (320sec)
[Error ] retry 4 of 4 times
[Error ] Unable to update channel Leafs Nation Network
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from Leafs Nation Network
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

you have an old version of wg i think this happens with 3.2.x.x so update to version 4 or 5

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

i resolve with tvtv.us.ini file and change the site in the webgrab++ config, put the us robot file and works.
very strange.
thx for support

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months
mat8861 wrote:

you have an old version of wg i think this happens with 3.2.x.x so update to version 4 or 5

you intend 3.2.5 ?

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

Yes you should use one of these:
https://github.com/SilentButeo2/webgrabplus-siteinipack/tree/master/eval...
i suggest the new 5.0.0.1 or the latest 4.2.4.6

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

thx i try.

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

something change for Rex postprocess?
I have this but the epg now dont show the subtitle
'title'{ - 'subtitle'}

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

after the new tvtv.us.ini file seem that in the xml subtitle tag disappeared so the rex postprocess (title - subtitle) fail.
these are the tag grabbed:

title
desc lang="en"
date
category lang="en">News
category lang="en">Sports talk
icon src=
its possible fix this?

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

They have reduced all elements and made guide very simple, anyway if you post couple channel line i can check

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

yes but the subtitle there should be on the epg
in attach the grab of 2 channel

Attachments: 
dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

actualy epg show only NFL FOOTBALL

before with rex was NFL FOOTBALL - Houston texas Chicago bears

i use rex title - subtitle

thx as usualy

Attachments: 
dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

i dont understand seem theres subtitle(1) and sub of the subtitle(2)

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

will try to separate

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months

thx for your kindness

frankabagnale3rd
Offline
frankabagnale3rd's picture
Has donated long time ago
Joined: 4 years
Last seen: 1 year

So I did a lot of things today to get tvtv back to functional, including ordering a new server with fresh installs, etc. The one thing I did recently to finally stop the robot files form being changed was change the name of the original folder, add a new robots folder, then create new robot files and chmod them. On ubuntu:

--------------------
cd ~/.wg++

mv robots robots.OLD

mkdir robots

cd robots

nano tvtv.us.robots

*ADD THESE 2 lines to the file ONLY
User-agent: *
User-agent: WebGrab+Plus
*Save and exit

nano tvtv.ca.robots

*ADD THESE 2 lines to the file ONLY
User-agent: *
User-agent: WebGrab+Plus
*Save and exit

cd ..

chmod -R 444 robots

--------------------

Since I did that I didn't have any edits. Today I realized my tvtv wasn't running and I saw a post here on a totally different ini that fixed my issue.

I did this:
nano ~/.wg++/siteini.pack/USA/tvtv.us.ini
After all the change log and scanning instructions the first line looks like this:

**------------------------------------------------------------------------------------------------
site {url=tvtv.us|timezone=UTC|maxdays=7|cultureinfo=en-US|charset=UTF-8|episodesystem=onscreen|ratingsystem=US}

At the very beginning add compression=gzip|

It should now look like this:

**------------------------------------------------------------------------------------------------
site {compression=gzip|url=tvtv.us|timezone=UTC|maxdays=7|cultureinfo=en-US|charset=UTF-8|episodesystem=onscreen|ratingsystem=US}

My tvtv.us is scanning now as we speak. Hope this helps.

Tw1zT3D247
Offline
Donator
Joined: 2 years
Last seen: 1 week

I am getting the same thing?

frankabagnale3rd
Offline
frankabagnale3rd's picture
Has donated long time ago
Joined: 4 years
Last seen: 1 year

Did you read the solution right above your post?

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour

You do not need compression=gzip is integrated, use update siteini.pack (yesterday i changed a bit tvtv.us but didn't change revision, so make sure looks the same as the one on git. Tvtv.ca was already fine.

frankabagnale3rd
Offline
frankabagnale3rd's picture
Has donated long time ago
Joined: 4 years
Last seen: 1 year

After messing with it for hours I really just deployed a new server with a fresh install and fresh siteini.pack. The latest revision dates are somehow tomorrow on them and they still weren't working. Adding that text to the ini 100% is the thing that got it working for me. Maybe I just missed the revisions or something.

frankabagnale3rd
Offline
frankabagnale3rd's picture
Has donated long time ago
Joined: 4 years
Last seen: 1 year

After messing with it for hours I really just deployed a new server with a fresh install and fresh siteini.pack. The latest revision dates are somehow tomorrow on them and they still weren't working. Adding that text to the ini 100% is the thing that got it working for me. Maybe I just missed the revisions or something.

Fallito
Offline
Donator
Joined: 8 years
Last seen: 10 months

My channels are being skipped. It gives this error:

( 1/209 ) TVTV.US -- chan. (xmltv_id=WKAQDT (WKAQ-DT)) -- skipped --> encrypted SiteIni

the previous ini file which was also encrypted didn't trigger this. Any thoughts?

frankabagnale3rd
Offline
frankabagnale3rd's picture
Has donated long time ago
Joined: 4 years
Last seen: 1 year

I would assume you need to update your software. Not sure what distro you’re using but download the update from here http://webgrabplus.com/sites/default/files/download/SW/V3.2.0/WebGrabPlu... that’s the latest stable release, but you can click other versions from the download page for beta and eval builds). Then In your current instance, rename the bin folder. I keep all mine and rename like bin.SEP21. Then add the bin folder from the new download zip to your instance. If on Linux you can wget the download and unzip to your current instance and it will ask you which files / folders you want to overwrite.

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months
mat8861 wrote:

will try to separate

I don't want to rush you but there is some news about missing tag of ini file?

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour
Fallito wrote:

My channels are being skipped. It gives this error:
( 1/209 ) TVTV.US -- chan. (xmltv_id=WKAQDT (WKAQ-DT)) -- skipped --> encrypted SiteIni
the previous ini file which was also encrypted didn't trigger this. Any thoughts?

Bad copy see FAQ please

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 1 hour
dariofol wrote:

mat8861 wrote:
will try to separate

I don't want to rush you but there is some news about missing tag of ini file?

can you post a sample of you need, I checked and seems fine.

dariofol
Offline
Donator
Joined: 5 years
Last seen: 10 months
mat8861 wrote:

dariofol wrote:

mat8861 wrote:
will try to separate

I don't want to rush you but there is some news about missing tag of ini file?

can you post a sample of you need, I checked and seems fine.

An example
actualy epg show only NFL FOOTBALL

before with rex was NFL FOOTBALL - Houston texas Chicago bears

i use rex: 'title'{ - 'subtitle'}
Seem the subtitle tag Is Missing

Above i post the file .xml for Two channel, and a pics of a epg on the TV site
In attach a pics to show the request.
Tel me if you need other things

Attachments: 
Fallito
Offline
Donator
Joined: 8 years
Last seen: 10 months

Updating to the latest beta version just do it. If you are a linux user like me, it has to be the latest(5.xx.xx) because dotnet5 is no longer available for download. You have to install dotnet6 and the latest beta is the only one supporting it.
Yes Matt,that also was a problem. Thank both of you, Frank & Matt.

ejohalj
Offline
Donator
Joined: 6 years
Last seen: 1 month

I do still have some problem with this, I have version version V3.2.2.0 of Webgrabplus(Linux version), I also updated to the latest tvtv.us.ini, so I have"@Revision 8 - [21/09/2022] Mat8861*rewrite".

So the error I get is this:

( x/xx ) TVTV.US -- chan. (xmltv_id=CMT) -- mode Incremental
iiiiiii
Unable to update channel CMT
Generic syntax exception:
message:
no index page data received from CMT
unable to update channel, try again later
Existing guide data restored!

I would be happy to get a little help, thanks!!

Tw1zT3D247
Offline
Donator
Joined: 2 years
Last seen: 1 week

I get this error any ideas? I also updated to the latest tvtv.us.ini, so I have"@Revision 8 - [21/09/2022] Mat8861*rewrite".

error downloading page: The requested address is not valid in its context. (tvtv.us:443)

Pages

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl