hi,
The tvdigital.de.ini file requires show-delay="1" This makes grabbing take a really long time, 1 second per title -> 10 days are about 300 Titles -> 5 Minutes delay. Without a delay, the description(<desc) isn't reliably populated. Couldn't a new delay value be created that applies between retries (after error) With show-delay="0", there are a lot of these errors: [Warning] Error downloading page: Response status code does not indicate success: 429 (Too Many Requests). after that Error it should be possible to retry grabbing after a delay I would prefer a Setting like: retry-delay="1", or better in milliseconds retry-delayms="500" i can also donate to push this. tell me how much. thanks, onur
what your saying doesnt make sense.
your using a delay of 1 sec and your getting hit with error 429 and you want to shorten the delay to less to solve it?
its just the opposite you need to increase the delay so you dont get the 429 errors in the first place.
if you dont like how long it takes used a different site file.
what your asking/trying todo is never going to work.
my fault, Error in the text, I have corrected the text.
With show-delay="0", there are a lot of these errors
Show-delay=0 you are not slowing down. Just for your info, how it works: wg reads the main channel page (indexshowdetails) example: https://www.tvdigital.de/tv-programm/daserste/ where all the shows are listed but with few elements, the time, the title, category and showicon, this in picture number 1 is grabbed with "iii" ...then wg++ goes to the single show page (showdetails) example https://www.tvdigital.de/tv-programm/der-zuerich-krimi-borchert-und-die-... to grab additional elements, description. director, actors etc etc. this happens when you see "nnnnnnn..."
The problem is that tvdigital when we call the page for showdetails, if they are called too fast it blocks you. This time is not "defined", infact if you grab one day it works fine, but when tvdigital see a continuos call of web pages thinks it's an attack. This is why we added only show delay and forunately works with 1 second delay. For other sites a full delay can be implemented retry=<retry time-out="10" channel-delay="5" index-delay="1" show-delay="1">4</retry> to slow down between channel, indexshowdetails and showdetails.
As i said in the other post and from LicNotRequired post, usually is more then 1 sec. in this case you are lucky with one second. Now what you asking is if gets error, stop, wait 1 sec and retry, which basically happens grabbing at the second day, the advantage is very very small, worth it? Personally don't think so.
thanks, for you answer.
i belive advantage can be big.
when i test with dleay=0 then 50% of description is faulty.
So delay only after error - could cut the time in half.
when implementing pls make millisec value. that would also be great for testing.
How much do I need to donate to move this forward (retry-delayms="500")?
thanks, onur
By the way, I’d like to have the unencrypted tvdigital.ini.
I used to edit it myself, for example, to process the "Show of the Day" "Tagestipp"
Contact the author