You are here

Split guide.xml

11 posts / 0 new
Last post
Tapiocapioca
Offline
Has donated long time ago
Joined: 7 years
Last seen: 4 years
Split guide.xml

After many tests I made ready the list of my channels. Totally are like 1000 and I catched one problem, my pc is quite old and till I am grabbing the first 100 channels is fast, after become slower, slower, slower.... So I tought can be fast if i can make 10 files xml, with the data grabbed and after join them.
I like if I can make 10 files like guide01.xml guide02.xml guide03.xml ....  and after join to one. Join is not a problem, but about spread the job on many threads i have no idea :P Thank you if someone can help me!

Tapiocapioca
Offline
Has donated long time ago
Joined: 7 years
Last seen: 4 years
Blackbear199 wrote:

make a folder,put you exe in that folder.in that same folder make 10 folders put the ini and a config.xml in each for the channels you want in that folder.set the path for you guide.xml to each folder.

run webgrab,create a script.

WebGrab+Plus.exe /path_to_folder_1/

WebGrab+Plus.exe /path_to_folder_2/

WebGrab+Plus.exe /path_to_folder_3/

ect..

when its done each folder will have a guide.xml

merger it however you want.

 

Excuseme but I am confuse. I am using windows, so I have the software in this folder

C:\Program Files (x86)\ServerCare\WebGrab+PlusV1.1.1\

After I made in that location the folders with inside the configuration, first the original folder, after the folders i made new

C:\ProgramData\ServerCare\WebGrab\
C:\ProgramData\ServerCare\WebGrab_01\
C:\ProgramData\ServerCare\WebGrab_02\

What's the way to launch the execution choosing the folder? In my mind I want stop to execute the orignal folder and execute the number 01 and 02 in one time, two sessions, but I can only execute the file intalled in C:\Program Files (x86)\ServerCare\WebGrab+PlusV1.1.1\ and I can't choose what folder pick.
I think your suggestion is about linux, with windows everywhere I place the file WebGrab+Plus.exe always call the same config.

Tapiocapioca
Offline
Has donated long time ago
Joined: 7 years
Last seen: 4 years

Ok! Now is clear, I tried and is working :D Really thank you!

Tapiocapioca
Offline
Has donated long time ago
Joined: 7 years
Last seen: 4 years

I think I try to abuse about your patient. Can you suggest me also a simple way to join the files I made?

I tried with sed, but I think is not the right one command to do it. In my mind I want make 10 dfferent thread and after join 10 files. I did this with sed, but I have not a regular guide.xml file. I have 10 different sections with the tags <programme> and the the tags </channel>

Something like this

<?xml version="1.0" encoding="UTF-8"?>
  <channel id="Rai Uno">
    <display-name lang="it">Rai Uno</display-name>
  </channel>
  <channel id="Rai Due">
    <display-name lang="it">Rai Due</display-name>
  </channel>
  <channel id="Rai Tre">
    <display-name lang="it">Rai Tre</display-name>
  </channel>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rai Uno">
    <title lang="it">Tg1</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rai Due">
    <title lang="it">Tg2</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rai Tre">
    <title lang="it">Tg3</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <channel id="Rete 4">
    <display-name lang="it">Rete 4</display-name>
  </channel>
  <channel id="Canale 5">
    <display-name lang="it">Canale 5</display-name>
  </channel>
  <channel id="Italia 1">
    <display-name lang="it">Italia 1</display-name>
  </channel>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rete 4">
    <title lang="it">Tg4</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Canale 5">
    <title lang="it">Tg5</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Italia 1">
    <title lang="it">Tg6</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  </tv>

But I think is really better if I have one file like this

<?xml version="1.0" encoding="UTF-8"?>
  <channel id="Rai Uno">
    <display-name lang="it">Rai Uno</display-name>
  </channel>
  <channel id="Rai Due">
    <display-name lang="it">Rai Due</display-name>
  </channel>
  <channel id="Rai Tre">
    <display-name lang="it">Rai Tre</display-name>
  </channel>
  <channel id="Rete 4">
    <display-name lang="it">Rete 4</display-name>
  </channel>
  <channel id="Canale 5">
    <display-name lang="it">Canale 5</display-name>
  </channel>
  <channel id="Italia 1">
    <display-name lang="it">Italia 1</display-name>
  </channel>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rai Uno">
    <title lang="it">Tg1</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rai Due">
    <title lang="it">Tg2</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rai Tre">
    <title lang="it">Tg3</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Rete 4">
    <title lang="it">Tg4</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Canale 5">
    <title lang="it">Tg5</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  <programme start="20160611004000 +0200" stop="20160611005500 +0200" channel="Italia 1">
    <title lang="it">Tg6</title>
    <sub-title>notiziario</sub-title>
    <desc lang="it">bla bla bla</desc>
  </programme>
  </tv>

Kiros
Offline
Donator
Joined: 3 years
Last seen: 4 months

can someone please explain this http://www.webgrabplus.com/comment/6542#comment-6542
seems that i am missing something out :(

TUISTERa
Offline
Donator
Joined: 9 years
Last seen: 4 months

Explain what exactly? What are you trying to do, on which OS , which version of webgrab? Where is your problem?
Basically - Webgrab is using xml config file. You need to make different config files for each 100 channels, and use webgrab to generate different guide.xml files. Then you collect them all in one big guide.xml using merge.ini

Kiros
Offline
Donator
Joined: 3 years
Last seen: 4 months

sorry forgot to update about that
using v3
the os windows 7
i tried to make separate folders but for some reason it reads the the main config when i run another instance of webgrab
i have around 800 channels in a config and it takes ages for it dl all the data so i was looking for for splitting the process to speedup the update

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 17 hours

you need the .exe and config in each folder, then start each istance, as described above.

Kiros
Offline
Donator
Joined: 3 years
Last seen: 4 months

i did had an exe and the config in each folder but if i had one instances running when i start another one for some reason it grabs the data from the first instance

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 17 hours

run each command in its path

Kiros
Offline
Donator
Joined: 3 years
Last seen: 4 months

okie i have managed to run few instances thanks even tho the info is a little bit fading
but still somehow managed to understand it

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl