Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revisionLast revisionBoth sides next revision | ||
c3tracker:setup [2022/05/27 17:35] – andi | c3tracker:setup [2023/09/02 09:07] – kunsi | ||
---|---|---|---|
Line 7: | Line 7: | ||
* Compare project properties with previous instalment of the same event | * Compare project properties with previous instalment of the same event | ||
- | optimal properties from current project | + | ==== optimal properties from current project |
``` | ``` | ||
- | Project | + | Meta.Acronym |
- | Project.Slug eh19 | + | Meta.Album Chaos Communication Camp 2023 |
- | Processing | + | Meta.License |
- | Processing.Loudnorm.Enable yes | + | Meta.Year |
- | Processing.BasePath /video | + | |
- | Processing.Path.Intros / | + | Processing.Auphonic.Enable |
- | Processing.Path.Outro / | + | Processing.BasePath |
- | Publishing | + | Processing.MasterMe.Enable |
- | Publishing.Path / | + | Processing.Path.Intros |
- | Publishing.Upload.SkipSlaves speedy, | + | Processing.Path.Outro |
- | Publishing.UploadOptions -i / | + | |
- | Publishing.UploadTarget upload@releasing.c3voc.de:/ | + | Publishing.Path |
- | Publishing.Voctoweb.Enable yes | + | Publishing.Upload.SkipSlaves |
- | Publishing.Voctoweb.Path / | + | Publishing.UploadTarget |
- | Publishing.Voctoweb.Thumbpath / | + | Publishing.Voctoweb.Enable |
- | Publishing.Voctoweb.Slug eh19 | + | Publishing.Voctoweb.Path |
- | Publishing.Voctoweb.Tags easterhegg, Wien, c3w | + | Publishing.Voctoweb.Slug |
- | Publishing.Voctoweb.Url https:/ | + | Publishing.Voctoweb.Tags |
- | Publishing.YouTube.Category 27 | + | Publishing.Voctoweb.Thumbpath |
- | Publishing.YouTube.Enable yes | + | Publishing.YouTube.Category |
- | Publishing.YouTube.Privacy public | + | Publishing.YouTube.Enable |
- | Publishing.YouTube.Tags easterhegg, Wien, bun intended, Chaos Computer Club Wien, c3w | + | Publishing.YouTube.Playlists |
- | Publishing.YouTube.TitlePrefix Easterhegg 2019 - | + | Publishing.YouTube.Privacy |
- | Publishing.YouTube.Token 1/ | + | Publishing.YouTube.Tags < |
- | Publishing.Mastodon.Enable yes | + | Publishing.YouTube.Token |
- | Publishing.Twitter.Enable yes | + | |
- | Record | + | Record.Container |
- | Record.Container TS | + | Record.StartPadding |
- | Record.Slides yes | + | Record.EndPadding |
+ | Record.Slides | ||
+ | Record.StartPadding | ||
``` | ``` | ||
Line 50: | Line 52: | ||
``` | ``` | ||
+ | Please note that the conditions in the " | ||
+ | Specifying a property with an empty value, which is often done for EncodingProfile.IsMaster, | ||
== Pipeline setup during event | == Pipeline setup during event | ||
During event setup of the pipeline, you have to decide if you want leave the MPEG TS snippets only on the [[hardware: | During event setup of the pipeline, you have to decide if you want leave the MPEG TS snippets only on the [[hardware: | ||
+ | |||
+ | |||
+ | === Simple: decentralised classic (Variant 2) | ||
+ | |||
+ | {{drawio> | ||
+ | |||
+ | |||
+ | This variant is only practical if you have only one room, or at least one release encoder (aka [[hardware: | ||
+ | When using this variant with multiple rooms in one Tracker project (like at JEV22), you also have to set room filters in the tracker worker queues. | ||
+ | |||
+ | For every worker: | ||
+ | * set room filters in tracker e.g. `Fahrplan.Room = Foobar` | ||
+ | |||
+ | For every recoding cube: | ||
+ | * start tracker worker: `sudo systemctl start crs-worker.target` | ||
+ | |||
+ | For each minion: | ||
+ | * mount filesystems from encoder cube: `sudo crs-mount <storage location> | ||
+ | * start tracker scripts for encoding: `sudo systemctl start crs-encoding.service` | ||
=== centralised storage (rsync) (Variant 1) | === centralised storage (rsync) (Variant 1) | ||
- | The first variant is typically used for events with more than one room. For bigger events we use the dedicated [[hardware:event-storage|storage]] server in the event server rack, for smaller events a USB connected hard drive to one of the minions might be sufficient. Each recording cube exposes the files via rsyncd, which are pulled by an rsync process running inside a screen on the storage pc. | + | {{drawio> |
- | For each encoderX open a screen tab on the central storage: | + | |
- | cd / | + | |
- | while true; do rsync -av --bwlimit=10000 --append --inplace -t encoderX.lan.c3voc.de:: | + | |
- | start tracker workers on storage | ||
- | cd / | ||
- | sudo ./ | ||
- | Don't forget | + | The first variant is typically used for events with more than one room. For bigger events we use the dedicated [[hardware: |
+ | For each encoderX start rsync on the central storage: `sudo systemctl start rsync-from-encoder@encoderX.lan.c3voc.de` | ||
+ | |||
+ | Then, start tracker workers on storage: `sudo systemctl start crs-worker.target` (only needed if you don't use `storage.lan.c3voc.de` - worker scripts get started automatically) | ||
==== Minion setup | ==== Minion setup | ||
- | To allow the encoding workers to do there job, they need to mount several folders on each minion: | ||
- | | + | To allow the encoding workers to do their job, they need to mount the storage first: `sudo crs-mount |
- | | + | |
- | | + | After mounting, you can start the tracker encoding workers: `sudo systemctl start crs-encoding.service` |
- | mount -t cifs //storage.lan.c3voc.de/encoded / | + | |
- | + | The minion VMs running inside our event colo case automatically | |
- | The first mount point is read-only, the other two are read-write. | + | |
- | + | ||
- | start tracker encoding workers | + | |
- | cd / | + | |
- | sudo ./ | + | |
- | | + | |
| | ||
==== Cube as worker setup | ==== Cube as worker setup | ||
Line 93: | Line 106: | ||
The rest is very similar to above, but with different mounts so `/ | The rest is very similar to above, but with different mounts so `/ | ||
- | + | ```bash | |
- | sudo -s | + | sudo mount -t cifs -o uid=voc,password= // |
- | | + | sudo mount -t cifs -o uid=voc,password= // |
- | mount -t cifs -o password= // | + | sudo mount -t cifs -o uid=voc,password= // |
- | mount -t cifs -o password= // | + | sudo mount -t cifs -o uid=voc,password= // |
- | mount -t cifs -o password= // | + | ``` |
| | ||
- | === decentralised classic (Variant 2) | ||
- | The second variant is only practical if you have at least one release encoder | + | === decentralised pipeline |
- | For every worker: | + | <panel type=" |
- | * set room filters in tracker | + | |
- | For every recoding cube: | + | Similar to variant 2, but the release encoder (minion) only mounts the /video/fuse/$room/ from each recording cube. The encoded and tmp files life on one minion, the secondary minions mount /video/ |
- | * start tracker workers | + | |
- | cd /opt/crs/tools/tracker3.0 | + | |
- | sudo ./start-screenrc-scripts.sh | + | |
- | + | ||
- | For each minion: | + | You have to set the room filters only for the recording cubes, the minions can process talks independently. |
- | * mount filesystems from encoder cube | + | |
+ | * On release encoders: | ||
- | < | ||
- | e=echo | ||
- | if [ ! -d /video/tmp ]; then | ||
- | $e mount -t cifs -o password= // | ||
- | $e mount -t cifs -o password= // | ||
- | $e mount -t cifs -o password= // | ||
- | else | ||
- | echo " | ||
- | fi</ | ||
- | * start tracker scripts for encoding | ||
- | < | + | ==== New example with systemd units and case 1 and 5: |
- | cd / | + | |
- | sudo ./ | + | |
- | </ | + | |
+ | {{drawio> | ||
- | === decentralised pipeline | + | optional: configure `10.73.0.2` |
- | Similar to variant 2, but the release encoder (minion) only mounts the / | + | on recording |
- | You have to set the room filters only for the recording cubes, the minions can process talks independently. | + | sudo mount -t cifs -o password= {// |
+ | sudo systemctl start crs-recording-scheduler | ||
+ | sudo systemctl start crs-mount4cut | ||
+ | sudo systemctl start crs-cut-postprocessor | ||
+ | |||
+ | # check if everything is running as expected – you might have to disable/ | ||
+ | sudo systemctl status -n 0 crs-* | ||
- | Modify ''/ | + | on master minion (in this example `storage.lan.c3voc.de`) |
- | * On recording cubes: comment out steps '' | + | |
- | * On release encoders: comment out steps '' | + | |
- | After modification, start the workers via the main screenrc on both recording cubes and release encoders: | + | ``` |
+ | mkdir -p / | ||
+ | mount -t cifs -o password= {// | ||
+ | mount -t cifs -o password= {// | ||
- | | + | sudo systemctl |
+ | sudo systemctl start crs-postencoding | ||
+ | sudo systemctl start crs-postprocessing | ||
+ | # check if everything is running as expected – you might have to disable/ | ||
+ | sudo systemctl status -n 0 crs-* | ||
+ | |||
+ | ``` | ||
+ | |||
+ | //(ensure that samba is installed on this master minion aka storage)// | ||
+ | |||
+ | |||
+ | on other minions | ||
+ | ``` | ||
+ | mkdir -p / | ||
+ | mount -t cifs -o uid=voc, | ||
+ | mount -t cifs -o uid=voc, | ||
+ | mount -t cifs // | ||
+ | mount -t cifs -o password= // | ||
+ | mount -t cifs -o password= // | ||
+ | mount -t cifs -o password= {// | ||
+ | |||
+ | ``` | ||
+ | |||
+ | |||
- | ==== Example | + | ==== Old example |
- | on recording cube, without intros either copy or mount the intros from their source | + | on recording cube, without intros either copy or mount the intros from their source |
sudo mount -t cifs -o password= {// | sudo mount -t cifs -o password= {// | ||
Line 181: | Line 207: | ||
cd / | cd / | ||
sudo ./start screenrc-encoding-only # only step E | sudo ./start screenrc-encoding-only # only step E | ||
+ | |||
``` | ``` | ||