Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revisionBoth sides next revision | ||
c3tracker:setup [2022/09/04 18:55] – kunsi | c3tracker:setup [2023/09/01 17:09] – kunsi | ||
---|---|---|---|
Line 7: | Line 7: | ||
* Compare project properties with previous instalment of the same event | * Compare project properties with previous instalment of the same event | ||
- | optimal properties from current project | + | ==== optimal properties from current project |
``` | ``` | ||
- | Project | + | Meta.Acronym |
- | Project.Slug eh19 | + | Meta.Album Chaos Communication Camp 2023 |
- | Processing | + | Meta.License |
- | Processing.Loudnorm.Enable yes | + | Meta.Year |
- | Processing.BasePath /video | + | |
- | Processing.Path.Intros / | + | Processing.Auphonic.Enable |
- | Processing.Path.Outro / | + | Processing.BasePath |
- | Publishing | + | Processing.MasterMe.Enable |
- | Publishing.Path / | + | Processing.Path.Intros |
- | Publishing.Upload.SkipSlaves speedy, | + | Processing.Path.Outro |
- | Publishing.UploadOptions -i / | + | |
- | Publishing.UploadTarget upload@releasing.c3voc.de:/ | + | Publishing.Path |
- | Publishing.Voctoweb.Enable yes | + | Publishing.Upload.SkipSlaves |
- | Publishing.Voctoweb.Path / | + | Publishing.UploadTarget |
- | Publishing.Voctoweb.Thumbpath / | + | Publishing.Voctoweb.Enable |
- | Publishing.Voctoweb.Slug eh19 | + | Publishing.Voctoweb.Path |
- | Publishing.Voctoweb.Tags easterhegg, Wien, c3w | + | Publishing.Voctoweb.Slug |
- | Publishing.Voctoweb.Url https:/ | + | Publishing.Voctoweb.Tags |
- | Publishing.YouTube.Category 27 | + | Publishing.Voctoweb.Thumbpath |
- | Publishing.YouTube.Enable yes | + | Publishing.YouTube.Category |
- | Publishing.YouTube.Privacy public | + | Publishing.YouTube.Enable |
- | Publishing.YouTube.Tags easterhegg, Wien, bun intended, Chaos Computer Club Wien, c3w | + | Publishing.YouTube.Playlists |
- | Publishing.YouTube.TitlePrefix Easterhegg 2019 - | + | Publishing.YouTube.Privacy |
- | Publishing.YouTube.Token 1/ | + | Publishing.YouTube.Tags |
- | Publishing.Mastodon.Enable yes | + | Publishing.YouTube.Token |
- | Publishing.Twitter.Enable yes | + | |
- | Record | + | Record.Container |
- | Record.Container TS | + | Record.EndPadding |
- | Record.Slides yes | + | Record.Slides |
+ | Record.StartPadding | ||
``` | ``` | ||
Line 50: | Line 51: | ||
``` | ``` | ||
+ | Please note that the conditions in the " | ||
+ | Specifying a property with an empty value, which is often done for EncodingProfile.IsMaster, | ||
== Pipeline setup during event | == Pipeline setup during event | ||
During event setup of the pipeline, you have to decide if you want leave the MPEG TS snippets only on the [[hardware: | During event setup of the pipeline, you have to decide if you want leave the MPEG TS snippets only on the [[hardware: | ||
+ | |||
+ | |||
+ | === Simple: decentralised classic (Variant 2) | ||
+ | |||
+ | {{drawio> | ||
+ | |||
+ | |||
+ | This variant is only practical if you have only one room, or at least one release encoder (aka [[hardware: | ||
+ | When using this variant with multiple rooms in one Tracker project (like at JEV22), you also have to set room filters in the tracker worker queues. | ||
+ | |||
+ | For every worker: | ||
+ | * set room filters in tracker e.g. `Fahrplan.Room = Foobar` | ||
+ | |||
+ | For every recoding cube: | ||
+ | * start tracker worker: `sudo systemctl start crs-worker.target` | ||
+ | |||
+ | For each minion: | ||
+ | * mount filesystems from encoder cube: `sudo crs-mount <storage location> | ||
+ | * start tracker scripts for encoding: `sudo systemctl start crs-encoding.service` | ||
=== centralised storage (rsync) (Variant 1) | === centralised storage (rsync) (Variant 1) | ||
+ | |||
+ | {{drawio> | ||
+ | |||
The first variant is typically used for events with more than one room. For bigger events we use the dedicated [[hardware: | The first variant is typically used for events with more than one room. For bigger events we use the dedicated [[hardware: | ||
- | For each encoderX | + | For each encoderX |
- | ```bash | + | |
- | # TODO document rsync systemd unit once that's working | + | |
- | cd / | + | |
- | while true; do rsync -av --bwlimit=10000 --append --inplace -t encoderX.lan.c3voc.de:: | + | |
- | ``` | + | |
- | Then, start tracker workers on storage: `sudo systemctl start crs-worker.target` | + | Then, start tracker workers on storage: `sudo systemctl start crs-worker.target` |
==== Minion setup | ==== Minion setup | ||
Line 74: | Line 94: | ||
After mounting, you can start the tracker encoding workers: `sudo systemctl start crs-encoding.service` | After mounting, you can start the tracker encoding workers: `sudo systemctl start crs-encoding.service` | ||
+ | |||
+ | The minion VMs running inside our event colo case automatically mount `storage.lan.c3voc.de` via cifs and start their worker scripts. You usually do not need to touch them. | ||
| | ||
==== Cube as worker setup | ==== Cube as worker setup | ||
Line 90: | Line 112: | ||
``` | ``` | ||
| | ||
- | === decentralised classic (Variant 2) | ||
- | The second variant is only practical if you have at least one release encoder | + | === decentralised pipeline |
- | For every worker: | + | <panel type=" |
- | * set room filters in tracker | + | |
- | For every recoding | + | Similar to variant 2, but the release encoder (minion) only mounts the / |
- | * start tracker worker: `sudo systemctl start crs-worker.target` | + | |
- | For each minion: | + | You have to set the room filters only for the recording cubes, the minions can process talks independently. |
- | * mount filesystems from encoder cube: `sudo crs-mount <storage location> | + | |
- | * start tracker scripts | + | |
- | === decentralised pipeline (Variant 3) | + | * On recording cubes: |
+ | * On release encoders: | ||
- | <panel type=" | ||
- | Similar to variant 2, but the release encoder (minion) only mounts the / | ||
- | You have to set the room filters only for the recording cubes, the minions can process talks independently. | + | ==== New example with systemd units and case 1 and 5: |
- | Modify ''/ | + | {{drawio> |
- | * On recording cubes: comment out steps '' | + | |
- | * On release encoders: comment out steps '' | + | |
- | After modification, | + | optional: configure `10.73.0.2` (aka `storage.lan.c3voc.de`) on the master minion as secondary ip |
- | sudo ./start screenrc-pipeline | + | on recording cubes, mount or copy the intros from their source – here `storage.lan.c3voc.de` |
+ | sudo mount -t cifs -o password= {// | ||
+ | sudo systemctl start crs-recording-scheduler | ||
+ | sudo systemctl start crs-mount4cut | ||
+ | sudo systemctl start crs-cut-postprocessor | ||
+ | | ||
+ | # check if everything is running as expected – you might have to disable/ | ||
+ | sudo systemctl status -n 0 crs-* | ||
+ | |||
+ | on master minion (in this example `storage.lan.c3voc.de`) | ||
+ | |||
+ | ``` | ||
+ | mkdir -p / | ||
+ | mount -t cifs -o password= {// | ||
+ | mount -t cifs -o password= {// | ||
+ | |||
+ | sudo systemctl start crs-encoding | ||
+ | sudo systemctl start crs-postencoding | ||
+ | sudo systemctl start crs-postprocessing | ||
+ | |||
+ | # check if everything is running as expected – you might have to disable/ | ||
+ | sudo systemctl status -n 0 crs-* | ||
+ | |||
+ | ``` | ||
+ | |||
+ | //(ensure that samba is installed on this master minion aka storage)// | ||
+ | |||
+ | |||
+ | on other minions | ||
+ | ``` | ||
+ | mkdir -p / | ||
+ | mount -t cifs -o uid=voc, | ||
+ | mount -t cifs -o uid=voc, | ||
+ | mount -t cifs // | ||
+ | mount -t cifs -o password= // | ||
+ | mount -t cifs -o password= // | ||
+ | mount -t cifs -o password= {// | ||
+ | |||
+ | ``` | ||
+ | |||
+ | |||
- | ==== Example | + | ==== Old example |
- | on recording cube, without intros either copy or mount the intros from their source | + | on recording cube, without intros either copy or mount the intros from their source |
sudo mount -t cifs -o password= {// | sudo mount -t cifs -o password= {// | ||
Line 152: | Line 206: | ||
cd / | cd / | ||
sudo ./start screenrc-encoding-only # only step E | sudo ./start screenrc-encoding-only # only step E | ||
+ | |||
``` | ``` | ||