The performing arts and stage sector is a significant part of Swiss cultural output, featuring over 20’000 annual events across more than 650 venues. However, smaller events that comprise over 80% of the market are limited to live audiences only because of high video production and distribution costs.

YourStage.live, known as "The Netflix of Performing Arts", is changing the local event industry by offering affordable, professional multicam live production. The service is designed from a dramaturgical perspective to meet high standards, providing subscription-based live-streaming and video-on-demand content.

The dAlrector project aims to create an autonomous AI system that will revolutionize video production by directing camera shots, following scripts, and incorporating human inputs. Several key innovations are part of the project:

1. The Real-time Audio and Video Feature Extraction (AVFE) accurately determines performer positions and extracts key audio-visual features in real-time,
2. the Self-supervised Video Features Learning utilizes a V-JEPA (Video Joint-Embedding Predictive Architecture) to learn visual representations from unannotated video data,
3. the View-Ranker is an AI system to rate different camera views based on completeness, novelty, beauty, and interest, and
4. the Cut Predictor is a multimodal time-series model to determine optimal moments for video cuts.

The dAlrector integrates these components into a compact hardware solution that interfaces with multiple remotely controllable audio/ video sources (e.g. cameras, microphones). This system is designed to enable a single remote operator to manage multiple shows simultaneously and to reduce production costs for Group Galore drastically.

It will allow the implementation partner to stream more than 400 events to more than 100'000 subscribers.