grafisk-ritn-teleop-fb

Real time video solutions for remote and/or autonomous operation

Youtube video by Cargotec/HIAB (Voysys customer). The system is in commercial use in various countries around the world.

Low latency

Voysys video solution is optimized to provide the shortest possible delay. Some of our live systems provide below 100 ms delay from glass to glass, which is short enough for remote operation of delicate work tasks like loading timber.

Immersiveness

We believe a human can do it’s best driving/operating a vehicle/machine if he/she feels like physically being by the machine.

Voysys video solution renders immersive operation’s environments on many different screen alternatives:

VR Headsets

Spherical domes

Cylindrical domes

Flat screens

Stereo 3D

Voysys video solution allows for stereo 3D both on domes and flat screens as well as in VR headsets. 3D can be applied to all video, or just selected directions. Many machines only require stereo 3D in the forward direction, and sending mono video in all other directions will in such scenarios help save bandwidth.

Stereo 3D (especially in VR headsets) has proven to dramatically increase the operators distance assessment. Playing with the stereo offset can result in better distance assessment than in real life.

Multiple 3D Environments

Voysys video solution allows for setting up several 3D environments (internally called “scenes”), where each scene is it’s own 3D world created from objects like

Immersive video (360°, 180° etc.)

2D cameras/videos rendered as overlays (virtual screens)

Still graphics

Motion graphics

3D models

Point clouds from LiDARs etc.

Dynamic information pushed through the Voysys plugin architecture

Etc.

Using the scenes concept allows the driver/operator to use optimised environments per work task/scenario. While driving forward you may want a large immersive video in the front direction on your 180° dome with overlay rear mirrors. Driving backwards you would rather want the immersive video in the backwards directions and overlay “rear mirrors” from cameras pointing in the forward direction.

 

Voysys provides a graphical editor for quick creation of 3D environments.

Fleet Monitoring

Voysys video solution allows an operator to use the same immersive screen for fleet monitoring and teleoperation. The advantage compared to traditional multi-monitor approaches is a fully flexible system where the most important information can be in focus at all time. No need for hardware monitors or cables.

Up to 16 HDMI inputs can be connected to the Voysys system for rendering as virtual screens.

Dynamic information can also be rendered directly into the Voysys 3D render engine to create even stronger immersive effects.

Camera agnostic

Voysys video solution is input agnostic and allows for using literally any cameras. Real time measurement systems like Lidar or similar can also be used as input. Input modules are already available for a wide range of cameras on the market using interfaces such as USB, GigE, HDMi, SDI, RTMP etc.

Fast turnaround times

Voysys video solution is (to an extent) off the shelf and allows for experiments to get started as soon as camera hardware can be mounted on the vehicle/machine. Thanks to a smooth calibration process, new placements of cameras can be incorporated quickly into the system. Hence, many iterations of camera placements can be conducted at low costs. The drag-and-drop editor allows for fast iterations on the operator GUI.

The road to autonomous operation

Voysys video solution can be used as data collector for training of Neural Networks. All live video sources can be recorded in the field during remote operations, and then later be used at the office/lab for training of Neural Networks.

Our plugin architecture even allows for development of logics for automated control of a machine or a vehicle.

Detection of humans in security area

Voysys video solution can also be integrated with Neural Networks for detecting objects in the security area around a machine.