Project goals

  • Development of a fast telescope system for UAV detection and tracking
  • Real-time deep learning object detection and tracking
  • Camera-based control with high-speed auto focus

Description

Drones and other types of unmanned aerial vehicles (UAVs) have gained massive popularity not only in the professional but also in the private sector in recent years. Incidents such as the closure of London’s Gatwick Airport due to a drone sighting demonstrate that advances in UAV technology pose a threat to public safety. The early identification of incoming UAVs is of the highest priority for situational assessment.
Commercial drone detection systems use a multispectral approach for object detection and identification. For this purpose, the interaction of different sensors is used to be able to recognize and identify objects. The figure below shows an example where an object at a distance of 5 to 10 km is detected using radar. The problem, however, is that it is difficult to differentiate between a UAV and, for example, a bird. Optical sensors are used for this, which can clearly classify the object based on a recorded camera image. The operational distance of this optical component is currently limited to one to two kilometers, which only allows short reaction times in the event of a threat.

Protection concept with zones: detection (radar/radio), identification, defense, protection area. Drone at 1 km, < 15 s to protection area.

Fig. 1 Illustration of a commercial drone detection system. State of the art technology provides in worst case only 15s for optical detection, identification and situation assessment.

OptoFence II aims to develop a telescope-based optical platform to enable a larger identification area and significantly extend the time available for situational assessment. The combination of a precise and fast mount, a high-quality telescope, a camera system, and advanced methods in control systems and computer vision creates a versatile platform for the optical detection, tracking, and identification of UAVs.

[Translate to English:] Optical telescope system detects drones, data analyzed on computer, right shows detection of DJI Mini 2.

Fig. 2 Left: Overview of OptoFence II system concept. Right: Example image captured through telescope.

The basic concept is shown in Figure 2. A suitable pair of telescopes and cameras provides high-resolution images. These are analyzed using modern deep learning algorithms to extract the position of the UAV in the individual images. For this purpose, an efficient software architecture was implemented in the project, enabling the detection and tracking of drones at up to 100 images per second. For control of the telescope platform, model-based controllers were developed that enable highly dynamic positioning of the system and tracking of drones at speeds of up to 250 km/h. In addition, a specially implemented automatic focus tracking system keeps the drone sharply in focus.

The implemented overall system was extensively tested during field trials under various scenarios. It was demonstrated that small drones, such as the DJI Mavic 3, can be detected and tracked fully automatically at distances ranging from 100 m to 5 km.

Large dual telescope system on tripod with control unit, deployed outdoors.

Fig. 3 Implemented telescope system for the detection and tracking of small drones over distances of several kilometers

Use case

  • UAV reconnaissance

Related Publications

Project partners

  • ASA Astrosystems GmbH
  • Austrian Federal Ministry of Defence

Funding

This project is funded by the Austrian defense research program FORTE of the Federal Ministry of Finance (BMF).