Computer vision technology to detect drone threat
It’s been called ‘the future of warfare.’ Off-the-shelf unmanned aerial systems (UASs), carrying a ‘payload’ of explosives or biological material, flown by terrorists or enemy armed forces into a crowded building or military base.
But now the University of Technology Sydney (UTS) and Sydney ASX-listed defence tech company, DroneShield, have produced next generation drone technology to better identify threats from these aggressive UAS.
In a partnership funded by the NSW and Australian Governments, UTS and Droneshield – an Australian developer of counter-UAS solutions – have produced an optical system for detection, identification and tracking of fast moving threats such as nefarious UAS, comprised of a camera and Convolutional Neural Network (CNN).
UTS and DroneShield began working together in October 2019 – just a month after one of the most recent examples of aggressive use of drones when the oil facilities at Abqaiq–Khurais in Saudi Arabia were attacked by a swarm of UASs.
The new technology was recently demonstrated at Sydney Science Park.
NSW Minister for Jobs and Western Sydney, Stuart Ayres, said the State Government was committed to helping small businesses grow through programs such as the NSW Government-funded Defence Innovation Network (DIN).
“The collaboration between DroneShield and UTS is exactly the type of industry/university partnership the NSW Government is committed to expanding. This is a key part of how the Government is supporting growth in jobs in NSW in areas such as defence tech. And seeing the technology here in Western Sydney, just outside of the future Aerotropolis, gives us a glimpse into the type of R&D and industry activity that will take place out here in the future.
The Hon Stuart Ayres, MP
UTS Vice-Chancellor Attila Brungs says this project is a great example of the types of partnerships UTS is committed to.
“For UTS to do what we do best – develop and translate world-leading research for practical application by industry – government support is critical. Having both the NSW and Australian Governments invest in this partnership which has produced defence technology that can be used around the world shows what can happen when universities, government and industry works together.”
UTS is committed to developing more industry co-working spaces, both on our home campus in the Sydney CBD, and here in Western Sydney at the Sydney Science Park with Celestino,
Professor Attila Brungs
Vice- Chancellor and President, UTS
Project lead and Co-Director of UTS Intelligent Drone Lab (IDL) Dr Nabin Sharma said UTS has both expertise and experience in collaborating with industry partners to develop and deliver innovative vision systems for UAVs. This is seen in the multi-award-winning SpotterAI suite of drones (SharkSpotter, CrocSpotter) which identify particular threats to humans and are used to safeguard swimmers, fishers and other marine species.
“We are using CNNs and deep learning to provide a solution for DroneShield to identify drones which could be of potential threat,” Dr Sharma said. “The algorithm enables the vision system to see what’s happening, to collate data and process it for ultra-fast image recognition and analysis. This delivers a speedy and efficient assessment of a threat and the decision-making in response to it. The system is able to detect different types of drones and check if there is a payload,” he said.
DroneShield’s Guillaume Jounel actively collaborated with the UTS team in developing the technology and was responsible for its integration to DroneSentry, DroneShield’s detect and defeat solution.
This exciting opportunity allowed us to mutually benefit from each other’s expertise, resulting in a highly innovative product using sensor fusion to reliably track drones up to a kilometre away.
DroneShield AI Team Lead
Oleg Vornik, DroneShield’s CEO, said “We are pleased to add this ground-breaking technology to our systems, enabling our customers a unique camera-based detection, ID and tracking of improvised threats such as UAS. This project has been a great example of collaboration between an Australian defence SME and an educational institution, promoting development of world leading, cutting edge defence technologies right here in Sydney.”