Skip to main content

Site navigation

  • University of Technology Sydney home
  • Home

    Home
  • For students

  • For industry

  • Research

Explore

  • Courses
  • Events
  • News
  • Stories
  • People

For you

  • Libraryarrow_right_alt
  • Staffarrow_right_alt
  • Alumniarrow_right_alt
  • Current studentsarrow_right_alt
  • Study at UTS

    • arrow_right_alt Find a course
    • arrow_right_alt Course areas
    • arrow_right_alt Undergraduate students
    • arrow_right_alt Postgraduate students
    • arrow_right_alt Research Masters and PhD
    • arrow_right_alt Online study and short courses
  • Student information

    • arrow_right_alt Current students
    • arrow_right_alt New UTS students
    • arrow_right_alt Graduates (Alumni)
    • arrow_right_alt High school students
    • arrow_right_alt Indigenous students
    • arrow_right_alt International students
  • Admissions

    • arrow_right_alt How to apply
    • arrow_right_alt Entry pathways
    • arrow_right_alt Eligibility
arrow_right_altVisit our hub for students

For you

  • Libraryarrow_right_alt
  • Staffarrow_right_alt
  • Alumniarrow_right_alt
  • Current studentsarrow_right_alt

POPULAR LINKS

  • Apply for a coursearrow_right_alt
  • Current studentsarrow_right_alt
  • Scholarshipsarrow_right_alt
  • Featured industries

    • arrow_right_alt Agriculture and food
    • arrow_right_alt Defence and space
    • arrow_right_alt Energy and transport
    • arrow_right_alt Government and policy
    • arrow_right_alt Health and medical
    • arrow_right_alt Corporate training
  • Explore

    • arrow_right_alt Tech Central
    • arrow_right_alt Case studies
    • arrow_right_alt Research
arrow_right_altVisit our hub for industry

For you

  • Libraryarrow_right_alt
  • Staffarrow_right_alt
  • Alumniarrow_right_alt
  • Current studentsarrow_right_alt

POPULAR LINKS

  • Find a UTS expertarrow_right_alt
  • Partner with usarrow_right_alt
  • Explore

    • arrow_right_alt Explore our research
    • arrow_right_alt Research centres and institutes
    • arrow_right_alt Graduate research
    • arrow_right_alt Research partnerships
arrow_right_altVisit our hub for research

For you

  • Libraryarrow_right_alt
  • Staffarrow_right_alt
  • Alumniarrow_right_alt
  • Current studentsarrow_right_alt

POPULAR LINKS

  • Find a UTS expertarrow_right_alt
  • Research centres and institutesarrow_right_alt
  • University of Technology Sydney home
Explore the University of Technology Sydney
Category Filters:
University of Technology Sydney home University of Technology Sydney home
  1. home
  2. arrow_forward_ios ... Newsroom
  3. arrow_forward_ios ... 2020
  4. arrow_forward_ios 06
  5. arrow_forward_ios Motion control of robots with wearable skin-like sensor

Motion control of robots with wearable skin-like sensor

29 June 2020

Bioinspired sensors control robotic devices by detecting and responding to strain and motion, without the need for voice control.

outstretched hand in the dark

Image: Se Nuno / Unsplash


Imagine if you could direct a robot to clean your car with a wave of your hand?

Now, a team of researchers have developed an electronic skin-like sensor to control robotic devices with hand gestures.

Dr Zheng Yan is one of the primary researchers of the project; a collaboration with the UTS Australian Artificial Intelligence Institute (AAII) and Singapore’s Nanyang Technological University.

“We capture high-quality somatosensory data from hand gestures with the new stretchable and wearable sensor,” Yan said. “Then, our brain-inspired machine-learning architecture recognises the movements and learns how to respond to the visual and somatosensory information.”

The transparent sensors, worn directly on the skin, not only detect strain but also detect motion flow, and can operate during the day or in complete darkness.

Like other smart inventions that mimic the natural world, the human brain was the main inspiration behind the development of the sensor.

“High perceptual activities in the brain, such as thinking, planning and inspiration, do not depend on specific sensory information,” he said.  “They are derived from the integration of multi-sensory information from diverse sensors, and this is what inspired us to combine visual and sensory information with high-precision gesture recognition.”

transparent, stretchable sensor worn on hand (left) and demonstrating stretch capabilities by pulling of the sensor (right)

Bioinspired sensors stick directly to the skin (left). Transparent sensors detect pressure and strain (right)
Image: Zheng Yan


To demonstrate the technology in real-world situations, Yan and his team used the wearable sensor to successfully navigate a quadruped (four-legged) robot through a labyrinth in a dark environment, with an illuminance of 10 lux, to resemble an open parking lot at night.

Now, with their research paper published in this month’s prestigious journal, Nature Electronics, Yan and his collaborators have future plans to take the smart wearable technology to the next level, by enabling the wearable device to run directly on the AI models.

Share
Share this on Facebook Share this on Twitter Share this on LinkedIn
Back to AAII News

Acknowledgement of Country

UTS acknowledges the Gadigal People of the Eora Nation and the Boorooberongal People of the Dharug Nation upon whose ancestral lands our campuses now stand. We would also like to pay respect to the Elders both past and present, acknowledging them as the traditional custodians of knowledge for these lands. 

University of Technology Sydney

City Campus

15 Broadway, Ultimo, NSW 2007

Get in touch with UTS

Follow us

  • Instagram
  • LinkedIn
  • YouTube
  • Facebook

A member of

  • Australian Technology Network
Use arrow keys to navigate within each column of links. Press Tab to move between columns.

Study

  • Find a course
  • Undergraduate
  • Postgraduate
  • How to apply
  • Scholarships and prizes
  • International students
  • Campus maps
  • Accommodation

Engage

  • Find an expert
  • Industry
  • News
  • Events
  • Experience UTS
  • Research
  • Stories
  • Alumni

About

  • Who we are
  • Faculties
  • Learning and teaching
  • Sustainability
  • Initiatives
  • Equity, diversity and inclusion
  • Campus and locations
  • Awards and rankings
  • UTS governance

Staff and students

  • Current students
  • Help and support
  • Library
  • Policies
  • StaffConnect
  • Working at UTS
  • UTS Handbook
  • Contact us
  • Copyright © 2025
  • ABN: 77 257 686 961
  • CRICOS provider number: 00099F
  • TEQSA provider number: PRV12060
  • TEQSA category: Australian University
  • Privacy
  • Copyright
  • Disclaimer
  • Accessibility