Embedded Files
Prof. Saeid Nahavandi
Fellow of IEEE, IET, IEAust
Associate DVCR & Chief of Defence Innovation, Swinburne Research
Australian Academy of Technology and Engineering (ATSE)
General Chair for IEEE SMC 2021.
Speech Title:
Emerging haptically-enabled systems for immersive simulation-based training: Design, Development, and Deployment
Simulation-based training (SBT) is on the cusp of offering a cost-effective regime for administering realistic and safe training in a virtual environment across a wide range of sectors. In SBT, the immersion factor is of prime concern to ensure efficacy of skill learning. Nowadays, emerging technologies, including virtual/mixed reality (VR/MR) and artificial intelligence (AI), have dramatically improved the immersive quality of SBT tools, providing AI-based smart interfaces with high-fidelity 3D visual and auditory experiences to users (trainees). While VR/MR systems offer effective visual cues, they often are unable to provide realistic tactile sensation when interacting with virtual objects for performing dexterous tasks in SBT.
This plenary speech will explicate the integration of haptic (force feedback) technology into VR/MR systems to increase their fidelity for SBT. Through this innovation, a user is able to “touch-and-feel” virtual and/or remote objects, and perceive their attributes via haptically-enabled VR/MR systems. As such, the user can feel the object properties, such as texture or hardness/softness characteristics, when utilising these haptically-enabled SBT tools in an immersive environment for skill acquisition.
This lecture will focus on the design and development of a series of haptically-enabled systems, particularly haptically-enabled motion simulators, firefighting trainers, and tele-healthcare robotic systems, for SBT purposes. Serving as a flight/vehicle simulator, the developed robotic-based platform is integrated with haptically-enabled peripherals, such as haptic chairs and haptic control devices, to offer a high-fidelity training environment. The user can enjoy realistic flying/driving experiences, e.g., air turbulence or rough terrain, during training. On the other hand, the haptically-enabled hot-fire trainers enable the user to experience realistic jet reaction forces from the hose and provides immersive water dispersion and interaction with fire and smoke particles based on accurate physics modelling via the VR/MR-based tools. In addition, a haptically-enabled ultrasound scanning system for tele-healthcare applications will also be exemplified. It allows the user (sonographer) to remotely “touch and-feel” the anatomical structure of a patient during tele-scanning, allowing accurate diagnosis of patients in tele-health services.
A series of demonstration of these haptically-enabled systems will be presented during the lecture. Successful deployment of several developed systems in real-world environments through start-up companies will be illustrated. The impact of these emerging haptically-enabled system to realise the next generation of SBT tools for immersive and personalized training in various sectors, including aviation, automotive, healthcare and emergency services, will be discussed.
About Speaker
Distinguished Professor Saeid Nahavandi is Swinburne University of Technology’s inaugural Associate Deputy Vice-Chancellor Research and Chief of Defence Innovation. He previously served as Pro Vice-Chancellor (Defence Technologies) and Founding Director of the Institute for Intelligent Systems Research and Innovation, Deakin University.
Saeid Nahavandi received a Ph.D. from Durham University, U.K. in 1991. His research interests include autonomous systems, modeling of complex systems, robotics and haptics. He has published over 1300 scientific papers in various international journals and conferences. Saeid was the recipient of the Clunies Ross Entrepreneur of the Year Award 2022 from the Australian Academy of Technological Sciences & Engineering, Researcher of the Year for Australian Space Awards 2021, Australian Defence Industry Awards - Winner of Innovator of the year, The Essington Lewis Awards, and Australian Engineering Excellence Awards - Professional Engineer of the Year.
Saeid has carried out industry based research with several major international companies such as Airbus, Boeing, Bosch, Ford Motor Company, General Motors, General Dynamics, Holden, Lockheed Martin, Nissan, Thales and Vestas just to name a few.
Professor Nahavandi holds six patents, two of which have resulted in two very successful start-ups (Universal Motion Simulator Pty Ltd and FLAIM Systems Pty Ltd).
Professor Nahavandi is the President Elect, IEEE System Man and Cybernetics Society, Senior Associate Editor: IEEE Systems Journal, Associate Editor of IEEE Transactions on Cybernetics and IEEE Press Editorial Board member.
Prof. Ming Hou
Fellow of IEEE
Principal Defence Scientist, DND Canada
Adjunct Professor, University of Toronto and University of Calgary
Speech Title:
Interaction-Centred Design for Trustworthy Human-Robot Partnership: The Next Stage of Evolution
Robotics and artificial intelligence (AI) as two representative technologies of the 4th Industrial Revolution continue to advance rapidly to become increasingly exploitable across domains in multiple ways. While AI and robotics can provide solutions to a wide range of capability gaps and challenges, but the digitization of the world is not intended to replace human involvement completely. This collision of humans and robots raises questions on their co existence. Increasingly smart autonomous decision-making power poses risk, responsibility, and trust to public safety, like self-driving cars, home care robots, drones. Stringent AI-enabled robotic system requirements are not just a technical challenge, but design imperative. Designing a collaborative human robot partnership through dynamic interactions and intelligent adaptation are critical.
However, the popular human-centred design approach is obviously not sufficient to address today’s complex interaction issues when transferring the control authority from human to increasingly powerful AI-enabled robotic decision-making. This is one of the main reasons of recent catastrophic aviation and autonomous vehicle accidents. A new design paradigm is imperatively needed for the safe, responsible, and trustworthy human-robot partnership. This talk explains an interaction-centred design (ICD) approach as a solution to address a variety of design, development, and operational issues of human-robot symbiosis technologies. The ICD framework guided the development of international standards and a United Nations White Paper to address human-robot interaction issues. An ICD-enabled technological solution of trustworthy, effective, and responsible human-AI robot collaboration for decision-making in weapon engagement will be discussed as a best practice example for researchers and practitioners who are interested in building and using 21st century human-AI robot symbiosis technologies.
About Speaker
Dr. Hou is a Principal Scientist and Authority in Human-Technology Interactions within the Department of National Defence (DND), Canada. He is responsible for delivering cutting-edge technological solutions, science-based advice, and evidence-based policy recommendations on AI, Autonomy, Robotics, and Telepresence science, technology, and innovation strategies to senior government decision makers and their national and international partner organizations including the United Nations. As the Canadian National Leader in human-AI/autonomy teaming (HAT), he directs the Canadian innovation ecosystems to formulate and deliver science and technology capability development programs and support major acquisition projects and large-scale live, virtual, and constructive international joint exercises. As the Co-Chair of an international HAT Specialist Committee, he leads the development of international standards for the integration of AI-enabled autonomous systems into the socio-technical applications. His book entitled “Intelligent Adaptive Systems – An Interaction-Centered Design Perspective” is considered authoritative and outlines a systemic approach to Human-AI Symbiotic Collaborations. It has been instrumental in the development of HAT R&D roadmap, novel industrial autonomy technologies, international standards, and AI policy and regulatory frameworks. Dr. Hou has shared his Human-AI Symbiosis vision, methodology, and best practices with broad audiences through numerous invited keynote speeches, panel discussions, and lectures at various prestigious international fora. He is the recipient of the most prestigious DND Science and Technology Excellence Award in 2020, the President’s Achievement Award of the Professional Institute of the Public Service of Canada in 2021, and the IEEE Outstanding Contribution Award in 2024. Dr. Hou is an IEEE Fellow, Distinguished Lecturer, and the General Chair of the 2024 IEEE International Conference on Human-Machine Systems and International Defence Excellence and Security Symposium. He is also an Adjunct Professor at the University of Toronto and University of Calgary.
Prof. Mingcong Deng
Fellow of IEEE, AAIA, Engineering Academy of Japan
Head of Department of EEE
Speech Title:
Learning & Operator based Nonlinear Control for Systems with Smart Material Actuators and Sensors
Learning based nonlinear control design is necessary to compensate nonlinear factors in systems. Recently, smart materials have been used as actuators and sensors in many nonlinear dynamic systems to realize the reduction in size and weight of the systems, such as piezoelectric elements, shape-memory alloy etc. In this talk, nonlinear control schemes for plants with piezoelectric actuators & sensors based on operator theory is introduced, nonlinear control for a plant using an interactive shape memory alloy actuation is also shown. Further, some current results are shown to combine learning schemes.
About Speaker
Prof. Mingcong Deng received his PhD in Systems Science from Kumamoto University, Japan, in 1997. From 1997.04 to 2010.09, he was with Kumamoto University; University of Exeter, UK; NTT Communication Science Laboratories; Okayama University. From 2010.10, he has been with Tokyo University of Agriculture and Technology, Japan, as a professor. Now he is the head of Department of EEE. Prof. Deng has over 210 journal papers in peer reviewed journals including IEEE Transactions, IEEE Press and other top tier outlets. He serves as a chief editor for 2 international journals, and associate editors of 6 international journals. Prof. Deng is a co-chair of agricultural robotics and automation technical committee, IEEE Robotics and Automation Society; Also a chair of the environmental sensing, networking, and decision making technical committee, IEEE SMC Society. He was the recipient of 2014 & 2019 Meritorious Services Award of IEEE SMC Society, 2020 IEEE RAS Most Active Technical Committee Award (IEEE RAS Society) and 2024 IEEE Most Active SMC Technical Committee Award (IEEE RAS Society). He is a fellow of The Engineering Academy of Japan, and a fellow of IEEE, AAIA.
Prof. Jung Kim
Department Head Department of Mechanical Engineering, KAIST
Director of BK21 Four program of Mechanical Engineering
President of Korea Robotics Society (KSB)
President of Korea Robotics Society (KRoS)
Chair of International Affair in ME
Speech Title:
Robot Haptics: A Critical Gateway to Physical AI in Human-Robot Interaction
This presentation delves into the forefront of robot haptics, emphasizing the role of mechanical signal transmission in advancing human-robot interaction (HRI). As humanoid robots become increasingly integrated into daily life, the development of safe, reliable, and perceptually enhanced robotic systems is paramount. This talk highlights the significance of touch as a key modality in non-verbal communication and dexterous manipulation, underscoring its broader bandwidth relative to other sensory inputs.
A central challenge in achieving human-like touch perception in robots lies in the scalability, conformability, and multimodality of robotic skin technologies. To address these challenges, the presentation introduces pioneering methodologies developed at KAIST, including:
Hydrogel-based robotic skin utilizing Electrical Impedance Tomography (EIT) for low-temporal-resolution stimuli sensing,
Acoustic super-resolution techniques employing microphone arrays for high-temporal-resolution tactile sensing, and
Conductive fabric-based robotic skin designed for multimodal sensing capabilities.
These advancements contribute to the broader domain of physical AI, which seeks to integrate principles of physics into artificial intelligence systems. The discussion extends to the role of mechanics in enhancing robotics and AI, particularly in medical applications such as complex tissue manipulation. The presentation concludes by outlining future research directions, including the development of neuromorphic signal transmission, advanced fabrication techniques for three-dimensional, complex-shaped robotic skin, and the establishment of generalizable representations for touch perception. Additionally, it explores the impact of high-fidelity contact modeling in robotic simulation tools and the critical role of biomechanics in facilitating precise interaction with biological tissues in medical robotics.
About Speaker
Prof. Jung Kim received his PhD in Mechanical Engineering from Massachusetts Institute of Technology in 2003. He is serving as the Department Head of Mechanical Engineering at KAIST, he has made significant contributions to the fields of haptics, robot perception, wearable robotics, and biomechanics. With a Ph.D. from MIT and extensive experience in academia and industry, he has supervised over 60 graduate theses, published 80 SCI journal papers, and registered 61 patents. His research has been recognized with prestigious awards, including the Science and Technology Award of the Month (2024) and KAIST’s Top 10 Research Achievements (2023).
He has played a vital role in the robotics and engineering communities, serving as President of the Korea Robotics Society (KRoS), Editor of the International Journal of Precision Engineering and Manufacturing, and General Chair for major conferences such as HRI 2019 and UR 2023.
Page updated
Google Sites
Report abuse