Human Sensorimotor Interface
Capture intention and return external sensory information without requiring every channel to be reproduced literally.
- motion
- gaze
- EMG
- voice
- haptics
- vision
A shared-agency architecture for projecting human sensorimotor presence into synthetic bodies — keeping biological crew protected while human judgment remains physically present where it matters.
A concept architecture for letting astronauts perform physical work through synthetic bodies while autonomy handles stabilization, reflexes and increasingly large fractions of execution.
Future human exploration of the Moon and Mars will require physical work in environments that impose substantial physiological, operational and logistical burdens on biological crew. Conventional extravehicular activity places astronauts directly within vacuum, radiation, abrasive dust, thermal extremes and equipment hazards, while autonomous robotic systems remain poorly suited to many unstructured manipulation and contingency tasks requiring human judgment.
Embodied Synthetic EVA proposes an intermediate architecture in which an astronaut projects sensorimotor agency through a remotely located robotic or synthetic body while machine autonomy provides stabilization, reflexes, task execution and increasing levels of independent operation.
The architecture extends historical work in telepresence, robotic EVA, Surrogate Astronaut Robotic Avatars, NASA surface telerobotics and ESA/DLR Surface Avatar by treating embodiment itself as an engineering variable. Control may transition continuously between direct human tele-embodiment, shared control, supervised autonomy and autonomous operation.
The machine goes, but the human can be there when needed.
Spaceflight has historically treated biological presence and operational presence as the same thing. They do not need to be.
Future sustained lunar and Martian operations make the traditional choice between “send the astronaut” and “send the robot” increasingly restrictive. Human judgment, improvisation and dexterity remain exceptional, but biological exposure to vacuum, radiation, abrasive regolith, thermal extremes and complex EVA operations is costly.
The more useful question is therefore not whether a task belongs to a human or a robot. It is:
Embodied Synthetic EVA treats the surrogate as an alternative operational body. The astronaut may directly inhabit it through synchronized sensorimotor interfaces, while local intelligence manages balance, contact, navigation, reflexes and routine action. The long-term objective is neither full teleoperation nor full autonomy. It is transferable physical agency.
The novelty is not the existence of a robotic surrogate astronaut. The contribution is the integration of embodiment, shared agency, somatosensation and synthetic physiology into one measurable HSF architecture.
A mission may move repeatedly between direct human control and machine autonomy. The body stays the same; the locus of agency changes.
Direct first-person control resolves an unfamiliar connector, damaged mechanism, science target or contingency.
Local AI handles locomotion, balance, transport, inspection and repetitive actions until human judgment is again required.
The architecture preserves sensorimotor coherence while allowing morphology, sensing and intelligence to depart from ordinary human anatomy.
Capture intention and return external sensory information without requiring every channel to be reproduced literally.
Retarget movement, scale force and reconcile different body geometries while preserving predictable sensorimotor relationships.
Human operates at the right abstraction level while the machine handles balance, grip regulation, collision avoidance and local planning.
Distributed touch, strain, slip, temperature, loading and damage sensing create a synthetic peripheral nervous system.
Progress from conventional motors toward compliant actuation, tendon systems, artificial muscles and adaptive structures.
Retain enough anthropomorphism for embodiment while changing anatomy where vacuum, dust, terrain and tool use reward it.
The architecture supports several operating modes without requiring a fully autonomous humanoid.
The surrogate goes first so biological EVA time is spent only where direct human presence adds value.
The astronaut remains inside a protected, shirtsleeve environment while physically acting through the surrogate.
A biological astronaut outside works with one or more surrogates operated by crew or specialists inside.
Low-latency orbital crews project physical agency onto a planetary surface without landing the biological operator.
Earth provides commercially meaningful environments that mature the same sensing, control and embodiment stack needed for the Moon and Mars.
Remote maintenance, inspection, waste handling and decommissioning where skilled manipulation is valuable but radiation exposure is not.
Dust, unstable terrain, heavy machinery, poor visibility and restricted communications create a direct analogue for lunar industrial operations.
Unknown environments force the human/autonomy handoff hypothesis: machine handles routine work, human enters when novelty exceeds capability.
Offshore energy, tunnels, polar facilities, hazardous chemical sites and extreme construction create early deployment pathways.
The program should be judged by operational performance and human factors — not whether the demo looks futuristic.
An initial Earth testbed can use a commercially available mobile manipulator or humanoid, immersive display, motion tracking, haptic feedback, instrumented tasks and a shared-autonomy layer. The same tasks should be repeated under conventional remote control, immersive telepresence, tele-embodiment, shared embodiment and supervised autonomy.
Research hypotheses: embodiment should improve complex manipulation; shared agency should outperform pure teleoperation or pure autonomy in mixed-predictability tasks; operators should tolerate bounded morphological divergence; local machine reflexes should reduce bandwidth and intervention burden; and surrogate architectures should reduce mission-level biological exposure.
Synthetic physiology is a long-term evolutionary layer, not a prerequisite for first deployment.
Commercial humanoid or mobile manipulator. Mature actuation, teleoperation and sensing. Build the embodiment stack first.
Compliant mechanisms, tendons, artificial muscles, distributed skin, local reflexes, adaptive structure and selected biohybrid components.
The attraction of artificial muscle and machine skin is not cosmetic realism. It is compliant interaction, compact distributed actuation, shock tolerance, richer body sensing and a mechanical architecture that may map more naturally onto human sensorimotor control.
Biohybrid robotics pushes further by integrating living tissue with engineered systems. For spaceflight it remains a long-horizon research direction because of radiation, vacuum, nutrition, sterility, reliability and planetary-protection constraints. Its relevance here is architectural: the system should not assume the surrogate will always be a rigid motorized robot.
The surrogate should preserve enough anthropomorphism for intuitive embodiment while exploiting the freedom of an engineered body.
Human-built environments reward human-compatible reach, tools and work envelopes. But the Moon does not reward strict anatomical fidelity. A surrogate might lower its center of gravity, add a manipulator, rotate joints beyond human limits, swap hands for tools, integrate anchors, widen its spectral vision or treat structural damage as a replaceable module rather than an injury.
Embodiment should be treated as a capability whose achievable depth changes with communications geometry.
Very low latency. Strong candidate for high-fidelity haptic embodiment and direct whole-body control.
Low enough latency for interactive telerobotics; strong candidate for tele-embodiment with local machine reflexes.
Delay reduces transparency. Shared autonomy and task-level execution become more important.
Potentially powerful architecture for real-time surface exploration without immediate crew surface exposure.
A staged program can create useful evidence long before a full synthetic astronaut exists.
Arm/hand mapping, stereo vision, force feedback, tool and connector tasks.
Whole-body operation, locomotion, manipulation, balance and human/AI transition.
Nuclear mockup, mining site, industrial maintenance or disaster training environment.
Compare suited simulation, remote operation, embodied control and shared autonomy.
ISS/Gateway crew controlling a remote embodiment platform under flight constraints.
Infrastructure assets work autonomously before arrival, become embodied during crew presence, then continue afterward.
Embodiment creates new failure modes: agency confusion, automation surprise, sensory conflict, cybersickness and over-trust.
A formal Agency Authority Model should always define the current controller, permitted control envelope, machine safety vetoes, transfer request, transfer acknowledgement, emergency return and communications-loss behavior.
The architecture does not require machine consciousness, artificial personhood or human-equivalent cognition. Early surrogate systems are best treated as instruments of extended human action. Ethical questions around increasingly human-like or biohybrid machines may emerge later, but they should not be conflated with the near-term engineering requirement.
Future exploration can evolve from transporting the biological human body everywhere capability is required toward transporting human agency.
Embodied Synthetic EVA reframes human–robot collaboration around a continuous relationship between biological operator and synthetic body. Human intelligence supplies improvisation, judgment, semantic understanding and expertise. The machine supplies survivability, strength, endurance, sensing, reflexes and autonomous routine execution.
As AI improves, direct human involvement can decline without invalidating the architecture. At first: human intelligence → machine body. Later: human intention → machine execution. Eventually: human intervention → only when desired or necessary.
Selected references from the Springer manuscript. Links open to the original source where available.