Harmony: Adaptive Spatial Intelligence

Human activity is inherently spatial, embodied, and continuous. Yet most AI systems operate on discrete, non-spatial data — creating a fundamental mismatch between computational intelligence and lived experience. Current XR systems suffer from three critical failures: they remain stateless across sessions, isolated within application silos, and unable to adapt intelligently over time.

Harmony investigates a different premise: intelligence emerges from system-level integration, not component optimization alone. A unified spatial intelligence system can enable continuity, adaptation, and generalization across diverse XR experiences — properties impossible in fragmented architectures.

Core Research Problem
How can an XR system perceive, reason, remember, and adapt across spatial experiences in a continuous and context-aware manner?

Harmony XR + AI Framework · 2025 · Google Scholar

Harmony One — Four-Layer Architecture

Harmony One implements a closed-loop cognitive architecture. Each layer serves a distinct function, connected through a Shared World Model that persists, evolves, and enables cross-task learning.

Shared World Model — persistent · evolving · cross-task
01 Perception Spatial sensing, user action tracking, environmental context capture in real time
02 Cognition World model construction, intent inference, multi-modal reasoning over spatial context
03 Memory Persistent spatial memory, longitudinal history, interaction traces across sessions
04 Action Context-aware guidance, adaptive feedback, dynamic response — closing the loop

Research Questions

RQ1

How does shared spatial memory affect task performance and learning transfer across XR experiences?

RQ2

Can a unified system demonstrate measurable improvement in user outcomes over extended interaction timescales?

RQ3

What quantitative advantages emerge from adaptive guidance compared to traditional static XR instruction?

RQ4

What architectural and interaction patterns consistently emerge for effective spatial intelligence systems?

Research Agenda

Three interconnected research branches validated through Harmony One. Covers multimodal context inference, cognitive load-aware XR interfaces, and explainable AI mediation.

View Research Agenda

Selected Publications — APA 7th Edition · View all on Google Scholar ↗

Koutitas, G., Siddaraju, V. K., & Metsis, V.

In Situ Wireless Channel Visualization Using Augmented Reality and Ray Tracing

Sensors, 20(3), 690. MDPI, 2020.

Journal Article DOI: 10.3390/s20030690

Siddaraju, V. K., et al.

X-Reality: Augmented Reality Meets Internet of Things

IEEE INFOCOM Workshops, Honolulu, HI, USA. IEEE, 2018.

Conference Demo IEEE Xplore

Siddaraju, V. K., & Koutitas, G.

An Augmented Reality Facet Mapping Technique for Ray Tracing Applications

Proc. ICDT 2018, Athens, Greece. IARIA, 2018.

🏆 Best Paper Award Conference Paper IARIA Program

Siddaraju, V. K.

Small Teams, Strong Systems

Self-published. 2025. Designing High-Leverage Work for Scaling Teams.

Book Amazon

Ong, S., & Siddaraju, V. K.

Beginning Windows Mixed Reality Programming (2nd ed.)

Apress / Springer Nature. 2021. ISBN 978-1-4842-7103-2.

Future Directions

Multi-User Intelligence

Shared spatial understanding across simultaneous users

Cross-Environment Transfer

Knowledge portability between distinct contexts

Standardized Benchmarks

Community evaluation frameworks for spatial intelligence

Open Research Ecosystems

Collaborative infrastructure on Harmony principles