Arborist

Mixed Reality Experience - Experience Design, Real-time Visualization

Real time visualization experience in mixed reality

In collaboration with Yale's XR Pediatrics lab. Arborist links a user's physiological signals such as heart rate, GSR and PPG and renders them visually in real time. The sensor and the visuals are linked in the experience to a floral petal render. Visuals and renders are linked to various visual design parameters such as petal color, shape, particle and more.
‍
Publication link: https://dl.acm.org/doi/10.1145/3706370.3731714

Procedurally Generated Petals

The visual shaders needed to be mapped to a range of values. The rendered petals are all procedurally generated. Fresnel shaders allow the soft organic petals to be given depth and airy softness.

The particle effects were added as a way to provide additional movement and reflect the aromas of the petals as well as their pollen.

Converting Bio Data

Each signal needed its own visual parameter separate but cohesively appearing at the same time.

The parameters would not be known only their ranges and would all have to coexist visually to represent the data in one petal