2023-10-12 –, Bazar
This paper proposes a computational framework for a novel experience of embodied knowledge archives, an integral part of Intangible Cultural Heritage (ICH), focusing specifically on the exploration of dance performances within the audiovisual archive of the Prix de Lausanne. By applying advanced computer vision algorithms to capture human poses, the computational augmentation of moving image archives enables the extraction of rich processable data, resulting on two main levels of augmentation: archive-level browsing and item-level movements visualisation.
First, dimensionality reduction algorithms like t-SNE and UMAP are employed to visualise the archive in 2D or 3D, enabling both a more 'generous' browsing experience and serendipitous discoveries. The effects of different parameters on the mapping results, as well as the clustering of similar poses, will be discussed.
Second, various real-time and preprocessed visualisations are generated at scale to unlock new modes of viewing dancers' movements. These novel ways of representing bodies in motion offer a captivating and aesthetic experience for the audience, revealing the ephemeral nature of dance performances.
This session will present a comprehensive framework that combines AI, audiovisual archives and computational techniques to preserve embodied knowledge, unlock new modes of access and enhance the understanding and appreciation of dance performances as an example of ICH practices. This research offers valuable insights into the potential applications of AI in the preservation and exploration of diverse forms of embodied knowledge, with methods and concepts that go beyond the specific case of the Prix de Lausanne dance performances.
Giacomo Alliata is a PhD student at EPFL's Laboratory of Experimental Museology, where he specialises in using cutting-edge technologies to create interactive and innovative ways to approach cultural and heritage collections. He combines human-computer interaction, data visualisation, theories of embodiment and the use of immersive environments to place visitors inside cultural archives. Giacomo has developed various installations for exploring audiovisual and mixed-media archives, which have been showcased in exhibitions in Lausanne, Switzerland.