2024 | United States | Animation,Documentary,Experimental,Data Visualization

Aesthusion

  • English 2 mins
  • Director | Rose Ansari
  • Writer | Rose Ansari
  • Producer | Rose Ansari

STATUS: Research

This film is currently not available.   

This video is being generated as part of the Aesthusion project. 

Aesthusion is a wireless, portable, battery-powered wearable device. This researched-based project is an exploration at the intersection of art, technology, and neuroscience, aimed at redefining the boundaries of human perception and expression. Through the integration robotics, virtual reality (VR), and brainwave data analysis, Aesthusion transforms the intangible realm of thought into tangible, multisensory experiences.

At its core, this project utilizes the structure of a VR headset as a telecommunication device, bridging the gap between the intricacies of individual cognition and the external world. By capturing the intricate patterns of brainwave data and translating them into a dynamic spectrum of high and low-frequency sound, Aesthusion orchestrates a symphony of auditory and visual stimuli on the VR screen and speaker.

Drawing inspiration from Strabismus, Auditory-visual synesthesia, and the concept of "thinking out loud," Aesthusion delves deep into the phenomenology of perception. Through the lens of Gestalt theory, it seeks to unravel the complexities of human cognition, offering a bio feedback-loop snapshot of individual state of mind. Inspired by Optical art, Aesthusion employs sophisticated algorithms and filters in p5.js to create mesmerizing fluctuations in images, captivating attention and evoking a sense of flux. The project aims to challenge conventional notions of art representation and human sensory perception by integrating dissonance in color and texture (visual elements) with frequency, amplitude, and oscillation in sound (audio components).

Central to Aesthusion is the concept of the "third ear" – a metaphorical construct within the system for perceiving tonal sound frequencies beyond the auditory realm.

At its essence, Aesthusion poses a profound question: "Can you hear and see my notion and mind?" Through its immersive experiences, it invites participants to transcend the confines of individual consciousness and forge connections on a deeper, more visceral level. By pushing the boundaries of art and science, Aesthusion aims to inspire non-verbal dialogue, trigger senses, and redefine the essence of human interaction.

Inspirations: 

Disability or super ability. Visual Art is not about vision, but it’s about the brain.

Strabismus, commonly known as 'crossed eyes,' is a condition where the eyes are misaligned and do not look at the same object simultaneously. An estimated 4 percent of adults in the world experience strabismus in their lifetimes. In strabismus, the eye muscles do not work together as a team, leading to one eye focusing on one object while the other eye looks in a different direction. This results in two different images being sent to the brain, causing confusion.

People with strabismus may experience a loss of depth perception. Strabismus can cause individuals to see the world more flatly or two-dimensionally. This can result in difficulties with depth perception and spatial awareness. This neurological eye-muscle condition has inspired me to create distorted realities and deformed pictures as an artist to challenge the viewer's perception of reality and conventional representations.

Living with this condition for 6 years has led me to believe that visual art is more than what is perceived by the eyes visually. It has detached me from the real world and has sparked my curiosity to consider art-making as a phenomenon happening inside the brain that can be presented to the outer world.

Projection vs. Association

"What is the color of sound? Can we see a song? Can we hear a color?

Auditory-visual synesthesia is a fascinating phenomenon where individuals experience a blending of auditory and visual sensations. In this condition, sounds automatically trigger visual perceptions in addition to the auditory experience. For example, hearing a specific sound may evoke the perception of colors, shapes, textures, or movements in the individual's mind. Auditory-visual synesthesia can manifest in various ways, such as tone-color (musical note-color), chord-color, timbre-color, song-color, and more. Each individual may have unique inducers (sounds) and concurrents (visual experiences).

The parts of the brain involved in auditory-visual synesthesia include sensory and motor regions, as well as areas responsible for cross-modal integration. Specific brain regions implicated in auditory-visual synesthesia include the orbitofrontal cortex (OFC), inferior temporal lobe, and colliculi, which play crucial roles in processing auditory and visual stimuli and integrating information across different sensory modalities.

Synesthetes may either project the visual experiences into their physical surroundings or associate them with their mind's eye. Research suggests that approximately 4.4% of the population may experience some form of synesthesia. Having this condition inspired me to create a sensory experience which involves engaging multiple sensory modalities to create immersive and holistic experiences for the audience. This project is also a wearable Synesthesia machine (device).

I'd rather to be a cyborg than a goddess.

A cyborg is a cybernetic organism, part human and part machine, where technology is integrated into the human body to restore function or enhance abilities. Cyborgs challenge traditional notions of identity and embodiment by blurring the boundaries between organic and artificial elements. On the other hand, Post-humanism explores the idea of moving beyond traditional human limitations through technological advancements, genetic engineering, and artificial enhancements. The post-human era envisions a future where humans transcend their biological constraints to become something different, potentially merging with technology to create new forms of existence. Cyborgs embody a transitional phase where humans integrate with machines, while the post-human represents a future state where human identity and capabilities are fundamentally transformed by technological interventions. Both concepts challenge conventional understandings of what it means to be human, opening up new possibilities for enhanced abilities, altered perceptions of self, and novel modes of existence in an increasingly technologically mediated world. 

Nature of Code, Code of Nature. Neural Network:

Neural networks are computer systems inspired by the human brain's structure and functionality. Also known as artificial neural networks (ANNs), they consist of interconnected nodes, or artificial neurons, organized in layers with weighted connections that process and transmit data. These networks learn patterns from training data, continuously adapt, and apply their learning to make predictions or decisions. Through processes like forward propagation and backpropagation, neural networks adjust weights to minimize errors and improve performance. They excel at handling complex data, learning from examples, adapting to new conditions, processing information in parallel, tolerating noise, and scaling up for large-scale problems. While they share similarities with the human brain in learning and decision-making processes, neural networks are more simplified versions designed for specific computational tasks (1) (2) (3). Deep learning, a subset of machine learning utilizing neural networks inspired by the human brain, processes data in layers to recognize patterns in diverse data types. This technology enables tasks like image and speech recognition with high accuracy. In the art world, deep learning is revolutionizing image analysis, colorization, art generation, pattern recognition, and mixed image creation, showcasing its transformative impact on artistic endeavors. 

Completed proposal: https://drive.google.com/file/d/1w0g1PHnbgKyZMrYOij7fJzm7qA9D9M5D/view?usp=sharing

Brain Wave Creativity AI Neural Networks animation documentary experimental system Aesthusion phenomenology
Issues