Converting human movements into a conceptual painting based on music using a motion capture system: Action Research

Motion capturing is a concept which has been taken into consideration in recent decades and it has been used for various purposes like improving the performance of patients with motor problems, increasing motivation and creativity of users. It can also be used in film industry both in two- and threedimensional animations. Research has shown that this system may be used to enhance creativity and thinking power. The aim of this study was to use the VICON motion capturing device to convert creative human movements into a conceptual painting with the help of music.

for culturally adaption of the system. the first chapter of “HAFTVAD” music album called “the introduction” composed by MASOUD NEKOYI’s and the story of ROSTAM AND SOHRAB from FERDOWSI‘s SHAHNAMEH were chosen as the musical groundworkas and the scenario for this survey. A human model was trained to perform movements in accordance with the musical and fictional workarounds of the study; the model was also allowed to use self-created styles in movements in the final performance. The segmental movements of the model body were identified in the Vicon Vero system using wearing clothes equipped with reflective markers. This information was transmitted into the Unity engine, and without modeling the body's segments, different colors and brushes were defined to illustrate the path of the movements of the hand, foot, head, and heart.

By defining various brushes in different colors, human movements were converted into a conceptual painting in accordance to the music.

this study discussed a creative process, entitled Motion Paint, which was implemented in IRAN for the first time. This method can be used to make the process of exercise therapy more attractive, especially in chronic motor problems.