{"id":7900,"date":"2023-07-17T10:05:21","date_gmt":"2023-07-17T01:05:21","guid":{"rendered":"https:\/\/realtokyo.co.jp\/_sys2024\/?p=7900"},"modified":"2023-07-18T19:11:23","modified_gmt":"2023-07-18T10:11:23","slug":"contact-gonzo-x-yang02","status":"publish","type":"post","link":"https:\/\/realtokyo.co.jp\/en\/performance\/contact-gonzo-x-yang02\/","title":{"rendered":"contact Gonzo X yang02
\u201cjactynogg zontaanaco \u30b8\u30e3ku\u30c6\u30a3\u30fc\u4e43\u611a\u30fb\u5b58ta\u30a2ko\u30b3\u201d
ANOMALY
2023.5.19 -21<\/small>"},"content":{"rendered":"

Photo: Yurika Takano<\/p>\n

 <\/p>\n

This work by contact Gonzo and yang02 was the continuation of an \u201cuntitled session\u201d presented at Tokyo Arts and Space Hongo in 2019. In the performance, members of contact Gonzo are seemingly\u00a0<\/span>attacking each other as if they were fighting, all while an automatic guided vehicle (AGV) and a Segway modified to move on its own seek to \u201cobserve\u201d and \u201cexplain\u201d the scene. The performance was preceded by a work-in-progress version presented in Osaka in March and documented in a published report.*1<\/p>\n

\u00a0*1\u3000https:\/\/theatreforall.net\/feature\/feature-8568\/<\/a><\/small><\/p>\n

 <\/p>\n

On the official website, two main points are raised pertaining to the work. One is cooperation with artificial intelligence (AI), and the other that the performance is being conducted as part of a festival called \u201cTRANSLATION for ALL.\u201d*2<\/p>\n

*2\u3000https:\/\/theatreforall.net\/join\/jactynogg-zontaanaco\/<\/a><\/small><\/p>\n

 <\/p>\n

Let\u2019s begin by addressing the first point, collaboration with AI.<\/p>\n

The work makes use of a technology called image captioning, which automatically generates captions (or descriptive text) for images. The AI analyzes an image, detecting shapes and features in it, and interprets its content by recognizing objects in the image and their relationships. It then generates a caption using natural language processing methods such as deconstructing sentences to understand grammar and structure, understanding meaning from context, extracting specific information, and determining emotions and opinions contained in a sentence.<\/p>\n

Silver lines on the floor of the venue served as tracks for the AGV, which can carry a load of up to 100 kilograms and sometimes moved with a performer on board, while the Segway had been modified to move autonomously without a human driver. Cameras mounted on each of the devices took still images every ten seconds or so, and AI-generated captions for those images were projected onto the venue\u2019s walls. The AGV\u2019s captions were read out in a male computer voice, the Segway\u2019s in a female. Since audience members could be exposed to the machines\u2019 cameras, contact Gonzo provided masks to those who wished to hide their faces.<\/p>\n

 <\/p>\n

\"\"<\/p>\n

Photo: Yurika Takano<\/p>\n

 <\/p>\n

contact Gonzo\u2019s performances resemble a martial art, with the participants\u2019 bodies colliding repeatedly with each other, and it isn\u2019t clear whether any rules govern their movement. The heavy sound of body slams and the performers\u2019 disordered breathing make one feel uneasy. Explaining the scene in words would seem very difficult. For the purposes of this work, the AI was described as playing the role of a translator that converts the performance into language. How did that turn out?<\/p>\n

As in the image below, the AI-generated captions described something different from that happening in front of my eyes. But was it really \u201cdifferent\u201d?<\/p>\n

The performers made adjustments such as changing costumes and picking up instruments, as if fighting to see how the AI would interpret them while their performance. I guess they were trying to see if they could get it to produce an appropriate caption. But looking at the captions actually generated, one could vaguely make out the content of, and trends in, the data the AI had been trained on, and I felt like I was watching the show while chatting with a non-human intelligence\u2014an interpretation more interesting than evaluating the AI\u2019s abilities for translation or explanation. The AI appeared to pick up a certain sadness in the performers\u2019 eyes, one I didn\u2019t see.<\/p>\n

 <\/p>\n

\"\"<\/p>\n

Photo: Yurika Takano<\/p>\n

 <\/p>\n

Let\u2019s move on to the second point, \u201cTRANSLATION \u00a0for ALL.\u201d<\/p>\n

As stated on the project\u2019s website, \u201cThere are all sorts of barriers on the road to delivering physical expression to audiences. The various works [presented] are taking up the challenge of overcoming [those barriers] through diverse techniques and opening up accessibility to ALL, meaning all kinds of people.\u201d*3<\/p>\n

\u00a0*3 TRANSLATION for ALL: https:\/\/theatreforall.net\/translation-for-all\/<\/a><\/small><\/p>\n

 <\/p>\n

The organizers added live commentary by a human after the work-in-progress performance, and at the dress rehearsal of this showing they consulted a monitoring group composed of visually impaired individuals<\/span>. The<\/span>\u00a0commentary was provided by the dancer Akiyoshi Nita, who whispered into a microphone, as if bringing an explanation intended only for someone right next to or in front of him to the entire audience. Conveying the progress of the performance and the participants\u2019 movements, Nita\u2019s commentary accurately described the way these bodies were moving\u2014such as how arms were bent\u2014and their intricate interplay, all while infusing his words with the atmosphere of the scene and the rhythm of the performers. His rap-like delivery made for pleasant listening.<\/p>\n

 <\/p>\n

\"\"<\/p>\n

Photo: Yurika Takano<\/p>\n

 <\/p>\n

The AI \u201cchatter\u201d and Nita\u2019s commentary were enjoyable as elements of the performance, but how did they further the goal of \u201copening up accessibility to all\u201d? In the project handout, this was addressed as follows: \u201cIn an attempt to promote accessibility in the appreciation of artworks, we will attempt to \u2018translate\u2019 physical expression by incorporating, as elements of the artwork, verbal explanations of the performance by an AI and a human, as well as textual support through UD TALK [a communication support app developed in Japan] and subtitles.\u201d<\/p>\n

By including elements such as commentary, linguistic explanations, and UD TALK compatibility, the organizers had undoubtedly gone to great lengths to help the audience enjoy the work. However, I felt that including these \u201cas elements of the artwork,\u201d and making the work\/performance accessible in itself, are matters that differ in kind.<\/p>\n

Artistic expression focuses on issues related to the method and intent of an artwork, while accessibility emphasizes making that artwork approachable to anyone. Precisely because this performance was experimental, I felt that it could have involved people with a stake in accessibility from the outset, thereby enabling the organizers to separate and coordinate these aspects\u2014and open up even greater artistic possibilities.<\/p>\n

Let me end on a different note. During the intermission, the owners of Leggy_ (plant sales) and Ken-chan Curry, who had stalls at the venue, talked about how they are attracted to plants that have grown into unwanted shapes and collect them by going from one gardening store to the other. Similarly to these overgrown succulents, \u201cjactynogg zontaanaco\u201d appeared to reveal the appeal of AI that materializes in situations beyond the optimal. I look forward to seeing new attempts in this vein in the future.<\/p>\n

 <\/p>\n

Translated by Ilmari Saarinen<\/small><\/p>\n","protected":false},"excerpt":{"rendered":"Photo: Yurika Takano   This work by contact Gonzo and yang02 was the continuation of an \u201cuntitled session […]","protected":false},"author":114,"featured_media":7880,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[73,152],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/posts\/7900"}],"collection":[{"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/users\/114"}],"replies":[{"embeddable":true,"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/comments?post=7900"}],"version-history":[{"count":34,"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/posts\/7900\/revisions"}],"predecessor-version":[{"id":7952,"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/posts\/7900\/revisions\/7952"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/media\/7880"}],"wp:attachment":[{"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/media?parent=7900"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/categories?post=7900"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/realtokyo.co.jp\/en\/wp-json\/wp\/v2\/tags?post=7900"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}