₇ IMPULS: VR and live performance

For this impulse, I decided to research some VR-experiences, as I myself did not (yet) have the possibility to experience many VR-related performances, festivals, movies etc, seeing as I mostly came in contact with VR-games and building VR-environments at work.

Thus, in order to get a better feeling of what the world of performing arts makes out of the possibility to extend performative spaces. I, myself, have seen an exhibition so far, but I found a blog series that describes examples of the usage of VR in a theatric/performance environment, one of which I would like to share in this impulse.

The first blog post I read was a play that happened simultaneously in the real world and a VR-environment. The actors were wearing VR-headsets while physically standing in the same room as their audience within a classic stage setting. At the same time, there was a virtual audience group that experienced the virtual play via High Fidelity (a VR platform). Within the virtual world, there was a projection of the real world and vice versa. This allowed for the creators of the play to sort of merge the real and virtual worlds and providing the audience with two different sets of the story.

I thought this was rather interesting, the author of the blog post describes it as a prototype of a new form of theater. I agree with her, based on the pictures of the performance, on the fact that this is an approach that still needs tweaking as the physical VR-equipment doesn’t (yet) allow for a live performance that is as emotional, intimate or intense as a „traditional“ play, and furthermore, the lip synchronization of the avatars was not yet on point. So, there is room for improvement, but I agree with the author that this is an interesting approach to experiencing theater and opening the theater space for a virtual audience.

Further interest

https://vrgeschichten.de/loveseat

https://www.hypergridbusiness.com/2019/09/loveseat-first-play-to-combine-virtual-and-real-world-audience/

https://www.artbasel.com/news/virtual-reality-technology-and-art

https://artsartistsartwork.com/virtual-reality-and-the-future-of-art-exhibitions/

₆ IMPULS: Virtual Reality Healthcare

For this impulse, I started looking for alternate sources on VR/AR topics and ended up encountering a variety of podcasts that have said topics as their main objective.The content of these podcasts varies from reviews of equipment or games, tech insights into the world of VR/AR-glasses, and more. During my research, I stumbled upon a podcast episode of UXPodcast that discussed a very interesting topic that one might not necessarily think about at first when hearing the word “VR” ¬– the hosts of this episode were interviewing an expert on the usage of VR in healthcare, the challenges, possibilities and further developments in this area and how VR could be incredibly valuable in medical care. More specifically, the expert who is a doctoral researcher and organisational developer within the areas of brain computer interfaces, artificial intelligence, social robotics and extended reality, works on developing VR-applications as a medical tool, in this case talking about the usage in psychiatric and palliative care.

One thing that was mentioned in the episode that stuck with me was her approach to VR: she calls it not just an educational tool but rather a tool for empathy. VR can be used for both medical training and treatment strategies and offers the unique possibility to fully recreate a person’s individual condition and make it possible for someone else to experience it, thus making it more relatable for people not suffering from said condition. By, for example, recreating auditory and visual hallucinations of a patient with psychosis, it is possible to share that experience with someone else, thus making them more susceptible to empathize with the patient’s experience. That is something that hasn’t yet been possible before VR, as there was no tool that allowed for this kind of immersion before.

I believe that the possibilities and what is yet to come in terms of making illnesses relatable for others bears so much potential for the future and I am excited to see, what kind of developments there will be. Of course, there are also a lot of challenges when using VR in a medical context, accessibility, data and patient safety being only a few of them. But I think that these are topics that will hopefully be addressed sensitively and cautiously, because I believe that the benefit will be invaluable to health services.

Further Interest

https://uxpodcast.com/virtual-reality-healthcare/

https://www.forbes.com/health/mind/virtual-reality-therapy/

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7366939/

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4361984/

₅ IMPULS: The Future of VR

Looking at the development of AR and VR technologies over the past decades it’s impossible not to be astonished. For this impulse, I looked at various TED-Talks that were given between the years 2010 and 2019, each reflecting on different projects and (at that time) new developments in the respective field. Seeing as these days, the time the average human spends in front of screens is higher than ever, it makes sense to view AR/VR-Applications as one of the most impactful and biggest mediums of the modern age.

Through all of the TED-Talks I was able to gather one big takeaway: AR/VR allows us to experience things rather than just watch them. Through AR/VR we can simulate doing things ourselves instead of observing, which has both physiological and psychological effects: the body and mind react in authentic ways, causing feelings/reactions such as an adrenaline rush, a jolt of fear, a pounding heart etc., making it a much more intense way of experiencing other realities. The TED-talks presented projects that partially date back many years, thus being far from recent these days, and STILL, the project, such as the 2010 presentation of a Microsoft feature that extended a map into a 3D-space, basically showing what we know as Google Street View today, is incredible.

I think all presenters, and I share their point of view, are convinced that VR/AR is much more than just a gadget or technology. It is a new, enhanced form of communication, allowing us to get immersed in worlds and realities in a way that we will remember on a whole new level: we basically live through them as we experience not only the visual, but all the physical and emotional effects of the augmented or virtual environment.

Further Interest

https://www.ted.com/talks/catherine_allen_the_future_of_virtual_reality

https://www.ted.com/talks/catherine_allen_the_future_of_virtual_realityhttps://www.ted.com/talks/blaise_aguera_y_arcas_augmented_reality_maps

https://www.ted.com/talks/jessica_ochoa_hendrix_how_virtual_reality_turns_students_into_scientists

https://www.ted.com/talks/chris_milk_the_birth_of_virtual_reality_as_an_art_form

₄ IMPULS: Effects of VR (on me)

Today I would like to talk about the physiological effects that I have experienced while both playing a VR game and watching others play. I have tried a couple of games but would like to describe one in particular, as it is a very a good example for the instant physiological responses VR experiences can cause.

I borrowed a pair of VR glasses from my workplace and gathered my parents in order to both observe their behavior while playing and experience myself what reactions the game would cause. The game I am talking about is called a plank experience, where the user/player takes an elevator up a high storey building and then, as the elevator doors open, is faced with the challenge of walking a narrow plank that leads outdoors, with a rather steep drop on both sides. This is probably an experiment known to quite a few, and for many probaply one of the first touchpoints with virtual reality.

Figure 1: Richie’s Plank Experience1

We laid out a piece of wood that most closely resembled a plank, but rather than having it high up the outer walls of a building, we put it on to the floor, in order to create a more realistic environment. Before trying it myself, I watched everyone else walk the plank and was highly amused by their reactions, as I saw them hestitate, walk the plank rather slowly and fight for balance. My mother even refused to take a step „outside” – she didn’t move until I took off her VR glasses. Lastly, it was my turn, and all I can say is that i was pretty surprised by the way my body reacted. Firstly, I had a feeling of elevation when the elevator was going up, a halting sensation as it came to a stop and I could sense my heart beat just a bit faster in anticipation. With the doors opening, I felt like I was standing atop a tall building and looking down into the abyss was surprisingly leaving my toes a bit tingly, even though logically, I knew that I was perfectly safe. The feeling of walking the plank itself was even worse, making it rather challenging to step on it and walk what was ultimately nothing more than a straight line.
I was quite astonished by the intensity of the reactions that came with this experience and the unique feeling of logic and sensation going in different directions. It makes me wonder what all those people who had a real plank on the floor at those VR demo stands went through.

Further interest

https://www.meta.com/de-de/experiences/1642239225880682/

https://www.sciencedaily.com/releases/2019/03/190318114550.htm

https://www.frontiersin.org/articles/10.3389/fspor.2020.531535/full

https://hearingreview.com/hearing-loss/vestibular-care/virtual-reality-technology-help-treat-balance-problems-new-study-says

Images

1. Meta. “Richie’s Plank Experience für Meta Quest | Quest VR Games | Meta Store” Meta Quest Store. Accessed February 2, 2024. https://www.meta.com/de-de/experiences/1642239225880682/#?

Blog Entry 10:  Organization

Since my latest entry about the preliminary structure of my thesis, I started searching literature for my chapters. But before I actually started doing it, I remembered my bachelor thesis. My bachelor thesis had over 120 pages and 15 pages of literature references. And I kinda didn’t really have a good plan for organizing everything. I basically used Browser bookmarks and crude descriptions. At some point it was basically impossible to find certain quotes again or even whole articles. It took an insane amount of time to work like this and constantly search for something. I really don’t want this to happen again. So this time I will figure out a system for sorting my literature that works for me.  

For that I will use a document which I’ll use to keep track of everything.  

Firstly I will use the chapters I have or more precisely the different topics of my thesis. There I will sort in my literature. Secondly, I will give every reference a unique number that I will also assign to the downloaded PDF, so I’ll always be able to find what I need. Moreover, I will give every reference a rating from one to five stars, depending on how important I think it will be for my thesis. I’ll also write down if I already found full-text access to the document or where I can still search for it. Furthermore, I’ll also assign a Letter to know at first glance what kind of reference it is.  

As I was starting on this, I already noticed the first flaws with that system. When I will start writing it would be important to also have a summary of the reference, the most important quotes and a comment on the quality or critical points. The problem is, if I add all this the document will be confusing. Also i can’t sort it, which will be probably very important, so I’ll will transform this document into an excel spreadsheet which will bring a lot more benefits. At the current state I am thinking about these categories.

While working on the thesis I’ll probably add some categories, but at the moment I think this a way better start to this project than my approach to my bachelor thesis.

Impuls VIII: Literally me: Why we connect with sociopaths: 

Since my last entry about Drive I (re)watched some films that fit the same category. (Fight Club, Nightcrawler, American Psycho and Blade Runner 2049) At first these films don’t really have a lot in common. Except that they deal with men confronted with isolation and emasculation and the simple fact that when people watch them, they think: „this is literally me!“ Even though they are neither Get-away Drivers, sociopaths filming crime scenes, killers or replicants in a dystopian cyberpunk world. I think the fact why people associate with these characters on such a deep level, is that they have experienced similar feelings and situations. They have been the outcast, never learned to really talk or even feel trough their emotions, and society doesn’t want them to or doesn’t even allow it all. That’s why all these characters are on quest for meaning. We all are. The only difference is that these characters really break conventions to actually achieve it. People might not associate with the ways these characters search for meaning but they definitely associate with the need for it. I think it is very important that these „literally me“ films and characters exist, because they are a rare example of media that deal with male emotional struggles. These films show people that they are not alone and that others feel the same way. 

Impuls VII: DRIVE

Drive is a 2011 neo noir – arthouse – action film by Nicolas Winding Refn and one of the best films I have ever seen. This Impulse contains spoilers for the film so if you haven’t watched I highly recommend to do so. 

Film Summary: The unnamed protagonist Driver is a stunt driver who works as a getaway driver at night. He meets his neighbor, Irene, and her son and they become close. But things take a dangerous turn when he gets involved in a heist that goes wrong. To protect Irene and her son from the criminals involved, he has to navigate through a world of violence and betrayal, putting his own life at risk to keep them safe

Driver: „You know the story about the scorpion and the frog? Your friend Nino didn’t make it across the river.” 

From Drivers point of view it becomes obvious that he thinks of himself of the Scorpion. This also implies that everything bad he has done previously is just his nature. Even though the action of killing someone comes rather easy to him the consequences that come out of it show that killing is not his nature and that the scorpion is probably not him himself but sitting on his back preparing to sting him.

Goslings character starts out as someone who is in total control of everything indicated by the perfect escape from the police in the opening scene of the film. However when Irene and her son enter his life he slowly learns that he is not in control of everything especially not his own emotions and feelings. 

As Gosling himself put it Driver is a character who has seen to many films and became a captive in his own head. And you got to give it to him. There is just something about Ryan Gosling playing the detached loner longing for meaning. I have never seen an actor portraying that feeling of loneliness and being a captive of  his own feelings as well as Ryan Gosling does it. Blade Runner 2049, some parts of La La Land or Drive are perfect of examples of this. 

In Drive there is grave difference from the in-control, emotionally disconnected person executing the perfect get-away to someone who is violently shaking while smashing in someone’s Hand and shoving a bullet down his throat. Driver can’t escape his life. The only scene where he briefly escapes it and pulls Irene aside to kiss her before violently smashing the hitmen’s head in is borderline reality. The way the camera and the lighting work in this scene it can be assumed that the kiss only plays out in Drivers head and the frustration about not being able to live with Irene leads to his overreaction of kicking the hitman even though he is long dead resulting in Irene realizing what he actually is. 

But does this really make him the scorpion. I would argue that the scorpion is on his back, also implied by his jacket he is wearing throughout the film. This could be in form of Bernie which would make a lot of sense. Since Driver let’s himself be stabbed by Bernie in the end before killing him.

 I would however argue that Driver is his own Scorpion. He is never in control and so caught up in his own imagination of himself that he doesn’t realize that he barely ever takes a conscious decision before the point of already being involved with people whose hands are actually dirty compared to his hands which are only a little dirty. He only starts to take control to save Irenes life sacrificing their future of being together.

https://www.imdb.com/title/tt0780504/

Impuls VI: Virtual production

Virtual production, as seen in The Mandalorian, could probably be a revolution in filmmaking by combining real-time computer visuals with live-action filming. As opposed to conventional green screen methods, which call for performers to stand in front of a blank green backdrop, virtual production makes use of projection systems or LED panels to show high-definition digital surroundings in real time. Actors can engage with their environment more naturally with this immersive technique, which improves performances and minimizes the amount of post-production work required.

The capacity of virtual production to give actors and filmmakers instant visual input is one of its main advantages over green screen production. In The Mandalorian, performers were able to respond and perform more naturally since they could see the computerized sets and creatures on the LED screens surrounding them. On set, this real-time communication encourages a collaborative atmosphere where innovative decisions may be made quickly, expediting the production process and saving money and time.

Furthermore, virtual production gives you more freedom and control over how your movie turns out. Real-time experimentation with lighting configurations, camera angles, and visual effects allows directors to maintain the film’s stylistic consistency throughout production.Virtual production produces more visually attractive and engaging content by fusing real-world sets with virtual ones. This technique captivates viewers and expands the possibilities of cinematic storytelling.

Impuls V: Steinhorster Bruch 

When I was at home over the holidays my grandparents and I went to the Steinhorster Bruch which is a huge protecting breeding area for birds with multiple small lakes and Forrests. I just bought the Sony a7IV and the 200-600 G so it was time to test these out. My goal for the trip was to more actively focus filmmaking instead of photography. That is something I always struggled with so I wanted to address this. The problem is when I go out with the goal to just shoot videos or pictures it is very easy for me to just do that. But when it comes to hybrid shooting I usually end up being hyper focused on one thing (usually photography) and completely neglecting the other. So I often end up with the perfect images but not a singular video. So that’s why I wanted to actively try to both. But it proved to be kinda hard. In situation where there is only one thing possible, for example a bird flying by my brain seems to value photos a lot more and automatically tries to just shoot pictures. With actively addressing that issue I got somewhat an even ratio, however I really have to actively try to not take photos. I’ll try again on my next trips and hopefully achieve a flow state in both categories without thinking about it too much. 

Anyway here are some pictures from the trip: 

Impuls IV: STOP overexposing SLOG3 to +1.7… and more

Before settling on these two I watched a lot of videos on how to expose S-Log 3. Since we film Hannis Documentary on the weekend I thought it was a good idea to freshen up on this topic. Those two videos were very thorough on the topic. Good bye to the days of always exposing up to +1.7. The videos were very detailed on when to overexpose and when to expose for skin tones and when to use which metering mode and when and to what extend to use the zebra and of course when to use (which is basically always) use false colour. A lot of the Information was of course familiar but there were bits and pieces that were new. After that I also freshened up on when to use which focus speeds for smooth transitions for each PAL Framerate. After that I checked up on the best codec settings for the camera, before getting inspiration on possible Custom Button layouts. I have to say, people make interesting choices when it comes to custom button layouts. But since preferences seem to very different some of those layouts were straight up lunacy for me, but whatever works for people I guess. Whenever I watch videos like this I always learn new things but also there is often stuff missing that I know. Maybe sometime I will start my own YouTube tutorial series with a specific focus on wildlife. Time will tell.