Contextual and theoretical studies 2: 360 Gaze (10)

This final week before the end of the unit we dove into a little bit more art history.

1787. Robert Barker “The Panorama” | by Esther Bang | Medium
The Rotunda in London’s Leicester Square was purpose-built for the exhibition of panoramas

Some classic immersive art like panoramic paintings such as those made by Robert Baker. A classmate brought up that they had visited some similar paintings that had blended with 3D objects in the space merging the line between the paintings and the audience.

This brought to mind virtual reality pop-ups and arcades that use objects like boxes to create the boundaries of the play area, in reality, matching those in the virtual reality or having real sand beneath the user’s feet. Also, the Meta (Oculus) Quest 2’s new passthrough feature where the line between AR and VR is blurred with MR.

Wanderer above the Sea of Fog Caspar David Friedrich -1818

We Looked at Romanticism and how paintings that portray this art movement prefer to depict scenes in a way that emphasises emotional feel and impact. With few concerns on how plausible it is in our reality only that the viewer has suspension of disbelief and that the scene maximises its emotional feel.

In an exercise, we thought up a “never ended VR story” based on this Wanderer above the Sea of Fog.

I wrote “The man climbed down from the craggy rocks making sure not to dirty his freshly washed clothes. As he makes his way down into the fog he falls on his knees scuffing and tearing his trousers. He wades through the fog searching for his lost lamb. Sometimes finding a gap in the fog. He would clamber up out of the fog to listen for the lambs cry’s that are dampened by the fog. He worries that if he tears up his clothing he would have to retreat home to put on a new set of clothes before coming back another day to return the lost lamb to its herd. He rushes because he worries that predators will find the lamb before he does. Returning home would allow the opportunity to rally help from his family and friends in a search party before setting out. Collecting supplies to aid in the search for the lost lamb.”

I liked the idea of Gamifying this narrative into some sort of Rough-lite game. personally, I find the setting of misty Craigs very familiar to the emotional mimics the emotional response I have to my Scottish home. In thinking about creating such a scene I had an idea for a perspective change in VR.

Continuing to use the painting as a reference, You see the man as an NPC. He has a pair of binoculars around his neck just the same as you the VR player. As you pick up your own binoculars he mirrors your hand, not one to one with your controller but in Keeping with the binoculars target. looking where you look matching your gaze. Bringing up the binoculars to your face would narrow your peripheral vision and as you remove the binoculars it transitions the man to your First-person perspective.

I went looking for tutorials for how to do binocular effects however the only examples I have found at this time are for scopes on guns and that seemed like a bit of a Cunningham’s Law. I’m looking for more of a transitional effect like the ones used in Tender Claw games.

I’d love to try and come up with more unique and specific techniques for transitioning perspectives in VR.

I should also note that I found Frederick Kiesler’s remarks about infinite space (here) ring true to the power of VR and I think he would be a fan.

Edit: I need to look into first and second-order reality more because I didn’t quite understand the distinction.

Some more Virtual Spaces Stuff

Some last min attempted additions to my project before submission.

Sound

Oculus Spatialised

I added Oculuses spatialised audio to the tools so that the sound interacts with position velocity and its environment. I wanted to make something more for the scene that would make use of sound.

Turntable

In designing a turntable I underestimated the depth of design choices that I would need to make. such as where the player can grab. how the rotation reacts to the position of the player’s hand, whether the hand holds onto the controller position or grab point position.

Record Player

In seek of more objects to emit sound I had the idea for a record player that using joints to imitate the record needle and start playing the music. also possibly later adding the ability to change records and record sides. however, I did not give myself enough time to have this idea so late in production.

Tool Interactions #2

After making the controller models vanish when holding an interactable. I had to move the Hand tag ridged body from the controller prefab to the XR toolkit prefab as to not disturb the hand count on the toolkit animation. otherwise, the hands would not register to leave the toolkit collider.

Drop script

Virtual Space

Deciding on the setting wasn’t a huge priority of mine. of course, my first thought whereof a Japanese style garden with paper wall buildings (I even went to visit Kyoto gardens to get a feel for the style) but thinking back to my own experience I first was made aware of bonsai at Royal Botanic Garden Edinburgh when I was very young. I find the art deco and nouveau greenhouses visually interesting and in the back of my mind I intend to create a world for VR-Chat at some point and although the Japanese style is very popular with the Anime fan community’s on VR-Chat I feel as if it a style that’s a little played out.

I found this Victorian-style greenhouse under creative commons through the sketchpad blender plugin and used it as a base to create my main botanical space. this model was made to be viewed from the outside and its supports are hollow on the inside so I cut up the model and turned the curve inside out.

used an empty at a 45-degree rotation and used it as a mirror object for the x and y-axis. I then merged them together and created the centre cross and with Ctrl-F created window pains.

I rescaled the Greenhouse in Unity and remade the materials making the glass have additive transparency so the glass wasn’t completely clear but would let light through.

I feel now that spending a day making the greenhouse larger and into the shape of a cross was a waste as all the gameplay elements take place on a desk and the player is gifted far more space than is needed making it feel as if the room feel large and empty. I added cubes as table placeholders. I ended up removing the table in the centre because it felt isolated and lonesome so I moved the XR Rig and toolkit to be on a table away from the centre. I had I little look at the decor that could help fill all the empty space. TLDR: too much space not enough time.

VR Tools

I have been working in Blender to create the bonsai tools for my project. I decided to have the different parts of the mesh divided into separate materials this is less optimal but I thought if I decided to edit the materials in unity later I could visually affect the blade to dull or allow customer colours for the handles and pins. To the 3d cursor to the centre of the pin and then setting the origin point of the parts to the 3d cursor, then rotation one part by 180. I made the Cutters, Trimmers and this way but the sheers ended up being one object so I would need to figure out a different technique other than using a pivot object. I first considered using a vertex displace shader, so I split the UV to have it organised left to right. however, I realised that using bones and weight painting would allow me to have more control over the mesh’s movement in the long run.

Thought it would be nice to have a place for the tools to go. I considered having it as a player.

Thought about having the toolkit start packed up

L-System Introduction

http://algorithmicbotany.org/papers/#abop

In class, we discussed coding techniques that we could use in our projects and our lecturer (Sokol) suggested I look into Lindenmayer systems to generate my Tree. I find the idea of being able to have my tree grow over time very appealing and is a far cry from the restricted step by step tutorial I had in mind for my project.

Since finding out about L-systems I have watched a few videos including this one video above that shows the L-system growing over time made in Javascript (there GitHub download was broken), as well as 3D l-systems like TreeSketch and ones found on http://www.algorithmicbotany.org/TreeSketch/ and semi interactable unity example on the unity asset store.

3D L-System

In Class Sokol gave us a step by step tutorial talking us through creating the sets of rules (the axioms) and the dictionary that defines those rules with a String builder. I didn’t think I got it to work at first but realised, later on, I just needed to zoom out and I had what you could just about call a tree, Just without deviations, a third dimension, leaves, growth or colour.

I noticed that the sidebar was filled with branch prefabs and found that I could instantiate them as children of the pot by using the above. I think later on I could use this to have branches understand their hierarchy in that when an older branch that is higher on the hierarchy is cut the children of that branch will fall off. However, my understanding of the system right now has it so that when I edit a branch it all branches in its iteration.

I created this script to make it easier to view the l-system in-game view. which rotates the camera around the pot by drawing the mouse across the screen. I did this by using the distance between where the mouse clicked and the mouse currently is.

I then created two scripts, one from the orbit around the Y-axis (up and down) by clicking and dragging the screen and the other so I could zoom in and out. At first, my zoom script moved the cameras transform position but the meant the camera would clip through the leaves so I edited the cameras FOV instead and had it bound to the mouse scroll wheel.

Weatherproof Bonsai Rotating Platform

Now that I had set up a rig that allowed me to view the L-system. Iv had to think more about how this will work with a VR player. The XR camera isn’t something I have to worried about however if the Bonsai is on a table, as is the player would have to walk around it. I rather the player be able to use a turntable to rotate the tree as they work on it. I thought having the branches parented to the pot as I had done previously would mean I would just need to change the rotation of the camera to the rotation of the pot. However, because the l-System position is determined only at the Start the rotation of the pot would be implemented after restarting the game. So I would need to put it in an update function to have it rotate the way things are right now but that I feel would scale poorly and be incredibly taxing on the system especially running in VR. I Tried to detect if the tree was moving with an exterior script that would detect if the tree was moving and call an update. this didn’t get me anywhere.

Case studies and state of the art.

I have been researching state of the art and what current developers have for VR, I Haven’t been able to play all of them as of yet but I have been watching/reading a review for all of them and for those, I couldn’t afford in money and time I watched lets players only to try to find interesting perspective interactions and perspective shifts. I was disappointed that a lot of these games layout their perspective and most don’t change the character’s perspective and if they do it is only as a brief edge case.

Bonsai Tree: 1

So I started to plan out my VR experience for Virtual Spaces and have decided to explore the art of Bonsai. Creating a miniature tree that the users will be able to manipulate whilst learning about the tools and techniques used in creating living art. I could also use it as a way to teach the history of bonsai as it moved from china to japan to all across the world and how it became synonyms with zen Buddhism. possibly also touching on famous individuals like Makoto Azuma, Yuji Yoshimura, Kunio Kobayashi, Akanori Aiba.

Bonsai is seemed to be quite a rabbit hole of complexity where creating a truly fatal reaeration of bonsai is seemingly infeasible as it’s important to remember that a tree is a living thing and they are incredibly complex. So I have to watch out for feature creep as the idealistic vision I might have for a VR bonsai simulation won’t be achievable in the few months I have for the project aspectual considering this will be my first dive into unity interactions and scripting. So I have listed out mechanics and features I think would be cool to have and listed them in order of importance and relevance. Some features like being able to see the tree grow will prove to be incredibly challenging for me but we love the challenge.

  • Branch Bending
  • Branch Wire
  • Branch clippers
  • leaf sheers
  • Temperature
  • Real-time growing
  • Seasonal changes
  • Dead bark
  • customer pots
  • Root rake
  • Root cutting
  • Decoration
  • History and meditation lessons (getting over it with Bennett Foddy style)
  • Plant grafting