reading:
watch: moonwalking with einstein & brief history of intelligence.
writing:
ask:
It is time to return to earth’s orbit. We have been exploring the high dimensional character of your’s (and other’s) “inner space”, as captured by the embedding space of machine learning networks. Now let’s render this in a way that your humble primate body that believes in and is focused on time and space can understand using your laptop’s 2D laptop screen. At the intersection of your inner space and outer space is computer interface. Will spatial metaphors allow you to create more powerful interfaces?
Distilling many dimensions to a few (and back) is a great challenge of computer interface and visualization tools. More generally the culling from the overall possibilities of thought to the important few is the main challenge of communication in general with words putting simple labels on the complex world. Going from many things to fewer things is the great offering of machine learning models. We will be considering rendering high dimensions in few dimensions for the next two weeks.
Does 3D space help you think? Would more spatial metaphor in computer interface help you organize and inspire your thoughts? Does placing items in a particular place help you remember and be able to recall it. Do the spatial affordances help to you in an activity. Does spatial metaphor feel more real and thus become more deeply convincing. Is there a part of your body that will only accept things as real if the are presented in a spatial form?
Can you square the two meanings of space, the common sense space that appears before us and the mathematical space of possibility. Can we get the best of both worlds, you ancient “nematode” desire to understand the world through 3 dimensions and your modern minds ability to connect symbolic things across hundreds of dimensions? One possible way to do this is not invite travel through a space but rather the conjuring or creation of a space that emerges from you. This connects with the idea of navigation by creation. Cinema does this by cutting to the next thing to think about regardless of its time and space but virtual reality usually makes you slave to following the dimension of time space. Which do you like better? Can you dynamically map new meaning to convention degrees of freedom (dimensions) in a 3D computer interface?
Importantly for this class can you make different locations in space bring you in contact with other people. You may have heard of the multiverse theory in Physics of parallel universes that in superimposition which can seem a little hard to swallow. But it is easy to imaging 8 billion parallel universes, one for the internal life of each inhabitant of earth. Can you building a interface that conjures the superimpositions of all those people.
making:
ask:
Introduce 3D into beyond your 2D HMTL interfaces we have been using.
You can try implementing one of your previous projects in 3D. Or you can start over and wake up in 3D. Imagine you are a baby (or a nematode) trying to make sense of the world within and outside your body. How can space help. Maybe experiment with a photograph as background. You can use your phone or a camera from the ER for Video. Maybe try rotating Camera to tell a story. Try adding text, image or shapes, maybe getting the “bouncing ball” happening in 3D, Maybe try changing the primitive shape. for starters. Now that you have space as an amenity of your thinking, try to locate your thoughts in a 3D world.
Can you get Models to create the world for you. Actual world models like Google’s Genie or Runway gwm might be too expensive but maybe you have an LLM write buiild a world for you out of three.js primitives or have Replicate create 3D models for you via the proxy.
Investigating Gaussian Splats,where you build 3D world from just a few images, would also be appropriate this week.Splats
Car Commercial 1 and 2,
Inception