Early Collage Results!

Posted: April 29, 2017 at 3:58 pm

SOMResults_500000-Collage-8192

The image above shows some early results of organizing 200,000 percepts (the same vocabulary used in “Watching (Blade Runner)“) in a collage according to their similarity (according to width, height, and colour). I’ve included a few details below showing the fine structure of the composition. The image directly below shows a visualization of the SOM that determines the composition of the work. (more…)


Blade Runner Collages

Posted: April 25, 2017 at 3:50 pm

I have not started work on making large collages from Blade Runner clusters and segments since the residency. I ended up writing some code for my public art commission (“As our gaze peers off into the distance, imagination takes over reality…“, 2016) that arranged segments using a SOM. I did not end up using that approach in the final work, so I’m now adapting it to make collages from Blade Runner clusters and then segments.

The following image shows the colour values of each of the 200,000 clusters, in no particular order:

sampleVectorsColoursBGR

(more…)


Stall on ‘Dreaming’

Posted: April 25, 2017 at 3:05 pm

I’ve stalled on the ‘Dreaming’ size of the project for now realizing that changes I made for ‘Watching’ significantly impact dreaming. With 200,000 percepts and each being able to be in multiple locations for every frame, the LSTM (prediction network) would have an input vector of 5.7 million elements (Including a 19+8 position histogram for each frame). Too big for me to even build a model (at least on my hardware). I took the opportunity to rethink what I should do and came to the conclusion that I’ll need to recompute segments to downscale the LSTM input vector to something feasible. This will be about a month of computation time, so I’ve spent some time working on other projects, such as: “Through the haze of a machine’s mind we may glimpse our collective imaginations (Blade Runner)”.


“Through the haze of a machine’s mind we may glimpse our collective imaginations (Blade Runner)” 2017

Promo Package (PDF)

SOCBR-0006266

“Through the haze of a machine’s mind we may glimpse our collective imaginations (Blade Runner)” is the result of a machine subject reorganizing the pixels and audio samples from Ridley Scott’s Blade Runner according to colour and spectral similarity. This destroys the composition of the original, but preserves underlying statistical properties. The resulting images are softly undulating colour fields while the sounds flow between constant drone and glitch complexity due to the process of self-organization. The structure of the work is an emergent result of the interaction between the machine’s subjectivity and the underlying structure of Blade Runner. The incremental evolution of each scene’s sound-scape and colour field are realizations of the machine’s learning process, enabled by a self-organizing machine learning algorithm. The slow ambient movement of the sound and image is punctuated by drastic changes occurring in the image and sound corresponding to the cuts between scenes in the original. (more…)