Artificial Intelligence & Photography

mickyates Art, Computer Generated, Coursework, Critical Research Journal, Generative, Ideas, Photography, SSWeek4, SurfacesStrategies Leave a Comment

It is hard to consider any photograph completely devoid of human intervention. Images taken on Mars are only possible because humans created the recording and broadcasting equipment. Monkeys taking selfies … well, however you look at it, a human designed the camera and the capture setup.

Yet it is also clear that we are increasingly aided by technology. Cameras have long had programs of various descriptions. Image manipulation software, facial recognition and so forth muddy the waters of authorship.

It would appear to me, however, that only with the advent of Artificial Intelligence (AI) featuring deep machine learning could computers actually generate new imagery without human intervention. Yes, humans design the learning algorithms, and provide ‘seed’ imagery. But entirely new images and ways of learning are created.

The header, above, shows two such images – imaginary people that do not exist.

As the system learns, it can create new images, and search for new seeds over the internet, without human intervention. As is the case with AI language research, when computers communicate directly without human interaction, novel things happen. For example, they get aggressive.

In 2017, [Google Deep Mind] researchers tested its willingness to cooperate with others, and revealed that when DeepMind feels like it’s about to lose, it opts for “highly aggressive” strategies to ensure that it comes out on top. The Google team ran 40 million turns of a simple ‘fruit gathering’ computer game that asks two DeepMind ‘agents’ to compete against each other to gather as many virtual apples as they could. They found that things went smoothly so long as there were enough apples to go around, but as soon as the apples began to dwindle, the two agents turned aggressive, using laser beams to knock each other out of the game to steal all the apples.

And remember the tabloid scare that ‘researchers switched off computers as they were afraid that they were learning their own language‘? Not exactly true, though Facebook was more interested in computers that could communicate with humans, hence the switch off.

NVIDIA, amongst others, are creating GANs (Generative Adversarial Networks), which allow computers to self-train in image making.

Here is the abstract of a recent paper:

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively: starting from a low resolution, we add new layers that model increasingly fine details as training progresses. This both speeds the training up and greatly stabilizes it, allowing us to produce images of unprecedented quality, e.g., CelebA images at 1024². We also propose a simple way to increase the variation in generated images, and achieve a record inception score of 8.80 in unsupervised CIFAR10.

Additionally, we describe several implementation details that are important for discouraging unhealthy competition between the generator and discriminator. Finally, we suggest a new metric for evaluating GAN results, both in terms of image quality and variation. As an additional contribution, we construct a higher-quality version of the CelebA dataset.

Note: CelebA is a huge dataset of human faces for researcher’s use in facial recognition, facial attribute recognition and so forth. Found here.

Original NVIDIA Video

Put in simpler words, the system uses competition to create new images.

GANs consists of two parts, a discriminator and a generator. The former learns how to distinguish fake from real objects, and the latter creates new content and tries to fool the discriminator by developing novel images that it hasn’t seen before.

This is quite different to ‘traditional’ generative programs that create new images that are firmly based on human-defined rules – for example Fractals, based on the Mandelbrot Set.

I was fascinated by these, years ago, and here is an example made in 2006:

I founds a very helpful and comprehensive resource which lists a wide range of computer Generative Art programs and sources.

Generative Art refers to that created with the use of an autonomous system, to independently determine artwork that would otherwise require decisions made directly by the artist. It is almost always ‘algorithmic’ in that humans write an algorithm or equation to start the process – with unpredictable end results.

GANs take this further, by minimising the impact of human influence via ‘learnt’ machine determined inputs.

Another algorithmic approach is Agent Based Modelling, which uses Complexity Theory, an area I was tangentially involved in through my business activities in the late 1990’s / early 2000’s. In particular, US Marine Corps LtGen (Ret) Paul van Riper applied the lessons of complexity theory to warfare, which directly inspired the ISAAC and EINSTein projects. EINSTein allowed the programming of various war-fighting parameters – hardware, firepower – as wall as human elements – no harm to civilians, don’t leave anyone behind.

The scenario then allowed the computer to run thousands of ‘red on blue’ war-games. Interestingly Van Riper demonstrated that asymmetric warfare needed to be addressed more throughly by the Marine Corps (think terrorism). But that is out of scope here 🙂

The algorithms created interesting images.

Again, however, whilst the visualisations were always different on every computer run, over time probability kicked in and the images tended to merge.

My point here is that, again, this falls into the Generative category of image creation, rather than AI.

Actual human characteristics and activities are often seeds for AI implantation. The full potential (for good and bad) as the machines learn independently is yet to be realised. There is a point in time, often referred to as The Singularity, at which machines become effectively sentient / super intelligent, with unfathomable consequences for technology and society. That will be interesting!

https://en.m.wikipedia.org/wiki/Technological_singularity

It is worth also noting the Turing Test, developed by Alan Turing in 1950. This is a test of a machine’s ability to exhibit intelligent behaviorequivalent to, or indistinguishable from, that of a human. Current estimates suggest that will happen by 2029, though machines can already regularly do quite well in etc etc (think Blade Runner).

https://en.wikipedia.org/wiki/Turing_test

Another interesting link – Artificial Intelligence: How To Give A Robot A Soul

…………………………………………….

FREDLAKE, Christopher & WANG, Kai Wang. 2008. EINSTein goes to War. https://www.cna.org/CNA_files/PDF/D0018865.A1.pdf (Accessed 23.6.2018)

KARRAS, Tero; AILA, Tim; LAINE, Samuli; Lehtinen, Jaakko (NVIDIA and Aalto University). 2018. Progressive Growing of GANs for Improved Quality, Stability, and Variation. Available at http://research.nvidia.com/publication/2017-10_Progressive-Growing-of. (Accessed 22.6.2018).

KOMOSINSKI, Maciej & ADAMATZKY, Andrew (Eds). 2009. Artificial Life Models in Software. Heidelberg: Springer.