Style Transfer with Keras
All art is at once surface and symbol.
All art is quite useless.
From Wilde's preface to The Picture of Dorian Gray
The slides from a talk I gave on neural networks and style transfer are available here.
Without me telling you engaging stories while you look at them, I hope that something is lost. But some of them are pretty, and I hope they give a feel for the effect that the parameters have on the final image.
I've copied some of the images to this page to give an idea - for more, see the slides.
The input image for many of the examples is this view of Nottingham, the location of the conference:

Input image

In the style of Starry Night
Big Bold Colours
Since everyone knows what a Starry Night looks like, here's something by Matisse with big bold colours:

The Snail
More Bold

Picasso's Guitar
Thomas Bewick's Bear
I deliberately showed examples where the algorithm failed. Here's one - the slides show one way of removing those white erasures.


A Breakout Image
This style was used because of an earlier presentation about teaching neural networks to play Atari games, also using Keras.

Breakout

Not bad
Velazquez

The dappling is art, not compression artifact

Voyager Animation
The beautiful animation of Voyager below flickers because the starting image for each frame is a different random set of values. It shows that the outcome is sensitive to the starting condition, but not critically so. In the slides there is another version where I used the same initial condition for each. The flickering is replaced with twinkling, because the optimizer is non-deterministic.
⁂