Alien Recombination: Exploring Concept Compositions Beyond Human Cognitive Availability in Visual Art
Alejandro Hernandez, Levin Brinkmann, Ignacio Serna, Nasim Rahaman, Hassan Abu Alhaija, Hiromu Yakura, Mar Canet Sola, Bernhard Schölkopf, Iyad Rahwan (2024)
Abstract
Beyond Human Cognitive Availability in Visual Art Alejandro Hernandez1, Levin Brinkmann1, Ignacio Serna1, Nasim Rahaman2, Hassan Abu Alhaija3, Hiromu Yakura1, Mar Canet Sola1,4, Bernhard Schölkopf2, and Iyad Rahwan1 1Max Planck Institute for Human Development, Berlin, Germany. 2Max Planck Institute for Intelligent Systems, Tübingen, Germany. 3NVIDIA. 4BFM, Tallinn University, Estonia. Figure 1: Comparison of images generated using random sampling versus Alien sampling with the Art model for the input sequence “Insect”. The Art model, fine-tuned on WikiArt concepts [1], combines likely concepts to produce artworks, with novelty controlled by temperature. Random sampling selects concept combinations arbitrarily, while Alien sampling ranks combinations based on cognitive unavailability and artistic fit, generating images from top-ranked sequences. For the full Alien Recombination method, see Figure 4.
Venue: NeurIPS 2024 Workshop on Creativity & Generative AI