This is the first in a series of posts on Fine Tunings in NightCafe.
One of the most exciting advances in AI-Assisted Art on NightCafe is the introduction of "fine tunings". This feature allows the user to create their own AI model (or "LoRa") based upon a relatively small number of images (up to 64 or 128 depending on the type of model you create). As of this writing, there are three types of models available: faces, things, and styles. Face and things allow you to use AI-Assisted Art based on images of yourself, your pets, or others (with their permission and subject to terms and conditions, of course). This can be quite a bit of fun, but the focus of this series will be on the third option - styles.
With the styles option, you can, quite literally, create your own style of art. In this post, I will walk you through how I created the "MosaicD" LoRa. My goal was to create a style that existed on the boundaries between abstract art and more realistic art. If you imagine abstract geometric art as the substrata of reality, and then imagine that this substrata is breaking through to the surface and disintegrating as it does so, that is the effect I was searching for. A mixture of the more figurative styles of surrealism and cubism that is somewhere between becoming and dissolving, abstract and real, known and unknown. So how to turn these lofty ambitions into something like reality?
By tinkering, of course. It took a little while, but eventually I hit upon an image that was close to what I had in mind. A colorful three dimensional robin perched upon a rock with a flat two dimensional mosaic background. Not exactly what I was looking for, but close.
With some more tinkering, I was eventually able to get the prompt that would form the basis of most of the images that were used in creating MosaicD. I varied the subject modifiers (in the example below, "quaint Post Windmill on a hill by a river:: starry night with luminous moon:: fireflies") and to some extent the artist modifiers, although for the most part Max Ernst, Albert Gleizes, and Jean Metzinger were always present. Most of the artists I picked were known for surrealism or cubism, with some of the artists towards the end of the prompt known perhaps for impressionism. I also switched out various fractal patterns (Julia Set and Barnsley Fern below).
Prompt 1
digital painting:: quaint Post Windmill on a hill by a river:: starry night with luminous moon:: fireflies:: breathtaking intricate detail:: max ernst surrealism:: disintegrating mosaic:: crumbling geometric tiles:: hypermodernism:: Julia Set tessellation:: albert gleizes cubism:: 8k3d:: 3d color detail shading:: unreal engine 5:: bioluminescent hues:: high contrast:: awe:: liu haisu colors:: Zdzisław Beksiński:: impressionist synthetism:: deep depth:: Deviantart
Prompt 2
digital concept art Pierre Roy surrealism:: quaint Post Windmill on a hill by a river:: starry night with luminous moon:: fireflies:: breathtaking intricate detail:: Jean Metzinger cubism:: disintegrating mosaic:: crumbling geometric tiles:: hypermodernism:: Barnsley Fern tessellation:: 8k3d:: 3d color detail shading:: unreal engine 5:: bioluminescent hues:: high contrast:: awe:: Caspar David Friedrich:: Remedios Varo:: Affandi expressionism:: deep depth:: masterpiece
Negative Prompt
low contrast:: deformed limbs:: extra limbs:: incorrect anatomy:: 2d:: flat:: dull:: ordinary:: blurred:: blurry:: draft:: low quality:: soft:: out of frame:: cropped:: cut off:: signature:: watermark:: logo:: text:: numbers:: brand:: border:: frame
The result of this prompt was, to me at least, very exciting.
After 128 images like this had been created, I had the basis for MosaicD. As a test to see how well the LoRa MosaicD compares to the prompts used to create the images for this fine tuning, I duplicated the image above adding the LoRa MosaicD and changing the prompt to "<lora:MosaicD:1.0> quaint Post Windmill on a hill by a river:: starry night with luminous moon:: fireflies". I also used the default negative prompt. This is the result:
That is probably more than you will ever want to know about MosaicD, but there it is! In the future, I hope to create a few more posts about fine tunings, including fine tunings from other creators on NightCafe. Until then, happy creating!