ControlNet is great for image-to-image text transformation. I’ve started with simple “Hello” black and white image using the ControlNet Stable Diffusion with Depth Maps using the demo on Huggingface. I’ve tried different settings and I had good results with 30 Steps and a Guidance Scale of 9.5. The prompts I used were simple like Wood, Wood Texture, Marble, Gold Texture, etc. Basically, you can take any writing, logo, or simple icon and apply any texture or pattern.