SmartAICompendium.ImageGeneration 1.1.0

This package allow easy and typed image generation with a local Stable Diffusion model and a embedded python. Compatible with windows, linux and mac.

Generation Parameters

Usage examples

Image to image with ControlNet

The model can be a huggingface repoId ("{user}/{model}"), civitai modelId ("civitai/{modelId}") or local folder containing the model. The model will be downloaded if not already present (see SmartAICompendium.Common)

var testPromptImage = File.ReadAllBytes("/path/to/base/image.png");
var testMaskImage = File.ReadAllBytes("/path/to/mask.png");

var model = new ImageInference("runwayml/stable-diffusion-v1-5", BaseImageModelType.SD15);

var outputImage = model.Generate("green apple, best quality",   
    safeMode: true,
    negativeTextPrompt: "red, earth, bad quality",
    numInferenceSteps: 15,
    strength: 0.8f,
    stepCallback: new Action<StepCallbackEvent>((callbackEvent) =>
        File.WriteAllBytes($"/path/to/imagetestpreview-{callbackEvent.Step}.png", callbackEvent.Preview)),
    imagePrompt: testPromptImage, 
    controlNets: new ControlNetPrompt[] {
        new() {
            Model = ControlNetType.Canny,
            ControlImage = testPromptImage,
            ConditioningScale = 1
        },
        new() {
            Model = ControlNetType.OpenPose,
            ControlImage = testPromptImage,
            ConditioningScale = 1
        },
        new() {
            Model = ControlNetType.InPaint,
            ControlImage = testMaskImage,
            ConditioningScale = 1
        }
});

File.WriteAllBytes("/path/to/output.png", outputImage);

ControlNet preview

var testPromptImage = File.ReadAllBytes("path/to/base/image.jpg");

var outputImage = ImageInference.GenerateControlNetPreview(new()
    {
        Model = ControlNetType.LineartAnime,
        ControlImage = testPromptImage,
        ConditioningScale = 1
    });

File.WriteAllBytes("/path/to/output.png", outputImage);

Loading packages before use

if not done, the packages will be installed at the class initialization.

ImageInference.Update();

Support My work