ComfyUI Lora loader for SDXL with no refiner

AdamDart

Aug 27th, 2023

1,287

Never

Add comment

Not a member of Pastebin yet? Sign Up, it unlocks many cool features!

text 18.25 KB | None | 0 0

raw download clone embed print report

{
"last_node_id": 58,
"last_link_id": 71,
"nodes": [
{
"id": 39,
"type": "Note",
"pos": [
474,
295
],
"size": {
"0": 210,
"1": 95.42681121826172
},
"flags": {
"collapsed": true,
"pinned": false
},
"order": 0,
"mode": 0,
"title": "Note - CLIP Encode (BASE)",
"properties": {
"text": ""
},
"widgets_values": [
"These nodes receive the text from the prompt and use the optimal CLIP settings for the specified checkpoint model (in this case: SDXL Base)"
],
"color": "#323",
"bgcolor": "#535",
"shape": 1
},
{
"id": 41,
"type": "Note",
"pos": [
807.7498779296875,
233.78460728149417
],
"size": {
"0": 326.1493225097656,
"1": 140.60494995117188
},
"flags": {
"collapsed": true,
"pinned": false
},
"order": 1,
"mode": 0,
"title": "Note - VAE Decoder",
"properties": {
"text": ""
},
"widgets_values": [
"This node will take the latent data from the KSampler and, using the VAE, it will decode it into visible data\n\nVAE = Latent --> Visible\n\nThis can then be sent to the Save Image node to be saved as a PNG."
],
"color": "#233",
"bgcolor": "#355",
"shape": 1
},
{
"id": 38,
"type": "Note",
"pos": [
71,
521
],
"size": {
"0": 284.3257141113281,
"1": 123.88604736328125
},
"flags": {
"collapsed": true,
"pinned": false
},
"order": 2,
"mode": 0,
"title": "Note - Text Prompts",
"properties": {
"text": ""
},
"widgets_values": [
"These nodes are where you include the text for:\n - what you want in the picture (Positive Prompt, Green)\n - or what you don't want in the picture (Negative Prompt, Red)\n\nThis node type is called a \"PrimitiveNode\" if you are searching for the node type."
],
"color": "#323",
"bgcolor": "#535",
"shape": 1
},
{
"id": 36,
"type": "Note",
"pos": [
70.85639976806641,
-329.72836625976583
],
"size": {
"0": 315.70074462890625,
"1": 147.9551239013672
},
"flags": {
"collapsed": true,
"pinned": false
},
"order": 3,
"mode": 0,
"title": "Note - Load Checkpoint BASE",
"properties": {
"text": ""
},
"widgets_values": [
"This is a checkpoint model loader. \n - This is set up automatically with the optimal settings for whatever SD model version you choose to use.\n - In this example, it is for the Base SDXL model\n - This node is also used for SD1.5 and SD2.x models\n \nNOTE: When loading in another person's workflow, be sure to manually choose your own *local* model. This also applies to LoRas and all their deviations (ComfyUI supports all current filter types as of 14-03-2023!)"
],
"color": "#323",
"bgcolor": "#535",
"shape": 1
},
{
"id": 42,
"type": "Note",
"pos": [
65,
897
],
"size": {
"0": 260,
"1": 210
},
"flags": {
"collapsed": false,
"pinned": false
},
"order": 4,
"mode": 0,
"title": "Note - Empty Latent Image",
"properties": {
"text": ""
},
"widgets_values": [
"LANDSCAPE BASE RESOLUTION\n3:2 1216 x 832 1:1 1024x1024\n4:3 1152 x 896\n8:5 1216 x 768\n16:9 1344 x 768\n19:9 1472 x 704\n21:9 1536 x 640\n\nPORTRAIT\n2:3 832 x 1216\n3:4 896 x 1152\n5:8 768 x 1216\n9:16 768 x 1344\n9:19 704 x 1472\n9:21 640 x 1536"
],
"color": "#323",
"bgcolor": "#535",
"shape": 1
},
{
"id": 4,
"type": "CheckpointLoaderSimple",
"pos": [
55.85639976806641,
-126.72836625976555
],
"size": {
"0": 350,
"1": 100
},
"flags": {
"pinned": false
},
"order": 5,
"mode": 0,
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"links": [
70
],
"slot_index": 0
},
{
"name": "CLIP",
"type": "CLIP",
"links": [
71
],
"slot_index": 1
},
{
"name": "VAE",
"type": "VAE",
"links": [
52
],
"slot_index": 2
}
],
"title": "Load Checkpoint - BASE",
"properties": {
"Node name for S&R": "CheckpointLoaderSimple"
},
"widgets_values": [
"sd_xl_base_1.0.safetensors"
],
"color": "#323",
"bgcolor": "#535",
"shape": 1
},
{
"id": 48,
"type": "VAEDecodeTiled",
"pos": [
812,
128
],
"size": {
"0": 210,
"1": 46
},
"flags": {
"pinned": false
},
"order": 14,
"mode": 0,
"inputs": [
{
"name": "samples",
"type": "LATENT",
"link": 65
},
{
"name": "vae",
"type": "VAE",
"link": 52
}
],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"links": [
55
],
"shape": 3,
"slot_index": 0
}
],
"properties": {
"Node name for S&R": "VAEDecodeTiled"
},
"shape": 1
},
{
"id": 14,
"type": "PrimitiveNode",
"pos": [
65,
321
],
"size": {
"0": 300,
"1": 160
},
"flags": {
"pinned": false
},
"order": 6,
"mode": 0,
"outputs": [
{
"name": "STRING",
"type": "STRING",
"links": [
18
],
"widget": {
"name": "text",
"config": [
"STRING",
{
"multiline": true
}
]
},
"slot_index": 0
}
],
"title": "Negative Prompt (Text)",
"properties": {},
"widgets_values": [
""
],
"color": "#322",
"bgcolor": "#533",
"shape": 1
},
{
"id": 13,
"type": "PrimitiveNode",
"pos": [
65,
118
],
"size": {
"0": 297.8631286621094,
"1": 160.9127655029297
},
"flags": {
"pinned": false
},
"order": 7,
"mode": 0,
"outputs": [
{
"name": "STRING",
"type": "STRING",
"links": [
16
],
"widget": {
"name": "text",
"config": [
"STRING",
{
"multiline": true
}
]
},
"slot_index": 0
}
],
"title": "Positive Prompt (Text)",
"properties": {},
"widgets_values": [
"a miniature model of a dark gothic fantasy castle warm light licks off ignited cruxifix an angry mob with pitchforks march along a lone vampire hunter stands in solitude a body horror monstrosity hides in a grotto beneath secret rituals happen in the dark by ClassipeintXL"
],
"color": "#232",
"bgcolor": "#353",
"shape": 1
},
{
"id": 7,
"type": "CLIPTextEncode",
"pos": [
474,
205
],
"size": {
"0": 210,
"1": 54
},
"flags": {
"collapsed": false,
"pinned": false
},
"order": 12,
"mode": 0,
"inputs": [
{
"name": "clip",
"type": "CLIP",
"link": 69
},
{
"name": "text",
"type": "STRING",
"link": 18,
"widget": {
"name": "text",
"config": [
"STRING",
{
"multiline": true
}
]
},
"slot_index": 1
}
],
"outputs": [
{
"name": "CONDITIONING",
"type": "CONDITIONING",
"links": [
62
],
"slot_index": 0
}
],
"properties": {
"Node name for S&R": "CLIPTextEncode"
},
"widgets_values": [
""
],
"color": "#322",
"bgcolor": "#533",
"shape": 1
},
{
"id": 6,
"type": "CLIPTextEncode",
"pos": [
474,
115
],
"size": {
"0": 210,
"1": 54
},
"flags": {
"collapsed": false,
"pinned": false
},
"order": 11,
"mode": 0,
"inputs": [
{
"name": "clip",
"type": "CLIP",
"link": 68
},
{
"name": "text",
"type": "STRING",
"link": 16,
"widget": {
"name": "text",
"config": [
"STRING",
{
"multiline": true
}
]
},
"slot_index": 1
}
],
"outputs": [
{
"name": "CONDITIONING",
"type": "CONDITIONING",
"links": [
63
],
"slot_index": 0
}
],
"properties": {
"Node name for S&R": "CLIPTextEncode"
},
"widgets_values": [
"a miniature model of a dark gothic fantasy castle warm light licks off ignited cruxifix an angry mob with pitchforks march along a lone vampire hunter stands in solitude a body horror monstrosity hides in a grotto beneath secret rituals happen in the dark by ClassipeintXL"
],
"color": "#232",
"bgcolor": "#353",
"shape": 1
},
{
"id": 56,
"type": "KSampler",
"pos": [
429,
494
],
"size": {
"0": 315,
"1": 262
},
"flags": {
"pinned": false
},
"order": 13,
"mode": 0,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 67
},
{
"name": "positive",
"type": "CONDITIONING",
"link": 63
},
{
"name": "negative",
"type": "CONDITIONING",
"link": 62
},
{
"name": "latent_image",
"type": "LATENT",
"link": 66
}
],
"outputs": [
{
"name": "LATENT",
"type": "LATENT",
"links": [
65
],
"shape": 3,
"slot_index": 0
}
],
"properties": {
"Node name for S&R": "KSampler"
},
"widgets_values": [
611720110730452,
"randomize",
26,
4.7,
"dpmpp_3m_sde",
"karras",
1
],
"color": "#223",
"bgcolor": "#335",
"shape": 1
},
{
"id": 40,
"type": "Note",
"pos": [
432,
834
],
"size": {
"0": 631.6643676757812,
"1": 250.24887084960938
},
"flags": {
"collapsed": true,
"pinned": false
},
"order": 8,
"mode": 0,
"title": "Note - KSampler ADVANCED General Information",
"properties": {
"text": ""
},
"widgets_values": [
"Here are the settings that SHOULD stay in place if you want this workflow to work correctly:\n - add_noise: enable = This adds random noise into the picture so the model can denoise it\n\n - return_with_leftover_noise: enable = This sends the latent image data and all it's leftover data to the next KSampler node.\n\nThe settings to pay attention to:\n - control_after_generate = generates a new random seed after each workflow job completed.\n - steps = This is the amount of iterations you would like to run the positive and negative CLIP prompts through. Each Step will add (positive) or remove (negative) pixels based on what stable diffusion \"thinks\" should be there according to the model's training\n - cfg = This is how much you want SDXL to adhere to the prompt. Lower CFG gives you more creative but often blurrier results. Higher CFG (recommended max 10) gives you stricter results according to the CLIP prompt. If the CFG value is too high, it can also result in \"burn-in\" where the edges of the picture become even stronger, often highlighting details in unnatural ways.\n - sampler_name = This is the sampler type, and unfortunately different samplers and schedulers have better results with fewer steps, while others have better success with higher steps. This will require experimentation on your part!\n - scheduler = The algorithm/method used to denoise the picture, used for processing certain amounts of data per step.\n - start_at_step = This is the step number the KSampler will start out it's process of de-noising the picture or \"removing the random noise to reveal the picture within\". The first KSampler usually starts with Step 0, though this is not always necessary.\n - end_at_step = This is the step number the KSampler will stop it's process of de-noising the picture. If there is any remaining leftover noise and return_with_leftover_noise is enabled, then it will pass on the left over noise to the next KSampler (assuming there is another one)."
],
"color": "#223",
"bgcolor": "#335",
"shape": 1
},
{
"id": 57,
"type": "LoraLoader",
"pos": [
463,
-150
],
"size": {
"0": 315,
"1": 126
},
"flags": {
"pinned": false
},
"order": 10,
"mode": 0,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 70
},
{
"name": "clip",
"type": "CLIP",
"link": 71
}
],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"links": [
67
],
"shape": 3,
"slot_index": 0
},
{
"name": "CLIP",
"type": "CLIP",
"links": [
68,
69
],
"shape": 3,
"slot_index": 1
}
],
"properties": {
"Node name for S&R": "LoraLoader"
},
"widgets_values": [
"ClassipeintXL.safetensors",
1,
1
],
"color": "#323",
"bgcolor": "#535",
"shape": 1
},
{
"id": 58,
"type": "EmptyLatentImage",
"pos": [
65,
751
],
"size": [
295.9440640536221,
106
],
"flags": {
"pinned": false
},
"order": 9,
"mode": 0,
"outputs": [
{
"name": "LATENT",
"type": "LATENT",
"links": [
66
],
"shape": 3,
"slot_index": 0
}
],
"properties": {
"Node name for S&R": "EmptyLatentImage"
},
"widgets_values": [
896,
1152,
1
],
"color": "#323",
"bgcolor": "#535",
"shape": 1
},
{
"id": 50,
"type": "SaveImage",
"pos": [
795,
492
],
"size": {
"0": 702,
"1": 525
},
"flags": {
"pinned": false
},
"order": 15,
"mode": 0,
"inputs": [
{
"name": "images",
"type": "IMAGE",
"link": 55
}
],
"properties": {},
"widgets_values": [
"SDXL-Classipeint"
],
"shape": 1
}
],
"links": [
[
16,
13,
0,
6,
1,
"STRING"
],
[
18,
14,
0,
7,
1,
"STRING"
],
[
52,
4,
2,
48,
1,
"VAE"
],
[
55,
48,
0,
50,
0,
"IMAGE"
],
[
62,
7,
0,
56,
2,
"CONDITIONING"
],
[
63,
6,
0,
56,
1,
"CONDITIONING"
],
[
65,
56,
0,
48,
0,
"LATENT"
],
[
66,
58,
0,
56,
3,
"LATENT"
],
[
67,
57,
0,
56,
0,
"MODEL"
],
[
68,
57,
1,
6,
0,
"CLIP"
],
[
69,
57,
1,
7,
0,
"CLIP"
],
[
70,
4,
0,
57,
0,
"MODEL"
],
[
71,
4,
1,
57,
1,
"CLIP"
]
],
"groups": [
{
"title": "Base Prompt",
"bounding": [
454,
34,
252,
361
],
"color": "#3f789e"
},
{
"title": "Text Prompts",
"bounding": [
45,
35,
339,
622
],
"color": "#3f789e"
},
{
"title": "Load in BASE SDXL Model",
"bounding": [
49,
-411,
369,
399
],
"color": "#a1309b"
},
{
"title": "Empty Latent Image",
"bounding": [
45,
665,
339,
443
],
"color": "#a1309b"
},
{
"title": "VAE Decoder",
"bounding": [
789,
41,
360,
350
],
"color": "#8AA"
}
],
"config": {},
"extra": {},
"version": 0.4
}

Tags: nodes Workflow ComfyUI

Add Comment

Please, Sign In to add comment