Trained with multi-level line segment detectionĪn image with depth information, usually represented as a grayscale image.Īn image with surface normal information, usually represented as a color-coded image.Īn image with segmented regions, usually represented as a color-coded image.Īn image with line art, usually black lines on a white background. The authors released 14 different checkpoints, each trained with Stable Diffusion v1-5Ī monochrome image with white edges on a black background. "a handsome man with ray-ban sunglasses", "runwayml/stable-diffusion-v1-5", controlnet=controlnet, torch_dtype=torch.float16 "lllyasviel/control_v11p_sd15_inpaint", torch_dtype=torch.float16 ![]() Image = np.expand_dims(image, 0).transpose( 0, 3, 1, 2)Ĭontrol_image = make_inpaint_condition(init_image, mask_image)Ĭontrolnet = om_pretrained( The ControlNet learns task-specific conditions in an end-to-end way, and the learning is robust even when the training dataset is small ( 0.5] = - 1.0 # set as masked pixel We present a neural network structure, ControlNet, to control pretrained large diffusion models to support additional input conditions. Resources for more information: GitHub Repository, Paper.Ĭite Conditional Control to Text-to-Image Diffusion Models},Īuthor=,Ĭontrolnet was proposed in Adding Conditional Control to Text-to-Image Diffusion Models by See also the article about the BLOOM Open RAIL license on which our license is based. License: The CreativeML OpenRAIL M license is an Open RAIL M license, adapted from the work that BigScience and the RAIL Initiative are jointly carrying in the area of responsible AI licensing. ![]() Model type: Diffusion-based text-to-image generation model This checkpoint corresponds to the ControlNet conditioned on inpaint images.ĭeveloped by: Lvmin Zhang, Maneesh Agrawala It can be used in combination with Stable Diffusion, such as runwayml/stable-diffusion-v1-5.įor more details, please also have a look at the □ Diffusers docs.ĬontrolNet is a neural network structure to control diffusion models by adding extra conditions. This checkpoint is a conversion of the original checkpoint into diffusers format. Controlnet v1.1 was released in lllyasviel/ControlNet-v1-1 by Lvmin Zhang.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |