Comfyui face swap video reddit

Comfyui face swap video reddit. It is meant to be a faster solution to do "face" swap. Achieve clear and realistic results with our advanced AI technology. I would like to be able to face swap to achieve a more consistent character. com/dataleveling/ComfyUI-Reactor-WorkflowCustom NodesReActor: https://github. I use ControlNet to capture the actions of the characters in the original video, then feed the new character portraits with removed backgrounds into IPAdapter. Forget face swap. Or any suggestions as to how to marry a head and a body would be greatly… Guess the model those solutions use is just too lowres, so you don't get good results with the new higher resolutions SDXL provides. I'm looking for the best method to perform a face swap on video clips where the subject is facing the camera. It is less of a model and more like a "face preset". The face model is not similar to a checkpoint or a LoRA. I have to push around 0. FILM VFI (Frame Interpolation using Learned Motion) generate intermediate frames between images, effectively creating smooth transitions and enhancing the fluidity of animations. For example, a professional tennis player pretending to be an amateur tennis player or a famous singer smurfing as an unknown singer. Thank you again! Nevertheless, I found that when you really wanna get rid of artifacts, you cannot run a low denoising. I would like to just be able to face swap the eyes area, so i can make a more consistent look. I love that and I'm trying to find a good workflow for my image creation + face swapping. Which does not happen when I use Roop. Please keep posted images SFW. If you want some some face likeness, try detailing the the face using impact pack, but use the old mmdet model, because the new utralytic model is realistic. It doesn't do head or person swap. For the face swapping effect in the picture, I directly used the open source roop plugging. For anime look, i suggest inpainting the face afterward, but you want to experiment with the denoise level. It helps extract scenes with humans, scenes without humans, scenes without a face, scenes with a face, and faces at specific angles. So that the underlying model makes the image accordingly to the prompt and the face is the last thing that is changed. You can swap the face of one or more subjects in any image with the face of choice. Hi guys, I try to do a few face swaps for fare well gifts. 8 even. Hi guys, I used a111 for some time and now I'm switching to comfyui (portable). At this stage, you can save the image, but I've got roop (face-swap) and face-restorer taking this image to make it more what I want. I've been using a ComfyUI workflow, but I've run into issues that I haven't been able to resolve, even with ChatGPT's help. 0 you can save face models as "safetensors" files (stored in ComfyUI\models\reactor\faces) and load them into ReActor implementing different scenarios and keeping super lightweight face models of the faces you use. He is the author of the IPAdapeter Plus nodes, and has amazing videos. Well I can get it working fine (I'm using ReActor but have tried vanilla roop), but the faces are just all pretty low-res. Additionally Batch Face Swap sometimes doesn't detect the face and the process is getting too complicated. In either case, you must load the target image in the I2I section of the workflow. It's perfect for modifying a movie or TV show clip. I hav no idea how did you even made a video faceswap in A1111 with reactor. google. Does anyone know of a "head swap" workflow - not just face, but entire head. I am looking to do a face swap on the following video. DM/comment for question or your experiential needs. Video Face Swap Want to change faces in your videos? DeepSwapper's video feature makes it easy. Just install it and see for yourself. Typically resulted in cutoff head, annoying head positions, etc. Still using the same inswap128 model in a1111 and the face quality is so much better, what am I doing wrong? Here's FaceSwap with Reactor with a very cool optional, which is FaceAnalysis. Re Joker, have had pretty good results using reactor face swap, using for example Jokers face as source, then swap with whoever you want, tends to keep core joker skin colours mostly intact, but far from perfect or in control of detail. Use IP Adapter for face. Di reactor face swap Been using the face swap for a while - all of the sudden node disappered - turns out its failing to import - anyone else had this particular issue - totally confused - have tried reinstalling it - both from github and via the node manager. This is another implementation of face swapping. The "FACE_MODEL" output from the ReActor node can be used with the Save Face Model node to create a insightface model, then that can be used as a ReActor input instead of an image. mtb node has face swap, kinda like roop, but not as good as training with lora. It may improve depending on your case. The general idea and buildup of my workflow is: Create a picture consisting of a person doing things they are known for/are characteristic for them (i. If you are getting started, check out his other videos as well, they are all pretty great. The subject and background are rendered separately, blended and then upscaled together. Since version 0. Please share your tips, tricks, and workflows for using this software to create your AI art. You can't use that model for generations/ksampler, it's still only useful for swapping. 4. Honestly, the best thing you can do is use your own face, use your own generation, or get explicit permission. You can swap one face or multiple faces in a video. 4 alpha 0. Welcome to the unofficial ComfyUI subreddit. reactor is a castrated version of face fusion that can be used directly in A1111. Additionally, it allows you to stitch these segments back together. All packages were forked directly from the #! repositories/Github and changed only where necessary to keep it up to date with newer packages. Like 0. I'm leaving aside the fact that inswaper128 model (which is used in roop) was designed for swapping faces quite small 128x128 everything bigger is the work of an upscaler (GAN, codeformer, etc). Our tool works well even if there are many people in the video. This video specfically addresses clothing replacement: Face + Pose + Clothing. The video has to be an activity that the person is known for. But what is good FaceSwap app you don't have video cutter that can cut by person detection, face detection, or face angle. youtube. Just use Reactor. com/watch?v=4ay8C8dAqEg. It only works with ReActor and maybe other nodes using the same technology. That said, I'm looking for a front-end face swap, something that will inject the face into the mix at the point of ksampler, so if I prompt for something like Freckles they won't get lost in the swap/upscale but I've still got my likeness. (just the short version): photograph of a person as a sailor with a yellow rain coat on a ship in the rough ocean with a pipe in his mouth OR photograph of a young man in a sports car Thanks for the reply. We do not encourage stolen content and unauthorized face-swap (deepfake). Also the face mask seems to include part of the hair most of the time, which also gets lowres by the process. com/file/d/1EMAuVgPnOLXr2VFm5zW-Yh_yfFecNNFl/v Welcome to the ComfyUI Face Swap Workflow repository! Here, you'll find a collection of workflows designed for face swapping, tailored to meet various needs and preferences. You can also use ctrl button to select multiple faces. See, this is another big problem with IP adapter (and me) is that it's totally unclear what all it's for and what it should be used for. ComfyUI, combined with stock or your own videos, can transform your storyboarding and video projects. Roop isn't that good for anything else than a face with a closed mouth, teeth are usually out of the question. If you want to learn how to Rope Pearl for both video deep fakes and image face swapping this is the best tutorial made so far. That determines how close the generated output face matches with its source. ) didn't work well. So I spent 30 minutes, coming up with a workflow that would fix the faces by upscaling them (Roop in Auto1111 has it by default). In face fusion it takes like 10 seconds However the one thing I cannot for the life of me get working properly is face swap. 3 in order to get rid of jaggies, unfortunately it will diminish the likeness during the Ultimate Upscale. Jul 31, 2024 · Posted in r/comfyui by u/Automatic_Berry7474 • 3 points and 1 comment Very simple workflow. I could have something that seems entirely cartoonish with an eerie, lifelike face. Faces always have less resolution than the rest of the image. Lightning speed face swapping with all the features Upscalers Likeness modifiers Orientation management Masks: borders, differentials, auto occlusion, face parsers, text-based masking-all with strength adjustments and blending settings Mask view to evaluate masks directly Source face merging and saving Swap images or videos Feb 28, 2024 · Workflow: https://github. But it gave better results than I thought. info/ however, the only node I can find for face fixing (FaceRestoreWithModel) seems to accept just the two models mentioned above. Let us know if you find it useful and stay tuned for the next post! DISCLAIMER: all images here are generated. Thumbnail Hello r/comfyui I made a video showing how to install and setup InstaSwap. Anyone know of a good workflow that can faceswap videos without ruining the high quality resolution of the input video? Welcome to the unofficial ComfyUI subreddit. You can swap faces in individual images or all images in a directory. However, I am noticing that the resolution of the video goes down after the processing. *ComfyUI Workflow* - https://drive. If your source image has multiple faces, you can target the desired one via an index value. Yeah what I like to do with comfyui is that I crank up the weight but also don't let the IP adapter start until very late. DOES anyone know where I could get a workflow that will just accept an mp4 and a face image and it does everything to convert or whatever to just output the same video with just the face swapped? Oct 13, 2023 · With the easy implementation of ComfyUI's Custom Note, you'll be able to create face swap images and animations in ComfyUI quickly. It never producec the same level of quality as facefusion. e. Now I'm seeing this FaceSwapLab module for A1111 and looks very interesting, what I'm not sure is if you can directly swap faces on videos, or if it's limited to single images. /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. Should the latter be true, what's the current to-go software to perform face swaps on movies? Thanks! Put ImageBatchToImageList > Face Detailer > ImageListToImageBatch > Video Combine. Hi I am looking for feedback on people's experience with face swapping on video. For videos of celebrities just going undercover and not doing the activity they are known for please submit to /r/UndercoverCelebs. Created by: CgTopTips: With ReActor, you can easily swap the faces of one or more characters in images or videos. Also watch Laten't Vision's vids and tutorials. As we showed in our previous video, we demonstrated In this video, we will see how to face swap in a video using ReActor. Face Swapper. com/Gourieff/comfyui-reactor-nodeVideo Helper Suite: ht When using Roop (faceswaping extension) on sdxl and even some non xl models, i discovered that the face in the resulting image was always blurry. Still, gotta respect their decision, even if face-swapping already has its own ethical grey areas. Is there any way to use a face restore model OTHER THAN cfpgan or codeformer in Comfy? There are a number of face-optimizing models on https://openmodeldb. And Also Bypass the AnimateDiff Loader model to Original Model loader in the To Basic Pipe node else It will give you Noise on the face (as AnimateDiff loader dont work on single image, you need 4 atleast maybe and facedetailer can handle only 1 ) Face Swapper. And very recently, I've added a solution provided by the bright mind who came up with the Manager and other stuff we use in ComfyUI - I reckon he's a genius! - to fix the hands. However, i notice that if the moth is doing anything, or even that part of the face is covered by a shoulder or anything, the face swap messes up the picture a lot. . 4) Then you can cut out face and redo-it with IP Adapter. Here is the… Hi, i am trying to perform face swap on animal characters on children's storybooks. I wanted to be able to generate a simple square image of a well framed head and face that could be fed without modification to the ReActor face swap node, I found the normal shot control prompts (medium closeup, straight on, looking at viewer, etc. I was trying to keep it to a simple process, but the face swap keeps restoring the face so that it doesn't match the style at all, even if I use a different checkpoint. The way I could see it working is you start your work flow with an image of a pose fed into controlnet and/or a desciprtive prompt to generate your base, then just has you would use Reactor with a picture of a model to face swap to, you could also have the ability to feed it specific pictures of the target body partsleft arm, right arm Thanks. In A1111 I tried Batch Face Swap extension for creating a mask for face only, but then I have to run the batch three times (first for the mask, second for inpainting with masked face and third for face only with adetailer). r/comfyui • I made a composition workflow, mostly to avoid prompt bleed. I'll play around and see what I find. In fact, our current self-developed face swapping will still have the problem that the face does not look like the original face, but the effect will still be better than roop, as shown in the picture below. https://www. for those with only one character, i could do face swap with ipadapter face id models, but I am wondering how i can do it with multiple characters in the picture. The thing is, I want to use comfyui because it is easier to use. CrunchBangPlusPlus (or #!++) is an effort to continue the #! environment. My approach is to split the video into individual frames, use Segment Anything to obtain the human mask, then use VAE inpaint encoder to convert it into latent space. For general upscaling of photos go: remacri 4x upscale resize down to what you want GFPGAN sharpen (radius 1 sigma 0. #!++ a lightweight Debian-based distribution featuring the Openbox and GTK+ applications. gea ino srjsx eqdjfjj bvykh oyvrg ggnm eae romj gommkl