Wanna Animate? Join our Discord
A custom nodes module for creating real-time interactive avatars powered by blender bpy mesh api + Avatech Shape Flow runtime.
WARNING
We are still making changes to the nodes and demo templates, please stay tuned.
Interact π |
Interact π |
Interact π |
Interact π |
---|---|---|---|
Interact π |
Interact π |
Interact π |
Interact π |
- Basic Rigging Workflow Template
- Best Practices for image input
- Custom Nodes List
- Shape Flow
- Installation
- Development
- Join Discord π¬
For optimal results, please input a character image with an open mouth and a minimum resolution of 768x768. This higher resolution will enable the tool to accurately recognize and work with facial features.
Download: Save the image, and drag into Comfyui or Simple Shape Flow
Download: Save the image, and drag into Comfyui
Download: Save the image, and drag into Comfyui or Dog Workflow
We need a character image with an open mouth and enable the tool to easily recognize facial features, so please add to the prompt:
looking at viewer, detailed face, open mouth, [smile], solo,eye-level angle
Download: Character Gen Template
To maintain consistency with the base image, it is recommended to utilize a checkpoint model that aligns with its style.
Download: Mouth Open Inpaint Template
Inpaint Demonstration
270589612-ff48c3d9-7292-4505-8993-8f117cee34ff.mp4
Place normal and openpose image with reference to images.
Download: ControlNet Gen
- https://civitai.com/models/4201/realistic-vision-v51
- https://civitai.com/models/49463/am-i-real
- https://civitai.com/models/43331/majicmix-realistic
Expand to see all the available nodes description.
All Custom Nodes
Name | Description | Preview |
---|---|---|
Segmentation (SAM) |
Integrative SAM node allowing you to directly select and create multiple image segment output. |
Name | Description | Preview |
---|---|---|
Avatar Main Output |
The primary output of the .ava file. The embedded Avatar View will auto update with this node's output |
Clone the repository to custom_nodes in your ComfyUI directory:
-
cd custom_nodes
-
git clone https://github.com/avatechgg/avatar-graph-comfyui.git
-
Install deps
cd avatar-graph-comfyui && python -m pip install -r requirements.txt
-
Restart comfyui
-
Run comfyui with enable-cors-header
python main.py --enable-cors-header
or (mac)python main.py --force-fp16 --enable-cors-header
If you are interested in contributing
For comfyui frontend extension, frontend js located at avatar-graph-comfyui/js
Web stack used: vanjs tailwindcss
pnpm i
Run the dev command to start the tailwindcss watcher
pnpm dev
For each changes, simply refresh the comfyui page to see the changes.
p.s. For tailwind autocomplete, add the following to your vscode settings.json.
{
"tailwindCSS.experimental.classRegex": [
["class\\s?:\\s?([\\s\\S]*)", "(?:\"|')([^\"']*)(?:\"|')"]
]
}
To update blender operations input and output types (stored in blender/input_types.txt
), run:
python generate_blender_types.py
Any question? Join our Discord