Conversation
There was a problem hiding this comment.
Pull request overview
This PR adds HeyGen Avatar support to the Runware Video Inference integration by extending the available video model list and introducing new avatar/speech-related inputs and settings nodes used to build the API payload.
Changes:
- Added HeyGen “Avatar IV” model entry (with dimensions/resolution mappings) to video model search (Python + client UI).
- Extended Video Inference Settings/Inputs nodes with HeyGen-oriented parameters (avatar id, background image, background removal, expressiveness, background color).
- Replaced inline
speechVoice/speechTextinputs on the Video Inference node with a dedicated “Video Inference Speech Input” node (Python + client UI toggle handler).
Reviewed changes
Copilot reviewed 9 out of 9 changed files in this pull request and generated 4 comments.
Show a summary per file
| File | Description |
|---|---|
| modules/videoSettings.py | Adds optional HeyGen-related settings fields and forwards them into the settings dict. |
| modules/videoModelSearch.py | Registers HeyGen model(s) and associated dimensions/resolutions. |
| modules/videoInferenceSpeechInput.py | Introduces a new node to construct genConfig[0].speech. |
| modules/videoInferenceInputs.py | Adds Avatar and Background inputs and passes them into the inputs payload. |
| modules/videoInference.py | Switches speech configuration from two string inputs to a structured speech input node. |
| clientlibs/utils.js | Updates UI model lists/mappings; adds widget toggle handler for the new speech input node and new video settings fields. |
| clientlibs/types.js | Registers the new node type for client UI handling. |
| clientlibs/main.js | Wires the new speech input node toggle handler into node creation. |
| init.py | Registers the new Runware Video Inference Speech Input node. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
You can also share your feedback on Copilot code review. Take the survey.
There was a problem hiding this comment.
Pull request overview
This PR adds HeyGen Avatar support to the video pipeline by extending model selection metadata, expanding video input/settings options for avatar/background controls, and replacing the legacy speechVoice/speechText fields with a dedicated speech input node wired into Runware Video Inference.
Changes:
- Add HeyGen model metadata (
heygen:avatar@4) to video model search lists and resolution/dimension mappings (Python + client UI). - Extend video inference inputs/settings to support HeyGen avatar IDs, background images, and avatar-specific settings (background color, remove background, expressiveness).
- Introduce a new
Runware Video Inference Speech Inputnode and update video inference to consumespeechfrom that node.
Reviewed changes
Copilot reviewed 9 out of 9 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
modules/videoSettings.py |
Adds HeyGen-related settings fields and includes them in the settings payload when enabled. |
modules/videoModelSearch.py |
Adds HeyGen to supported model architectures and maps the model to dimensions/resolution. |
modules/videoInferenceSpeechInput.py |
New node that constructs the speech dict for video inference. |
modules/videoInferenceInputs.py |
Adds Avatar (HeyGen avatar ID) and Background image support; enforces avatar vs image precedence. |
modules/videoInference.py |
Replaces speechVoice/speechText inputs with a typed speech input and injects it into genConfig. |
clientlibs/utils.js |
Updates UI toggling for new video settings fields; adds toggle handler for the new speech input node; adds HeyGen to UI model lists. |
clientlibs/types.js |
Registers the new node type (Runware Video Inference Speech Input) for the UI extension. |
clientlibs/main.js |
Hooks the new speech input node into the extension’s node-created handlers. |
__init__.py |
Registers the new node class in the package mappings. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
You can also share your feedback on Copilot code review. Take the survey.
No description provided.