Skip to content

Added support for HeyGen Avatar#105

Open
Sirsho1997 wants to merge 2 commits intomainfrom
feature-HeyGenAvatarSupport
Open

Added support for HeyGen Avatar#105
Sirsho1997 wants to merge 2 commits intomainfrom
feature-HeyGenAvatarSupport

Conversation

@Sirsho1997
Copy link
Contributor

No description provided.

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds HeyGen Avatar support to the Runware Video Inference integration by extending the available video model list and introducing new avatar/speech-related inputs and settings nodes used to build the API payload.

Changes:

  • Added HeyGen “Avatar IV” model entry (with dimensions/resolution mappings) to video model search (Python + client UI).
  • Extended Video Inference Settings/Inputs nodes with HeyGen-oriented parameters (avatar id, background image, background removal, expressiveness, background color).
  • Replaced inline speechVoice/speechText inputs on the Video Inference node with a dedicated “Video Inference Speech Input” node (Python + client UI toggle handler).

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 4 comments.

Show a summary per file
File Description
modules/videoSettings.py Adds optional HeyGen-related settings fields and forwards them into the settings dict.
modules/videoModelSearch.py Registers HeyGen model(s) and associated dimensions/resolutions.
modules/videoInferenceSpeechInput.py Introduces a new node to construct genConfig[0].speech.
modules/videoInferenceInputs.py Adds Avatar and Background inputs and passes them into the inputs payload.
modules/videoInference.py Switches speech configuration from two string inputs to a structured speech input node.
clientlibs/utils.js Updates UI model lists/mappings; adds widget toggle handler for the new speech input node and new video settings fields.
clientlibs/types.js Registers the new node type for client UI handling.
clientlibs/main.js Wires the new speech input node toggle handler into node creation.
init.py Registers the new Runware Video Inference Speech Input node.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds HeyGen Avatar support to the video pipeline by extending model selection metadata, expanding video input/settings options for avatar/background controls, and replacing the legacy speechVoice/speechText fields with a dedicated speech input node wired into Runware Video Inference.

Changes:

  • Add HeyGen model metadata (heygen:avatar@4) to video model search lists and resolution/dimension mappings (Python + client UI).
  • Extend video inference inputs/settings to support HeyGen avatar IDs, background images, and avatar-specific settings (background color, remove background, expressiveness).
  • Introduce a new Runware Video Inference Speech Input node and update video inference to consume speech from that node.

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated no comments.

Show a summary per file
File Description
modules/videoSettings.py Adds HeyGen-related settings fields and includes them in the settings payload when enabled.
modules/videoModelSearch.py Adds HeyGen to supported model architectures and maps the model to dimensions/resolution.
modules/videoInferenceSpeechInput.py New node that constructs the speech dict for video inference.
modules/videoInferenceInputs.py Adds Avatar (HeyGen avatar ID) and Background image support; enforces avatar vs image precedence.
modules/videoInference.py Replaces speechVoice/speechText inputs with a typed speech input and injects it into genConfig.
clientlibs/utils.js Updates UI toggling for new video settings fields; adds toggle handler for the new speech input node; adds HeyGen to UI model lists.
clientlibs/types.js Registers the new node type (Runware Video Inference Speech Input) for the UI extension.
clientlibs/main.js Hooks the new speech input node into the extension’s node-created handlers.
__init__.py Registers the new node class in the package mappings.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants