Skip to content

An intialization promblem of fnn.embeddings with padding_idx  #1

Description

@CConory

🐛 Describe the bug

if module.padding_idx is not None:
     module.weight.data[module.padding_idx].zero_()

When module.padding_idx exist, the weight of embedding will initial to 0 since the padding_idx is incorrectly index to the fusion_B dimension.

Versions / Dependencies

Pytorch 2.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions