Skip to content
This repository was archived by the owner on May 29, 2026. It is now read-only.
This repository was archived by the owner on May 29, 2026. It is now read-only.

why padding embedding is 128 x 512 Parameter #53

@wuji3

Description

@wuji3
Image Image

padding embedding in my mind is usually 1 shared token, but GLIDE use nn.Parameter. My question is what about 128K context-window?Why not share padding token?

Thanks for your attention

code is at https://github.com/openai/glide-text2im/blob/main/glide_text2im/text2im_model.py#L10

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions