Skip to content

SeLU activation range? #1287

Open
Open
@jmitrevs

Description

@jmitrevs

Quick summary

The SeLU activation uses (typename data_T::value_type)1.0507009873554804934193349852946. This is dangerous because there are no guarantees that the data type has a range covering 1.05, or if there sufficient precision for the value to be meaningful. What if the data range is -0.25 to 0.25 or so? The dimensions should be decoupled. One possibility is to just hardcode, say ap_ufixed<16, 1, AP_RND> or something.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions