Open
Description
Quick summary
The SeLU activation uses (typename data_T::value_type)1.0507009873554804934193349852946
. This is dangerous because there are no guarantees that the data type has a range covering 1.05, or if there sufficient precision for the value to be meaningful. What if the data range is -0.25 to 0.25 or so? The dimensions should be decoupled. One possibility is to just hardcode, say ap_ufixed<16, 1, AP_RND>
or something.