Squashing Function
Ten maximal sigmoid derivatives multiply to 9.537e-07 and forty to 8.272e-25. These are activation-only factors; the latter is still representable in float32.
Ten maximal sigmoid derivatives multiply to 9.537e-07 and forty to 8.272e-25. These are activation-only factors; the latter is still representable in float32.