Sigmoid Function
At x = 9, a local slope estimate suggests -81.05 for a 0.01 output decrease. The exact input change is about -4.42; the derivative is only local.
-
-
Squashing Function
Ten maximal sigmoid derivatives multiply to 9.537e-07 and forty to 8.272e-25. These are activation-only factors; the latter is still representable in float32.