02. PyTorch Neural Network Classification - Excercise 6: Tanh()

[jonorl]

I managed to sucessfully do the excercises for the 2nd module, but under the excercises, number 6 asks to replicate the Tanh (hyperbolic tangent) activation function in pure PyTorch. I did it in a similar way to Sigmoid() and ReLU() but I don't understand if the excercise is referncing Tanh because we were supposed to use it in the previous moons excercise.

I tried using Tanh() replacing nn.ReLU() on my moon module with nn.tanh() as well as replacing torch.sigmoid() with torch.tanh() when transforming logits to predictions but in both cases the model needed more epochs to get to the target 96% accuracy. Am I doing something wrong?