Pytorch vs. Keras: Pytorch model overfits heavily

it may be because type of weight initialization you are using
otherwise this should not happen
try with same initializer in both the models