truncated normal initializer

[ruotianluo]

I have a reasonable truncated normal approximation. (Actually that is what tf does).
https://discuss.pytorch.org/t/implementing-truncated-normal-initializer/4778/16?u=ruotianluo

[thomwolf]

We could try that. Not sure how important it is though. Did you try it?

[thomwolf]

Ok I think we will stick to the normal_initializer for now. Thanks for indicating this option!