Published on February 6, 2019 by Chuan Li Multi-GPU enabled BERT using Horovod BERT is Google's pre-training language representations which obtained the state-of-the-art results on a wide range of Natural Language Processing tasks. ...