This repository was archived by the owner on Jun 11, 2026. It is now read-only.
Repository navigation
This repository was archived by the owner on Jun 11, 2026. It is now read-only.
Preprocessed data are in the wrong path 512/wikipedia_pretrain. #27
Description
BERT_pretrain.ipynb instructs to download https://bertonazuremlwestus2.blob.core.windows.net/public/bert_data.tar.gz for the preprocessed data. The tar file contains data in 512/wikipedia_pretrain, but it should be 512/wiki_pretrain.
Activity
kaiidams commentedon Sep 10, 2019
The serialized data
wikipedia_segment ed_part_NN.binreferWikiNBookCorpusPretrainingDataCreatorwhich has been deleted in the latest code. Adding the following can avoid the issue.skaarthik commentedon Sep 25, 2019
Katsuya Iida (@kaiidams) thanks for reporting this issue. We will update the tar file soon. In the meantime, download and use the data referenced in https://github.com/microsoft/AzureML-BERT/blob/master/docs/artifacts.md#preprocessed-data and you will not need the deleted file for loading the data.