Skip to content
Snippets Groups Projects
Commit 0aad2ab3 authored by Mathieu Rene's avatar Mathieu Rene Committed by Jeff Wu
Browse files

Fetch model using curl, add shebang to download_files.sh and mark it executable

parent 2d0b6222
No related branches found
No related tags found
No related merge requests found
...@@ -8,7 +8,7 @@ See more details in our [blog post](https://blog.openai.com/better-language-mode ...@@ -8,7 +8,7 @@ See more details in our [blog post](https://blog.openai.com/better-language-mode
## Installation ## Installation
Download the model data (needs [gsutil](https://cloud.google.com/storage/docs/gsutil_install)): Download the model data
``` ```
sh download_model.sh 117M sh download_model.sh 117M
``` ```
......
#!/bin/sh
if [ "$#" -ne 1 ]; then if [ "$#" -ne 1 ]; then
echo "You must enter the model name as a parameter, e.g.: sh download_model.sh 117M" echo "You must enter the model name as a parameter, e.g.: sh download_model.sh 117M"
exit 1 exit 1
...@@ -9,5 +11,7 @@ mkdir -p models/$model ...@@ -9,5 +11,7 @@ mkdir -p models/$model
# TODO: gsutil rsync -r gs://gpt-2/models/ models/ # TODO: gsutil rsync -r gs://gpt-2/models/ models/
for filename in checkpoint encoder.json hparams.json model.ckpt.data-00000-of-00001 model.ckpt.index model.ckpt.meta vocab.bpe; do for filename in checkpoint encoder.json hparams.json model.ckpt.data-00000-of-00001 model.ckpt.index model.ckpt.meta vocab.bpe; do
gsutil cp gs://gpt-2/models/$model/$filename models/$model fetch=$model/$filename
echo "Fetching $fetch"
curl --output models/$fetch https://storage.googleapis.com/gpt-2/models/$fetch
done done
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment