Skip to content
GitLab
Menu
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
Gaëtan Caillaut
minibert-deft2018
Commits
304c66f9
Commit
304c66f9
authored
Jun 23, 2021
by
Gaëtan Caillaut
Browse files
Camembert correctement gelée
parent
dfaf429b
Changes
2
Hide whitespace changes
Inline
Side-by-side
slurm_scripts/job_t2_camembert_frozen.sh
View file @
304c66f9
...
...
@@ -33,4 +33,4 @@ export PYTHONPATH="/lium/raid01_b/gcaillaut/polysemy/minibert:${PYTHONPATH}"
set
-x
set
-e
python train.py camembert-t2
${
TRAIN
}
${
TEST
}
${
DEV
}
--outdir
${
OUT_DIR
}
--bs
${
BS
}
-e
10
--epochs-between-save
1
--logdir
${
LOGDIR
}
--device
${
DEVICE
}
python train.py camembert-t2
${
TRAIN
}
${
TEST
}
${
DEV
}
--outdir
${
OUT_DIR
}
--bs
${
BS
}
-e
10
--epochs-between-save
1
--logdir
${
LOGDIR
}
--device
${
DEVICE
}
--freeze
train.py
View file @
304c66f9
...
...
@@ -1035,7 +1035,7 @@ def finetune_t1_camembert(args):
prev_epoch
=
checkpoint
[
"epoch"
]
if
args
.
freeze
:
for
param
in
model
.
roberta
.
roberta
.
parameters
():
for
param
in
model
.
roberta
.
parameters
():
param
.
requires_grad
=
False
model
.
train
()
...
...
@@ -1340,7 +1340,7 @@ def finetune_t2_camembert(args):
prev_epoch
=
checkpoint
[
"epoch"
]
if
args
.
freeze
:
for
param
in
model
.
roberta
.
roberta
.
parameters
():
for
param
in
model
.
roberta
.
parameters
():
param
.
requires_grad
=
False
model
.
train
()
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment