Commit b8b1a0b5 authored by Gaëtan Caillaut's avatar Gaëtan Caillaut
Browse files

do not create datasets dir in __full_pipeline

parent c65caa52
......@@ -135,10 +135,7 @@ if __name__ == "__main__":
outdir.mkdir(exist_ok=args.force)
lemmatized_path = str(Path(outdir, "lemmatized.txt.gz"))
datasets_dir_path = Path(outdir, "datasets")
datasets_dir_path.mkdir(exist_ok=args.force)
tokenizer_path = str(Path(outdir, "tokenizer.json"))
args.output = lemmatized_path
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment