Bump jinja2 from 3.1.2 to 3.1.3 in /taskcluster #357
firefoxci-taskcluster / translate-mono-src-ru-en-1/2
succeeded
Jan 11, 2024 in 48m 24s
FirefoxCI (pull_request)
translate mono for ru
Details
View task in Taskcluster
View logs in Taskcluster
[vcs 2024-01-11T21:36:31.138Z] Cloning into '/home/ubuntu/tasks/task_170500893759935/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-01-11T21:36:32.890Z] Cloning into '/home/ubuntu/tasks/task_170500893759935/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-01-11T21:36:34.742Z] Cloning into '/home/ubuntu/tasks/task_170500893759935/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-01-11T21:36:35.458Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-01-11T21:36:35.475Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-01-11T21:36:35.499Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-01-11T21:36:35.543Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-01-11T21:36:35.713Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-01-11T21:36:35.745Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-01-11T21:36:35.746Z] cleaning git checkout...
[vcs 2024-01-11T21:36:35.746Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-01-11T21:36:35.750Z] removing []
[vcs 2024-01-11T21:36:35.750Z] successfully cleaned git checkout!
[vcs 2024-01-11T21:36:35.772Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0' title='Built from firefox-translations-training commit 3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0'>3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0</a>
[setup 2024-01-11T21:36:35.772Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170500893759935/fetches
[fetches 2024-01-11T21:36:35.772Z] fetching artifacts
[fetches 2024-01-11T21:36:35.772Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170500893759935/./fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DGJ-SukfRaCQkIC7RbQvFQ/artifacts/public/build/file.1.zst to /home/ubuntu/tasks/task_170500893759935/fetches/file.1.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170500893759935/fetches/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DGJ-SukfRaCQkIC7RbQvFQ/artifacts/public/build/file.1.zstattempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170500893759935/fetches/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst
attempt 1/5
/home/ubuntu/tasks/task_170500893759935/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
with urllib.request.urlopen(
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DGJ-SukfRaCQkIC7RbQvFQ/artifacts/public/build/file.1.zst resolved to 293423 bytes with sha256 4118cb052dc00cf6254f485e70463aaee939812a6bb2ba673e8806f2ded189b2 in 0.865s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm resolved to 252751 bytes with sha256 b96adf2cf89d08d12da6125f6f7e3b99e5ae68d0eafa460aebd5416da0e541a3 in 0.893s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 178659466 bytes with sha256 08909231294d985ce4a792eee329161f7d326a4f2f19bdeb2d60e586cfee81d7 in 3.216s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst resolved to 655359725 bytes with sha256 cd84a74c3ab6c11ce7d5dbf432c92fdf8e71f5cc51846b40b97edf75cd63176e in 7.660s
Extracting /home/ubuntu/tasks/task_170500893759935/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170500893759935/fetches
/home/ubuntu/tasks/task_170500893759935/fetches/marian.tar.zst extracted in 7.022s
Removing /home/ubuntu/tasks/task_170500893759935/fetches/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst resolved to 3292700193 bytes with sha256 a3fb0996aeda9edd3737d0a76d371bcf8309187462c89dae62692bcb5a9d81ce in 101.538s
Extracting /home/ubuntu/tasks/task_170500893759935/fetches/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170500893759935/fetches
/home/ubuntu/tasks/task_170500893759935/fetches/cuda-toolkit.tar.zst extracted in 18.977s
Removing /home/ubuntu/tasks/task_170500893759935/fetches/cuda-toolkit.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 121.030744259, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-01-11T21:38:37.128Z] finished fetching artifacts
[task 2024-01-11T21:38:37.128Z] executing ['bash', '-xc', 'export MARIAN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/translate-taskcluster.sh $MOZ_FETCHES_DIR/file.1.zst artifacts plain $MOZ_FETCHES_DIR/vocab.spm $MOZ_FETCHES_DIR/model*/*.npz']
[task 2024-01-11T21:38:37.131Z] + export MARIAN=/home/ubuntu/tasks/task_170500893759935/fetches
[task 2024-01-11T21:38:37.131Z] + MARIAN=/home/ubuntu/tasks/task_170500893759935/fetches
[task 2024-01-11T21:38:37.131Z] + ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh /home/ubuntu/tasks/task_170500893759935/fetches/file.1.zst artifacts plain /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:38:37.132Z] + set -euo pipefail
[task 2024-01-11T21:38:37.132Z] + input=/home/ubuntu/tasks/task_170500893759935/fetches/file.1.zst
[task 2024-01-11T21:38:37.132Z] + output_dir=artifacts
[task 2024-01-11T21:38:37.132Z] + type=plain
[task 2024-01-11T21:38:37.132Z] + other_args=("${@:4}")
[task 2024-01-11T21:38:37.133Z] ++ dirname ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh
[task 2024-01-11T21:38:37.134Z] + pushd ./checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2024-01-11T21:38:37.135Z] ++ pwd
[task 2024-01-11T21:38:37.135Z] + VCS_ROOT=/home/ubuntu/tasks/task_170500893759935/checkouts/vcs
[task 2024-01-11T21:38:37.135Z] + popd
[task 2024-01-11T21:38:37.135Z] + mkdir -p artifacts
[task 2024-01-11T21:38:37.137Z] + zstd -d --rm /home/ubuntu/tasks/task_170500893759935/fetches/file.1.zst
[task 2024-01-11T21:38:37.511Z]
[task 2024-01-11T21:38:37.515Z] 5/fetches/file.1.zst : 0 MB...
[task 2024-01-11T21:38:37.515Z]
[task 2024-01-11T21:38:37.515Z] /home/ubuntu/tasks/task_170500893759935/fetches/file.1.zst: 1014919 bytes
[task 2024-01-11T21:38:37.515Z] + input=/home/ubuntu/tasks/task_170500893759935/fetches/file.1
[task 2024-01-11T21:38:37.515Z] + outfile=/home/ubuntu/tasks/task_170500893759935/fetches/file.1.out
[task 2024-01-11T21:38:37.515Z] + '[' plain = nbest ']'
[task 2024-01-11T21:38:37.515Z] + '[' -s /home/ubuntu/tasks/task_170500893759935/fetches/file.1 ']'
[task 2024-01-11T21:38:37.515Z] + '[' plain = plain ']'
[task 2024-01-11T21:38:37.515Z] + /home/ubuntu/tasks/task_170500893759935/checkouts/vcs/pipeline/translate/translate.sh /home/ubuntu/tasks/task_170500893759935/fetches/file.1 /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:38:37.517Z] + set -euo pipefail
[task 2024-01-11T21:38:37.517Z] + test -v GPUS
[task 2024-01-11T21:38:37.517Z] + test -v MARIAN
[task 2024-01-11T21:38:37.517Z] + test -v WORKSPACE
[task 2024-01-11T21:38:37.517Z] + input=/home/ubuntu/tasks/task_170500893759935/fetches/file.1
[task 2024-01-11T21:38:37.517Z] + vocab=/home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm
[task 2024-01-11T21:38:37.517Z] + models=("${@:3}")
[task 2024-01-11T21:38:37.518Z] ++ dirname /home/ubuntu/tasks/task_170500893759935/checkouts/vcs/pipeline/translate/translate.sh
[task 2024-01-11T21:38:37.519Z] + cd /home/ubuntu/tasks/task_170500893759935/checkouts/vcs/pipeline/translate
[task 2024-01-11T21:38:37.519Z] + /home/ubuntu/tasks/task_170500893759935/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz -v /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm -i /home/ubuntu/tasks/task_170500893759935/fetches/file.1 -o /home/ubuntu/tasks/task_170500893759935/fetches/file.1.out --log /home/ubuntu/tasks/task_170500893759935/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2024-01-11T21:38:52.186Z] [2024-01-11 21:38:52] [marian] Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-01-11T21:38:52.186Z] [2024-01-11 21:38:52] [marian] Running on translations-1-b-linux-v100-gpu-4-wznerpwutf2-rs5-s2dimg as process 1860 with command line:
[task 2024-01-11T21:38:52.186Z] [2024-01-11 21:38:52] [marian] /home/ubuntu/tasks/task_170500893759935/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz -v /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm -i /home/ubuntu/tasks/task_170500893759935/fetches/file.1 -o /home/ubuntu/tasks/task_170500893759935/fetches/file.1.out --log /home/ubuntu/tasks/task_170500893759935/fetches/file.1.log -d 0 1 2 3 -w 12000
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] alignment: ""
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] allow-special: false
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] allow-unk: false
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] authors: false
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] beam-size: 8
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] bert-class-symbol: "[CLS]"
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] bert-mask-symbol: "[MASK]"
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] bert-masking-fraction: 0.15
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] bert-sep-symbol: "[SEP]"
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] bert-train-type-embeddings: true
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] bert-type-vocab-size: 2
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] best-deep: false
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] build-info: ""
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] check-nan: false
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] cite: false
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] cpu-threads: 0
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dec-cell: gru
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dec-cell-base-depth: 2
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dec-cell-high-depth: 1
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dec-depth: 6
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] devices:
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] - 0
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] - 1
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] - 2
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] - 3
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dim-emb: 512
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dim-rnn: 1024
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dim-vocabs:
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] - 1000
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] - 1000
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] dump-config: ""
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] enc-cell: gru
[task 2024-01-11T21:38:52.188Z] [2024-01-11 21:38:52] [config] enc-cell-depth: 1
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] enc-depth: 6
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] enc-type: bidirectional
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] factors-combine: sum
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] factors-dim-emb: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] gemm-type: float32
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] ignore-model-config: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] input:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] - /home/ubuntu/tasks/task_170500893759935/fetches/file.1
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] input-types:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] []
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] interpolate-env-vars: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] layer-normalization: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] lemma-dependency: ""
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] lemma-dim-emb: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] log: /home/ubuntu/tasks/task_170500893759935/fetches/file.1.log
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] log-level: info
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] log-time-zone: ""
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] max-length: 200
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] max-length-crop: true
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] max-length-factor: 3
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] maxi-batch: 1000
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] maxi-batch-sort: src
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] mini-batch: 16
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] mini-batch-words: 500
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] models:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] - /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] n-best: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] no-spm-decode: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] normalize: 1.0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] num-devices: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] optimize: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] output: /home/ubuntu/tasks/task_170500893759935/fetches/file.1.out
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] output-approx-knn:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] []
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] output-omit-bias: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] output-sampling: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] precision:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] - float32
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] quantize-range: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] quiet: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] quiet-translation: True
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] relative-paths: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] right-left: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] seed: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] shortlist:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] []
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] skip: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] skip-cost: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] stat-freq: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] tied-embeddings: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] tied-embeddings-all: true
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] tied-embeddings-src: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-aan-activation: swish
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-aan-depth: 2
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-aan-nogate: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-decoder-autoreg: self-attention
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-depth-scaling: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-dim-aan: 2048
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-dim-ffn: 2048
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-ffn-activation: relu
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-ffn-depth: 2
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-guided-alignment-layer: last
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-heads: 8
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-no-projection: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-pool: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-postprocess: dan
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-postprocess-emb: d
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-postprocess-top: ""
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-preprocess: ""
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-tied-layers:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] []
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] transformer-train-position-embeddings: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] tsv: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] tsv-fields: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] type: transformer
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] ulr: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] ulr-dim-emb: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] ulr-trainable-transformation: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] version: v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] vocabs:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] - /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] - /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] weights:
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] []
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] word-penalty: 0
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] word-scores: false
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] workspace: 12000
[task 2024-01-11T21:38:52.189Z] [2024-01-11 21:38:52] [config] Loaded model has been created with Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-01-11T21:38:52.191Z] [2024-01-11 21:38:52] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm
[task 2024-01-11T21:38:52.194Z] [2024-01-11 21:38:52] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170500893759935/fetches/vocab.spm
[task 2024-01-11T21:38:56.044Z] [2024-01-11 21:38:56] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-01-11T21:38:56.044Z] [2024-01-11 21:38:56] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-01-11T21:38:56.044Z] [2024-01-11 21:38:56] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-01-11T21:38:56.044Z] [2024-01-11 21:38:56] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-01-11T21:38:56.103Z] [2024-01-11 21:38:56] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:38:56.103Z] [2024-01-11 21:38:56] Loading model from /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:38:56.104Z] [2024-01-11 21:38:56] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:38:56.104Z] [2024-01-11 21:38:56] Loading model from /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:38:56.104Z] [2024-01-11 21:38:56] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:38:56.105Z] [2024-01-11 21:38:56] Loading model from /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:38:56.107Z] [2024-01-11 21:38:56] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:38:56.107Z] [2024-01-11 21:38:56] Loading model from /home/ubuntu/tasks/task_170500893759935/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:38:56.546Z] [2024-01-11 21:38:56] [memory] Reserving 170 MB, device gpu3
[task 2024-01-11T21:38:56.554Z] [2024-01-11 21:38:56] [memory] Reserving 170 MB, device gpu1
[task 2024-01-11T21:38:56.555Z] [2024-01-11 21:38:56] [memory] Reserving 170 MB, device gpu0
[task 2024-01-11T21:38:56.578Z] [2024-01-11 21:38:56] [memory] Reserving 170 MB, device gpu2
[task 2024-01-11T21:38:57.569Z] [2024-01-11 21:38:57] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-01-11T21:42:49.633Z] [2024-01-11 21:42:49] Total time: 232.98669s wall
[task 2024-01-11T21:42:51.675Z] ++ wc -l
[task 2024-01-11T21:42:51.701Z] ++ wc -l
[task 2024-01-11T21:42:51.704Z] + test 4974 == 4974
[task 2024-01-11T21:42:51.705Z] + zstd --rm /home/ubuntu/tasks/task_170500893759935/fetches/file.1.out
[task 2024-01-11T21:42:51.706Z]
[task 2024-01-11T21:42:51.706Z]
[task 2024-01-11T21:42:51.712Z] Read : 0 / 3 MB ==> 0%
[task 2024-01-11T21:42:51.712Z]
[task 2024-01-11T21:42:51.712Z] /home/ubuntu/tasks/task_170500893759935/fetches/file.1.out : 1.18% (3411841 => 40337 bytes, /home/ubuntu/tasks/task_170500893759935/fetches/file.1.out.zst)
[task 2024-01-11T21:42:51.713Z] + cp /home/ubuntu/tasks/task_170500893759935/fetches/file.1.out.zst artifacts
[fetches 2024-01-11T21:42:51.716Z] removing /home/ubuntu/tasks/task_170500893759935/fetches
[fetches 2024-01-11T21:42:53.378Z] finished
[taskcluster 2024-01-11T21:42:53.389Z] Exit Code: 0
[taskcluster 2024-01-11T21:42:53.389Z] User Time: 16m3.98003s
[taskcluster 2024-01-11T21:42:53.389Z] Kernel Time: 37.376248s
[taskcluster 2024-01-11T21:42:53.389Z] Wall Time: 6m27.124994814s
[taskcluster 2024-01-11T21:42:53.389Z] Result: SUCCEEDED
[taskcluster 2024-01-11T21:42:53.389Z] === Task Finished ===
[taskcluster 2024-01-11T21:42:53.389Z] Task Duration: 6m27.127171908s
[taskcluster 2024-01-11T21:42:53.474Z] Uploading artifact public/build/file.1.out.zst from file /home/ubuntu/tasks/task_170500893759935/artifacts/file.1.out.zst with content encoding "identity", mime type "application/zstd" and expiry 2024-04-10T20:54:28.124Z
[taskcluster 2024-01-11T21:42:53.640Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170500893759935/checkouts" to "/home/ubuntu/caches/OPiwv4n3Twy1cizkt2V5oQ"
[taskcluster 2024-01-11T21:42:53.695Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-04-10T20:54:28.124Z
Loading