[vcs 2024-01-11T21:37:55.763Z] Cloning into '/home/ubuntu/tasks/task_170500900875279/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-01-11T21:37:56.356Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-01-11T21:37:56.377Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-01-11T21:37:56.399Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-01-11T21:37:56.442Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-01-11T21:37:56.589Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-01-11T21:37:56.622Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-01-11T21:37:56.623Z] cleaning git checkout...
[vcs 2024-01-11T21:37:56.623Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-01-11T21:37:56.627Z] removing []
[vcs 2024-01-11T21:37:56.627Z] successfully cleaned git checkout!
[vcs 2024-01-11T21:37:56.652Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0' title='Built from firefox-translations-training commit 3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0'>3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0</a>
[setup 2024-01-11T21:37:56.652Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170500900875279/fetches
[fetches 2024-01-11T21:37:56.652Z] fetching artifacts
[fetches 2024-01-11T21:37:56.652Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170500900875279/./fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PBTsF1iFRbOPBzQgq0F07w/artifacts/public/build/file.2.zst to /home/ubuntu/tasks/task_170500900875279/fetches/file.2.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PBTsF1iFRbOPBzQgq0F07w/artifacts/public/build/file.2.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170500900875279/fetches/cuda-toolkit.tar.zst
/home/ubuntu/tasks/task_170500900875279/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(
attempt 1/5Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170500900875279/fetches/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npzattempt 1/5

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PBTsF1iFRbOPBzQgq0F07w/artifacts/public/build/file.2.zst resolved to 220441 bytes with sha256 613dbb3ff913746b8c996e679635fb22a2be6f8f6b7b38caf18b8458c7781764 in 0.689s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm resolved to 252751 bytes with sha256 b96adf2cf89d08d12da6125f6f7e3b99e5ae68d0eafa460aebd5416da0e541a3 in 0.697s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 178659466 bytes with sha256 08909231294d985ce4a792eee329161f7d326a4f2f19bdeb2d60e586cfee81d7 in 2.656s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst resolved to 655359725 bytes with sha256 cd84a74c3ab6c11ce7d5dbf432c92fdf8e71f5cc51846b40b97edf75cd63176e in 6.129s
Extracting /home/ubuntu/tasks/task_170500900875279/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170500900875279/fetches
/home/ubuntu/tasks/task_170500900875279/fetches/marian.tar.zst extracted in 6.421s
Removing /home/ubuntu/tasks/task_170500900875279/fetches/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UGkRJAPkTfmkxcB8UlS-Cw/artifacts/public/build/cuda-toolkit.tar.zst resolved to 3292700193 bytes with sha256 a3fb0996aeda9edd3737d0a76d371bcf8309187462c89dae62692bcb5a9d81ce in 61.948s
Extracting /home/ubuntu/tasks/task_170500900875279/fetches/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_170500900875279/fetches
/home/ubuntu/tasks/task_170500900875279/fetches/cuda-toolkit.tar.zst extracted in 18.663s
Removing /home/ubuntu/tasks/task_170500900875279/fetches/cuda-toolkit.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 81.08375892900001, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-01-11T21:39:18.087Z] finished fetching artifacts
[task 2024-01-11T21:39:18.087Z] executing ['bash', '-xc', 'export MARIAN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/translate-taskcluster.sh $MOZ_FETCHES_DIR/file.2.zst artifacts nbest $MOZ_FETCHES_DIR/vocab.spm $MOZ_FETCHES_DIR/model*/*.npz  --mini-batch-words 1000 --precision float16']
[task 2024-01-11T21:39:18.089Z] + export MARIAN=/home/ubuntu/tasks/task_170500900875279/fetches
[task 2024-01-11T21:39:18.089Z] + MARIAN=/home/ubuntu/tasks/task_170500900875279/fetches
[task 2024-01-11T21:39:18.089Z] + ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh /home/ubuntu/tasks/task_170500900875279/fetches/file.2.zst artifacts nbest /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz --mini-batch-words 1000 --precision float16
[task 2024-01-11T21:39:18.091Z] + set -euo pipefail
[task 2024-01-11T21:39:18.091Z] + input=/home/ubuntu/tasks/task_170500900875279/fetches/file.2.zst
[task 2024-01-11T21:39:18.091Z] + output_dir=artifacts
[task 2024-01-11T21:39:18.091Z] + type=nbest
[task 2024-01-11T21:39:18.091Z] + other_args=("${@:4}")
[task 2024-01-11T21:39:18.091Z] ++ dirname ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh
[task 2024-01-11T21:39:18.092Z] + pushd ./checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2024-01-11T21:39:18.093Z] ++ pwd
[task 2024-01-11T21:39:18.093Z] + VCS_ROOT=/home/ubuntu/tasks/task_170500900875279/checkouts/vcs
[task 2024-01-11T21:39:18.093Z] + popd
[task 2024-01-11T21:39:18.093Z] + mkdir -p artifacts
[task 2024-01-11T21:39:18.095Z] + zstd -d --rm /home/ubuntu/tasks/task_170500900875279/fetches/file.2.zst
[task 2024-01-11T21:39:18.141Z] 
[task 2024-01-11T21:39:18.144Z] 9/fetches/file.2.zst : 0 MB...     
[task 2024-01-11T21:39:18.144Z]                                                                                
[task 2024-01-11T21:39:18.144Z] /home/ubuntu/tasks/task_170500900875279/fetches/file.2.zst: 841789 bytes 
[task 2024-01-11T21:39:18.144Z] + input=/home/ubuntu/tasks/task_170500900875279/fetches/file.2
[task 2024-01-11T21:39:18.144Z] + outfile=/home/ubuntu/tasks/task_170500900875279/fetches/file.2.out
[task 2024-01-11T21:39:18.144Z] + '[' nbest = nbest ']'
[task 2024-01-11T21:39:18.144Z] + outfile=/home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest
[task 2024-01-11T21:39:18.144Z] + '[' -s /home/ubuntu/tasks/task_170500900875279/fetches/file.2 ']'
[task 2024-01-11T21:39:18.144Z] + '[' nbest = plain ']'
[task 2024-01-11T21:39:18.144Z] + '[' nbest = nbest ']'
[task 2024-01-11T21:39:18.144Z] + /home/ubuntu/tasks/task_170500900875279/checkouts/vcs/pipeline/translate/translate-nbest.sh /home/ubuntu/tasks/task_170500900875279/fetches/file.2 /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz --mini-batch-words 1000 --precision float16
[task 2024-01-11T21:39:18.146Z] + set -euo pipefail
[task 2024-01-11T21:39:18.146Z] + test -v GPUS
[task 2024-01-11T21:39:18.146Z] + test -v MARIAN
[task 2024-01-11T21:39:18.146Z] + test -v WORKSPACE
[task 2024-01-11T21:39:18.147Z] + input=/home/ubuntu/tasks/task_170500900875279/fetches/file.2
[task 2024-01-11T21:39:18.147Z] + vocab=/home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm
[task 2024-01-11T21:39:18.147Z] + models=("${@:3}")
[task 2024-01-11T21:39:18.147Z] ++ dirname /home/ubuntu/tasks/task_170500900875279/checkouts/vcs/pipeline/translate/translate-nbest.sh
[task 2024-01-11T21:39:18.148Z] + cd /home/ubuntu/tasks/task_170500900875279/checkouts/vcs/pipeline/translate
[task 2024-01-11T21:39:18.148Z] + /home/ubuntu/tasks/task_170500900875279/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz --mini-batch-words 1000 --precision float16 -v /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm -i /home/ubuntu/tasks/task_170500900875279/fetches/file.2 -o /home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest --log /home/ubuntu/tasks/task_170500900875279/fetches/file.2.log --n-best -d 0 1 2 3 -w 12000
[task 2024-01-11T21:39:21.891Z] [2024-01-11 21:39:21] [marian] Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-01-11T21:39:21.891Z] [2024-01-11 21:39:21] [marian] Running on translations-1-b-linux-v100-gpu-4-1tb-iw5ownejt96zzxuczp2w6w as process 2659 with command line:
[task 2024-01-11T21:39:21.891Z] [2024-01-11 21:39:21] [marian] /home/ubuntu/tasks/task_170500900875279/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz --mini-batch-words 1000 --precision float16 -v /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm -i /home/ubuntu/tasks/task_170500900875279/fetches/file.2 -o /home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest --log /home/ubuntu/tasks/task_170500900875279/fetches/file.2.log --n-best -d 0 1 2 3 -w 12000
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] alignment: ""
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] allow-special: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] allow-unk: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] authors: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] beam-size: 8
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] bert-class-symbol: "[CLS]"
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] bert-mask-symbol: "[MASK]"
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] bert-masking-fraction: 0.15
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] bert-sep-symbol: "[SEP]"
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] bert-train-type-embeddings: true
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] bert-type-vocab-size: 2
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] best-deep: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] build-info: ""
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] check-nan: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] cite: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] cpu-threads: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dec-cell: gru
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dec-cell-base-depth: 2
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dec-cell-high-depth: 1
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dec-depth: 6
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] devices:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - 1
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - 2
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - 3
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dim-emb: 512
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dim-rnn: 1024
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dim-vocabs:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - 1000
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - 1000
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] dump-config: ""
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] enc-cell: gru
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] enc-cell-depth: 1
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] enc-depth: 6
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] enc-type: bidirectional
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] factors-combine: sum
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] factors-dim-emb: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] gemm-type: float32
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] ignore-model-config: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] input:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - /home/ubuntu/tasks/task_170500900875279/fetches/file.2
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] input-types:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   []
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] interpolate-env-vars: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] layer-normalization: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] lemma-dependency: ""
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] lemma-dim-emb: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] log: /home/ubuntu/tasks/task_170500900875279/fetches/file.2.log
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] log-level: info
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] log-time-zone: ""
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] max-length: 200
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] max-length-crop: true
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] max-length-factor: 3
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] maxi-batch: 1000
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] maxi-batch-sort: src
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] mini-batch: 16
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] mini-batch-words: 1000
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] models:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] n-best: true
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] no-spm-decode: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] normalize: 1.0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] num-devices: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] optimize: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] output: /home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] output-approx-knn:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   []
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] output-omit-bias: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] output-sampling: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] precision:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - float16
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] quantize-range: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] quiet: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] quiet-translation: True
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] relative-paths: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] right-left: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] seed: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] shortlist:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   []
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] skip: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] skip-cost: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] stat-freq: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] tied-embeddings: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] tied-embeddings-all: true
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] tied-embeddings-src: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-aan-activation: swish
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-aan-depth: 2
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-aan-nogate: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-decoder-autoreg: self-attention
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-depth-scaling: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-dim-aan: 2048
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-dim-ffn: 2048
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-ffn-activation: relu
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-ffn-depth: 2
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-guided-alignment-layer: last
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-heads: 8
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-no-projection: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-pool: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-postprocess: dan
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-postprocess-emb: d
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-postprocess-top: ""
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-preprocess: ""
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-tied-layers:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   []
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] transformer-train-position-embeddings: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] tsv: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] tsv-fields: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] type: transformer
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] ulr: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] ulr-dim-emb: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] ulr-trainable-transformation: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] version: v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] vocabs:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   - /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] weights:
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config]   []
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] word-penalty: 0
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] word-scores: false
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] workspace: 12000
[task 2024-01-11T21:39:21.894Z] [2024-01-11 21:39:21] [config] Loaded model has been created with Marian v1.10.25; e8a1a25 2021-12-07 17:47:33 +0000
[task 2024-01-11T21:39:21.896Z] [2024-01-11 21:39:21] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm
[task 2024-01-11T21:39:21.899Z] [2024-01-11 21:39:21] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_170500900875279/fetches/vocab.spm
[task 2024-01-11T21:39:24.489Z] [2024-01-11 21:39:24] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-01-11T21:39:24.489Z] [2024-01-11 21:39:24] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-01-11T21:39:24.489Z] [2024-01-11 21:39:24] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-01-11T21:39:24.489Z] [2024-01-11 21:39:24] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-01-11T21:39:24.543Z] [2024-01-11 21:39:24] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:39:24.543Z] [2024-01-11 21:39:24] Loading model from /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:39:24.543Z] [2024-01-11 21:39:24] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:39:24.543Z] [2024-01-11 21:39:24] Loading model from /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:39:24.544Z] [2024-01-11 21:39:24] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:39:24.544Z] [2024-01-11 21:39:24] Loading model from /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:39:24.544Z] [2024-01-11 21:39:24] Loading scorer of type transformer as feature F0
[task 2024-01-11T21:39:24.544Z] [2024-01-11 21:39:24] Loading model from /home/ubuntu/tasks/task_170500900875279/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:39:24.989Z] [2024-01-11 21:39:24] [memory] Reserving 85 MB, device gpu2
[task 2024-01-11T21:39:24.993Z] [2024-01-11 21:39:24] [memory] Reserving 85 MB, device gpu0
[task 2024-01-11T21:39:25.001Z] [2024-01-11 21:39:25] [memory] Reserving 85 MB, device gpu3
[task 2024-01-11T21:39:25.005Z] [2024-01-11 21:39:25] [memory] Reserving 85 MB, device gpu1
[task 2024-01-11T21:39:25.828Z] [2024-01-11 21:39:25] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-01-11T21:41:44.266Z] [2024-01-11 21:41:44] Total time: 139.18545s wall
[task 2024-01-11T21:41:46.403Z] ++ wc -l
[task 2024-01-11T21:41:46.441Z] ++ wc -l
[task 2024-01-11T21:41:46.443Z] + test 26984 -eq 26984
[task 2024-01-11T21:41:46.444Z] + zstd --rm /home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest
[task 2024-01-11T21:41:46.445Z] 
[task 2024-01-11T21:41:46.445Z]                                                                                
[task 2024-01-11T21:41:46.472Z] Read :  0 / 19 MB ==>  0%
[task 2024-01-11T21:41:46.472Z]                                                                                
[task 2024-01-11T21:41:46.472Z] /home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest :  2.10%   (20489007 => 429261 bytes, /home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest.zst) 
[task 2024-01-11T21:41:46.478Z] + cp /home/ubuntu/tasks/task_170500900875279/fetches/file.2.nbest.zst artifacts
[fetches 2024-01-11T21:41:46.481Z] removing /home/ubuntu/tasks/task_170500900875279/fetches
[fetches 2024-01-11T21:41:48.173Z] finished
[taskcluster 2024-01-11T21:41:48.185Z]    Exit Code: 0
[taskcluster 2024-01-11T21:41:48.185Z]    User Time: 9m48.106324s
[taskcluster 2024-01-11T21:41:48.185Z]  Kernel Time: 34.252402s
[taskcluster 2024-01-11T21:41:48.185Z]    Wall Time: 4m57.47750492s
[taskcluster 2024-01-11T21:41:48.185Z]       Result: SUCCEEDED
[taskcluster 2024-01-11T21:41:48.185Z] === Task Finished ===
[taskcluster 2024-01-11T21:41:48.186Z] Task Duration: 4m57.527925795s
[taskcluster 2024-01-11T21:41:48.392Z] Uploading artifact public/build/file.2.nbest.zst from file /home/ubuntu/tasks/task_170500900875279/artifacts/file.2.nbest.zst with content encoding "identity", mime type "application/zstd" and expiry 2024-04-10T20:54:28.125Z
[taskcluster 2024-01-11T21:41:48.535Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170500900875279/checkouts" to "/home/ubuntu/caches/XfqD9z7bQh-bB0jGABrskw"
[taskcluster 2024-01-11T21:41:48.617Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-04-10T20:54:28.125Z