Bump jinja2 from 3.1.2 to 3.1.3 in /taskcluster #357
firefoxci-taskcluster / evaluate-teacher-ensemble-flores-flores_devtest-ru-en
succeeded
Jan 11, 2024 in 44m 29s
FirefoxCI (pull_request)
teacher evaluation for flores_devtest ru-en
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2024-01-11T21:35:02.435Z] Worker Type (translations-1/b-linux-v100-gpu) settings:
[taskcluster 2024-01-11T21:35:02.435Z] {
[taskcluster 2024-01-11T21:35:02.435Z] "config": {
[taskcluster 2024-01-11T21:35:02.435Z] "deploymentId": ""
[taskcluster 2024-01-11T21:35:02.435Z] },
[taskcluster 2024-01-11T21:35:02.435Z] "generic-worker": {
[taskcluster 2024-01-11T21:35:02.435Z] "engine": "simple",
[taskcluster 2024-01-11T21:35:02.435Z] "go-arch": "amd64",
[taskcluster 2024-01-11T21:35:02.435Z] "go-os": "linux",
[taskcluster 2024-01-11T21:35:02.435Z] "go-version": "go1.21.5",
[taskcluster 2024-01-11T21:35:02.435Z] "release": "https://github.com/taskcluster/taskcluster/releases/tag/v59.1.3",
[taskcluster 2024-01-11T21:35:02.435Z] "revision": "b550fe4ca7e2d17c16afbfe61b66aa7a9ce283e6",
[taskcluster 2024-01-11T21:35:02.435Z] "source": "https://github.com/taskcluster/taskcluster/commits/b550fe4ca7e2d17c16afbfe61b66aa7a9ce283e6",
[taskcluster 2024-01-11T21:35:02.435Z] "version": "59.1.3"
[taskcluster 2024-01-11T21:35:02.435Z] },
[taskcluster 2024-01-11T21:35:02.435Z] "image": "projects/taskcluster-imaging/global/images/generic-translations-gcp-googlecompute-2023-12-19t18-58-22z",
[taskcluster 2024-01-11T21:35:02.435Z] "instance-id": "4218419127813791828",
[taskcluster 2024-01-11T21:35:02.435Z] "instance-type": "projects/887720501152/machineTypes/n1-highmem-8",
[taskcluster 2024-01-11T21:35:02.435Z] "local-ipv4": "10.128.2.190",
[taskcluster 2024-01-11T21:35:02.435Z] "project-id": "fxci-production-level1-workers",
[taskcluster 2024-01-11T21:35:02.435Z] "public-hostname": "translations-1-b-linux-v100-gpu-fkcn2xi0s4uevvwgra54-w.c.fxci-production-level1-workers.internal",
[taskcluster 2024-01-11T21:35:02.435Z] "public-ipv4": "34.121.56.237",
[taskcluster 2024-01-11T21:35:02.435Z] "region": "us-central1",
[taskcluster 2024-01-11T21:35:02.435Z] "zone": "us-central1-a"
[taskcluster 2024-01-11T21:35:02.435Z] }
[taskcluster 2024-01-11T21:35:02.435Z] Task ID: LNK7aD7DTN2RPLaUSKoOow
[taskcluster 2024-01-11T21:35:02.435Z] === Task Starting ===
[taskcluster 2024-01-11T21:35:02.819Z] Uploading redirect artifact public/logs/live.log to URL https://firefoxci-websocktunnel.services.mozilla.com/us-central1.4218419127813791828.60099/log/SNmJdAvaRbyom_dywu_Aqg with mime type "text/plain; charset=utf-8" and expiry 2024-02-10T21:50:02.765Z
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] No existing writable directory cache 'translations-level-1-checkouts' - creating /home/ubuntu/caches/FlM5-xTFR4iHY0i9Qcr7Nw
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] Creating directory /home/ubuntu/tasks/task_170500890228513/checkouts
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] Successfully mounted writable directory cache '/home/ubuntu/tasks/task_170500890228513/checkouts'
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] Downloading url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task to /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA
[taskcluster:warn 2024-01-11T21:35:32.923Z] [mounts] Download of url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task failed on this attempt: Get "https://firefoxci.taskcluster-artifacts.net/Vn4jRmjGRamdkD3qb_uNQw/0/public/run-task": dial tcp: lookup firefoxci.taskcluster-artifacts.net: i/o timeout
[taskcluster 2024-01-11T21:35:33.339Z] [mounts] Downloading url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task to /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA
[taskcluster 2024-01-11T21:35:35.025Z] [mounts] Downloaded 45746 bytes with SHA256 58974d7dcf0417b3fe536280e49d18e6c908a77c665a69cdbd51e7231ddb0ee7 from url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task to /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA
[taskcluster:warn 2024-01-11T21:35:35.025Z] [mounts] Download /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA of url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task has SHA256 58974d7dcf0417b3fe536280e49d18e6c908a77c665a69cdbd51e7231ddb0ee7 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2024-01-11T21:35:35.025Z] [mounts] Creating directory /home/ubuntu/tasks/task_170500890228513
[taskcluster 2024-01-11T21:35:35.025Z] [mounts] Copying /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA to /home/ubuntu/tasks/task_170500890228513/run-task
[taskcluster 2024-01-11T21:35:35.029Z] [mounts] Downloading url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/fetch-content to /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw
[taskcluster 2024-01-11T21:35:35.127Z] [mounts] Downloaded 29990 bytes with SHA256 1b5680bd9953834c961eac614b18b846f7f15be2812792709c6b5646a7c7fdb8 from url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/fetch-content to /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw
[taskcluster:warn 2024-01-11T21:35:35.127Z] [mounts] Download /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw of url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/fetch-content has SHA256 1b5680bd9953834c961eac614b18b846f7f15be2812792709c6b5646a7c7fdb8 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2024-01-11T21:35:35.127Z] [mounts] Creating directory /home/ubuntu/tasks/task_170500890228513
[taskcluster 2024-01-11T21:35:35.127Z] [mounts] Copying /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw to /home/ubuntu/tasks/task_170500890228513/fetch-content
[taskcluster 2024-01-11T21:35:35.130Z] Executing command 0: chmod '+x' run-task
[taskcluster 2024-01-11T21:35:35.132Z] Exit Code: 0
[taskcluster 2024-01-11T21:35:35.132Z] User Time: 1.286ms
[taskcluster 2024-01-11T21:35:35.132Z] Kernel Time: 0s
[taskcluster 2024-01-11T21:35:35.132Z] Wall Time: 1.488432ms
[taskcluster 2024-01-11T21:35:35.132Z] Result: SUCCEEDED
[taskcluster 2024-01-11T21:35:35.132Z] Executing command 1: './run-task' '--firefox_translations_training-checkout=./checkouts/vcs/' -- bash -c 'pip install -r $VCS_PATH/pipeline/eval/requirements/eval.txt && export PATH=$PATH:~/.local/bin && export MARIAN=$MOZ_FETCHES_DIR && export BMT_MARIAN=$MOZ_FETCHES_DIR && sed -i -e "s,- .*fetches,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && sed -i -e "s,- .*artifacts,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && $VCS_PATH/pipeline/eval/eval-gpu.sh $TASK_WORKDIR/artifacts/devtest $MOZ_FETCHES_DIR/devtest ru en $MOZ_FETCHES_DIR/final.model.npz.best-chrf.npz.decoder.yml $MOZ_FETCHES_DIR/model*/*.npz'
[setup 2024-01-11T21:35:35.223Z] run-task started in /home/ubuntu/tasks/task_170500890228513
[setup 2024-01-11T21:35:35.223Z] Invoked by command: --firefox_translations_training-checkout=./checkouts/vcs/ -- bash -c pip install -r $VCS_PATH/pipeline/eval/requirements/eval.txt && export PATH=$PATH:~/.local/bin && export MARIAN=$MOZ_FETCHES_DIR && export BMT_MARIAN=$MOZ_FETCHES_DIR && sed -i -e "s,- .*fetches,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && sed -i -e "s,- .*artifacts,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && $VCS_PATH/pipeline/eval/eval-gpu.sh $TASK_WORKDIR/artifacts/devtest $MOZ_FETCHES_DIR/devtest ru en $MOZ_FETCHES_DIR/final.model.npz.best-chrf.npz.decoder.yml $MOZ_FETCHES_DIR/model*/*.npz
[setup 2024-01-11T21:35:35.223Z] Python version: 3.10.12
[vcs 2024-01-11T21:35:35.225Z] WARNING: vcs checkout path (/home/ubuntu/tasks/task_170500890228513/checkouts/vcs) not in cache or volume; performance will likely suffer
[vcs 2024-01-11T21:35:35.225Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs']
[vcs 2024-01-11T21:35:35.398Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs']
[vcs 2024-01-11T21:35:35.402Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs'...
[vcs 2024-01-11T21:35:36.443Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'dependabot/pip/taskcluster/jinja2-3.1.3']
[vcs 2024-01-11T21:35:36.692Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-11T21:35:36.692Z] * branch dependabot/pip/taskcluster/jinja2-3.1.3 -> FETCH_HEAD
[vcs 2024-01-11T21:35:36.700Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'dependabot/pip/taskcluster/jinja2-3.1.3']
[vcs 2024-01-11T21:35:36.948Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-11T21:35:36.948Z] * branch dependabot/pip/taskcluster/jinja2-3.1.3 -> FETCH_HEAD
[vcs 2024-01-11T21:35:36.955Z] executing ['git', 'checkout', '-f', '-B', 'dependabot/pip/taskcluster/jinja2-3.1.3', '3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0']
[vcs 2024-01-11T21:35:37.015Z] Switched to a new branch 'dependabot/pip/taskcluster/jinja2-3.1.3'
[vcs 2024-01-11T21:35:37.016Z] executing ['git', 'submodule', 'init']
[vcs 2024-01-11T21:35:37.105Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-01-11T21:35:37.106Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-01-11T21:35:37.107Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-01-11T21:35:37.107Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-01-11T21:35:37.108Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-01-11T21:35:37.109Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-01-11T21:35:37.110Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-01-11T21:35:37.164Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-01-11T21:35:38.951Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-01-11T21:35:39.308Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-01-11T21:35:39.682Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-01-11T21:35:40.475Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-01-11T21:35:42.368Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-01-11T21:35:43.034Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-01-11T21:35:43.094Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-01-11T21:35:43.122Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-01-11T21:35:43.179Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-01-11T21:35:43.378Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-01-11T21:35:43.413Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-01-11T21:35:43.414Z] cleaning git checkout...
[vcs 2024-01-11T21:35:43.414Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-01-11T21:35:43.418Z] removing []
[vcs 2024-01-11T21:35:43.418Z] successfully cleaned git checkout!
[vcs 2024-01-11T21:35:43.422Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0' title='Built from firefox-translations-training commit 3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0'>3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0</a>
[setup 2024-01-11T21:35:43.422Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170500890228513/fetches
[fetches 2024-01-11T21:35:43.422Z] fetching artifacts
[fetches 2024-01-11T21:35:43.422Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170500890228513/./fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.en.zst to /home/ubuntu/tasks/task_170500890228513/fetches/devtest.en.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.ru.zst to /home/ubuntu/tasks/task_170500890228513/fetches/devtest.ru.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.ru.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.en.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst
/home/ubuntu/tasks/task_170500890228513/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
with urllib.request.urlopen(
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170500890228513/fetches/model1/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npzDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz.decoder.yml to /home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz.decoder.yml
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170500890228513/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm resolved to 252751 bytes with sha256 b96adf2cf89d08d12da6125f6f7e3b99e5ae68d0eafa460aebd5416da0e541a3 in 1.242s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz.decoder.yml resolved to 333 bytes with sha256 c8c2604e1e4880f0418b65b47094fd56d3b137beaf5206464397bfc04af365de in 1.244s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.ru.zst resolved to 81727 bytes with sha256 f869cb52f8a491f00a04f9c6f3e65ad948a746246c6e7cd2d95f46ede72ed308 in 1.304s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.en.zst resolved to 56883 bytes with sha256 9bb6ca271828747c4772d9aa534426d15f403ae142ecdba471631e7f70b1e523 in 1.320s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 178659466 bytes with sha256 08909231294d985ce4a792eee329161f7d326a4f2f19bdeb2d60e586cfee81d7 in 3.668s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst resolved to 655359725 bytes with sha256 cd84a74c3ab6c11ce7d5dbf432c92fdf8e71f5cc51846b40b97edf75cd63176e in 5.536s
Extracting /home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170500890228513/fetches
/home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst extracted in 7.324s
Removing /home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 12.986079383000003, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-01-11T21:35:56.658Z] finished fetching artifacts
[task 2024-01-11T21:35:56.658Z] executing ['bash', '-c', 'pip install -r $VCS_PATH/pipeline/eval/requirements/eval.txt && export PATH=$PATH:~/.local/bin && export MARIAN=$MOZ_FETCHES_DIR && export BMT_MARIAN=$MOZ_FETCHES_DIR && sed -i -e "s,- .*fetches,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && sed -i -e "s,- .*artifacts,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && $VCS_PATH/pipeline/eval/eval-gpu.sh $TASK_WORKDIR/artifacts/devtest $MOZ_FETCHES_DIR/devtest ru en $MOZ_FETCHES_DIR/final.model.npz.best-chrf.npz.decoder.yml $MOZ_FETCHES_DIR/model*/*.npz']
[task 2024-01-11T21:35:58.405Z] Defaulting to user installation because normal site-packages is not writeable
[task 2024-01-11T21:35:59.444Z] Collecting colorama==0.4.6
[task 2024-01-11T21:35:59.641Z] Downloading colorama-0.4.6-py2.py3-none-any.whl (25 kB)
[task 2024-01-11T21:36:00.149Z] Collecting lxml==4.9.2
[task 2024-01-11T21:36:00.185Z] Downloading lxml-4.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (7.1 MB)
[task 2024-01-11T21:36:03.828Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.1/7.1 MB 2.0 MB/s eta 0:00:00
[task 2024-01-11T21:36:04.524Z] Collecting numpy==1.24.3
[task 2024-01-11T21:36:04.560Z] Downloading numpy-1.24.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
[task 2024-01-11T21:36:10.164Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 3.2 MB/s eta 0:00:00
[task 2024-01-11T21:36:10.443Z] Collecting portalocker==2.7.0
[task 2024-01-11T21:36:10.479Z] Downloading portalocker-2.7.0-py2.py3-none-any.whl (15 kB)
[task 2024-01-11T21:36:11.970Z] Collecting regex==2023.5.5
[task 2024-01-11T21:36:12.008Z] Downloading regex-2023.5.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (769 kB)
[task 2024-01-11T21:36:12.468Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 769.7/769.7 KB 1.7 MB/s eta 0:00:00
[task 2024-01-11T21:36:12.923Z] Collecting sacrebleu==2.3.1
[task 2024-01-11T21:36:12.960Z] Downloading sacrebleu-2.3.1-py3-none-any.whl (118 kB)
[task 2024-01-11T21:36:13.347Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.9/118.9 KB 283.1 kB/s eta 0:00:00
[task 2024-01-11T21:36:13.627Z] Collecting tabulate==0.9.0
[task 2024-01-11T21:36:13.662Z] Downloading tabulate-0.9.0-py3-none-any.whl (35 kB)
[task 2024-01-11T21:36:15.575Z] Installing collected packages: tabulate, regex, portalocker, numpy, lxml, colorama, sacrebleu
[task 2024-01-11T21:36:15.593Z] WARNING: The script tabulate is installed in '/home/ubuntu/.local/bin' which is not on PATH.
[task 2024-01-11T21:36:15.594Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[task 2024-01-11T21:36:18.495Z] WARNING: The scripts f2py, f2py3 and f2py3.10 are installed in '/home/ubuntu/.local/bin' which is not on PATH.
[task 2024-01-11T21:36:18.495Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[task 2024-01-11T21:36:20.334Z] WARNING: The script sacrebleu is installed in '/home/ubuntu/.local/bin' which is not on PATH.
[task 2024-01-11T21:36:20.334Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[task 2024-01-11T21:36:20.343Z] Successfully installed colorama-0.4.6 lxml-4.9.2 numpy-1.24.3 portalocker-2.7.0 regex-2023.5.5 sacrebleu-2.3.1 tabulate-0.9.0
[task 2024-01-11T21:36:20.536Z] + set -euo pipefail
[task 2024-01-11T21:36:20.536Z] + echo '###### Evaluation of a model'
[task 2024-01-11T21:36:20.536Z] ###### Evaluation of a model
[task 2024-01-11T21:36:20.536Z] + test -v GPUS
[task 2024-01-11T21:36:20.536Z] + test -v MARIAN
[task 2024-01-11T21:36:20.536Z] + test -v WORKSPACE
[task 2024-01-11T21:36:20.536Z] + res_prefix=/home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.536Z] + dataset_prefix=/home/ubuntu/tasks/task_170500890228513/fetches/devtest
[task 2024-01-11T21:36:20.536Z] + src=ru
[task 2024-01-11T21:36:20.536Z] + trg=en
[task 2024-01-11T21:36:20.536Z] + decoder_config=/home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml
[task 2024-01-11T21:36:20.536Z] + models=("${@:6}")
[task 2024-01-11T21:36:20.537Z] ++ dirname ./checkouts/vcs/pipeline/eval/eval-gpu.sh
[task 2024-01-11T21:36:20.538Z] + cd ./checkouts/vcs/pipeline/eval
[task 2024-01-11T21:36:20.538Z] + bash eval.sh /home/ubuntu/tasks/task_170500890228513/artifacts/devtest /home/ubuntu/tasks/task_170500890228513/fetches/devtest ru en /home/ubuntu/tasks/task_170500890228513/fetches /home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml -w 12000 --devices 0 -m /home/ubuntu/tasks/task_170500890228513/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:36:20.540Z] + set -euo pipefail
[task 2024-01-11T21:36:20.540Z] + echo '###### Evaluation of a model'
[task 2024-01-11T21:36:20.540Z] ###### Evaluation of a model
[task 2024-01-11T21:36:20.540Z] + res_prefix=/home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.540Z] + dataset_prefix=/home/ubuntu/tasks/task_170500890228513/fetches/devtest
[task 2024-01-11T21:36:20.540Z] + src=ru
[task 2024-01-11T21:36:20.540Z] + trg=en
[task 2024-01-11T21:36:20.540Z] + marian=/home/ubuntu/tasks/task_170500890228513/fetches
[task 2024-01-11T21:36:20.540Z] + decoder_config=/home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml
[task 2024-01-11T21:36:20.540Z] + args=("${@:7}")
[task 2024-01-11T21:36:20.540Z] + COMPRESSION_CMD=zstdmt
[task 2024-01-11T21:36:20.540Z] + ARTIFACT_EXT=zst
[task 2024-01-11T21:36:20.541Z] ++ dirname /home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.542Z] + mkdir -p /home/ubuntu/tasks/task_170500890228513/artifacts
[task 2024-01-11T21:36:20.544Z] + echo '### Evaluating dataset: /home/ubuntu/tasks/task_170500890228513/fetches/devtest, pair: ru-en, Results prefix: /home/ubuntu/tasks/task_170500890228513/artifacts/devtest'
[task 2024-01-11T21:36:20.544Z] ### Evaluating dataset: /home/ubuntu/tasks/task_170500890228513/fetches/devtest, pair: ru-en, Results prefix: /home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.544Z] + zstdmt -dc /home/ubuntu/tasks/task_170500890228513/fetches/devtest.en.zst
[task 2024-01-11T21:36:20.571Z] + zstdmt -dc /home/ubuntu/tasks/task_170500890228513/fetches/devtest.ru.zst
[task 2024-01-11T21:36:20.571Z] + tee /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.ru
[task 2024-01-11T21:36:20.571Z] + /home/ubuntu/tasks/task_170500890228513/fetches/marian-decoder -c /home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml --quiet --quiet-translation --log /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.log -w 12000 --devices 0 -m /home/ubuntu/tasks/task_170500890228513/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:36:20.572Z] + tee /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en
[task 2024-01-11T21:36:20.572Z] + sacrebleu /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en.ref -d -f text --score-only -l ru-en -m bleu chrf
[task 2024-01-11T21:36:20.572Z] + tee /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.metrics
[task 2024-01-11T21:38:55.883Z] 0.0
[task 2024-01-11T21:38:55.883Z] 0.8
[task 2024-01-11T21:38:55.883Z] No subset information found. Consider using --origlang argument.
[task 2024-01-11T21:38:55.925Z] + echo '###### Done: Evaluation of a model'
[task 2024-01-11T21:38:55.925Z] ###### Done: Evaluation of a model
[fetches 2024-01-11T21:38:55.926Z] removing /home/ubuntu/tasks/task_170500890228513/fetches
[fetches 2024-01-11T21:38:56.330Z] finished
[taskcluster 2024-01-11T21:38:56.343Z] Exit Code: 0
[taskcluster 2024-01-11T21:38:56.343Z] User Time: 2m53.231824s
[taskcluster 2024-01-11T21:38:56.343Z] Kernel Time: 10.667836s
[taskcluster 2024-01-11T21:38:56.343Z] Wall Time: 3m21.210748513s
[taskcluster 2024-01-11T21:38:56.343Z] Result: SUCCEEDED
[taskcluster 2024-01-11T21:38:56.343Z] === Task Finished ===
[taskcluster 2024-01-11T21:38:56.343Z] Task Duration: 3m21.212979844s
[taskcluster 2024-01-11T21:38:56.553Z] Uploading artifact public/build/devtest.en from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:56.744Z] Uploading artifact public/build/devtest.en.ref from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en.ref with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.047Z] Uploading artifact public/build/devtest.log from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.log with content encoding "gzip", mime type "text/plain" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.240Z] Uploading artifact public/build/devtest.metrics from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.metrics with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.446Z] Uploading artifact public/build/devtest.ru from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.ru with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.616Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170500890228513/checkouts" to "/home/ubuntu/caches/FlM5-xTFR4iHY0i9Qcr7Nw"
[taskcluster 2024-01-11T21:38:57.691Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-04-10T20:54:28.120Z
Loading