Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump jinja2 from 3.1.2 to 3.1.3 in /taskcluster #357

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Bump jinja2 from 3.1.2 to 3.1.3 in /taskcluster

3177fe8
Select commit
Loading
Failed to load commit list.
Open

Bump jinja2 from 3.1.2 to 3.1.3 in /taskcluster #357

Bump jinja2 from 3.1.2 to 3.1.3 in /taskcluster
3177fe8
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / evaluate-teacher-ensemble-flores-flores_devtest-ru-en succeeded Jan 11, 2024 in 44m 29s

FirefoxCI (pull_request)

teacher evaluation for flores_devtest ru-en

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2024-01-11T21:35:02.435Z] Worker Type (translations-1/b-linux-v100-gpu) settings:
[taskcluster 2024-01-11T21:35:02.435Z]   {
[taskcluster 2024-01-11T21:35:02.435Z]     "config": {
[taskcluster 2024-01-11T21:35:02.435Z]       "deploymentId": ""
[taskcluster 2024-01-11T21:35:02.435Z]     },
[taskcluster 2024-01-11T21:35:02.435Z]     "generic-worker": {
[taskcluster 2024-01-11T21:35:02.435Z]       "engine": "simple",
[taskcluster 2024-01-11T21:35:02.435Z]       "go-arch": "amd64",
[taskcluster 2024-01-11T21:35:02.435Z]       "go-os": "linux",
[taskcluster 2024-01-11T21:35:02.435Z]       "go-version": "go1.21.5",
[taskcluster 2024-01-11T21:35:02.435Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v59.1.3",
[taskcluster 2024-01-11T21:35:02.435Z]       "revision": "b550fe4ca7e2d17c16afbfe61b66aa7a9ce283e6",
[taskcluster 2024-01-11T21:35:02.435Z]       "source": "https://github.com/taskcluster/taskcluster/commits/b550fe4ca7e2d17c16afbfe61b66aa7a9ce283e6",
[taskcluster 2024-01-11T21:35:02.435Z]       "version": "59.1.3"
[taskcluster 2024-01-11T21:35:02.435Z]     },
[taskcluster 2024-01-11T21:35:02.435Z]     "image": "projects/taskcluster-imaging/global/images/generic-translations-gcp-googlecompute-2023-12-19t18-58-22z",
[taskcluster 2024-01-11T21:35:02.435Z]     "instance-id": "4218419127813791828",
[taskcluster 2024-01-11T21:35:02.435Z]     "instance-type": "projects/887720501152/machineTypes/n1-highmem-8",
[taskcluster 2024-01-11T21:35:02.435Z]     "local-ipv4": "10.128.2.190",
[taskcluster 2024-01-11T21:35:02.435Z]     "project-id": "fxci-production-level1-workers",
[taskcluster 2024-01-11T21:35:02.435Z]     "public-hostname": "translations-1-b-linux-v100-gpu-fkcn2xi0s4uevvwgra54-w.c.fxci-production-level1-workers.internal",
[taskcluster 2024-01-11T21:35:02.435Z]     "public-ipv4": "34.121.56.237",
[taskcluster 2024-01-11T21:35:02.435Z]     "region": "us-central1",
[taskcluster 2024-01-11T21:35:02.435Z]     "zone": "us-central1-a"
[taskcluster 2024-01-11T21:35:02.435Z]   }
[taskcluster 2024-01-11T21:35:02.435Z] Task ID: LNK7aD7DTN2RPLaUSKoOow
[taskcluster 2024-01-11T21:35:02.435Z] === Task Starting ===
[taskcluster 2024-01-11T21:35:02.819Z] Uploading redirect artifact public/logs/live.log to URL https://firefoxci-websocktunnel.services.mozilla.com/us-central1.4218419127813791828.60099/log/SNmJdAvaRbyom_dywu_Aqg with mime type "text/plain; charset=utf-8" and expiry 2024-02-10T21:50:02.765Z
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] No existing writable directory cache 'translations-level-1-checkouts' - creating /home/ubuntu/caches/FlM5-xTFR4iHY0i9Qcr7Nw
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] Creating directory /home/ubuntu/tasks/task_170500890228513/checkouts
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] Successfully mounted writable directory cache '/home/ubuntu/tasks/task_170500890228513/checkouts'
[taskcluster 2024-01-11T21:35:02.872Z] [mounts] Downloading url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task to /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA
[taskcluster:warn 2024-01-11T21:35:32.923Z] [mounts] Download of url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task failed on this attempt: Get "https://firefoxci.taskcluster-artifacts.net/Vn4jRmjGRamdkD3qb_uNQw/0/public/run-task": dial tcp: lookup firefoxci.taskcluster-artifacts.net: i/o timeout
[taskcluster 2024-01-11T21:35:33.339Z] [mounts] Downloading url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task to /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA
[taskcluster 2024-01-11T21:35:35.025Z] [mounts] Downloaded 45746 bytes with SHA256 58974d7dcf0417b3fe536280e49d18e6c908a77c665a69cdbd51e7231ddb0ee7 from url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task to /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA
[taskcluster:warn 2024-01-11T21:35:35.025Z] [mounts] Download /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA of url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/run-task has SHA256 58974d7dcf0417b3fe536280e49d18e6c908a77c665a69cdbd51e7231ddb0ee7 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2024-01-11T21:35:35.025Z] [mounts] Creating directory /home/ubuntu/tasks/task_170500890228513
[taskcluster 2024-01-11T21:35:35.025Z] [mounts] Copying /home/ubuntu/downloads/ajWD50BtTUyCv11uGI-EsA to /home/ubuntu/tasks/task_170500890228513/run-task
[taskcluster 2024-01-11T21:35:35.029Z] [mounts] Downloading url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/fetch-content to /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw
[taskcluster 2024-01-11T21:35:35.127Z] [mounts] Downloaded 29990 bytes with SHA256 1b5680bd9953834c961eac614b18b846f7f15be2812792709c6b5646a7c7fdb8 from url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/fetch-content to /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw
[taskcluster:warn 2024-01-11T21:35:35.127Z] [mounts] Download /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw of url https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vn4jRmjGRamdkD3qb_uNQw/artifacts/public/fetch-content has SHA256 1b5680bd9953834c961eac614b18b846f7f15be2812792709c6b5646a7c7fdb8 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2024-01-11T21:35:35.127Z] [mounts] Creating directory /home/ubuntu/tasks/task_170500890228513
[taskcluster 2024-01-11T21:35:35.127Z] [mounts] Copying /home/ubuntu/downloads/PisAz1fQRtObTAPXSg9SAw to /home/ubuntu/tasks/task_170500890228513/fetch-content
[taskcluster 2024-01-11T21:35:35.130Z] Executing command 0: chmod '+x' run-task
[taskcluster 2024-01-11T21:35:35.132Z]    Exit Code: 0
[taskcluster 2024-01-11T21:35:35.132Z]    User Time: 1.286ms
[taskcluster 2024-01-11T21:35:35.132Z]  Kernel Time: 0s
[taskcluster 2024-01-11T21:35:35.132Z]    Wall Time: 1.488432ms
[taskcluster 2024-01-11T21:35:35.132Z]       Result: SUCCEEDED
[taskcluster 2024-01-11T21:35:35.132Z] Executing command 1: './run-task' '--firefox_translations_training-checkout=./checkouts/vcs/' -- bash -c 'pip install -r $VCS_PATH/pipeline/eval/requirements/eval.txt && export PATH=$PATH:~/.local/bin && export MARIAN=$MOZ_FETCHES_DIR && export BMT_MARIAN=$MOZ_FETCHES_DIR && sed -i -e "s,- .*fetches,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && sed -i -e "s,- .*artifacts,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && $VCS_PATH/pipeline/eval/eval-gpu.sh $TASK_WORKDIR/artifacts/devtest $MOZ_FETCHES_DIR/devtest ru en $MOZ_FETCHES_DIR/final.model.npz.best-chrf.npz.decoder.yml $MOZ_FETCHES_DIR/model*/*.npz'
[setup 2024-01-11T21:35:35.223Z] run-task started in /home/ubuntu/tasks/task_170500890228513
[setup 2024-01-11T21:35:35.223Z] Invoked by command: --firefox_translations_training-checkout=./checkouts/vcs/ -- bash -c pip install -r $VCS_PATH/pipeline/eval/requirements/eval.txt && export PATH=$PATH:~/.local/bin && export MARIAN=$MOZ_FETCHES_DIR && export BMT_MARIAN=$MOZ_FETCHES_DIR && sed -i -e "s,- .*fetches,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && sed -i -e "s,- .*artifacts,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && $VCS_PATH/pipeline/eval/eval-gpu.sh $TASK_WORKDIR/artifacts/devtest $MOZ_FETCHES_DIR/devtest ru en $MOZ_FETCHES_DIR/final.model.npz.best-chrf.npz.decoder.yml $MOZ_FETCHES_DIR/model*/*.npz
[setup 2024-01-11T21:35:35.223Z] Python version: 3.10.12
[vcs 2024-01-11T21:35:35.225Z] WARNING: vcs checkout path (/home/ubuntu/tasks/task_170500890228513/checkouts/vcs) not in cache or volume; performance will likely suffer
[vcs 2024-01-11T21:35:35.225Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs']
[vcs 2024-01-11T21:35:35.398Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs']
[vcs 2024-01-11T21:35:35.402Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs'...
[vcs 2024-01-11T21:35:36.443Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'dependabot/pip/taskcluster/jinja2-3.1.3']
[vcs 2024-01-11T21:35:36.692Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-11T21:35:36.692Z]  * branch            dependabot/pip/taskcluster/jinja2-3.1.3 -> FETCH_HEAD
[vcs 2024-01-11T21:35:36.700Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'dependabot/pip/taskcluster/jinja2-3.1.3']
[vcs 2024-01-11T21:35:36.948Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-11T21:35:36.948Z]  * branch            dependabot/pip/taskcluster/jinja2-3.1.3 -> FETCH_HEAD
[vcs 2024-01-11T21:35:36.955Z] executing ['git', 'checkout', '-f', '-B', 'dependabot/pip/taskcluster/jinja2-3.1.3', '3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0']
[vcs 2024-01-11T21:35:37.015Z] Switched to a new branch 'dependabot/pip/taskcluster/jinja2-3.1.3'
[vcs 2024-01-11T21:35:37.016Z] executing ['git', 'submodule', 'init']
[vcs 2024-01-11T21:35:37.105Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-01-11T21:35:37.106Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-01-11T21:35:37.107Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-01-11T21:35:37.107Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-01-11T21:35:37.108Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-01-11T21:35:37.109Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-01-11T21:35:37.110Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-01-11T21:35:37.164Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-01-11T21:35:38.951Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-01-11T21:35:39.308Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-01-11T21:35:39.682Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-01-11T21:35:40.475Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-01-11T21:35:42.368Z] Cloning into '/home/ubuntu/tasks/task_170500890228513/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-01-11T21:35:43.034Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-01-11T21:35:43.094Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-01-11T21:35:43.122Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-01-11T21:35:43.179Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-01-11T21:35:43.378Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-01-11T21:35:43.413Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-01-11T21:35:43.414Z] cleaning git checkout...
[vcs 2024-01-11T21:35:43.414Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-01-11T21:35:43.418Z] removing []
[vcs 2024-01-11T21:35:43.418Z] successfully cleaned git checkout!
[vcs 2024-01-11T21:35:43.422Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0' title='Built from firefox-translations-training commit 3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0'>3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0</a>
[setup 2024-01-11T21:35:43.422Z] MOZ_FETCHES_DIR is /home/ubuntu/tasks/task_170500890228513/fetches
[fetches 2024-01-11T21:35:43.422Z] fetching artifacts
[fetches 2024-01-11T21:35:43.422Z] executing ['/usr/bin/python3', '-u', '/home/ubuntu/tasks/task_170500890228513/./fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.en.zst to /home/ubuntu/tasks/task_170500890228513/fetches/devtest.en.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.ru.zst to /home/ubuntu/tasks/task_170500890228513/fetches/devtest.ru.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.ru.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.en.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst to /home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst


/home/ubuntu/tasks/task_170500890228513/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_170500890228513/fetches/model1/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npzDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst
attempt 1/5

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz.decoder.yml to /home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz.decoder.yml
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_170500890228513/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/vocab.spm resolved to 252751 bytes with sha256 b96adf2cf89d08d12da6125f6f7e3b99e5ae68d0eafa460aebd5416da0e541a3 in 1.242s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz.decoder.yml resolved to 333 bytes with sha256 c8c2604e1e4880f0418b65b47094fd56d3b137beaf5206464397bfc04af365de in 1.244s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.ru.zst resolved to 81727 bytes with sha256 f869cb52f8a491f00a04f9c6f3e65ad948a746246c6e7cd2d95f46ede72ed308 in 1.304s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FcacAtQiTqGyJaKZZHtlKQ/artifacts/public/build/devtest.en.zst resolved to 56883 bytes with sha256 9bb6ca271828747c4772d9aa534426d15f403ae142ecdba471631e7f70b1e523 in 1.320s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PfLjiwjrThipzwjzUDPAZA/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 178659466 bytes with sha256 08909231294d985ce4a792eee329161f7d326a4f2f19bdeb2d60e586cfee81d7 in 3.668s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OMLSjscWRPCNXScuzkds3g/artifacts/public/build/marian.tar.zst resolved to 655359725 bytes with sha256 cd84a74c3ab6c11ce7d5dbf432c92fdf8e71f5cc51846b40b97edf75cd63176e in 5.536s
Extracting /home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst to /home/ubuntu/tasks/task_170500890228513/fetches
/home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst extracted in 7.324s
Removing /home/ubuntu/tasks/task_170500890228513/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 12.986079383000003, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-01-11T21:35:56.658Z] finished fetching artifacts
[task 2024-01-11T21:35:56.658Z] executing ['bash', '-c', 'pip install -r $VCS_PATH/pipeline/eval/requirements/eval.txt && export PATH=$PATH:~/.local/bin && export MARIAN=$MOZ_FETCHES_DIR && export BMT_MARIAN=$MOZ_FETCHES_DIR && sed -i -e "s,- .*fetches,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && sed -i -e "s,- .*artifacts,- $MOZ_FETCHES_DIR," $TASK_WORKDIR/fetches/*.yml && $VCS_PATH/pipeline/eval/eval-gpu.sh $TASK_WORKDIR/artifacts/devtest $MOZ_FETCHES_DIR/devtest ru en $MOZ_FETCHES_DIR/final.model.npz.best-chrf.npz.decoder.yml $MOZ_FETCHES_DIR/model*/*.npz']
[task 2024-01-11T21:35:58.405Z] Defaulting to user installation because normal site-packages is not writeable
[task 2024-01-11T21:35:59.444Z] Collecting colorama==0.4.6
[task 2024-01-11T21:35:59.641Z]   Downloading colorama-0.4.6-py2.py3-none-any.whl (25 kB)
[task 2024-01-11T21:36:00.149Z] Collecting lxml==4.9.2
[task 2024-01-11T21:36:00.185Z]   Downloading lxml-4.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (7.1 MB)
[task 2024-01-11T21:36:03.828Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.1/7.1 MB 2.0 MB/s eta 0:00:00
[task 2024-01-11T21:36:04.524Z] Collecting numpy==1.24.3
[task 2024-01-11T21:36:04.560Z]   Downloading numpy-1.24.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
[task 2024-01-11T21:36:10.164Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 3.2 MB/s eta 0:00:00
[task 2024-01-11T21:36:10.443Z] Collecting portalocker==2.7.0
[task 2024-01-11T21:36:10.479Z]   Downloading portalocker-2.7.0-py2.py3-none-any.whl (15 kB)
[task 2024-01-11T21:36:11.970Z] Collecting regex==2023.5.5
[task 2024-01-11T21:36:12.008Z]   Downloading regex-2023.5.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (769 kB)
[task 2024-01-11T21:36:12.468Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 769.7/769.7 KB 1.7 MB/s eta 0:00:00
[task 2024-01-11T21:36:12.923Z] Collecting sacrebleu==2.3.1
[task 2024-01-11T21:36:12.960Z]   Downloading sacrebleu-2.3.1-py3-none-any.whl (118 kB)
[task 2024-01-11T21:36:13.347Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.9/118.9 KB 283.1 kB/s eta 0:00:00
[task 2024-01-11T21:36:13.627Z] Collecting tabulate==0.9.0
[task 2024-01-11T21:36:13.662Z]   Downloading tabulate-0.9.0-py3-none-any.whl (35 kB)
[task 2024-01-11T21:36:15.575Z] Installing collected packages: tabulate, regex, portalocker, numpy, lxml, colorama, sacrebleu
[task 2024-01-11T21:36:15.593Z]   WARNING: The script tabulate is installed in '/home/ubuntu/.local/bin' which is not on PATH.
[task 2024-01-11T21:36:15.594Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[task 2024-01-11T21:36:18.495Z]   WARNING: The scripts f2py, f2py3 and f2py3.10 are installed in '/home/ubuntu/.local/bin' which is not on PATH.
[task 2024-01-11T21:36:18.495Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[task 2024-01-11T21:36:20.334Z]   WARNING: The script sacrebleu is installed in '/home/ubuntu/.local/bin' which is not on PATH.
[task 2024-01-11T21:36:20.334Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[task 2024-01-11T21:36:20.343Z] Successfully installed colorama-0.4.6 lxml-4.9.2 numpy-1.24.3 portalocker-2.7.0 regex-2023.5.5 sacrebleu-2.3.1 tabulate-0.9.0
[task 2024-01-11T21:36:20.536Z] + set -euo pipefail
[task 2024-01-11T21:36:20.536Z] + echo '###### Evaluation of a model'
[task 2024-01-11T21:36:20.536Z] ###### Evaluation of a model
[task 2024-01-11T21:36:20.536Z] + test -v GPUS
[task 2024-01-11T21:36:20.536Z] + test -v MARIAN
[task 2024-01-11T21:36:20.536Z] + test -v WORKSPACE
[task 2024-01-11T21:36:20.536Z] + res_prefix=/home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.536Z] + dataset_prefix=/home/ubuntu/tasks/task_170500890228513/fetches/devtest
[task 2024-01-11T21:36:20.536Z] + src=ru
[task 2024-01-11T21:36:20.536Z] + trg=en
[task 2024-01-11T21:36:20.536Z] + decoder_config=/home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml
[task 2024-01-11T21:36:20.536Z] + models=("${@:6}")
[task 2024-01-11T21:36:20.537Z] ++ dirname ./checkouts/vcs/pipeline/eval/eval-gpu.sh
[task 2024-01-11T21:36:20.538Z] + cd ./checkouts/vcs/pipeline/eval
[task 2024-01-11T21:36:20.538Z] + bash eval.sh /home/ubuntu/tasks/task_170500890228513/artifacts/devtest /home/ubuntu/tasks/task_170500890228513/fetches/devtest ru en /home/ubuntu/tasks/task_170500890228513/fetches /home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml -w 12000 --devices 0 -m /home/ubuntu/tasks/task_170500890228513/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:36:20.540Z] + set -euo pipefail
[task 2024-01-11T21:36:20.540Z] + echo '###### Evaluation of a model'
[task 2024-01-11T21:36:20.540Z] ###### Evaluation of a model
[task 2024-01-11T21:36:20.540Z] + res_prefix=/home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.540Z] + dataset_prefix=/home/ubuntu/tasks/task_170500890228513/fetches/devtest
[task 2024-01-11T21:36:20.540Z] + src=ru
[task 2024-01-11T21:36:20.540Z] + trg=en
[task 2024-01-11T21:36:20.540Z] + marian=/home/ubuntu/tasks/task_170500890228513/fetches
[task 2024-01-11T21:36:20.540Z] + decoder_config=/home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml
[task 2024-01-11T21:36:20.540Z] + args=("${@:7}")
[task 2024-01-11T21:36:20.540Z] + COMPRESSION_CMD=zstdmt
[task 2024-01-11T21:36:20.540Z] + ARTIFACT_EXT=zst
[task 2024-01-11T21:36:20.541Z] ++ dirname /home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.542Z] + mkdir -p /home/ubuntu/tasks/task_170500890228513/artifacts
[task 2024-01-11T21:36:20.544Z] + echo '### Evaluating dataset: /home/ubuntu/tasks/task_170500890228513/fetches/devtest, pair: ru-en, Results prefix: /home/ubuntu/tasks/task_170500890228513/artifacts/devtest'
[task 2024-01-11T21:36:20.544Z] ### Evaluating dataset: /home/ubuntu/tasks/task_170500890228513/fetches/devtest, pair: ru-en, Results prefix: /home/ubuntu/tasks/task_170500890228513/artifacts/devtest
[task 2024-01-11T21:36:20.544Z] + zstdmt -dc /home/ubuntu/tasks/task_170500890228513/fetches/devtest.en.zst
[task 2024-01-11T21:36:20.571Z] + zstdmt -dc /home/ubuntu/tasks/task_170500890228513/fetches/devtest.ru.zst
[task 2024-01-11T21:36:20.571Z] + tee /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.ru
[task 2024-01-11T21:36:20.571Z] + /home/ubuntu/tasks/task_170500890228513/fetches/marian-decoder -c /home/ubuntu/tasks/task_170500890228513/fetches/final.model.npz.best-chrf.npz.decoder.yml --quiet --quiet-translation --log /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.log -w 12000 --devices 0 -m /home/ubuntu/tasks/task_170500890228513/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-01-11T21:36:20.572Z] + tee /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en
[task 2024-01-11T21:36:20.572Z] + sacrebleu /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en.ref -d -f text --score-only -l ru-en -m bleu chrf
[task 2024-01-11T21:36:20.572Z] + tee /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.metrics
[task 2024-01-11T21:38:55.883Z] 0.0
[task 2024-01-11T21:38:55.883Z] 0.8
[task 2024-01-11T21:38:55.883Z] No subset information found. Consider using --origlang argument.
[task 2024-01-11T21:38:55.925Z] + echo '###### Done: Evaluation of a model'
[task 2024-01-11T21:38:55.925Z] ###### Done: Evaluation of a model
[fetches 2024-01-11T21:38:55.926Z] removing /home/ubuntu/tasks/task_170500890228513/fetches
[fetches 2024-01-11T21:38:56.330Z] finished
[taskcluster 2024-01-11T21:38:56.343Z]    Exit Code: 0
[taskcluster 2024-01-11T21:38:56.343Z]    User Time: 2m53.231824s
[taskcluster 2024-01-11T21:38:56.343Z]  Kernel Time: 10.667836s
[taskcluster 2024-01-11T21:38:56.343Z]    Wall Time: 3m21.210748513s
[taskcluster 2024-01-11T21:38:56.343Z]       Result: SUCCEEDED
[taskcluster 2024-01-11T21:38:56.343Z] === Task Finished ===
[taskcluster 2024-01-11T21:38:56.343Z] Task Duration: 3m21.212979844s
[taskcluster 2024-01-11T21:38:56.553Z] Uploading artifact public/build/devtest.en from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:56.744Z] Uploading artifact public/build/devtest.en.ref from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.en.ref with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.047Z] Uploading artifact public/build/devtest.log from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.log with content encoding "gzip", mime type "text/plain" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.240Z] Uploading artifact public/build/devtest.metrics from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.metrics with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.446Z] Uploading artifact public/build/devtest.ru from file /home/ubuntu/tasks/task_170500890228513/artifacts/devtest.ru with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-04-10T20:54:28.120Z
[taskcluster 2024-01-11T21:38:57.616Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_170500890228513/checkouts" to "/home/ubuntu/caches/FlM5-xTFR4iHY0i9Qcr7Nw"
[taskcluster 2024-01-11T21:38:57.691Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-04-10T20:54:28.120Z