[taskcluster 2024-01-11 21:16:49.376Z] Task ID: CMV6YUxxTLSofL3r3cldnA
[taskcluster 2024-01-11 21:16:49.376Z] Worker ID: 3755968565850531333
[taskcluster 2024-01-11 21:16:49.376Z] Worker Group: us-central1
[taskcluster 2024-01-11 21:16:49.376Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-01-11 21:16:49.376Z] Worker Pool: translations-1/b-linux-large-gcp-300gb
[taskcluster 2024-01-11 21:16:49.376Z] Worker Version: 38.0.5
[taskcluster 2024-01-11 21:16:49.376Z] Public IP: 34.67.42.151
[taskcluster 2024-01-11 21:16:49.376Z] Hostname: translations-1-b-linux-large-gcp-300gb-ex2hzvsasbyf3mdjybbcaq
[taskcluster 2024-01-11 21:16:49.376Z] using cache "translations-level-1-checkouts-v3-58974d7dcf0417b3fe53-JEojYIdHR228XjxewijpYw" -> /builds/worker/checkouts

[taskcluster 2024-01-11 21:16:52.052Z] Downloading artifact "public/image.tar.zst" from task ID: JEojYIdHR228XjxewijpYw.
[taskcluster 2024-01-11 21:16:54.904Z] Downloaded artifact successfully.
[taskcluster 2024-01-11 21:16:54.904Z] Downloaded 251.881 mb
[taskcluster 2024-01-11 21:16:54.904Z] Decompressing downloaded image
[taskcluster 2024-01-11 21:16:56.346Z] Loading docker image from downloaded archive.
[taskcluster 2024-01-11 21:17:05.910Z] Image 'public/image.tar.zst' from task 'JEojYIdHR228XjxewijpYw' loaded.  Using image ID sha256:c5ffa7c5a30f7c56161b6472aafb1fd56f2211a6dff55bb47b33e0214bd65ce9.
[taskcluster 2024-01-11 21:17:06.043Z] === Task Starting ===
[setup 2024-01-11T21:17:13.366Z] run-task started in /builds/worker
[setup 2024-01-11T21:17:13.366Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c zstd -d --rm $MOZ_FETCHES_DIR/file* && $VCS_PATH/pipeline/translate/collect.sh fetches artifacts/mono.ru.zst $MOZ_FETCHES_DIR/mono.en.zst
[setup 2024-01-11T21:17:13.366Z] Python version: 3.10.12
[cache 2024-01-11T21:17:13.368Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-01-11T21:17:13.368Z] volume /builds/worker/checkouts is a cache
[setup 2024-01-11T21:17:13.368Z] running as worker:worker
[vcs 2024-01-11T21:17:13.368Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-01-11T21:17:13.370Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-01-11T21:17:13.372Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-01-11T21:17:13.962Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'dependabot/pip/taskcluster/jinja2-3.1.3']
[vcs 2024-01-11T21:17:14.203Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-11T21:17:14.203Z]  * branch            dependabot/pip/taskcluster/jinja2-3.1.3 -> FETCH_HEAD
[vcs 2024-01-11T21:17:14.208Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'dependabot/pip/taskcluster/jinja2-3.1.3']
[vcs 2024-01-11T21:17:14.426Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-11T21:17:14.426Z]  * branch            dependabot/pip/taskcluster/jinja2-3.1.3 -> FETCH_HEAD
[vcs 2024-01-11T21:17:14.431Z] executing ['git', 'checkout', '-f', '-B', 'dependabot/pip/taskcluster/jinja2-3.1.3', '3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0']
[vcs 2024-01-11T21:17:14.466Z] Switched to a new branch 'dependabot/pip/taskcluster/jinja2-3.1.3'
[vcs 2024-01-11T21:17:14.466Z] executing ['git', 'submodule', 'init']
[vcs 2024-01-11T21:17:14.485Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-01-11T21:17:14.486Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-01-11T21:17:14.487Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-01-11T21:17:14.488Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-01-11T21:17:14.488Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-01-11T21:17:14.489Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-01-11T21:17:14.490Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-01-11T21:17:14.510Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-01-11T21:17:15.655Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-01-11T21:17:15.988Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-01-11T21:17:16.362Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-01-11T21:17:17.006Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-01-11T21:17:18.360Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-01-11T21:17:18.886Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-01-11T21:17:18.895Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-01-11T21:17:18.905Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-01-11T21:17:18.929Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-01-11T21:17:19.031Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-01-11T21:17:19.049Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-01-11T21:17:19.049Z] cleaning git checkout...
[vcs 2024-01-11T21:17:19.049Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-01-11T21:17:19.052Z] removing []
[vcs 2024-01-11T21:17:19.052Z] successfully cleaned git checkout!
[vcs 2024-01-11T21:17:19.053Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0' title='Built from firefox-translations-training commit 3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0'>3177fe8708ed9226cc0b7d5886eb1c13f3ad40b0</a>
[setup 2024-01-11T21:17:19.053Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2024-01-11T21:17:19.053Z] fetching artifacts
[fetches 2024-01-11T21:17:19.053Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YIAuix6hSza9xpMDUrg2Pw/artifacts/public/build/mono.en.zst to /builds/worker/fetches/mono.en.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RDS0_5CET3O4Z_AKGebxkQ/artifacts/public/build/file.1.out.zst to /builds/worker/fetches/file.1.out.zst
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YIAuix6hSza9xpMDUrg2Pw/artifacts/public/build/mono.en.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XdzBZb52Sn-v5XnhYUhbyA/artifacts/public/build/file.2.out.zst to /builds/worker/fetches/file.2.out.zst

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RDS0_5CET3O4Z_AKGebxkQ/artifacts/public/build/file.1.out.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XdzBZb52Sn-v5XnhYUhbyA/artifacts/public/build/file.2.out.zst

https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RDS0_5CET3O4Z_AKGebxkQ/artifacts/public/build/file.1.out.zst resolved to 1910 bytes with sha256 8b6c035ad82a08035a8e14e194d5f8cb8f2d3296c20c3ccff8471d5f35be6e05 in 0.163s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XdzBZb52Sn-v5XnhYUhbyA/artifacts/public/build/file.2.out.zst resolved to 1771 bytes with sha256 d5f8c5ba809d8f48ad313abd9ebdb97315d4abc970ce8204f641f0ba0fb8f062 in 0.206s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YIAuix6hSza9xpMDUrg2Pw/artifacts/public/build/mono.en.zst resolved to 507016 bytes with sha256 1e32e7242061058c19617f07777c6af2544f4ba8568d54a6f98ae7e0b34203da in 0.293s
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.29633484800001497, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-01-11T21:17:19.432Z] finished fetching artifacts
[task 2024-01-11T21:17:19.432Z] executing ['bash', '-c', 'zstd -d --rm $MOZ_FETCHES_DIR/file* && $VCS_PATH/pipeline/translate/collect.sh fetches artifacts/mono.ru.zst $MOZ_FETCHES_DIR/mono.en.zst']
[task 2024-01-11T21:17:19.434Z] 
[task 2024-01-11T21:17:19.434Z] Decompress:  1/ 2 files. Current: .../file.1.out.zst : 0 MB...    
[task 2024-01-11T21:17:19.435Z]                                                                                
[task 2024-01-11T21:17:19.435Z] 
[task 2024-01-11T21:17:19.435Z]                                                                                
[task 2024-01-11T21:17:19.435Z] 2 files decompressed :  74160 bytes total 
[task 2024-01-11T21:17:19.436Z] + set -euo pipefail
[task 2024-01-11T21:17:19.436Z] + chunks_dir=fetches
[task 2024-01-11T21:17:19.436Z] + output_path=artifacts/mono.ru.zst
[task 2024-01-11T21:17:19.436Z] + mono_path=/builds/worker/fetches/mono.en.zst
[task 2024-01-11T21:17:19.436Z] + COMPRESSION_CMD=zstdmt
[task 2024-01-11T21:17:19.436Z] + echo '### Collecting translations'
[task 2024-01-11T21:17:19.436Z] ### Collecting translations
[task 2024-01-11T21:17:19.436Z] + find fetches -name '*.out'
[task 2024-01-11T21:17:19.436Z] + sort -t . -k2,2n
[task 2024-01-11T21:17:19.436Z] + xargs cat
[task 2024-01-11T21:17:19.436Z] + zstdmt
[task 2024-01-11T21:17:19.439Z] + echo '### Comparing number of sentences in source and artificial target files'
[task 2024-01-11T21:17:19.439Z] ### Comparing number of sentences in source and artificial target files
[task 2024-01-11T21:17:19.440Z] ++ zstdmt -dc /builds/worker/fetches/mono.en.zst
[task 2024-01-11T21:17:19.440Z] ++ wc -l
[task 2024-01-11T21:17:19.444Z] + src_len=9929
[task 2024-01-11T21:17:19.444Z] ++ zstdmt -dc artifacts/mono.ru.zst
[task 2024-01-11T21:17:19.444Z] ++ wc -l
[task 2024-01-11T21:17:19.446Z] + trg_len=9929
[task 2024-01-11T21:17:19.446Z] + '[' 9929 '!=' 9929 ']'
[fetches 2024-01-11T21:17:19.446Z] removing /builds/worker/fetches
[fetches 2024-01-11T21:17:19.446Z] finished
[taskcluster 2024-01-11 21:17:19.941Z] === Task Finished ===
[taskcluster 2024-01-11 21:17:20.189Z] Successful task run with exit code: 0 completed in 30.814 seconds