2022-08-28T07:57:07.549 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-08-28T07:57:07.747 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging
2022-08-28T07:57:07.750 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server
2022-08-28T07:57:07.753 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-08-28T07:57:07.784 INFO:teuthology.lock.ops:Node 'smithi170.front.sepia.ceph.com' reimaging is complete
2022-08-28T07:57:07.784 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2022-08-28T07:57:07.785 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2022-08-28T07:57:07.785 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2022-08-28T07:57:07.818 INFO:teuthology.lock.ops:Node 'smithi187.front.sepia.ceph.com' reimaging is complete
2022-08-28T07:57:08.063 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of ubuntu 20.04
2022-08-28T07:57:08.068 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of ubuntu 20.04
2022-08-28T07:57:08.528 INFO:teuthology.orchestra.console:Power off smithi187
2022-08-28T07:57:08.554 INFO:teuthology.orchestra.console:Power off smithi170
2022-08-28T07:57:08.696 INFO:teuthology.orchestra.console:Power off for smithi187 completed
2022-08-28T07:57:08.708 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-08-28T07:57:08.798 INFO:teuthology.orchestra.console:Power on smithi187
2022-08-28T07:57:08.810 INFO:teuthology.orchestra.console:Power on smithi170
2022-08-28T07:57:17.184 INFO:teuthology.orchestra.console:Power on for smithi187 completed
2022-08-28T07:57:17.197 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2022-08-28T07:57:17.287 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2022-08-28T07:57:17.299 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2022-08-28T08:02:22.017 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-28T08:02:22.026 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-28T08:02:22.460 INFO:teuthology.provision.fog.smithi170:Node is ready
2022-08-28T08:02:22.468 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2022-08-28T08:02:22.477 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2022-08-28T08:02:22.563 INFO:teuthology.provision.fog.smithi187:Node is ready
2022-08-28T08:02:22.570 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com
2022-08-28T08:02:22.578 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187
2022-08-28T08:02:22.837 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2022-08-28T08:02:22.932 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2022-08-28T08:02:23.446 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2022-08-28T08:02:23.448 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-28T08:02:23.540 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2022-08-28T08:02:23.541 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-28T08:02:23.575 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2022-08-28T08:02:23.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-08-28T08:02:23.957 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2022-08-28T08:02:24.004 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu"
2022-08-28T08:02:24.011 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-08-28T08:02:24.022 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu
2022-08-28T08:02:24.023 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian
2022-08-28T08:02:24.023 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-08-28T08:02:24.023 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="20.04"
2022-08-28T08:02:24.024 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/"
2022-08-28T08:02:24.024 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-08-28T08:02:24.025 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-08-28T08:02:24.025 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-08-28T08:02:24.047 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=focal
2022-08-28T08:02:24.048 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=focal
2022-08-28T08:02:24.053 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-08-28T08:02:24.143 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2022-08-28T08:02:24.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2022-08-28T08:02:24.700 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2022-08-28T08:02:24.717 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu"
2022-08-28T08:02:24.717 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-08-28T08:02:24.724 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu
2022-08-28T08:02:24.725 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian
2022-08-28T08:02:24.725 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-08-28T08:02:24.726 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="20.04"
2022-08-28T08:02:24.727 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/"
2022-08-28T08:02:24.727 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-08-28T08:02:24.728 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-08-28T08:02:24.728 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-08-28T08:02:24.729 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=focal
2022-08-28T08:02:24.729 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=focal
2022-08-28T08:02:24.730 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2022-08-28T08:02:24.965 INFO:teuthology.dispatcher.supervisor:Running job 6996870
2022-08-28T08:02:24.976 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2022-08-28_07:46:16-rgw-wip-yuval-lua-filter2-distro-default-smithi/6996870 --name yuvalif-2022-08-28_07:46:16-rgw-wip-yuval-lua-filter2-distro-default-smithi --description rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec s3tests-branch tasks/rgw_s3tests ubuntu_latest} -- /home/teuthworker/archive/yuvalif-2022-08-28_07:46:16-rgw-wip-yuval-lua-filter2-distro-default-smithi/6996870/orig.config.yaml
2022-08-28T08:02:25.002 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2022-08-28_07:46:16-rgw-wip-yuval-lua-filter2-distro-default-smithi/6996870
2022-08-28T08:02:25.003 INFO:teuthology.dispatcher.supervisor:Job PID: 27452
2022-08-28T08:02:25.004 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-08-28T20:03:21.563 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-08-28T20:03:22.356 INFO:teuthology.kill:Killing Pids: {27452}
2022-08-28T20:03:23.660 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-08-28T20:03:23.661 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-08-28T20:03:23.661 INFO:teuthology.misc:Compressing logs...
2022-08-28T20:03:23.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-08-28T20:03:23.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2022-08-28T20:03:23.978 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-08-28T20:03:24.192 INFO:teuthology.orchestra.run.smithi187.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-08-28T20:03:24.221 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-08-28T20:03:24.221 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now
2022-08-28T20:03:24.261 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-08-28T20:03:24.262 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now
2022-08-28T20:03:24.263 INFO:teuthology.misc:Compressing logs...
2022-08-28T20:03:24.287 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory
2022-08-28T20:03:24.329 INFO:teuthology.orchestra.run.smithi187.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory
2022-08-28T20:03:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory
2022-08-28T20:03:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now
2022-08-28T20:03:24.398 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory
2022-08-28T20:03:24.398 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now
2022-08-28T20:03:24.399 INFO:teuthology.misc:Compressing logs...
2022-08-28T20:03:24.467 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/cephadm.log.gz already exists;	not overwritten
2022-08-28T20:03:24.469 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/misc.py", line 1383, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/orchestra/run.py", line 479, in wait
    proc.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/orchestra/run.py", line 183, in _raise_for_status
    node=self.hostname, label=self.label
teuthology.exceptions.CommandFailedError: Command failed on smithi187 with status 123: 'sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip --'
2022-08-28T20:03:24.513 INFO:teuthology.kill:No teuthology processes running
2022-08-28T20:03:25.656 INFO:teuthology.kill:No locked machines. Not nuking anything
2022-08-28T20:05:25.872 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15