2022-08-12T09:13:29.468 INFO:root:teuthology version: 1.1.1.dev409+g9e7483cc 2022-08-12T09:13:29.809 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2022-08-12T09:13:29.810 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2022-08-12T09:13:29.811 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-08-12T09:13:29.832 INFO:teuthology.lock.ops:Node 'smithi029.front.sepia.ceph.com' reimaging is complete 2022-08-12T09:13:29.832 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2022-08-12T09:13:29.832 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2022-08-12T09:13:29.833 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2022-08-12T09:13:29.858 INFO:teuthology.lock.ops:Node 'smithi115.front.sepia.ceph.com' reimaging is complete 2022-08-12T09:13:29.859 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2022-08-12T09:13:29.859 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2022-08-12T09:13:29.859 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2022-08-12T09:13:29.895 INFO:teuthology.lock.ops:Node 'smithi158.front.sepia.ceph.com' reimaging is complete 2022-08-12T09:13:30.083 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.6 2022-08-12T09:13:30.092 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.6 2022-08-12T09:13:30.137 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of rhel 8.6 2022-08-12T09:13:30.491 INFO:teuthology.orchestra.console:Power off smithi115 2022-08-12T09:13:30.548 INFO:teuthology.orchestra.console:Power off smithi158 2022-08-12T09:13:30.594 INFO:teuthology.orchestra.console:Power off smithi029 2022-08-12T09:13:39.029 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2022-08-12T09:13:39.050 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2022-08-12T09:13:39.086 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-08-12T09:13:39.138 INFO:teuthology.orchestra.console:Power on smithi158 2022-08-12T09:13:39.176 INFO:teuthology.orchestra.console:Power on smithi115 2022-08-12T09:13:39.236 INFO:teuthology.orchestra.console:Power on smithi029 2022-08-12T09:13:43.574 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2022-08-12T09:13:43.676 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2022-08-12T09:13:47.639 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2022-08-12T09:13:47.655 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2022-08-12T09:13:47.746 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2022-08-12T09:13:47.771 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2022-08-12T09:18:34.633 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-12T09:18:35.249 INFO:teuthology.provision.fog.smithi115:Node is ready 2022-08-12T09:18:35.314 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2022-08-12T09:18:35.390 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2022-08-12T09:18:35.784 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2022-08-12T09:19:16.971 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-12T09:19:17.268 INFO:teuthology.provision.fog.smithi158:Node is ready 2022-08-12T09:19:17.297 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2022-08-12T09:19:17.364 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2022-08-12T09:19:17.744 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2022-08-12T09:19:31.134 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-12T09:19:31.456 INFO:teuthology.provision.fog.smithi029:Node is ready 2022-08-12T09:19:31.480 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2022-08-12T09:19:31.559 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2022-08-12T09:19:31.985 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2022-08-12T09:19:32.342 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2022-08-12T09:19:32.343 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-12T09:19:32.378 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2022-08-12T09:19:32.379 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-12T09:19:32.413 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2022-08-12T09:19:32.414 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-12T09:19:32.455 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2022-08-12T09:19:32.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-08-12T09:19:32.762 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2022-08-12T09:19:32.826 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2022-08-12T09:19:32.827 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2022-08-12T09:19:32.827 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2022-08-12T09:19:32.827 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2022-08-12T09:19:32.828 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2022-08-12T09:19:32.828 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2022-08-12T09:19:32.828 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-08-12T09:19:32.828 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2022-08-12T09:19:32.828 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-08-12T09:19:32.829 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2022-08-12T09:19:32.829 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-08-12T09:19:32.829 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-12T09:19:32.829 INFO:teuthology.orchestra.run.smithi029.stdout: 2022-08-12T09:19:32.830 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-12T09:19:32.830 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-08-12T09:19:32.830 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-08-12T09:19:32.830 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-08-12T09:19:32.832 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-08-12T09:19:32.864 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2022-08-12T09:19:32.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2022-08-12T09:19:33.209 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2022-08-12T09:19:33.275 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2022-08-12T09:19:33.275 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)" 2022-08-12T09:19:33.275 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2022-08-12T09:19:33.276 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2022-08-12T09:19:33.276 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6" 2022-08-12T09:19:33.276 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2022-08-12T09:19:33.277 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-08-12T09:19:33.282 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2022-08-12T09:19:33.283 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-08-12T09:19:33.284 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2022-08-12T09:19:33.284 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-08-12T09:19:33.285 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-12T09:19:33.294 INFO:teuthology.orchestra.run.smithi115.stdout: 2022-08-12T09:19:33.294 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-12T09:19:33.295 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-08-12T09:19:33.295 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-08-12T09:19:33.296 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-08-12T09:19:33.297 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2022-08-12T09:19:33.326 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2022-08-12T09:19:33.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2022-08-12T09:19:33.694 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2022-08-12T09:19:33.765 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2022-08-12T09:19:33.765 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2022-08-12T09:19:33.766 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2022-08-12T09:19:33.766 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2022-08-12T09:19:33.767 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2022-08-12T09:19:33.767 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2022-08-12T09:19:33.767 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-08-12T09:19:33.767 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2022-08-12T09:19:33.768 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-08-12T09:19:33.768 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2022-08-12T09:19:33.768 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-08-12T09:19:33.768 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-12T09:19:33.769 INFO:teuthology.orchestra.run.smithi158.stdout: 2022-08-12T09:19:33.769 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-12T09:19:33.769 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-08-12T09:19:33.769 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-08-12T09:19:33.771 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-08-12T09:19:33.772 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2022-08-12T09:19:33.960 INFO:teuthology.dispatcher.supervisor:Running job 6967586 2022-08-12T09:19:33.961 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2022-08-11_16:19:16-fs:workload-wip-pdonnell-testing-20220811.135850-distro-default-smithi/6967586 --name pdonnell-2022-08-11_16:19:16-fs:workload-wip-pdonnell-testing-20220811.135850-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2022-08-11_16:19:16-fs:workload-wip-pdonnell-testing-20220811.135850-distro-default-smithi/6967586/orig.config.yaml 2022-08-12T09:19:33.973 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2022-08-11_16:19:16-fs:workload-wip-pdonnell-testing-20220811.135850-distro-default-smithi/6967586 2022-08-12T09:19:33.974 INFO:teuthology.dispatcher.supervisor:Job PID: 10181 2022-08-12T09:19:33.975 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-08-12T21:20:31.951 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-08-12T21:20:32.161 INFO:teuthology.kill:Killing Pids: {10181} 2022-08-12T21:20:33.731 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2022-08-12T21:20:33.732 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2022-08-12T21:20:33.732 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2022-08-12T21:20:33.732 INFO:teuthology.misc:Compressing logs... 2022-08-12T21:20:33.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-08-12T21:20:33.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2022-08-12T21:20:34.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2022-08-12T21:20:34.884 INFO:teuthology.misc:Compressing logs... 2022-08-12T21:20:35.714 INFO:teuthology.misc:Compressing logs... 2022-08-12T21:24:45.594 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2022-08-12T21:24:47.106 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2022-08-12T21:24:58.500 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-08-12T21:26:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-08-12T21:26:25.125 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-08-12T21:27:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-08-12T21:27:41.277 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2022-08-12T21:27:41.396 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mgr.z.log: file size changed while zipping 2022-08-12T21:30:01.893 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-08-12T21:30:12.441 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-08-12T21:30:21.894 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2022-08-12T21:30:27.293 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2022-08-12T21:30:45.802 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2022-08-12T21:30:47.452 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mds.f.log: file size changed while zipping 2022-08-12T21:30:49.285 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mds.c.log: file size changed while zipping 2022-08-12T21:30:57.652 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mds.i.log: file size changed while zipping 2022-08-12T21:31:20.554 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-08-13T01:17:02.439 INFO:teuthology.orchestra.run.smithi029.stderr: 2022-08-13T01:17:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ed489a22-1a22-11ed-8431-001a4aab830c/ceph-mon.a.log.gz: No space left on device 2022-08-13T01:17:04.253 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/teuthology/misc.py", line 1383, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 123: 'sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip --' 2022-08-13T01:17:04.408 INFO:teuthology.kill:No teuthology processes running 2022-08-13T01:17:05.742 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi115', 'smithi158'] 2022-08-13T01:17:06.902 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_9e7483cc68a9eb6b54dacbb0bec3bf23a5d32425/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-08-13T01:17:06.903 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-08-13T01:17:06.904 INFO:teuthology.kill:2022-08-13 01:17:06,902.902 INFO:teuthology.nuke:targets: 2022-08-13T01:17:06.904 INFO:teuthology.kill: smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCamzKbH42rYKqLt8IFsoMpDS36mwb5OGepdV7ruXXUUrVnSflc6/CL8EfUElpd4DuJ54Wg8ETXq3C96a/fdCqVKA0m6DOfkprkParIVzj7/7ynfEHI2hxo3ozxzDjAbUUrz0tM4dzOnM3CO9iwWzbFyBTPqrqWf9wGWAeZiRgNn2a7FnW3g0REJ/i8XEnD8SF8X1tdDEGPwqo5HaHkUYKeKdDpF8YZMdiLhXR7Gdy68t4PzmifI1oFKb6V+l3/3mP1JjgO3Xwci9ErljjGE+AThoCL+xsJ7NfuvThV8nc5w+In+quGRZlnNMiSR5wux0P1WyWkdnBkP4i+Sv8R9EZADrCx3fwCkhHs1pCOaTPzd++s+AplWC6VCOqQFQxMDV3aHb/2MbG0fIfSHzJIAj3/oRKiRCva7OxoHXSc/yt3G7XnXHiIsi6rfxJ7pdhTHjsOEw/qeK2IEayzS6GBSCsSVNI7L9NfslMJFO6pJcVJkPc3CjetHTZgfOZ9chJhxEs= 2022-08-13T01:17:06.904 INFO:teuthology.kill: smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gcIJELH9EH7QGZzbSTionRvEct1WlJdB4YNq09W4FE5w8fpZ0CI9lY6lWZSMI4Q065L/UBsdv7rKi9fUxP9SjN8iP6DmDdXrBfoyJOssX0J3aLlA1C42l6fX1tFnz1E4DQwVRdhNEgqyG7GYqRTCTSyMlfzmpW23/Mu5pw0vxjJ7frrc2s0SUwJULvbRA1Z0WGYSXItbQgc3W6cbbvHYEUUWTQ1oASNuzkempqhR5C4ZtB21IkmojbB5jzSocBHUwzVgaC0l7QrXBmBz6B7ev3eI5A08KwkmNfu66bI3EKaKIl66LzR3FUakLA9XNkFw0Qfj6h3XbxL7IYVIitEzz7NFl0nPYLl0noWXb+X8mIaSN3Co+gw2mc+SCCyz/jjd4pVHuw+iRqabR9dcAX5XemkcEejrz0BjDIzr88Ioi7gsyfjz0l5/2Zb96qwW55pKsD62AtBAznxr406kl4m9MH6idTzaDOHn/y6R643aSYC9u4AncwhR7NI4FgDxuuM= 2022-08-13T01:17:06.904 INFO:teuthology.kill: smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2/+2zO/Iu/SAFdcxRslPc6kjYZUhJ8AlYFSOMcZUYP/e2P/COD44ca5Eu3EAtxuA5RC3mu4sDGNXhG9LX3xMXCwyPDBPQO8pcjBtapWhKOYwXSz8Dr879PY0sURiCkUrQa0qvKLSLOFY6po+KfSzVKk7K8/6d1m2wp0VgD6uHDZtqPtnbu4lClZADSBjReWKPTfgK0AC85ur9osuxQZfdGS3WjQc2RZPDEkTAg2/k+VWrJP98YdqkwU+c53q6tB3qPBfwvx3nyYbAK5HSlyQeUZzubuxQUNy+XQplNLxVivLU5Hdtls/lBRzruEp141lH/VgiGP1SUkg5C7PSipqSnyJHzKI6+OSsiJ3Av2tlHie9qcFyhXhzsCNMe7Ki/TQo7uVd/x+p2e6Y7ledOuuLM0oqUZt0dK6AbQp0LSEcsw4MrAeGwNaO+yaY+qVnQN5TsHT5Q5V+SKN3FjJV02i2nndfQ6bBzKUH6Zp4J84O4KC0+c8c7vy3xan2GOtyM2c= 2022-08-13T01:17:06.905 INFO:teuthology.kill:2022-08-13 01:17:06,902.902 INFO:teuthology.nuke:Checking targets against current locks 2022-08-13T01:17:06.955 INFO:teuthology.kill:2022-08-13 01:17:06,955.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-13T01:17:06.982 INFO:teuthology.kill:2022-08-13 01:17:06,982.982 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-13T01:17:07.012 INFO:teuthology.kill:2022-08-13 01:17:07,012.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-13T01:17:07.050 INFO:teuthology.kill:2022-08-13 01:17:07,050.050 INFO:teuthology.orchestra.console:Power off smithi029 2022-08-13T01:17:07.092 INFO:teuthology.kill:2022-08-13 01:17:07,092.092 INFO:teuthology.orchestra.console:Power off smithi115 2022-08-13T01:17:07.145 INFO:teuthology.kill:2022-08-13 01:17:07,144.144 INFO:teuthology.orchestra.console:Power off smithi158 2022-08-13T01:17:15.429 INFO:teuthology.kill:2022-08-13 01:17:15,428.428 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-08-13T01:17:15.472 INFO:teuthology.kill:2022-08-13 01:17:15,472.472 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2022-08-13T01:17:15.504 INFO:teuthology.kill:2022-08-13 01:17:15,504.504 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2022-08-13T01:17:15.586 INFO:teuthology.kill:2022-08-13 01:17:15,586.586 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2022-08-13T01:17:15.615 INFO:teuthology.kill:2022-08-13 01:17:15,615.615 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2022-08-13T01:17:15.648 INFO:teuthology.kill:2022-08-13 01:17:15,648.648 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com 2022-08-13T01:19:15.969 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-08-13T01:19:16.126 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi158 but it was locked by another job: /home/teuthworker/archive/dis-2022-08-12_19:05:00-rbd-wip-dis-testing-distro-default-smithi/6969950