2023-03-08T15:13:41.248 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-08T15:13:41.424 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-03-08T15:13:41.425 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-03-08T15:13:41.426 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-03-08T15:13:41.464 INFO:teuthology.lock.ops:Node 'smithi064.front.sepia.ceph.com' reimaging is complete 2023-03-08T15:13:41.464 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-03-08T15:13:41.464 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-03-08T15:13:41.465 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-03-08T15:13:41.488 INFO:teuthology.lock.ops:Node 'smithi116.front.sepia.ceph.com' reimaging is complete 2023-03-08T15:13:41.488 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-03-08T15:13:41.489 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-03-08T15:13:41.489 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-03-08T15:13:41.514 INFO:teuthology.lock.ops:Node 'smithi154.front.sepia.ceph.com' reimaging is complete 2023-03-08T15:13:41.622 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of rhel 8.6 2023-03-08T15:13:41.661 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.6 2023-03-08T15:13:41.669 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of rhel 8.6 2023-03-08T15:13:42.100 INFO:teuthology.orchestra.console:Power off smithi064 2023-03-08T15:13:42.117 INFO:teuthology.orchestra.console:Power off smithi154 2023-03-08T15:13:42.129 INFO:teuthology.orchestra.console:Power off smithi116 2023-03-08T15:13:42.265 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-03-08T15:13:42.366 INFO:teuthology.orchestra.console:Power on smithi154 2023-03-08T15:13:50.725 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2023-03-08T15:13:50.826 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-03-08T15:13:54.601 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-03-08T15:13:54.608 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-03-08T15:13:54.702 INFO:teuthology.orchestra.console:Power on smithi064 2023-03-08T15:13:54.711 INFO:teuthology.orchestra.console:Power on smithi116 2023-03-08T15:14:03.070 INFO:teuthology.orchestra.console:Power on for smithi064 completed 2023-03-08T15:14:03.076 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2023-03-08T15:14:03.171 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-03-08T15:14:03.177 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-03-08T15:20:12.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-03-08T15:20:21.989 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-03-08T15:20:31.045 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-03-08T15:20:40.101 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-03-08T15:20:49.157 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-03-08T15:20:58.213 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-03-08T15:21:01.733 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-03-08T15:21:10.789 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-03-08T15:21:19.845 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-03-08T15:21:28.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-03-08T15:21:37.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-03-08T15:21:47.013 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-03-08T15:21:56.069 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-03-08T15:22:04.220 WARNING:teuthology.provision.fog:timed out 2023-03-08T15:22:10.554 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-08T15:22:10.854 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-03-08T15:22:10.912 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064 2023-03-08T15:22:10.969 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-03-08T15:22:11.318 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-03-08T15:23:02.077 WARNING:teuthology.provision.fog:timed out 2023-03-08T15:23:08.429 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-08T15:23:08.752 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-03-08T15:23:08.770 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-03-08T15:23:08.830 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-03-08T15:23:09.191 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-03-08T15:25:16.549 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-03-08T15:25:25.605 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-03-08T15:25:34.661 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-03-08T15:25:43.721 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-03-08T15:25:52.805 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-03-08T15:26:58.869 WARNING:teuthology.provision.fog:timed out 2023-03-08T15:27:05.121 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-08T15:27:05.406 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-03-08T15:27:05.425 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116 2023-03-08T15:27:05.484 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-03-08T15:27:05.845 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-03-08T15:27:06.056 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-03-08T15:27:06.057 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-03-08T15:27:06.058 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-08T15:27:06.083 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-03-08T15:27:06.083 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-08T15:27:06.109 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-03-08T15:27:06.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-03-08T15:27:06.377 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-03-08T15:27:06.435 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux" 2023-03-08T15:27:06.436 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)" 2023-03-08T15:27:06.436 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel" 2023-03-08T15:27:06.436 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora" 2023-03-08T15:27:06.436 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6" 2023-03-08T15:27:06.436 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-03-08T15:27:06.436 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-08T15:27:06.437 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-03-08T15:27:06.437 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-08T15:27:06.437 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/" 2023-03-08T15:27:06.437 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-08T15:27:06.437 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-08T15:27:06.437 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-03-08T15:27:06.437 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-08T15:27:06.438 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-08T15:27:06.438 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-08T15:27:06.438 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-08T15:27:06.439 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-03-08T15:27:06.466 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-03-08T15:27:06.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-03-08T15:27:06.705 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-03-08T15:27:06.764 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-03-08T15:27:06.765 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2023-03-08T15:27:06.765 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-03-08T15:27:06.765 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-03-08T15:27:06.765 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2023-03-08T15:27:06.765 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-03-08T15:27:06.765 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-08T15:27:06.766 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-03-08T15:27:06.766 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-08T15:27:06.766 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-03-08T15:27:06.766 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-08T15:27:06.766 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-08T15:27:06.766 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-03-08T15:27:06.766 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-08T15:27:06.767 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-08T15:27:06.767 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-08T15:27:06.767 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-08T15:27:06.767 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-03-08T15:27:06.791 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-03-08T15:27:06.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-03-08T15:27:07.047 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-03-08T15:27:07.105 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-03-08T15:27:07.105 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2023-03-08T15:27:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-03-08T15:27:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-03-08T15:27:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2023-03-08T15:27:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-03-08T15:27:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-08T15:27:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-03-08T15:27:07.107 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-08T15:27:07.107 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-03-08T15:27:07.107 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-08T15:27:07.107 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-08T15:27:07.107 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-03-08T15:27:07.107 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-08T15:27:07.108 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-08T15:27:07.108 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-08T15:27:07.108 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-08T15:27:07.109 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-03-08T15:27:07.243 INFO:teuthology.dispatcher.supervisor:Running job 7197043 2023-03-08T15:27:07.244 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197043 --name vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197043/orig.config.yaml 2023-03-08T15:27:07.247 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197043 2023-03-08T15:27:07.248 INFO:teuthology.dispatcher.supervisor:Job PID: 27418 2023-03-08T15:27:07.248 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-03-09T03:28:06.131 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-03-09T03:28:06.264 INFO:teuthology.kill:Killing Pids: {27418} 2023-03-09T03:28:07.038 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-03-09T03:28:07.038 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-03-09T03:28:07.039 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-03-09T03:28:07.039 INFO:teuthology.misc:Compressing logs... 2023-03-09T03:28:07.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-03-09T03:28:07.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-03-09T03:28:07.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-03-09T03:28:07.918 INFO:teuthology.misc:Compressing logs... 2023-03-09T03:28:08.193 INFO:teuthology.misc:Compressing logs... 2023-03-09T03:28:08.330 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-03-09T03:28:08.503 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-03-09T03:28:08.573 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-03-09T03:28:08.613 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-03-09T03:28:08.628 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-03-09T03:28:08.784 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.9.log: file size changed while zipping 2023-03-09T03:28:08.821 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-03-09T03:28:08.868 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-03-09T03:28:08.954 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-03-09T03:28:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2023-03-09T03:28:09.119 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-03-09T03:28:09.136 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-mds.k.log: file size changed while zipping 2023-03-09T03:28:09.334 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-03-09T03:28:09.453 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-03-09T03:28:09.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/3b71f246-bdc7-11ed-9aec-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-03-09T03:29:33.812 INFO:teuthology.orchestra.run.smithi116.stderr:tar: .: file changed as we read it 2023-03-09T03:30:21.380 INFO:teuthology.kill:No teuthology processes running 2023-03-09T03:30:22.230 INFO:teuthology.kill:Nuking machines: ['smithi064', 'smithi116', 'smithi154'] 2023-03-09T03:30:22.823 INFO:teuthology.kill:2023-03-09 03:30:22,823.823 INFO:teuthology.nuke:targets: 2023-03-09T03:30:22.824 INFO:teuthology.kill: smithi064.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-09T03:30:22.824 INFO:teuthology.kill: smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-09T03:30:22.825 INFO:teuthology.kill: smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-09T03:30:22.825 INFO:teuthology.kill:2023-03-09 03:30:22,823.823 INFO:teuthology.nuke:Checking targets against current locks 2023-03-09T03:30:22.885 INFO:teuthology.kill:2023-03-09 03:30:22,884.884 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-09T03:30:22.919 INFO:teuthology.kill:2023-03-09 03:30:22,919.919 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-09T03:30:22.936 INFO:teuthology.kill:2023-03-09 03:30:22,935.935 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-09T03:30:22.972 INFO:teuthology.kill:2023-03-09 03:30:22,972.972 INFO:teuthology.orchestra.console:Power off smithi064 2023-03-09T03:30:23.021 INFO:teuthology.kill:2023-03-09 03:30:23,021.021 INFO:teuthology.orchestra.console:Power off smithi116 2023-03-09T03:30:23.061 INFO:teuthology.kill:2023-03-09 03:30:23,061.061 INFO:teuthology.orchestra.console:Power off smithi154 2023-03-09T03:30:31.396 INFO:teuthology.kill:2023-03-09 03:30:31,396.396 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-03-09T03:30:31.555 INFO:teuthology.kill:2023-03-09 03:30:31,554.554 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-03-09T03:30:35.472 INFO:teuthology.kill:2023-03-09 03:30:35,472.472 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-03-09T03:30:35.546 INFO:teuthology.kill:2023-03-09 03:30:35,546.546 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-03-09T03:30:35.632 INFO:teuthology.kill:2023-03-09 03:30:35,632.632 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-03-09T03:30:35.704 INFO:teuthology.kill:2023-03-09 03:30:35,704.704 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2023-03-09T03:32:36.048 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-03-09T03:32:36.194 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi064 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-08_20:32:29-fs-wip-yuri3-testing-2023-03-08-0800-pacific-distro-default-smithi/7197992 2023-03-09T03:32:36.195 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi116 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-08_20:32:29-fs-wip-yuri3-testing-2023-03-08-0800-pacific-distro-default-smithi/7197990 2023-03-09T03:32:36.195 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi154 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-08_20:32:29-fs-wip-yuri3-testing-2023-03-08-0800-pacific-distro-default-smithi/7197990