2023-03-28T10:47:26.762 INFO:root:teuthology version: 0.0.1.dev1+ge372916 2023-03-28T10:47:26.948 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-03-28T10:47:26.949 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-03-28T10:47:26.949 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-03-28T10:47:26.975 INFO:teuthology.lock.ops:Node 'smithi002.front.sepia.ceph.com' reimaging is complete 2023-03-28T10:47:26.975 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-03-28T10:47:26.976 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-03-28T10:47:26.976 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-03-28T10:47:26.999 INFO:teuthology.lock.ops:Node 'smithi072.front.sepia.ceph.com' reimaging is complete 2023-03-28T10:47:27.000 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-03-28T10:47:27.000 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-03-28T10:47:27.000 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-03-28T10:47:27.024 INFO:teuthology.lock.ops:Node 'smithi097.front.sepia.ceph.com' reimaging is complete 2023-03-28T10:47:27.126 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of rhel 8.6 2023-03-28T10:47:27.131 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.6 2023-03-28T10:47:27.162 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.6 2023-03-28T10:47:27.384 INFO:teuthology.orchestra.console:Power off smithi002 2023-03-28T10:47:27.406 INFO:teuthology.orchestra.console:Power off smithi072 2023-03-28T10:47:27.446 INFO:teuthology.orchestra.console:Power off smithi097 2023-03-28T10:47:27.537 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-03-28T10:47:27.557 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-03-28T10:47:27.603 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-03-28T10:47:27.638 INFO:teuthology.orchestra.console:Power on smithi002 2023-03-28T10:47:27.658 INFO:teuthology.orchestra.console:Power on smithi072 2023-03-28T10:47:27.704 INFO:teuthology.orchestra.console:Power on smithi097 2023-03-28T10:47:31.908 INFO:teuthology.orchestra.console:Power on for smithi002 completed 2023-03-28T10:47:31.915 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2023-03-28T10:47:32.009 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-03-28T10:47:32.016 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-03-28T10:47:36.072 INFO:teuthology.orchestra.console:Power on for smithi097 completed 2023-03-28T10:47:36.173 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-03-28T10:50:20.905 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-28T10:50:24.937 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-03-28T10:50:29.993 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-28T10:50:33.993 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-03-28T10:50:39.050 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-28T10:50:43.045 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-03-28T10:50:48.133 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-28T10:50:50.985 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-03-28T10:50:52.101 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-03-28T10:51:00.069 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-03-28T10:51:01.157 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-03-28T10:51:09.125 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-03-28T10:51:18.181 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-03-28T10:51:27.237 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-03-28T10:51:36.293 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-03-28T10:51:54.149 WARNING:teuthology.provision.fog:timed out 2023-03-28T10:52:00.495 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-28T10:52:00.779 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-03-28T10:52:00.797 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-03-28T10:52:00.855 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-03-28T10:52:01.198 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-03-28T10:52:07.167 WARNING:teuthology.provision.fog:timed out 2023-03-28T10:52:13.503 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-28T10:52:13.812 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-03-28T10:52:13.831 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-03-28T10:52:13.889 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-03-28T10:52:14.240 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-03-28T10:52:42.329 WARNING:teuthology.provision.fog:timed out 2023-03-28T10:52:48.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-28T10:52:49.347 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-03-28T10:52:49.366 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-03-28T10:52:49.426 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-03-28T10:52:49.810 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-03-28T10:52:50.022 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-03-28T10:52:50.023 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-03-28T10:52:50.024 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-28T10:52:50.050 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-03-28T10:52:50.051 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-03-28T10:52:50.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-03-28T10:52:50.310 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-03-28T10:52:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2023-03-28T10:52:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2023-03-28T10:52:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2023-03-28T10:52:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2023-03-28T10:52:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2023-03-28T10:52:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-03-28T10:52:50.371 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-28T10:52:50.371 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-03-28T10:52:50.371 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-28T10:52:50.372 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2023-03-28T10:52:50.372 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-28T10:52:50.372 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-28T10:52:50.372 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-03-28T10:52:50.372 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-28T10:52:50.372 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-28T10:52:50.373 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-28T10:52:50.373 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-28T10:52:50.374 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-03-28T10:52:50.399 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-03-28T10:52:50.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-03-28T10:52:50.550 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-03-28T10:52:50.608 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-03-28T10:52:50.608 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-03-28T10:52:50.608 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-03-28T10:52:50.608 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-03-28T10:52:50.608 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-03-28T10:52:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-03-28T10:52:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-28T10:52:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-03-28T10:52:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-28T10:52:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-03-28T10:52:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-28T10:52:50.609 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-28T10:52:50.610 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-03-28T10:52:50.610 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-28T10:52:50.610 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-28T10:52:50.610 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-28T10:52:50.610 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-28T10:52:50.611 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-03-28T10:52:50.633 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-03-28T10:52:50.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-03-28T10:52:50.893 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-03-28T10:52:50.950 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-03-28T10:52:50.950 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)" 2023-03-28T10:52:50.950 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-03-28T10:52:50.950 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-03-28T10:52:50.950 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6" 2023-03-28T10:52:50.951 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-03-28T10:52:50.951 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-28T10:52:50.951 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-03-28T10:52:50.951 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-28T10:52:50.951 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-03-28T10:52:50.951 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-28T10:52:50.952 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-28T10:52:50.952 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-03-28T10:52:50.952 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-28T10:52:50.952 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-28T10:52:50.952 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-28T10:52:50.953 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-28T10:52:50.953 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-03-28T10:52:51.117 INFO:teuthology.dispatcher.supervisor:Running job 7222250 2023-03-28T10:52:51.118 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_main/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-03-28_00:15:34-fs-wip-yuri5-testing-2023-03-27-1315-distro-default-smithi/7222250 --name yuriw-2023-03-28_00:15:34-fs-wip-yuri5-testing-2023-03-27-1315-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/yuriw-2023-03-28_00:15:34-fs-wip-yuri5-testing-2023-03-27-1315-distro-default-smithi/7222250/orig.config.yaml 2023-03-28T10:52:51.123 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-03-28_00:15:34-fs-wip-yuri5-testing-2023-03-27-1315-distro-default-smithi/7222250 2023-03-28T10:52:51.124 INFO:teuthology.dispatcher.supervisor:Job PID: 13855 2023-03-28T10:52:51.124 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-03-28T22:53:15.700 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-03-28T22:53:15.881 INFO:teuthology.kill:Killing Pids: {13855} 2023-03-28T22:53:17.259 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-03-28T22:53:17.261 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-03-28T22:53:17.262 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-03-28T22:53:17.262 INFO:teuthology.misc:Compressing logs... 2023-03-28T22:53:17.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-03-28T22:53:17.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-03-28T22:53:17.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-03-28T22:53:18.098 INFO:teuthology.misc:Compressing logs... 2023-03-28T22:53:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-28T22:53:18.445 INFO:teuthology.misc:Compressing logs... 2023-03-28T22:54:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-03-28T22:54:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.g.log: file size changed while zipping 2023-03-28T22:54:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.a.log: file size changed while zipping 2023-03-28T22:54:35.583 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-03-28T22:54:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2023-03-28T22:54:37.798 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2023-03-28T22:54:38.516 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.e.log: file size changed while zipping 2023-03-28T22:55:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-03-28T22:55:30.966 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-03-28T22:55:32.057 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.f.log: file size changed while zipping 2023-03-28T22:55:33.150 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.c.log: file size changed while zipping 2023-03-28T22:55:34.408 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.i.log: file size changed while zipping 2023-03-28T22:55:48.308 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2023-03-28T22:55:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-03-28T22:55:49.753 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.l.log: file size changed while zipping 2023-03-28T22:56:36.839 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-03-28T22:56:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-03-28T22:56:44.261 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mgr.x.log: file size changed while zipping 2023-03-28T22:56:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.k.log: file size changed while zipping 2023-03-28T22:57:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-03-28T22:58:08.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-osd.9.log: file size changed while zipping 2023-03-28T22:58:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-03-28T22:58:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2023-03-28T22:58:41.588 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/25282c3a-cd58-11ed-9afe-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-03-28T23:01:21.979 INFO:teuthology.kill:No teuthology processes running 2023-03-28T23:01:22.890 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi072', 'smithi097'] 2023-03-28T23:01:23.514 INFO:teuthology.kill:2023-03-28 23:01:23,514.514 INFO:teuthology.nuke:targets: 2023-03-28T23:01:23.515 INFO:teuthology.kill: smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-28T23:01:23.515 INFO:teuthology.kill: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= 2023-03-28T23:01:23.516 INFO:teuthology.kill: smithi097.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-28T23:01:23.516 INFO:teuthology.kill:2023-03-28 23:01:23,514.514 INFO:teuthology.nuke:Checking targets against current locks 2023-03-28T23:01:23.573 INFO:teuthology.kill:2023-03-28 23:01:23,572.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-28T23:01:23.601 INFO:teuthology.kill:2023-03-28 23:01:23,601.601 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-28T23:01:23.625 INFO:teuthology.kill:2023-03-28 23:01:23,625.625 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-28T23:01:23.657 INFO:teuthology.kill:2023-03-28 23:01:23,657.657 INFO:teuthology.orchestra.console:Power off smithi002 2023-03-28T23:01:23.703 INFO:teuthology.kill:2023-03-28 23:01:23,703.703 INFO:teuthology.orchestra.console:Power off smithi072 2023-03-28T23:01:23.745 INFO:teuthology.kill:2023-03-28 23:01:23,745.745 INFO:teuthology.orchestra.console:Power off smithi097 2023-03-28T23:01:32.077 INFO:teuthology.kill:2023-03-28 23:01:32,076.076 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-03-28T23:01:32.238 INFO:teuthology.kill:2023-03-28 23:01:32,238.238 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-03-28T23:01:36.163 INFO:teuthology.kill:2023-03-28 23:01:36,163.163 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-03-28T23:01:36.218 INFO:teuthology.kill:2023-03-28 23:01:36,218.218 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-03-28T23:01:36.322 INFO:teuthology.kill:2023-03-28 23:01:36,322.322 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-03-28T23:01:36.374 INFO:teuthology.kill:2023-03-28 23:01:36,374.374 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-03-28T23:03:36.713 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-03-28T23:03:36.852 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi002 but it was locked by another job: /home/teuthworker/archive/zack-2023-03-28_19:56:10-powercycle-main-distro-default-smithi/7223747 2023-03-28T23:03:36.852 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi072 but it was locked by another job: /home/teuthworker/archive/zack-2023-03-28_19:56:10-powercycle-main-distro-default-smithi/7223747 2023-03-28T23:03:36.852 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi097 but it was locked by another job: /home/teuthworker/archive/zack-2023-03-28_19:56:10-powercycle-main-distro-default-smithi/7223747