2023-05-06T02:31:05.784 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-06T02:31:05.957 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-05-06T02:31:05.958 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-05-06T02:31:05.959 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-05-06T02:31:05.980 INFO:teuthology.lock.ops:Node 'smithi110.front.sepia.ceph.com' reimaging is complete 2023-05-06T02:31:05.981 INFO:teuthology.lock.ops:Start node 'smithi202.front.sepia.ceph.com' reimaging 2023-05-06T02:31:05.981 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: reset os type and version on server 2023-05-06T02:31:05.981 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-05-06T02:31:06.005 INFO:teuthology.lock.ops:Node 'smithi202.front.sepia.ceph.com' reimaging is complete 2023-05-06T02:31:06.005 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-05-06T02:31:06.006 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-05-06T02:31:06.006 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-05-06T02:31:06.032 INFO:teuthology.lock.ops:Node 'smithi203.front.sepia.ceph.com' reimaging is complete 2023-05-06T02:31:06.144 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.6 2023-05-06T02:31:06.169 INFO:teuthology.provision.fog.smithi202:Scheduling deploy of rhel 8.6 2023-05-06T02:31:06.192 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of rhel 8.6 2023-05-06T02:31:06.339 INFO:teuthology.orchestra.console:Power off smithi110 2023-05-06T02:31:06.356 INFO:teuthology.orchestra.console:Power off smithi202 2023-05-06T02:31:06.395 INFO:teuthology.orchestra.console:Power off smithi203 2023-05-06T02:31:06.488 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-05-06T02:31:06.506 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-05-06T02:31:06.535 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-05-06T02:31:06.589 INFO:teuthology.orchestra.console:Power on smithi110 2023-05-06T02:31:06.606 INFO:teuthology.orchestra.console:Power on smithi202 2023-05-06T02:31:06.637 INFO:teuthology.orchestra.console:Power on smithi203 2023-05-06T02:31:10.857 INFO:teuthology.orchestra.console:Power on for smithi202 completed 2023-05-06T02:31:10.888 INFO:teuthology.orchestra.console:Power on for smithi203 completed 2023-05-06T02:31:10.959 INFO:teuthology.provision.fog.smithi202:Waiting for deploy to finish 2023-05-06T02:31:10.989 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-05-06T02:31:14.962 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2023-05-06T02:31:15.064 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-05-06T02:33:59.760 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-05-06T02:34:03.792 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-05-06T02:34:08.816 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-05-06T02:34:12.848 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-05-06T02:34:14.800 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-05-06T02:34:17.872 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-05-06T02:34:21.904 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-05-06T02:34:23.856 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-05-06T02:34:26.928 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-05-06T02:34:30.960 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-05-06T02:34:32.912 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-05-06T02:34:35.984 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-05-06T02:34:40.016 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-05-06T02:34:41.972 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-05-06T02:34:49.076 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-05-06T02:34:51.056 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-05-06T02:34:58.160 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-05-06T02:35:00.112 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-05-06T02:35:09.168 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-05-06T02:35:41.993 WARNING:teuthology.provision.fog:timed out 2023-05-06T02:35:48.233 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-06T02:35:48.557 INFO:teuthology.provision.fog.smithi202:Node is ready 2023-05-06T02:35:48.577 INFO:teuthology.orchestra.run.smithi202.stdout:smithi202.front.sepia.ceph.com 2023-05-06T02:35:48.636 INFO:teuthology.orchestra.run.smithi202.stdout:172.21.15.202 smithi202.front.sepia.ceph.com smithi202 2023-05-06T02:35:49.001 INFO:teuthology.provision.fog.smithi202:Deploy complete! 2023-05-06T02:36:04.181 WARNING:teuthology.provision.fog:timed out 2023-05-06T02:36:10.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-06T02:36:10.774 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-05-06T02:36:10.791 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-05-06T02:36:10.849 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-05-06T02:36:11.203 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-05-06T02:36:15.178 WARNING:teuthology.provision.fog:timed out 2023-05-06T02:36:21.503 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-06T02:36:21.804 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-05-06T02:36:21.821 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-05-06T02:36:21.880 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-05-06T02:36:22.237 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-05-06T02:36:22.442 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-05-06T02:36:22.443 INFO:teuthology.lock.ops:Checking smithi202.front.sepia.ceph.com 2023-05-06T02:36:22.443 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-05-06T02:36:22.445 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-05-06T02:36:22.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-05-06T02:36:22.694 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-05-06T02:36:22.751 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-05-06T02:36:22.752 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)" 2023-05-06T02:36:22.752 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-05-06T02:36:22.752 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-05-06T02:36:22.752 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6" 2023-05-06T02:36:22.752 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-05-06T02:36:22.752 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-06T02:36:22.753 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-05-06T02:36:22.753 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-06T02:36:22.753 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-05-06T02:36:22.753 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-06T02:36:22.753 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-06T02:36:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-05-06T02:36:22.753 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-06T02:36:22.754 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-06T02:36:22.754 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-06T02:36:22.754 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-06T02:36:22.755 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-05-06T02:36:22.787 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: set os type and version on server 2023-05-06T02:36:22.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com' 2023-05-06T02:36:23.050 INFO:teuthology.orchestra.run.smithi202.stdout:x86_64 2023-05-06T02:36:23.110 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="Red Hat Enterprise Linux" 2023-05-06T02:36:23.110 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8.6 (Ootpa)" 2023-05-06T02:36:23.110 INFO:teuthology.orchestra.run.smithi202.stdout:ID="rhel" 2023-05-06T02:36:23.111 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="fedora" 2023-05-06T02:36:23.111 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8.6" 2023-05-06T02:36:23.111 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8" 2023-05-06T02:36:23.111 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-06T02:36:23.111 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31" 2023-05-06T02:36:23.111 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-06T02:36:23.111 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://www.redhat.com/" 2023-05-06T02:36:23.112 INFO:teuthology.orchestra.run.smithi202.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-06T02:36:23.112 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-06T02:36:23.112 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-05-06T02:36:23.112 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-06T02:36:23.112 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-06T02:36:23.112 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-06T02:36:23.113 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-06T02:36:23.113 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-05-06T02:36:23.136 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-05-06T02:36:23.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-05-06T02:36:23.326 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-05-06T02:36:23.383 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux" 2023-05-06T02:36:23.383 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.6 (Ootpa)" 2023-05-06T02:36:23.384 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel" 2023-05-06T02:36:23.384 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora" 2023-05-06T02:36:23.384 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.6" 2023-05-06T02:36:23.384 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-05-06T02:36:23.384 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-06T02:36:23.384 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-05-06T02:36:23.384 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-06T02:36:23.385 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/" 2023-05-06T02:36:23.385 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-06T02:36:23.385 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-06T02:36:23.385 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-05-06T02:36:23.385 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-06T02:36:23.385 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-06T02:36:23.385 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-06T02:36:23.386 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-06T02:36:23.386 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-05-06T02:36:23.499 INFO:teuthology.dispatcher.supervisor:Running job 7262211 2023-05-06T02:36:23.499 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/7262211 --name pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/7262211/orig.config.yaml 2023-05-06T02:36:23.503 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/7262211 2023-05-06T02:36:23.503 INFO:teuthology.dispatcher.supervisor:Job PID: 27190 2023-05-06T02:36:23.504 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-05-06T14:37:18.024 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-05-06T14:37:18.208 INFO:teuthology.kill:Killing Pids: {27190} 2023-05-06T14:37:19.070 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-05-06T14:37:19.071 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-05-06T14:37:19.072 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-05-06T14:37:19.072 INFO:teuthology.misc:Compressing logs... 2023-05-06T14:37:19.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-05-06T14:37:19.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com' 2023-05-06T14:37:19.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-05-06T14:37:19.967 INFO:teuthology.misc:Compressing logs... 2023-05-06T14:37:20.008 INFO:teuthology.orchestra.run.smithi202.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-06T14:37:20.014 INFO:teuthology.orchestra.run.smithi202.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-06T14:37:20.029 INFO:teuthology.orchestra.run.smithi202.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 76.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-06T14:37:20.037 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-06T14:37:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-06T14:37:20.056 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-06T14:37:20.058 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-06T14:37:20.059 INFO:teuthology.orchestra.run.smithi203.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 78.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-06T14:37:20.094 INFO:teuthology.orchestra.run.smithi110.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 88.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-06T14:37:20.132 INFO:teuthology.orchestra.run.smithi202.stderr: 89.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-06T14:37:20.158 INFO:teuthology.orchestra.run.smithi203.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 89.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-06T14:37:20.206 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-06T14:37:20.365 INFO:teuthology.misc:Compressing logs... 2023-05-06T14:37:20.395 INFO:teuthology.orchestra.run.smithi202.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.10.log 2023-05-06T14:37:20.396 INFO:teuthology.orchestra.run.smithi202.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.h.log 2023-05-06T14:37:20.396 INFO:teuthology.orchestra.run.smithi202.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.e.log 2023-05-06T14:37:20.397 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.10.log: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.4.log 2023-05-06T14:37:20.397 INFO:teuthology.orchestra.run.smithi202.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.1.log 2023-05-06T14:37:20.397 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.e.log: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.k.log 2023-05-06T14:37:20.397 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log 2023-05-06T14:37:20.398 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.7.log 2023-05-06T14:37:20.398 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.b.log 2023-05-06T14:37:20.398 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.b.log 2023-05-06T14:37:20.399 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.y.log 2023-05-06T14:37:20.399 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-06T14:37:20.427 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.0.log 2023-05-06T14:37:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.g.log 2023-05-06T14:37:20.429 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.a.log 2023-05-06T14:37:20.430 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.6.log 2023-05-06T14:37:20.431 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.3.log 2023-05-06T14:37:20.432 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.d.log 2023-05-06T14:37:20.432 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.x.log 2023-05-06T14:37:20.433 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.9.log 2023-05-06T14:37:20.434 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.5.log 2023-05-06T14:37:20.434 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.2.log 2023-05-06T14:37:20.434 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.11.log 2023-05-06T14:37:20.435 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log 2023-05-06T14:37:20.437 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.5.log: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.z.log 2023-05-06T14:37:20.437 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.8.log 2023-05-06T14:37:20.437 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.f.log 2023-05-06T14:37:20.437 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.c.log 2023-05-06T14:37:20.437 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.i.log 2023-05-06T14:37:20.437 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.c.log 2023-05-06T14:37:20.438 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log 2023-05-06T14:37:20.438 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.l.log 2023-05-06T14:37:20.438 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-06T14:37:20.439 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.j.log 2023-05-06T14:37:20.439 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.a.log 2023-05-06T14:37:20.439 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-06T14:37:20.439 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-05-06T14:37:20.441 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-05-06T14:37:20.538 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.l.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.l.log.gz 2023-05-06T14:37:20.561 INFO:teuthology.orchestra.run.smithi203.stderr: 94.5% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.z.log.gz 2023-05-06T14:37:20.717 INFO:teuthology.orchestra.run.smithi202.stderr:/var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.y.log: /var/log/ceph/cephadm.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-06T14:37:20.877 INFO:teuthology.orchestra.run.smithi203.stderr: 93.5% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log.gz 2023-05-06T14:37:21.223 INFO:teuthology.orchestra.run.smithi110.stderr: 93.2% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log.gz 2023-05-06T14:37:21.242 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2023-05-06T14:37:21.242 INFO:teuthology.orchestra.run.smithi202.stderr: 94.5% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.y.log.gz 2023-05-06T14:37:21.342 INFO:teuthology.orchestra.run.smithi110.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-06T14:37:21.411 INFO:teuthology.orchestra.run.smithi202.stderr: 93.5% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-volume.log.gz 2023-05-06T14:37:21.594 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.e.log: file size changed while zipping 2023-05-06T14:37:21.595 INFO:teuthology.orchestra.run.smithi202.stderr: 94.3% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.e.log.gz 2023-05-06T14:37:22.071 INFO:teuthology.orchestra.run.smithi203.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-06T14:37:22.079 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.k.log: file size changed while zipping 2023-05-06T14:37:22.080 INFO:teuthology.orchestra.run.smithi202.stderr: 94.4% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.k.log.gz 2023-05-06T14:37:22.260 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.g.log: file size changed while zipping 2023-05-06T14:37:22.260 INFO:teuthology.orchestra.run.smithi110.stderr: 94.7% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.g.log.gz 2023-05-06T14:37:22.483 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.d.log: file size changed while zipping 2023-05-06T14:37:22.484 INFO:teuthology.orchestra.run.smithi110.stderr: 94.6% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.d.log.gz 2023-05-06T14:37:22.554 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.f.log: file size changed while zipping 2023-05-06T14:37:22.555 INFO:teuthology.orchestra.run.smithi203.stderr: 94.8% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.f.log.gz 2023-05-06T14:37:22.850 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.j.log: file size changed while zipping 2023-05-06T14:37:22.850 INFO:teuthology.orchestra.run.smithi110.stderr: 94.2% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.j.log.gz 2023-05-06T14:37:28.799 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.c.log: file size changed while zipping 2023-05-06T14:37:28.800 INFO:teuthology.orchestra.run.smithi203.stderr: 93.5% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.c.log.gz 2023-05-06T14:37:31.741 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2023-05-06T14:37:31.741 INFO:teuthology.orchestra.run.smithi203.stderr: 92.2% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.c.log.gz 2023-05-06T14:37:32.754 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.i.log: file size changed while zipping 2023-05-06T14:37:32.755 INFO:teuthology.orchestra.run.smithi203.stderr: 95.3% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.i.log.gz 2023-05-06T14:37:36.520 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.x.log: file size changed while zipping 2023-05-06T14:37:36.520 INFO:teuthology.orchestra.run.smithi110.stderr: 90.1% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mgr.x.log.gz 2023-05-06T14:37:47.132 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2023-05-06T14:37:47.132 INFO:teuthology.orchestra.run.smithi202.stderr: 93.3% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.h.log.gz 2023-05-06T14:38:02.013 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-05-06T14:38:02.013 INFO:teuthology.orchestra.run.smithi202.stderr: 92.1% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.b.log.gz 2023-05-06T14:38:05.553 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2023-05-06T14:38:05.553 INFO:teuthology.orchestra.run.smithi203.stderr: 92.4% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.11.log.gz 2023-05-06T14:38:10.439 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-05-06T14:38:10.440 INFO:teuthology.orchestra.run.smithi203.stderr: 92.3% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.2.log.gz 2023-05-06T14:38:12.684 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-05-06T14:38:12.685 INFO:teuthology.orchestra.run.smithi203.stderr: 92.2% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.8.log.gz 2023-05-06T14:38:20.872 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-05-06T14:38:20.872 INFO:teuthology.orchestra.run.smithi203.stderr: 92.2% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.5.log.gz 2023-05-06T14:38:43.542 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-05-06T14:38:43.542 INFO:teuthology.orchestra.run.smithi110.stderr: 90.1% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mon.a.log.gz 2023-05-06T14:38:44.513 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.a.log: file size changed while zipping 2023-05-06T14:38:44.513 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.a.log.gz 2023-05-06T14:39:07.329 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-05-06T14:39:07.330 INFO:teuthology.orchestra.run.smithi202.stderr: 92.2% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.1.log.gz 2023-05-06T14:39:19.356 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-05-06T14:39:19.357 INFO:teuthology.orchestra.run.smithi110.stderr: 92.4% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.0.log.gz 2023-05-06T14:39:20.611 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-05-06T14:39:20.612 INFO:teuthology.orchestra.run.smithi202.stderr: 92.3% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.7.log.gz 2023-05-06T14:39:35.683 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-05-06T14:39:35.683 INFO:teuthology.orchestra.run.smithi202.stderr: 92.0% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.10.log.gz 2023-05-06T14:39:40.057 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-05-06T14:39:40.057 INFO:teuthology.orchestra.run.smithi202.stderr: 92.3% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.4.log.gz 2023-05-06T14:39:42.652 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-05-06T14:39:42.652 INFO:teuthology.orchestra.run.smithi110.stderr: 92.5% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.6.log.gz 2023-05-06T14:39:52.750 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-05-06T14:39:52.750 INFO:teuthology.orchestra.run.smithi110.stderr: 92.4% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.3.log.gz 2023-05-06T14:39:56.211 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.9.log: file size changed while zipping 2023-05-06T14:39:56.211 INFO:teuthology.orchestra.run.smithi110.stderr: 92.2% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-osd.9.log.gz 2023-05-06T14:40:48.649 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2023-05-06T14:40:48.649 INFO:teuthology.orchestra.run.smithi202.stderr: 95.0% -- replaced with /var/log/ceph/b412c854-ebb9-11ed-9b01-001a4aab830c/ceph-mds.b.log.gz 2023-05-06T14:42:24.885 INFO:teuthology.kill:No teuthology processes running 2023-05-06T14:42:25.729 INFO:teuthology.kill:Nuking machines: ['smithi110', 'smithi202', 'smithi203'] 2023-05-06T14:42:26.351 INFO:teuthology.kill:2023-05-06 14:42:26,350.350 INFO:teuthology.nuke:targets: 2023-05-06T14:42:26.351 INFO:teuthology.kill: smithi110.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-05-06T14:42:26.352 INFO:teuthology.kill: smithi202.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-05-06T14:42:26.352 INFO:teuthology.kill: smithi203.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-05-06T14:42:26.352 INFO:teuthology.kill:2023-05-06 14:42:26,350.350 INFO:teuthology.nuke:Checking targets against current locks 2023-05-06T14:42:26.413 INFO:teuthology.kill:2023-05-06 14:42:26,413.413 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-06T14:42:26.436 INFO:teuthology.kill:2023-05-06 14:42:26,436.436 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-06T14:42:26.468 INFO:teuthology.kill:2023-05-06 14:42:26,468.468 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-06T14:42:26.497 INFO:teuthology.kill:2023-05-06 14:42:26,497.497 INFO:teuthology.orchestra.console:Power off smithi110 2023-05-06T14:42:26.534 INFO:teuthology.kill:2023-05-06 14:42:26,533.533 INFO:teuthology.orchestra.console:Power off smithi202 2023-05-06T14:42:26.576 INFO:teuthology.kill:2023-05-06 14:42:26,575.575 INFO:teuthology.orchestra.console:Power off smithi203 2023-05-06T14:42:34.908 INFO:teuthology.kill:2023-05-06 14:42:34,908.908 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-05-06T14:42:34.946 INFO:teuthology.kill:2023-05-06 14:42:34,945.945 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-05-06T14:42:35.055 INFO:teuthology.kill:2023-05-06 14:42:35,055.055 INFO:teuthology.lock.ops:unlocked: smithi202.front.sepia.ceph.com 2023-05-06T14:42:35.098 INFO:teuthology.kill:2023-05-06 14:42:35,097.097 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com 2023-05-06T14:42:38.986 INFO:teuthology.kill:2023-05-06 14:42:38,986.986 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-05-06T14:42:39.148 INFO:teuthology.kill:2023-05-06 14:42:39,148.148 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-05-06T14:44:39.527 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-05-06T14:44:39.691 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi110 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263467 2023-05-06T14:44:39.691 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi202 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263469 2023-05-06T14:44:39.692 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi203 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263467