2023-03-01T03:02:50.251 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8
2023-03-01T03:02:50.431 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging
2023-03-01T03:02:50.432 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server
2023-03-01T03:02:50.432 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-03-01T03:02:50.460 INFO:teuthology.lock.ops:Node 'smithi038.front.sepia.ceph.com' reimaging is complete
2023-03-01T03:02:50.461 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging
2023-03-01T03:02:50.461 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server
2023-03-01T03:02:50.461 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2023-03-01T03:02:50.485 INFO:teuthology.lock.ops:Node 'smithi047.front.sepia.ceph.com' reimaging is complete
2023-03-01T03:02:50.485 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-03-01T03:02:50.485 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-03-01T03:02:50.486 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-03-01T03:02:50.501 INFO:teuthology.lock.ops:Node 'smithi093.front.sepia.ceph.com' reimaging is complete
2023-03-01T03:02:50.613 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.6
2023-03-01T03:02:50.648 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6
2023-03-01T03:02:50.652 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of rhel 8.6
2023-03-01T03:02:50.859 INFO:teuthology.orchestra.console:Power off smithi047
2023-03-01T03:02:50.872 INFO:teuthology.orchestra.console:Power off smithi038
2023-03-01T03:02:50.884 INFO:teuthology.orchestra.console:Power off smithi093
2023-03-01T03:02:59.250 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2023-03-01T03:02:59.351 INFO:teuthology.orchestra.console:Power on smithi038
2023-03-01T03:03:03.355 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2023-03-01T03:03:03.366 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-03-01T03:03:03.457 INFO:teuthology.orchestra.console:Power on smithi047
2023-03-01T03:03:03.467 INFO:teuthology.orchestra.console:Power on smithi093
2023-03-01T03:03:07.712 INFO:teuthology.orchestra.console:Power on for smithi047 completed
2023-03-01T03:03:07.719 INFO:teuthology.orchestra.console:Power on for smithi038 completed
2023-03-01T03:03:07.814 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish
2023-03-01T03:03:07.821 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish
2023-03-01T03:03:11.840 INFO:teuthology.orchestra.console:Power on for smithi093 completed
2023-03-01T03:03:11.941 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-03-01T03:05:38.640 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-03-01T03:05:39.759 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-03-01T03:05:40.837 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-03-01T03:05:56.997 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47
2023-03-01T03:06:06.053 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47
2023-03-01T03:06:15.109 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47
2023-03-01T03:06:16.201 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-03-01T03:06:24.165 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47
2023-03-01T03:06:25.353 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-03-01T03:06:34.405 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-03-01T03:06:41.840 WARNING:teuthology.provision.fog:timed out
2023-03-01T03:06:43.461 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-03-01T03:07:06.377 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-03-01T03:07:15.794 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-01T03:07:16.146 INFO:teuthology.provision.fog.smithi038:Node is ready
2023-03-01T03:07:16.168 INFO:teuthology.orchestra.run.smithi038.stdout:smithi022
2023-03-01T03:07:16.225 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-03-01T03:07:16.580 INFO:teuthology.provision.fog.smithi038:Deploy complete!
2023-03-01T03:07:30.168 WARNING:teuthology.provision.fog:timed out
2023-03-01T03:07:36.516 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-01T03:07:36.817 INFO:teuthology.provision.fog.smithi047:Node is ready
2023-03-01T03:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com
2023-03-01T03:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047
2023-03-01T03:07:37.098 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet
2023-03-01T03:07:37.099 ERROR:paramiko.transport:Traceback (most recent call last):
2023-03-01T03:07:37.100 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
2023-03-01T03:07:37.100 ERROR:paramiko.transport:    ptype, m = self.packetizer.read_message()
2023-03-01T03:07:37.100 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
2023-03-01T03:07:37.100 ERROR:paramiko.transport:    header = self.read_all(self.__block_size_in, check_rekey=True)
2023-03-01T03:07:37.100 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
2023-03-01T03:07:37.101 ERROR:paramiko.transport:    x = self.__socket.recv(n)
2023-03-01T03:07:37.101 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 663, in recv
2023-03-01T03:07:37.101 ERROR:paramiko.transport:    self._wait(self._read_event)
2023-03-01T03:07:37.101 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-03-01T03:07:37.102 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-03-01T03:07:37.102 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet
2023-03-01T03:07:37.102 ERROR:paramiko.transport:
2023-03-01T03:07:37.245 INFO:teuthology.provision.fog.smithi047:Deploy complete!
2023-03-01T03:07:49.463 WARNING:teuthology.provision.fog:timed out
2023-03-01T03:07:55.803 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-01T03:07:56.080 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-03-01T03:07:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093
2023-03-01T03:07:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-03-01T03:07:56.496 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-03-01T03:07:56.729 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com
2023-03-01T03:07:56.730 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-01T03:07:56.754 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com
2023-03-01T03:07:56.754 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-01T03:07:56.779 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-03-01T03:07:56.779 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-01T03:07:56.805 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server
2023-03-01T03:07:56.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-03-01T03:07:57.066 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64
2023-03-01T03:07:57.124 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux"
2023-03-01T03:07:57.125 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)"
2023-03-01T03:07:57.125 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel"
2023-03-01T03:07:57.125 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora"
2023-03-01T03:07:57.125 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6"
2023-03-01T03:07:57.126 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-03-01T03:07:57.126 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-01T03:07:57.126 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-03-01T03:07:57.126 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-01T03:07:57.127 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/"
2023-03-01T03:07:57.127 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-01T03:07:57.127 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-01T03:07:57.127 INFO:teuthology.orchestra.run.smithi038.stdout:
2023-03-01T03:07:57.127 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-01T03:07:57.127 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-01T03:07:57.128 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-01T03:07:57.128 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-01T03:07:57.129 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-03-01T03:07:57.154 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server
2023-03-01T03:07:57.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2023-03-01T03:07:57.417 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64
2023-03-01T03:07:57.476 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux"
2023-03-01T03:07:57.476 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)"
2023-03-01T03:07:57.476 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel"
2023-03-01T03:07:57.476 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora"
2023-03-01T03:07:57.477 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6"
2023-03-01T03:07:57.477 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8"
2023-03-01T03:07:57.477 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-01T03:07:57.477 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31"
2023-03-01T03:07:57.477 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-01T03:07:57.477 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/"
2023-03-01T03:07:57.477 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-01T03:07:57.478 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-01T03:07:57.478 INFO:teuthology.orchestra.run.smithi047.stdout:
2023-03-01T03:07:57.478 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-01T03:07:57.478 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-01T03:07:57.478 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-01T03:07:57.478 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-01T03:07:57.479 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2023-03-01T03:07:57.504 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-03-01T03:07:57.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-03-01T03:07:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-03-01T03:07:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2023-03-01T03:07:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2023-03-01T03:07:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2023-03-01T03:07:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2023-03-01T03:07:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2023-03-01T03:07:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-03-01T03:07:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-01T03:07:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-03-01T03:07:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-01T03:07:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2023-03-01T03:07:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-01T03:07:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-01T03:07:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:
2023-03-01T03:07:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-01T03:07:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-01T03:07:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-01T03:07:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-01T03:07:57.759 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-03-01T03:07:57.878 INFO:teuthology.dispatcher.supervisor:Running job 7190030
2023-03-01T03:07:57.879 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-01_02:28:49-fs-wip-vshankar-testing-20230228.105516-testing-default-smithi/7190030 --name vshankar-2023-03-01_02:28:49-fs-wip-vshankar-testing-20230228.105516-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/vshankar-2023-03-01_02:28:49-fs-wip-vshankar-testing-20230228.105516-testing-default-smithi/7190030/orig.config.yaml
2023-03-01T03:07:57.882 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-01_02:28:49-fs-wip-vshankar-testing-20230228.105516-testing-default-smithi/7190030
2023-03-01T03:07:57.883 INFO:teuthology.dispatcher.supervisor:Job PID: 375
2023-03-01T03:07:57.883 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-01T15:08:22.337 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-01T15:08:22.520 INFO:teuthology.kill:Killing Pids: {375}
2023-03-01T15:08:23.321 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0']
2023-03-01T15:08:23.322 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10']
2023-03-01T15:08:23.323 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']
2023-03-01T15:08:23.323 INFO:teuthology.misc:Compressing logs...
2023-03-01T15:08:23.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-03-01T15:08:23.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2023-03-01T15:08:23.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-03-01T15:08:24.391 INFO:teuthology.misc:Compressing logs...
2023-03-01T15:08:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-01T15:08:24.672 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-01T15:08:24.903 INFO:teuthology.misc:Compressing logs...
2023-03-01T15:10:08.719 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.10.log: file size changed while zipping
2023-03-01T15:10:12.730 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mds.e.log: file size changed while zipping
2023-03-01T15:10:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2023-03-01T15:10:17.894 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mds.g.log: file size changed while zipping
2023-03-01T15:12:02.413 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2023-03-01T15:12:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.8.log: file size changed while zipping
2023-03-01T15:13:39.315 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2023-03-01T15:13:41.169 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mds.k.log: file size changed while zipping
2023-03-01T15:15:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2023-03-01T15:15:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2023-03-01T17:01:21.224 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mds.a.log: file size changed while zipping
2023-03-01T17:03:40.465 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2023-03-01T17:06:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2023-03-01T17:06:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mgr.x.log: file size changed while zipping
2023-03-01T17:09:18.288 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-osd.9.log: file size changed while zipping
2023-03-01T17:10:15.391 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2023-03-01T17:10:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1a3c7a38-b7e1-11ed-9ae9-001a4aab830c/ceph-mds.b.log: file size changed while zipping
2023-03-01T17:29:31.788 INFO:teuthology.kill:No teuthology processes running
2023-03-01T17:29:32.586 INFO:teuthology.kill:Nuking machines: ['smithi038', 'smithi047', 'smithi093']
2023-03-01T17:29:33.249 INFO:teuthology.kill:2023-03-01 17:29:33,249.249 INFO:teuthology.nuke:targets:
2023-03-01T17:29:33.250 INFO:teuthology.kill:  smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-03-01T17:29:33.251 INFO:teuthology.kill:  smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-03-01T17:29:33.251 INFO:teuthology.kill:  smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=
2023-03-01T17:29:33.251 INFO:teuthology.kill:2023-03-01 17:29:33,249.249 INFO:teuthology.nuke:Checking targets against current locks
2023-03-01T17:29:33.306 INFO:teuthology.kill:2023-03-01 17:29:33,306.306 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-01T17:29:33.338 INFO:teuthology.kill:2023-03-01 17:29:33,337.337 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-01T17:29:33.359 INFO:teuthology.kill:2023-03-01 17:29:33,358.358 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-01T17:29:33.389 INFO:teuthology.kill:2023-03-01 17:29:33,389.389 INFO:teuthology.orchestra.console:Power off smithi038
2023-03-01T17:29:33.409 INFO:teuthology.kill:2023-03-01 17:29:33,409.409 INFO:teuthology.orchestra.console:Power off smithi047
2023-03-01T17:29:33.475 INFO:teuthology.kill:2023-03-01 17:29:33,475.475 INFO:teuthology.orchestra.console:Power off smithi093
2023-03-01T17:29:41.772 INFO:teuthology.kill:2023-03-01 17:29:41,771.771 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2023-03-01T17:29:41.843 INFO:teuthology.kill:2023-03-01 17:29:41,843.843 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-03-01T17:29:41.937 INFO:teuthology.kill:2023-03-01 17:29:41,936.936 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com
2023-03-01T17:29:41.995 INFO:teuthology.kill:2023-03-01 17:29:41,995.995 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-03-01T17:29:45.890 INFO:teuthology.kill:2023-03-01 17:29:45,890.890 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2023-03-01T17:29:46.045 INFO:teuthology.kill:2023-03-01 17:29:46,044.044 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com
2023-03-01T17:31:46.285 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-01T17:31:46.458 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi038 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-28_22:47:06-rados-wip-yuri7-testing-2023-02-27-1105-distro-default-smithi/7189770
2023-03-01T17:31:46.459 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi047 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-28_22:47:06-rados-wip-yuri7-testing-2023-02-27-1105-distro-default-smithi/7189769
2023-03-01T17:31:46.459 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi093 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-28_22:47:06-rados-wip-yuri7-testing-2023-02-27-1105-distro-default-smithi/7189769