2023-03-06T13:29:53.314 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05
2023-03-06T13:29:53.497 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging
2023-03-06T13:29:53.498 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server
2023-03-06T13:29:53.498 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2023-03-06T13:29:53.518 INFO:teuthology.lock.ops:Node 'smithi006.front.sepia.ceph.com' reimaging is complete
2023-03-06T13:29:53.518 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2023-03-06T13:29:53.519 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2023-03-06T13:29:53.519 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-03-06T13:29:53.543 INFO:teuthology.lock.ops:Node 'smithi031.front.sepia.ceph.com' reimaging is complete
2023-03-06T13:29:53.543 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2023-03-06T13:29:53.544 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2023-03-06T13:29:53.544 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2023-03-06T13:29:53.568 INFO:teuthology.lock.ops:Node 'smithi032.front.sepia.ceph.com' reimaging is complete
2023-03-06T13:29:53.670 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.6
2023-03-06T13:29:53.693 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6
2023-03-06T13:29:53.712 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6
2023-03-06T13:29:53.889 INFO:teuthology.orchestra.console:Power off smithi006
2023-03-06T13:29:53.907 INFO:teuthology.orchestra.console:Power off smithi031
2023-03-06T13:29:53.942 INFO:teuthology.orchestra.console:Power off smithi032
2023-03-06T13:29:54.037 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2023-03-06T13:29:54.050 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-03-06T13:29:54.085 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2023-03-06T13:29:54.139 INFO:teuthology.orchestra.console:Power on smithi006
2023-03-06T13:29:54.152 INFO:teuthology.orchestra.console:Power on smithi031
2023-03-06T13:29:54.186 INFO:teuthology.orchestra.console:Power on smithi032
2023-03-06T13:30:02.519 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2023-03-06T13:30:02.619 INFO:teuthology.orchestra.console:Power on for smithi006 completed
2023-03-06T13:30:02.620 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2023-03-06T13:30:02.636 INFO:teuthology.orchestra.console:Power on for smithi032 completed
2023-03-06T13:30:02.720 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2023-03-06T13:30:02.736 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2023-03-06T13:32:19.063 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed.
2023-03-06T13:32:20.183 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed.
2023-03-06T13:32:21.259 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed.
2023-03-06T13:32:52.613 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-03-06T13:32:52.614 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-03-06T13:33:01.669 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-03-06T13:33:01.669 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-03-06T13:33:10.725 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-03-06T13:33:10.725 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-03-06T13:33:19.781 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-03-06T13:33:22.262 WARNING:teuthology.provision.fog:timed out
2023-03-06T13:33:46.926 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-06T13:33:47.236 INFO:teuthology.provision.fog.smithi031:Node is ready
2023-03-06T13:33:47.255 INFO:teuthology.orchestra.run.smithi031.stdout:smithi022
2023-03-06T13:33:47.313 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-03-06T13:33:47.677 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2023-03-06T13:34:16.728 WARNING:teuthology.provision.fog:timed out
2023-03-06T13:34:22.944 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-06T13:34:23.234 INFO:teuthology.provision.fog.smithi032:Node is ready
2023-03-06T13:34:23.252 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2023-03-06T13:34:23.311 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2023-03-06T13:34:23.668 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2023-03-06T13:34:25.784 WARNING:teuthology.provision.fog:timed out
2023-03-06T13:34:32.025 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-06T13:34:32.346 INFO:teuthology.provision.fog.smithi006:Node is ready
2023-03-06T13:34:32.365 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2023-03-06T13:34:32.424 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2023-03-06T13:34:32.778 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2023-03-06T13:34:33.016 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2023-03-06T13:34:33.017 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-06T13:34:33.046 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2023-03-06T13:34:33.046 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-06T13:34:33.062 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2023-03-06T13:34:33.062 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-06T13:34:33.080 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2023-03-06T13:34:33.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2023-03-06T13:34:33.226 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2023-03-06T13:34:33.283 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2023-03-06T13:34:33.283 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)"
2023-03-06T13:34:33.283 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2023-03-06T13:34:33.284 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2023-03-06T13:34:33.284 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6"
2023-03-06T13:34:33.284 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2023-03-06T13:34:33.284 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-06T13:34:33.284 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2023-03-06T13:34:33.284 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-06T13:34:33.284 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2023-03-06T13:34:33.285 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-06T13:34:33.285 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-06T13:34:33.285 INFO:teuthology.orchestra.run.smithi006.stdout:
2023-03-06T13:34:33.285 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-06T13:34:33.285 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-06T13:34:33.285 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-06T13:34:33.285 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-06T13:34:33.286 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2023-03-06T13:34:33.312 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2023-03-06T13:34:33.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-03-06T13:34:33.572 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2023-03-06T13:34:33.630 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2023-03-06T13:34:33.630 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2023-03-06T13:34:33.630 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2023-03-06T13:34:33.630 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2023-03-06T13:34:33.630 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-06T13:34:33.631 INFO:teuthology.orchestra.run.smithi031.stdout:
2023-03-06T13:34:33.632 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-06T13:34:33.632 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-06T13:34:33.632 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-06T13:34:33.632 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-06T13:34:33.632 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-03-06T13:34:33.662 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2023-03-06T13:34:33.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2023-03-06T13:34:33.862 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2023-03-06T13:34:33.921 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2023-03-06T13:34:33.922 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)"
2023-03-06T13:34:33.922 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2023-03-06T13:34:33.922 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2023-03-06T13:34:33.923 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6"
2023-03-06T13:34:33.923 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2023-03-06T13:34:33.923 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-06T13:34:33.923 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2023-03-06T13:34:33.924 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-06T13:34:33.924 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2023-03-06T13:34:33.924 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-06T13:34:33.924 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-06T13:34:33.924 INFO:teuthology.orchestra.run.smithi032.stdout:
2023-03-06T13:34:33.925 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-06T13:34:33.925 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-06T13:34:33.925 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-06T13:34:33.925 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-06T13:34:33.926 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2023-03-06T13:34:34.048 INFO:teuthology.dispatcher.supervisor:Running job 7195174
2023-03-06T13:34:34.048 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195174 --name vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195174/orig.config.yaml
2023-03-06T13:34:34.051 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195174
2023-03-06T13:34:34.052 INFO:teuthology.dispatcher.supervisor:Job PID: 1908
2023-03-06T13:34:34.052 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-07T01:34:57.522 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-07T01:34:57.716 INFO:teuthology.kill:Killing Pids: {1908}
2023-03-07T01:34:58.521 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0']
2023-03-07T01:34:58.522 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10']
2023-03-07T01:34:58.522 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']
2023-03-07T01:34:58.523 INFO:teuthology.misc:Compressing logs...
2023-03-07T01:34:58.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2023-03-07T01:34:58.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-03-07T01:34:58.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2023-03-07T01:34:59.306 INFO:teuthology.misc:Compressing logs...
2023-03-07T01:34:59.598 INFO:teuthology.misc:Compressing logs...
2023-03-07T01:35:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mds.g.log: file size changed while zipping
2023-03-07T01:35:19.289 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.10.log: file size changed while zipping
2023-03-07T01:35:22.511 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2023-03-07T01:35:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2023-03-07T01:35:44.268 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2023-03-07T01:35:45.121 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2023-03-07T01:35:57.825 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2023-03-07T01:36:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mgr.x.log: file size changed while zipping
2023-03-07T01:36:05.772 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.8.log: file size changed while zipping
2023-03-07T01:36:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mds.f.log: file size changed while zipping
2023-03-07T01:36:09.091 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2023-03-07T01:36:10.075 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mds.k.log: file size changed while zipping
2023-03-07T01:36:23.330 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2023-03-07T01:36:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mds.l.log: file size changed while zipping
2023-03-07T01:36:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2023-03-07T01:36:40.767 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2023-03-07T01:36:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/2f589292-bc25-11ed-9aea-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2023-03-07T01:37:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:tar: .: file changed as we read it
2023-03-07T01:37:56.216 INFO:teuthology.kill:No teuthology processes running
2023-03-07T01:37:57.059 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi031', 'smithi032']
2023-03-07T01:37:57.674 INFO:teuthology.kill:2023-03-07 01:37:57,673.673 INFO:teuthology.nuke:targets:
2023-03-07T01:37:57.675 INFO:teuthology.kill:  smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=
2023-03-07T01:37:57.675 INFO:teuthology.kill:  smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=
2023-03-07T01:37:57.675 INFO:teuthology.kill:  smithi032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-03-07T01:37:57.675 INFO:teuthology.kill:2023-03-07 01:37:57,673.673 INFO:teuthology.nuke:Checking targets against current locks
2023-03-07T01:37:57.739 INFO:teuthology.kill:2023-03-07 01:37:57,739.739 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-07T01:37:57.764 INFO:teuthology.kill:2023-03-07 01:37:57,764.764 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-07T01:37:57.796 INFO:teuthology.kill:2023-03-07 01:37:57,795.795 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-07T01:37:57.830 INFO:teuthology.kill:2023-03-07 01:37:57,829.829 INFO:teuthology.orchestra.console:Power off smithi006
2023-03-07T01:37:57.874 INFO:teuthology.kill:2023-03-07 01:37:57,874.874 INFO:teuthology.orchestra.console:Power off smithi031
2023-03-07T01:37:57.889 INFO:teuthology.kill:2023-03-07 01:37:57,889.889 INFO:teuthology.orchestra.console:Power off smithi032
2023-03-07T01:38:06.242 INFO:teuthology.kill:2023-03-07 01:38:06,242.242 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-03-07T01:38:06.411 INFO:teuthology.kill:2023-03-07 01:38:06,411.411 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2023-03-07T01:38:10.345 INFO:teuthology.kill:2023-03-07 01:38:10,345.345 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2023-03-07T01:38:10.371 INFO:teuthology.kill:2023-03-07 01:38:10,371.371 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2023-03-07T01:38:10.502 INFO:teuthology.kill:2023-03-07 01:38:10,502.502 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com
2023-03-07T01:38:10.527 INFO:teuthology.kill:2023-03-07 01:38:10,527.527 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2023-03-07T01:40:10.817 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-07T01:40:10.962 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi006 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-06_23:13:27-rados-wip-yuri6-testing-2023-03-06-1200-quincy-distro-default-smithi/7195678
2023-03-07T01:40:10.963 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi031 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-06_23:13:27-rados-wip-yuri6-testing-2023-03-06-1200-quincy-distro-default-smithi/7195677
2023-03-07T01:40:10.963 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-06_23:13:27-rados-wip-yuri6-testing-2023-03-06-1200-quincy-distro-default-smithi/7195677