2023-03-09T18:53:18.248 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05
2023-03-09T18:53:18.437 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2023-03-09T18:53:18.438 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2023-03-09T18:53:18.439 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-03-09T18:53:18.462 INFO:teuthology.lock.ops:Node 'smithi029.front.sepia.ceph.com' reimaging is complete
2023-03-09T18:53:18.463 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging
2023-03-09T18:53:18.463 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server
2023-03-09T18:53:18.463 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2023-03-09T18:53:18.487 INFO:teuthology.lock.ops:Node 'smithi172.front.sepia.ceph.com' reimaging is complete
2023-03-09T18:53:18.487 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2023-03-09T18:53:18.487 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2023-03-09T18:53:18.487 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-03-09T18:53:18.515 INFO:teuthology.lock.ops:Node 'smithi176.front.sepia.ceph.com' reimaging is complete
2023-03-09T18:53:18.621 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.6
2023-03-09T18:53:18.634 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6
2023-03-09T18:53:18.669 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of rhel 8.6
2023-03-09T18:53:18.836 INFO:teuthology.orchestra.console:Power off smithi029
2023-03-09T18:53:18.890 INFO:teuthology.orchestra.console:Power off smithi176
2023-03-09T18:53:18.904 INFO:teuthology.orchestra.console:Power off smithi172
2023-03-09T18:53:27.341 INFO:teuthology.orchestra.console:Power off for smithi172 completed
2023-03-09T18:53:27.348 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2023-03-09T18:53:27.356 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2023-03-09T18:53:27.443 INFO:teuthology.orchestra.console:Power on smithi172
2023-03-09T18:53:27.452 INFO:teuthology.orchestra.console:Power on smithi029
2023-03-09T18:53:27.460 INFO:teuthology.orchestra.console:Power on smithi176
2023-03-09T18:53:35.843 INFO:teuthology.orchestra.console:Power on for smithi176 completed
2023-03-09T18:53:35.879 INFO:teuthology.orchestra.console:Power on for smithi172 completed
2023-03-09T18:53:35.881 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2023-03-09T18:53:35.944 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2023-03-09T18:53:35.981 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish
2023-03-09T18:53:35.983 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2023-03-09T18:56:40.453 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-03-09T18:56:40.455 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-03-09T18:56:49.541 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-03-09T18:56:49.542 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-03-09T18:56:58.597 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-03-09T18:56:58.598 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-03-09T18:57:07.685 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-03-09T18:57:07.686 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-03-09T18:57:10.405 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-03-09T18:57:16.741 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-03-09T18:57:19.461 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-03-09T18:57:25.797 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-03-09T18:57:28.517 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-03-09T18:58:13.729 WARNING:teuthology.provision.fog:timed out
2023-03-09T18:58:20.083 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-09T18:58:20.355 INFO:teuthology.provision.fog.smithi176:Node is ready
2023-03-09T18:58:20.373 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2023-03-09T18:58:20.431 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2023-03-09T18:58:20.776 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2023-03-09T18:58:31.814 WARNING:teuthology.provision.fog:timed out
2023-03-09T18:58:34.525 WARNING:teuthology.provision.fog:timed out
2023-03-09T18:58:38.158 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-09T18:58:38.460 INFO:teuthology.provision.fog.smithi172:Node is ready
2023-03-09T18:58:38.480 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com
2023-03-09T18:58:38.540 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172
2023-03-09T18:58:38.921 INFO:teuthology.provision.fog.smithi172:Deploy complete!
2023-03-09T18:58:40.854 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-09T18:58:41.362 INFO:teuthology.provision.fog.smithi029:Node is ready
2023-03-09T18:58:41.381 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2023-03-09T18:58:41.441 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2023-03-09T18:58:41.828 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2023-03-09T18:58:42.036 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2023-03-09T18:58:42.037 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com
2023-03-09T18:58:42.037 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-09T18:58:42.064 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2023-03-09T18:58:42.066 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2023-03-09T18:58:42.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-03-09T18:58:42.254 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2023-03-09T18:58:42.312 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux"
2023-03-09T18:58:42.312 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)"
2023-03-09T18:58:42.312 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel"
2023-03-09T18:58:42.312 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora"
2023-03-09T18:58:42.312 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-09T18:58:42.313 INFO:teuthology.orchestra.run.smithi029.stdout:
2023-03-09T18:58:42.314 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-09T18:58:42.314 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-09T18:58:42.314 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-09T18:58:42.314 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-09T18:58:42.315 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-03-09T18:58:42.339 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server
2023-03-09T18:58:42.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2023-03-09T18:58:42.530 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64
2023-03-09T18:58:42.589 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux"
2023-03-09T18:58:42.589 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)"
2023-03-09T18:58:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel"
2023-03-09T18:58:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora"
2023-03-09T18:58:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6"
2023-03-09T18:58:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2023-03-09T18:58:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-09T18:58:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2023-03-09T18:58:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-09T18:58:42.591 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/"
2023-03-09T18:58:42.591 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-09T18:58:42.591 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-09T18:58:42.591 INFO:teuthology.orchestra.run.smithi172.stdout:
2023-03-09T18:58:42.591 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-09T18:58:42.591 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-09T18:58:42.591 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-09T18:58:42.592 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-09T18:58:42.592 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2023-03-09T18:58:42.614 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2023-03-09T18:58:42.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-03-09T18:58:42.867 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2023-03-09T18:58:42.924 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Red Hat Enterprise Linux"
2023-03-09T18:58:42.924 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8.6 (Ootpa)"
2023-03-09T18:58:42.924 INFO:teuthology.orchestra.run.smithi176.stdout:ID="rhel"
2023-03-09T18:58:42.925 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="fedora"
2023-03-09T18:58:42.925 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8.6"
2023-03-09T18:58:42.925 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2023-03-09T18:58:42.925 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-03-09T18:58:42.925 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2023-03-09T18:58:42.925 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-03-09T18:58:42.926 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.redhat.com/"
2023-03-09T18:58:42.926 INFO:teuthology.orchestra.run.smithi176.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-03-09T18:58:42.926 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-09T18:58:42.926 INFO:teuthology.orchestra.run.smithi176.stdout:
2023-03-09T18:58:42.926 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-09T18:58:42.926 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-03-09T18:58:42.926 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-03-09T18:58:42.927 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-03-09T18:58:42.927 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-03-09T18:58:43.042 INFO:teuthology.dispatcher.supervisor:Running job 7198129
2023-03-09T18:58:43.042 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-03-08_20:36:11-fs-wip-pdonnell-testing-20230308.150904-distro-default-smithi/7198129 --name pdonnell-2023-03-08_20:36:11-fs-wip-pdonnell-testing-20230308.150904-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/pdonnell-2023-03-08_20:36:11-fs-wip-pdonnell-testing-20230308.150904-distro-default-smithi/7198129/orig.config.yaml
2023-03-09T18:58:43.046 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-03-08_20:36:11-fs-wip-pdonnell-testing-20230308.150904-distro-default-smithi/7198129
2023-03-09T18:58:43.046 INFO:teuthology.dispatcher.supervisor:Job PID: 27829
2023-03-09T18:58:43.047 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-10T06:59:40.981 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-10T06:59:41.153 INFO:teuthology.kill:Killing Pids: {27829}
2023-03-10T06:59:42.017 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0']
2023-03-10T06:59:42.018 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10']
2023-03-10T06:59:42.018 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']
2023-03-10T06:59:42.019 INFO:teuthology.misc:Compressing logs...
2023-03-10T06:59:42.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-03-10T06:59:42.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2023-03-10T06:59:42.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-03-10T06:59:42.900 INFO:teuthology.misc:Compressing logs...
2023-03-10T06:59:43.395 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-10T06:59:43.630 INFO:teuthology.misc:Compressing logs...
2023-03-10T06:59:47.120 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2023-03-10T06:59:47.466 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2023-03-10T06:59:49.620 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2023-03-10T06:59:50.766 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2023-03-10T06:59:53.873 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2023-03-10T06:59:54.617 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-mds.b.log: file size changed while zipping
2023-03-10T06:59:56.399 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.8.log: file size changed while zipping
2023-03-10T06:59:56.884 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-mds.c.log: file size changed while zipping
2023-03-10T07:00:00.689 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2023-03-10T07:00:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2023-03-10T07:01:00.170 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2023-03-10T07:01:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-mgr.x.log: file size changed while zipping
2023-03-10T07:01:08.207 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-osd.9.log: file size changed while zipping
2023-03-10T07:01:19.386 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e42ef640-bead-11ed-9af2-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2023-03-10T07:02:32.509 INFO:teuthology.orchestra.run.smithi172.stderr:tar: ./e42ef640-bead-11ed-9af2-001a4aab830c/ceph-mon.b.log.gz: file changed as we read it
2023-03-10T07:02:41.305 INFO:teuthology.orchestra.run.smithi172.stderr:tar: ./e42ef640-bead-11ed-9af2-001a4aab830c: file changed as we read it
2023-03-10T07:03:07.763 INFO:teuthology.kill:No teuthology processes running
2023-03-10T07:03:08.605 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi172', 'smithi176']
2023-03-10T07:03:09.300 INFO:teuthology.kill:2023-03-10 07:03:09,299.299 INFO:teuthology.nuke:targets:
2023-03-10T07:03:09.301 INFO:teuthology.kill:  smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-03-10T07:03:09.301 INFO:teuthology.kill:  smithi172.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-03-10T07:03:09.301 INFO:teuthology.kill:  smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-03-10T07:03:09.302 INFO:teuthology.kill:2023-03-10 07:03:09,300.300 INFO:teuthology.nuke:Checking targets against current locks
2023-03-10T07:03:09.362 INFO:teuthology.kill:2023-03-10 07:03:09,362.362 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-10T07:03:09.388 INFO:teuthology.kill:2023-03-10 07:03:09,388.388 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-10T07:03:09.416 INFO:teuthology.kill:2023-03-10 07:03:09,416.416 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-10T07:03:09.451 INFO:teuthology.kill:2023-03-10 07:03:09,451.451 INFO:teuthology.orchestra.console:Power off smithi029
2023-03-10T07:03:09.477 INFO:teuthology.kill:2023-03-10 07:03:09,477.477 INFO:teuthology.orchestra.console:Power off smithi172
2023-03-10T07:03:09.532 INFO:teuthology.kill:2023-03-10 07:03:09,532.532 INFO:teuthology.orchestra.console:Power off smithi176
2023-03-10T07:03:21.955 INFO:teuthology.kill:2023-03-10 07:03:21,955.955 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2023-03-10T07:03:21.976 INFO:teuthology.kill:2023-03-10 07:03:21,975.975 INFO:teuthology.orchestra.console:Power off for smithi172 completed
2023-03-10T07:03:22.011 INFO:teuthology.kill:2023-03-10 07:03:22,011.011 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2023-03-10T07:03:22.113 INFO:teuthology.kill:2023-03-10 07:03:22,113.113 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2023-03-10T07:03:22.129 INFO:teuthology.kill:2023-03-10 07:03:22,129.129 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com
2023-03-10T07:03:22.163 INFO:teuthology.kill:2023-03-10 07:03:22,163.163 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com
2023-03-10T07:05:22.548 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-10T07:05:22.722 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi029 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-03-08_20:36:11-fs-wip-pdonnell-testing-20230308.150904-distro-default-smithi/7198338
2023-03-10T07:05:22.723 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi172 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-03-08_20:36:11-fs-wip-pdonnell-testing-20230308.150904-distro-default-smithi/7198338
2023-03-10T07:05:22.723 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi176 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-03-08_20:36:11-fs-wip-pdonnell-testing-20230308.150904-distro-default-smithi/7198337