2023-01-23T16:51:42.687 INFO:root:teuthology version: 0.0.1.dev20+g5abecab 2023-01-23T16:51:42.820 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2023-01-23T16:51:42.821 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2023-01-23T16:51:42.821 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-01-23T16:51:42.835 INFO:teuthology.lock.ops:Node 'smithi039.front.sepia.ceph.com' reimaging is complete 2023-01-23T16:51:42.836 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-01-23T16:51:42.837 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-01-23T16:51:42.837 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-01-23T16:51:42.855 INFO:teuthology.lock.ops:Node 'smithi167.front.sepia.ceph.com' reimaging is complete 2023-01-23T16:51:42.855 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-01-23T16:51:42.855 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-01-23T16:51:42.855 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-01-23T16:51:42.870 INFO:teuthology.lock.ops:Node 'smithi178.front.sepia.ceph.com' reimaging is complete 2023-01-23T16:51:43.007 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of rhel 8.6 2023-01-23T16:51:43.019 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6 2023-01-23T16:51:43.024 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.6 2023-01-23T16:51:43.331 INFO:teuthology.orchestra.console:Power off smithi039 2023-01-23T16:51:43.344 INFO:teuthology.orchestra.console:Power off smithi167 2023-01-23T16:51:43.358 INFO:teuthology.orchestra.console:Power off smithi178 2023-01-23T16:51:43.486 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-01-23T16:51:43.587 INFO:teuthology.orchestra.console:Power on smithi039 2023-01-23T16:51:51.718 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-01-23T16:51:51.819 INFO:teuthology.orchestra.console:Power on smithi178 2023-01-23T16:51:51.945 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2023-01-23T16:51:52.046 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2023-01-23T16:51:55.824 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-01-23T16:51:55.925 INFO:teuthology.orchestra.console:Power on smithi167 2023-01-23T16:52:00.175 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2023-01-23T16:52:00.180 INFO:teuthology.orchestra.console:Power on for smithi178 completed 2023-01-23T16:52:00.276 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-01-23T16:52:00.280 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-01-23T16:57:06.472 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:57:15.528 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:57:24.584 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:57:33.640 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:57:42.728 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:57:51.788 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:57:51.852 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:00.872 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:58:00.904 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:09.928 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-23T16:58:09.960 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:19.016 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:28.072 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:37.132 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:46.220 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:47.929 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-23T16:58:48.240 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-01-23T16:58:48.256 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-01-23T16:58:48.313 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-01-23T16:58:48.710 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-01-23T16:58:55.304 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-01-23T16:58:56.113 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: Authentication failed. 2023-01-23T16:58:57.231 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: Authentication failed. 2023-01-23T16:58:58.347 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: Authentication failed. 2023-01-23T16:59:33.462 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-23T16:59:33.881 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-01-23T16:59:33.902 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-01-23T16:59:33.958 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-01-23T16:59:34.370 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-01-23T16:59:59.543 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: Authentication timeout. 2023-01-23T17:00:03.624 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-01-23T17:00:12.684 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-01-23T17:01:17.807 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-01-23T17:01:18.688 WARNING:teuthology.provision.fog:timed out 2023-01-23T17:01:25.021 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-23T17:01:25.329 INFO:teuthology.provision.fog.smithi039:Node is ready 2023-01-23T17:01:25.349 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2023-01-23T17:01:25.409 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2023-01-23T17:01:25.764 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2023-01-23T17:01:26.019 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2023-01-23T17:01:26.020 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-01-23T17:01:26.020 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-23T17:01:26.045 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-01-23T17:01:26.046 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-23T17:01:26.067 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2023-01-23T17:01:26.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-01-23T17:01:26.259 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-01-23T17:01:26.315 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux" 2023-01-23T17:01:26.316 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.6 (Ootpa)" 2023-01-23T17:01:26.316 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel" 2023-01-23T17:01:26.316 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora" 2023-01-23T17:01:26.316 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.6" 2023-01-23T17:01:26.317 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2023-01-23T17:01:26.317 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-23T17:01:26.317 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-01-23T17:01:26.317 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-23T17:01:26.317 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/" 2023-01-23T17:01:26.317 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-23T17:01:26.318 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-23T17:01:26.318 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-01-23T17:01:26.318 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-23T17:01:26.318 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-23T17:01:26.318 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-23T17:01:26.319 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-23T17:01:26.320 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-01-23T17:01:26.345 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-01-23T17:01:26.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-01-23T17:01:26.601 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-01-23T17:01:26.659 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-01-23T17:01:26.659 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2023-01-23T17:01:26.659 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-01-23T17:01:26.659 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-01-23T17:01:26.659 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2023-01-23T17:01:26.660 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-01-23T17:01:26.660 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-23T17:01:26.660 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-01-23T17:01:26.660 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-23T17:01:26.660 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-01-23T17:01:26.661 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-23T17:01:26.661 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-23T17:01:26.661 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-01-23T17:01:26.661 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-23T17:01:26.662 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-23T17:01:26.662 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-23T17:01:26.662 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-23T17:01:26.662 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-01-23T17:01:26.681 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-01-23T17:01:26.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-01-23T17:01:26.940 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-01-23T17:01:26.997 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-01-23T17:01:26.997 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2023-01-23T17:01:26.997 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-01-23T17:01:26.998 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-01-23T17:01:26.998 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2023-01-23T17:01:26.998 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-01-23T17:01:26.998 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-23T17:01:26.998 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-01-23T17:01:26.999 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-23T17:01:26.999 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-01-23T17:01:26.999 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-23T17:01:26.999 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-23T17:01:26.999 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-01-23T17:01:27.000 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-23T17:01:27.000 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-23T17:01:27.000 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-23T17:01:27.000 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-23T17:01:27.001 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-01-23T17:01:27.138 INFO:teuthology.dispatcher.supervisor:Running job 7133739 2023-01-23T17:01:27.139 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5abecab36c9da4d70461d81781464cf5acaea292/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-01-23_16:50:37-fs-main-distro-default-smithi/7133739 --name rishabh-2023-01-23_16:50:37-fs-main-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/rishabh-2023-01-23_16:50:37-fs-main-distro-default-smithi/7133739/orig.config.yaml 2023-01-23T17:01:27.142 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-01-23_16:50:37-fs-main-distro-default-smithi/7133739 2023-01-23T17:01:27.142 INFO:teuthology.dispatcher.supervisor:Job PID: 4836 2023-01-23T17:01:27.143 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-01-24T05:01:46.624 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-01-24T05:01:46.736 INFO:teuthology.kill:Killing Pids: {4836} 2023-01-24T05:01:47.466 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-01-24T05:01:47.466 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-01-24T05:01:47.466 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-01-24T05:01:47.467 INFO:teuthology.misc:Compressing logs... 2023-01-24T05:01:47.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-01-24T05:01:47.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-01-24T05:01:48.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-01-24T05:01:48.649 INFO:teuthology.misc:Compressing logs... 2023-01-24T05:01:48.931 INFO:teuthology.misc:Compressing logs... 2023-01-24T05:01:51.503 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-01-24T05:01:51.697 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.g.log: file size changed while zipping 2023-01-24T05:01:53.671 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-01-24T05:01:53.815 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2023-01-24T05:01:55.821 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-01-24T05:01:56.872 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-01-24T05:01:58.436 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-01-24T05:01:59.062 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mgr.x.log: file size changed while zipping 2023-01-24T05:01:59.394 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-01-24T05:01:59.599 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.k.log: file size changed while zipping 2023-01-24T05:02:03.164 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-01-24T05:02:03.187 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.9.log: file size changed while zipping 2023-01-24T05:02:04.586 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-01-24T05:02:04.827 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2023-01-24T05:02:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-01-24T05:02:54.172 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-01-24T05:03:53.876 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-01-24T05:04:37.730 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2023-01-24T05:05:23.804 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-01-24T05:06:36.845 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.f.log: file size changed while zipping 2023-01-24T05:06:42.689 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.c.log: file size changed while zipping 2023-01-24T05:08:32.291 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.i.log: file size changed while zipping 2023-01-24T05:08:43.190 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2023-01-24T05:08:48.950 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/20c4834e-9b41-11ed-9e56-001a4aab830c/ceph-mds.l.log: file size changed while zipping 2023-01-24T05:12:55.477 INFO:teuthology.kill:No teuthology processes running 2023-01-24T05:12:57.178 INFO:teuthology.kill:Nuking machines: ['smithi039', 'smithi167', 'smithi178'] 2023-01-24T05:12:57.793 INFO:teuthology.kill:2023-01-24 05:12:57,793.793 INFO:teuthology.nuke:targets: 2023-01-24T05:12:57.794 INFO:teuthology.kill: smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-01-24T05:12:57.794 INFO:teuthology.kill: smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-01-24T05:12:57.795 INFO:teuthology.kill: smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-01-24T05:12:57.795 INFO:teuthology.kill:2023-01-24 05:12:57,794.794 INFO:teuthology.nuke:Checking targets against current locks 2023-01-24T05:12:57.859 INFO:teuthology.kill:2023-01-24 05:12:57,858.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-24T05:12:57.887 INFO:teuthology.kill:2023-01-24 05:12:57,887.887 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-24T05:12:57.914 INFO:teuthology.kill:2023-01-24 05:12:57,914.914 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-24T05:12:57.948 INFO:teuthology.kill:2023-01-24 05:12:57,947.947 INFO:teuthology.orchestra.console:Power off smithi039 2023-01-24T05:12:57.970 INFO:teuthology.kill:2023-01-24 05:12:57,969.969 INFO:teuthology.orchestra.console:Power off smithi167 2023-01-24T05:12:58.020 INFO:teuthology.kill:2023-01-24 05:12:58,017.017 INFO:teuthology.orchestra.console:Power off smithi178 2023-01-24T05:13:06.362 INFO:teuthology.kill:2023-01-24 05:13:06,362.362 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-01-24T05:13:06.372 INFO:teuthology.kill:2023-01-24 05:13:06,372.372 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-01-24T05:13:06.388 INFO:teuthology.kill:2023-01-24 05:13:06,387.387 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-01-24T05:13:06.510 INFO:teuthology.kill:2023-01-24 05:13:06,509.509 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2023-01-24T05:13:06.511 INFO:teuthology.kill:2023-01-24 05:13:06,511.511 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2023-01-24T05:13:06.530 INFO:teuthology.kill:2023-01-24 05:13:06,530.530 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com 2023-01-24T05:15:06.730 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-01-24T05:15:06.889 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/teuthology-2023-01-24_05:00:07-smoke-main-distro-default-smithi/7134844 2023-01-24T05:15:06.890 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/teuthology-2023-01-24_05:00:07-smoke-main-distro-default-smithi/7134844 2023-01-24T05:15:06.890 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi178 but it was locked by another job: /home/teuthworker/archive/teuthology-2023-01-24_05:00:07-smoke-main-distro-default-smithi/7134844