2022-04-05T17:33:16.780 INFO:root:teuthology version: 1.1.0-d877b023
2022-04-05T17:33:16.896 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging
2022-04-05T17:33:16.897 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server
2022-04-05T17:33:16.898 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-04-05T17:33:16.920 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete
2022-04-05T17:33:16.920 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging
2022-04-05T17:33:16.921 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server
2022-04-05T17:33:16.921 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2022-04-05T17:33:16.941 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete
2022-04-05T17:33:17.141 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream
2022-04-05T17:33:17.162 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream
2022-04-05T17:33:17.491 INFO:teuthology.orchestra.console:Power off smithi029
2022-04-05T17:33:17.508 INFO:teuthology.orchestra.console:Power off smithi017
2022-04-05T17:33:25.869 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-04-05T17:33:25.970 INFO:teuthology.orchestra.console:Power on smithi017
2022-04-05T17:33:29.975 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2022-04-05T17:33:30.077 INFO:teuthology.orchestra.console:Power on smithi029
2022-04-05T17:33:34.336 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2022-04-05T17:33:34.342 INFO:teuthology.orchestra.console:Power on for smithi017 completed
2022-04-05T17:33:34.437 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2022-04-05T17:33:34.443 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2022-04-05T17:38:01.753 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-05T17:38:22.075 INFO:teuthology.provision.fog.smithi017:Node is ready
2022-04-05T17:38:22.135 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2022-04-05T17:38:22.192 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2022-04-05T17:38:22.573 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2022-04-05T17:38:42.651 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-05T17:38:42.966 INFO:teuthology.provision.fog.smithi029:Node is ready
2022-04-05T17:38:42.984 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2022-04-05T17:38:43.045 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2022-04-05T17:38:43.420 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2022-04-05T17:38:43.612 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2022-04-05T17:38:43.613 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-05T17:38:43.630 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2022-04-05T17:38:43.631 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-05T17:38:43.652 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2022-04-05T17:38:43.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-04-05T17:38:43.851 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2022-04-05T17:38:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2022-04-05T17:38:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2022-04-05T17:38:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2022-04-05T17:38:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2022-04-05T17:38:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2022-04-05T17:38:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2022-04-05T17:38:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-05T17:38:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2022-04-05T17:38:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-05T17:38:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2022-04-05T17:38:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-05T17:38:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-05T17:38:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-05T17:38:43.915 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-04-05T17:38:43.932 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2022-04-05T17:38:43.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2022-04-05T17:38:44.128 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2022-04-05T17:38:44.189 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2022-04-05T17:38:44.189 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8"
2022-04-05T17:38:44.189 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2022-04-05T17:38:44.189 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2022-04-05T17:38:44.190 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8"
2022-04-05T17:38:44.190 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2022-04-05T17:38:44.190 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-05T17:38:44.190 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2022-04-05T17:38:44.191 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-05T17:38:44.191 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2022-04-05T17:38:44.191 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-05T17:38:44.191 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-05T17:38:44.191 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-05T17:38:44.192 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2022-04-05T17:38:44.320 INFO:teuthology.dispatcher.supervisor:Running job 6777988
2022-04-05T17:38:44.320 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-05_17:16:28-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6777988 --name yuriw-2022-04-05_17:16:28-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2022-04-05_17:16:28-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6777988/orig.config.yaml
2022-04-05T17:38:44.324 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-05_17:16:28-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6777988
2022-04-05T17:38:44.325 INFO:teuthology.dispatcher.supervisor:Job PID: 7069
2022-04-05T17:38:44.325 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-06T00:09:11.417 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-06T00:09:11.678 INFO:teuthology.kill:Killing Pids: {7069}
2022-04-06T00:09:12.776 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-04-06T00:09:12.777 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-04-06T00:09:12.777 INFO:teuthology.misc:Compressing logs...
2022-04-06T00:09:12.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-04-06T00:09:12.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2022-04-06T00:09:13.275 INFO:teuthology.misc:Compressing logs...
2022-04-06T00:09:13.509 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-04-06T00:09:13.712 INFO:teuthology.misc:Compressing logs...
2022-04-06T00:09:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-04-06T00:09:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-mds.cephfs.smithi017.ijbvob.log: file size changed while zipping
2022-04-06T00:09:38.021 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-04-06T00:09:52.293 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-mon.smithi017.log: file size changed while zipping
2022-04-06T00:09:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-mds.cephfs.smithi029.tpejdw.log: file size changed while zipping
2022-04-06T00:10:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-04-06T00:10:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-mds.cephfs.smithi017.rfjmdy.log: file size changed while zipping
2022-04-06T00:10:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-04-06T00:10:10.389 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-mgr.smithi017.fhathj.log: file size changed while zipping
2022-04-06T00:10:18.724 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-04-06T00:10:28.023 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-04-06T00:11:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-mds.cephfs.smithi029.wytayj.log: file size changed while zipping
2022-04-06T00:11:13.633 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/1ad17336-b508-11ec-8c36-001a4aab830c/ceph-mon.smithi029.log: file size changed while zipping
2022-04-06T00:11:47.960 INFO:teuthology.kill:No teuthology processes running
2022-04-06T00:11:49.005 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi029']
2022-04-06T00:11:49.890 INFO:teuthology.kill:2022-04-06 00:11:49,890.890 INFO:teuthology.nuke:targets:
2022-04-06T00:11:49.891 INFO:teuthology.kill:  smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnwGAOYEyCdARBk0P3hhLXzfw4Y7cz5a6tFAwiR1c0Ig7BdiAWu14axFRH1hI+1EKQmitDf8C22/oRkci46QLvyyjlA+Eina1UXKBjbkCKEtDT/G8dy46NfBwtZEIqI4TWFszvL0GQsLCgFXfEwtGtlcF47Ndl2GxsCy6ITnZzBPj83UYAeQIjeB3DF+03PrcdZdDIlRnm0gsNjvoT3Q533y7goF45mdFKJYqQTdLhYLv93tzIiRR2XHtfdslEa77H2fc49cKz8IKXo+JZIf9TfoywC98Eb8wo9TXXIabtZEGC95ry98Q7p/OCVGfFrkqjQhUeC17Ox4jwyNO9NeKMzYxzhNGPj2lDylhdcq7Kk/KpCaDWZtWZQ3XwowHYfOFsvUWNprEpompwhVu2DHyKxZPwa0VqhPzQCMV31iM4l0dWRRgzOA/C6sx/BAYpuesc9Q0qasaYCCjYLX9AnnufQsAtCoofk+1xlPGrOE2hp5TL2uUlNBsI0vcObpCeGfk=
2022-04-06T00:11:49.891 INFO:teuthology.kill:  smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC3Y/E8BE3yRvfGBu+4WJzX/PPfHxUwtI7HIA+hj/WLnvgLslRHqrai3E37KeUXRWD5TWfvhmbdhB+DuqPQtRfbWGoylVVxAxcN/XHPXSLFT5bdgM/9UFPspC2Y41d6w0RM3dv2/oxonm8/VwxAJMNPKZjBn7G/4JSAdCbcNmkFIq4hKgd8UWW0fLnXFOwDlRrq7Q/JTNsmZ7OiAHDXv2bXFyhVuq2hvrtL3EDOUnzyWWMzu2cIxj0cAJq6GeJv+tR6Vg08BG8JE4EHqW4PKimND2DMm9g5oS4OAf1m4TVNNEY4JnkPnbWipQwhJjNfx9r3kXyBka66nQw+gBn9VzlNm+/XhXPeI5Hk+a4dAnCsfTZL1mek9RkEFtS9OiyNaLDM3M2rVv0iHlqdgA/gW8IiMkC2GJXzatdNC9wiunHBgKN8+sunwPtU64O84ShgqVcGAc8rTsgOv2OqciPcdDs8yvL/6h+5cczGEw44srqCpzxrIR0kC9bvi7tasiQVu0=
2022-04-06T00:11:49.917 INFO:teuthology.kill:2022-04-06 00:11:49,917.917 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-06T00:11:49.921 INFO:teuthology.kill:2022-04-06 00:11:49,920.920 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-06T00:11:49.992 INFO:teuthology.kill:2022-04-06 00:11:49,992.992 INFO:teuthology.orchestra.console:Power off smithi017
2022-04-06T00:11:50.005 INFO:teuthology.kill:2022-04-06 00:11:50,005.005 INFO:teuthology.orchestra.console:Power off smithi029
2022-04-06T00:11:58.369 INFO:teuthology.kill:2022-04-06 00:11:58,369.369 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2022-04-06T00:11:58.525 INFO:teuthology.kill:2022-04-06 00:11:58,524.524 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2022-04-06T00:12:02.477 INFO:teuthology.kill:2022-04-06 00:12:02,476.476 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-04-06T00:12:02.621 INFO:teuthology.kill:2022-04-06 00:12:02,620.620 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2022-04-06T00:14:02.917 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15