2022-06-12T04:28:21.957 INFO:root:teuthology version: 1.1.1.dev370+g2290146e
2022-06-12T04:28:22.102 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2022-06-12T04:28:22.103 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2022-06-12T04:28:22.103 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-06-12T04:28:22.128 INFO:teuthology.lock.ops:Node 'smithi002.front.sepia.ceph.com' reimaging is complete
2022-06-12T04:28:22.128 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2022-06-12T04:28:22.129 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2022-06-12T04:28:22.130 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-06-12T04:28:22.151 INFO:teuthology.lock.ops:Node 'smithi123.front.sepia.ceph.com' reimaging is complete
2022-06-12T04:28:22.352 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream
2022-06-12T04:28:22.376 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream
2022-06-12T04:28:22.708 INFO:teuthology.orchestra.console:Power off smithi002
2022-06-12T04:28:22.730 INFO:teuthology.orchestra.console:Power off smithi123
2022-06-12T04:28:31.097 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-06-12T04:28:31.128 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-06-12T04:28:31.199 INFO:teuthology.orchestra.console:Power on smithi002
2022-06-12T04:28:31.237 INFO:teuthology.orchestra.console:Power on smithi123
2022-06-12T04:28:39.587 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2022-06-12T04:28:39.613 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2022-06-12T04:28:39.689 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2022-06-12T04:28:39.715 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2022-06-12T04:32:46.340 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-06-12T04:32:48.035 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-06-12T04:32:48.308 INFO:teuthology.provision.fog.smithi002:Node is ready
2022-06-12T04:32:48.331 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2022-06-12T04:32:48.392 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2022-06-12T04:32:48.757 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2022-06-12T04:33:11.296 INFO:teuthology.provision.fog.smithi123:Node is ready
2022-06-12T04:33:11.322 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2022-06-12T04:33:11.385 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2022-06-12T04:33:11.796 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2022-06-12T04:33:11.986 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2022-06-12T04:33:11.987 INFO:teuthology.lock.ops:New key found. Updating...
2022-06-12T04:33:12.013 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2022-06-12T04:33:12.014 INFO:teuthology.lock.ops:New key found. Updating...
2022-06-12T04:33:12.047 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2022-06-12T04:33:12.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-06-12T04:33:12.386 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2022-06-12T04:33:12.463 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2022-06-12T04:33:12.464 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2022-06-12T04:33:12.464 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2022-06-12T04:33:12.465 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2022-06-12T04:33:12.465 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2022-06-12T04:33:12.465 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2022-06-12T04:33:12.466 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2022-06-12T04:33:12.468 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2022-06-12T04:33:12.468 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-06-12T04:33:12.468 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2022-06-12T04:33:12.469 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-06-12T04:33:12.469 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-06-12T04:33:12.469 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-06-12T04:33:12.472 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-06-12T04:33:12.493 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2022-06-12T04:33:12.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-06-12T04:33:12.721 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2022-06-12T04:33:12.782 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2022-06-12T04:33:12.782 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8"
2022-06-12T04:33:12.783 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2022-06-12T04:33:12.783 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2022-06-12T04:33:12.783 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8"
2022-06-12T04:33:12.783 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2022-06-12T04:33:12.784 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8"
2022-06-12T04:33:12.784 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2022-06-12T04:33:12.784 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-06-12T04:33:12.785 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2022-06-12T04:33:12.785 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-06-12T04:33:12.785 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-06-12T04:33:12.786 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-06-12T04:33:12.787 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-06-12T04:33:12.929 INFO:teuthology.dispatcher.supervisor:Running job 6874949
2022-06-12T04:33:12.930 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2290146eac7577b8500f128a53856c3ea4a00e3c/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-06-12_03:31:04-rados-pacific-distro-default-smithi/6874949 --name teuthology-2022-06-12_03:31:04-rados-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/teuthology-2022-06-12_03:31:04-rados-pacific-distro-default-smithi/6874949/orig.config.yaml
2022-06-12T04:33:12.937 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-06-12_03:31:04-rados-pacific-distro-default-smithi/6874949
2022-06-12T04:33:12.938 INFO:teuthology.dispatcher.supervisor:Job PID: 32192
2022-06-12T04:33:12.939 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-06-12T16:34:08.890 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-06-12T16:34:09.646 INFO:teuthology.kill:Killing Pids: {32192}
2022-06-12T16:34:10.947 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-06-12T16:34:10.948 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-06-12T16:34:10.948 INFO:teuthology.misc:Compressing logs...
2022-06-12T16:34:10.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-06-12T16:34:11.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-06-12T16:34:11.479 INFO:teuthology.misc:Compressing logs...
2022-06-12T16:34:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-06-12T16:34:12.097 INFO:teuthology.misc:Compressing logs...
2022-06-12T16:34:14.403 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-mds.cephfs.smithi123.xklutm.log: file size changed while zipping
2022-06-12T16:34:27.034 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-06-12T16:34:36.525 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-mds.cephfs.smithi123.wtyouo.log: file size changed while zipping
2022-06-12T16:34:43.668 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-mon.smithi123.log: file size changed while zipping
2022-06-12T16:34:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-06-12T16:34:52.606 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-mds.cephfs.smithi002.ilcygw.log: file size changed while zipping
2022-06-12T16:35:06.092 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-06-12T16:35:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-mon.smithi002.log: file size changed while zipping
2022-06-12T16:35:28.001 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-06-12T16:35:39.270 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-mds.cephfs.smithi002.vraosh.log: file size changed while zipping
2022-06-12T16:35:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-mgr.smithi002.dzdqxu.log: file size changed while zipping
2022-06-12T16:35:48.217 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/b53281f0-ea09-11ec-8422-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-06-12T16:36:26.962 INFO:teuthology.kill:No teuthology processes running
2022-06-12T16:36:28.242 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi123']
2022-06-12T16:36:29.214 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_2290146eac7577b8500f128a53856c3ea4a00e3c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-06-12T16:36:29.215 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-06-12T16:36:29.215 INFO:teuthology.kill:2022-06-12 16:36:29,214.214 INFO:teuthology.nuke:targets:
2022-06-12T16:36:29.216 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmtwnqY8AyQxuQHtZWa0L+KMrfaqpLT5xg8cpE6aNKy0zEqHpoyxqAcGdzmX8l4qu12pFsh66GgMnBnqkzBOl8CBKcKyYCZEjQhqU5AGi4/UqKRG9dyiVu8ZP/ddzTlNXcZTgYB0YIoIdIDsvXsOn5BUsDBIREQblE0S9aZ6M5f2VJjHwX9/pq8vnu8S9SbohNMH1sNebCFHLbm+/WjUODeHyK8522byiLlfkgJ9BcZCSBM01sin8cixuza027X2hCvJBhIu2LmlEPLlWnq0emFqlnNyZ54v+3+NcdUbAX1keFW9XIH0/TGJCnXynEE+NxEb9psvvlQqXTafYY2YyqigdPj9Z8PwWP4KR31TkM3iell2AWWO358gxKLJ+ze3IomuDItB5vTxVS3GXHbDovo0g1EfcKxIcQX5VEWnukRJP9HByWPaXUSEYtt0V3HPXd20NdHgO05AFR1Mq7rbUkNeXglITCEDi0rSQoPRYgaxgmqmQY9ie+P/PjPSYI1e8=
2022-06-12T16:36:29.216 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNyYwMBLkyoRlI4kL8LxgwimNOt+/hyYfXnc9WjB4b6u+kCvN92XQIXYhSgHDgEN+OIfhDN0f9gOu2PK8R0zy80qhmtrfUuqamcLQAqj5vx1hL29tiGdBlpa6xujoFPi/JbSLMVLT0z0na7ZgHer2x8RgMf05S1aZHaUbdQmfj9B9W0d2fJEZX7vx1EcTrdhwO8hcKvDvO9JYVOHtidXQv2JVVNZvyQOhwJTmBVy4/xw1pSCLJ9/9YoxZRrjEagaQz1XJ4RRynj075Cf0xV55wJmzevIMzaxbEVI7GWWcq0tjAK+H7CmlqJXM8LEVwgbEt0F/FmnCRkN0Zkh5KWJq41wqQXjeR0xlmcuqNgVDhPxHF0pmBym4wQZlVjqAQwR01VoajppSCu5UQpWIH1aLpOVbzOVD26ZZMyRQ01emCp5Wvl+YTXBiBzeU90ighiG1b4jbDvH6pvyWURSMK3csZSAhHmlA2yKCJNdci2IeHefw0kxoWEdxTmkVGC9BXPS0=
2022-06-12T16:36:29.247 INFO:teuthology.kill:2022-06-12 16:36:29,247.247 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-06-12T16:36:29.250 INFO:teuthology.kill:2022-06-12 16:36:29,250.250 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-06-12T16:36:29.332 INFO:teuthology.kill:2022-06-12 16:36:29,332.332 INFO:teuthology.orchestra.console:Power off smithi123
2022-06-12T16:36:29.345 INFO:teuthology.kill:2022-06-12 16:36:29,345.345 INFO:teuthology.orchestra.console:Power off smithi002
2022-06-12T16:36:37.712 INFO:teuthology.kill:2022-06-12 16:36:37,711.711 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-06-12T16:36:37.863 INFO:teuthology.kill:2022-06-12 16:36:37,862.862 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2022-06-12T16:36:41.828 INFO:teuthology.kill:2022-06-12 16:36:41,828.828 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-06-12T16:36:41.983 INFO:teuthology.kill:2022-06-12 16:36:41,982.982 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2022-06-12T16:38:42.245 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15