2022-05-30T19:37:11.449 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f
2022-05-30T19:37:11.744 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging
2022-05-30T19:37:11.745 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T19:37:11.745 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2022-05-30T19:37:11.767 INFO:teuthology.lock.ops:Node 'smithi084.front.sepia.ceph.com' reimaging is complete
2022-05-30T19:37:11.767 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2022-05-30T19:37:11.767 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T19:37:11.767 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-05-30T19:37:11.790 INFO:teuthology.lock.ops:Node 'smithi176.front.sepia.ceph.com' reimaging is complete
2022-05-30T19:37:11.790 INFO:teuthology.lock.ops:Start node 'smithi197.front.sepia.ceph.com' reimaging
2022-05-30T19:37:11.790 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T19:37:11.790 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-05-30T19:37:11.811 INFO:teuthology.lock.ops:Node 'smithi197.front.sepia.ceph.com' reimaging is complete
2022-05-30T19:37:11.983 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream
2022-05-30T19:37:12.002 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.stream
2022-05-30T19:37:12.033 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.stream
2022-05-30T19:37:12.360 INFO:teuthology.orchestra.console:Power off smithi176
2022-05-30T19:37:12.410 INFO:teuthology.orchestra.console:Power off smithi197
2022-05-30T19:37:12.426 INFO:teuthology.orchestra.console:Power off smithi084
2022-05-30T19:37:20.760 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-05-30T19:37:20.785 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-05-30T19:37:20.795 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2022-05-30T19:37:20.862 INFO:teuthology.orchestra.console:Power on smithi176
2022-05-30T19:37:20.886 INFO:teuthology.orchestra.console:Power on smithi197
2022-05-30T19:37:20.904 INFO:teuthology.orchestra.console:Power on smithi084
2022-05-30T19:37:29.252 INFO:teuthology.orchestra.console:Power on for smithi176 completed
2022-05-30T19:37:29.257 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2022-05-30T19:37:29.353 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2022-05-30T19:37:29.358 INFO:teuthology.orchestra.console:Power on for smithi084 completed
2022-05-30T19:37:29.358 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2022-05-30T19:37:29.458 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2022-05-30T19:41:32.930 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T19:41:58.355 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T19:41:58.628 INFO:teuthology.provision.fog.smithi176:Node is ready
2022-05-30T19:41:58.647 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2022-05-30T19:41:58.706 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2022-05-30T19:41:58.708 INFO:teuthology.provision.fog.smithi197:Node is ready
2022-05-30T19:41:58.731 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2022-05-30T19:41:58.790 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2022-05-30T19:41:59.065 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2022-05-30T19:41:59.159 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2022-05-30T19:42:13.491 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T19:42:13.753 INFO:teuthology.provision.fog.smithi084:Node is ready
2022-05-30T19:42:13.771 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com
2022-05-30T19:42:13.830 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084
2022-05-30T19:42:14.179 INFO:teuthology.provision.fog.smithi084:Deploy complete!
2022-05-30T19:42:14.386 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com
2022-05-30T19:42:14.387 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T19:42:14.417 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2022-05-30T19:42:14.418 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T19:42:14.440 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2022-05-30T19:42:14.440 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T19:42:14.463 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server
2022-05-30T19:42:14.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2022-05-30T19:42:14.667 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64
2022-05-30T19:42:14.725 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream"
2022-05-30T19:42:14.725 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8"
2022-05-30T19:42:14.725 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T19:42:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T19:42:14.728 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2022-05-30T19:42:14.749 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2022-05-30T19:42:14.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-05-30T19:42:15.040 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2022-05-30T19:42:15.097 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2022-05-30T19:42:15.097 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2022-05-30T19:42:15.098 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T19:42:15.099 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T19:42:15.099 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T19:42:15.099 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-05-30T19:42:15.123 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2022-05-30T19:42:15.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-05-30T19:42:15.407 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Stream"
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8"
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos"
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora"
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8"
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8"
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T19:42:15.465 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31"
2022-05-30T19:42:15.469 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T19:42:15.469 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://centos.org/"
2022-05-30T19:42:15.469 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T19:42:15.470 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T19:42:15.470 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T19:42:15.470 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-05-30T19:42:15.608 INFO:teuthology.dispatcher.supervisor:Running job 6853680
2022-05-30T19:42:15.609 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853680 --name rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853680/orig.config.yaml
2022-05-30T19:42:15.615 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853680
2022-05-30T19:42:15.615 INFO:teuthology.dispatcher.supervisor:Job PID: 7584
2022-05-30T19:42:15.615 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-31T02:12:43.549 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-31T02:12:43.733 INFO:teuthology.kill:Killing Pids: {7584}
2022-05-31T02:12:45.101 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2022-05-31T02:12:45.101 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['client.0']
2022-05-31T02:12:45.102 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['client.1']
2022-05-31T02:12:45.102 INFO:teuthology.misc:Compressing logs...
2022-05-31T02:12:45.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2022-05-31T02:12:45.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-05-31T02:12:45.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-05-31T02:12:45.885 INFO:teuthology.misc:Compressing logs...
2022-05-31T02:12:46.076 INFO:teuthology.misc:Compressing logs...
2022-05-31T02:15:12.022 INFO:teuthology.kill:No teuthology processes running
2022-05-31T02:15:13.446 INFO:teuthology.kill:Nuking machines: ['smithi084', 'smithi176', 'smithi197']
2022-05-31T02:15:14.524 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-31T02:15:14.524 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-31T02:15:14.524 INFO:teuthology.kill:2022-05-31 02:15:14,523.523 INFO:teuthology.nuke:targets:
2022-05-31T02:15:14.525 INFO:teuthology.kill:  smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxexQzwcSEOfoAEjogXV6JRxQfgyElP1Y/JDVQdk7OCXj+rdNVOZU1s2W3+qw/74XBQyZonvsGsCmhkhDgHG9q4eKjCt6kEMU1E3NZLK3k0Yt2+iM4sSpDgRrtcScqGoNH5Ipvdt+iXbAGfF/lFxKyV4ZxQo4hX60nl1M7AAlBV9MA0Qz70AGU/AHs6uyF9Q560FdWTl8MWKwmLQkfmnbQoulaoYu2QFgS4Sh6C6JumPKw1kzOot7hYz3m20XqQVD1GxlhAMdA4+CuTY/GlBr0VdeJ08esvrj5Y2sOF6xnN/Ojh8AMHBjqCILa4ZCJwcZtSlO7C8oQS6Q64iQMJGHUOgVEBodZcGnkGWnAOn3ETbkD/W0XsUF1zEloGo+0XaYrDHSyL3/axv7aI/6vQH6bdkCkFyLPnTfFecWbv0gvc1xpzPRQwiMIV1Pn8NkdKpv2apy5gyU1Lu8VJFqp9WS+/EajXbsPYogONRQ8UiiziC3IvrJRSlqBcZ4LpPjwBKk=
2022-05-31T02:15:14.525 INFO:teuthology.kill:  smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9Y/aXC6k909vEUpuExh4dOxa1ZdK6X4GlvpY2lB8Y17+VcIf7T+I1D3tOWy0zFVMenwFjyxrjlv+sZ07a6OgUFUgDaGC6hpEFU4NaAibC+9CRageH0uzaweH05Ke5S4pSorfYPKQAGImRXrkFpmTBAQvx5/EIO/Fh9qbmTdi5q482Dcj3v/rUB099VCRhMyOiWVqPOtwYwOb5EPjhQpMy4yQsJ0mlp6lzpX76FnJjrvglaAeovWehv2v0CbIOPMOT8bRunnglnalgHFGKXNJBrDKDEDe4fYR1JYw+WBQwIDR5Mrmjf3iYEg2xD5/qW8WXkRgFkuQ/Rd5vMEbl2d88wA7R9TXUuer1v6V/v3nalOA3q6mBoD2Ffl+iLuL2ev19r2ko7pORsZ6Nnoyqxl2tIyIbYkDAwhN7oO4RmmJRclnb7+fT9UP94pjdtM5tTw9fSi0YdrTqMrCbrLMCK5MM+uhcZwhGLnf9Xi5PD0DxsyX3hKAxqTRf6AscimZfT4c=
2022-05-31T02:15:14.525 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCl5/w926jMJaoctvu9RzL5iGF+a4Mfqgl2zilKkTEPyqeb0h8CYBBN9HAsTZ8y5181yQtnwG9iPdWnft4fbL95qRdFs8K4QB2qGOlCMPzf7EGI1lZ8yxOvuvm4SWbMFcxaZorADnCiaFxGqtHl9sMfatFIhXBYQ9L3aapFLXVzHnMPtj+cm69vuE+dJikYGQO/ihh4pvgZTAVKHxet1i8k42Z1ZN5HWyv0XWGOkWtuVAPj3HWV+4XAe5I8ZETEWpZs15UPqkOmvbnC3qKrugo3tN1EZePU4RXt9RMKAl7AJSoAHqDVVt0FA88/Tu3/rsd4V2BXDAI8ZhZuz2PcN9s7vGKAFpp/3MCKJNDLhJHy1T7Lx0cugZ/JxRxYbrwsCNwFSdyt9gN7emeGn54Qk5udyhDQWJMxGyo6tZr4H71rZfjuziczo0Op8TSMFO4hvJXKAv2d7jSS1nPzR8KD1IccMZx/7CrWIu/2vKU7G+N3y7s3HyNRdMCQxcSjKNMjNRs=
2022-05-31T02:15:14.554 INFO:teuthology.kill:2022-05-31 02:15:14,554.554 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-31T02:15:14.556 INFO:teuthology.kill:2022-05-31 02:15:14,555.555 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-31T02:15:14.559 INFO:teuthology.kill:2022-05-31 02:15:14,559.559 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-31T02:15:14.636 INFO:teuthology.kill:2022-05-31 02:15:14,636.636 INFO:teuthology.orchestra.console:Power off smithi084
2022-05-31T02:15:14.651 INFO:teuthology.kill:2022-05-31 02:15:14,651.651 INFO:teuthology.orchestra.console:Power off smithi197
2022-05-31T02:15:14.663 INFO:teuthology.kill:2022-05-31 02:15:14,663.663 INFO:teuthology.orchestra.console:Power off smithi176
2022-05-31T02:15:23.023 INFO:teuthology.kill:2022-05-31 02:15:23,023.023 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2022-05-31T02:15:23.028 INFO:teuthology.kill:2022-05-31 02:15:23,028.028 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-05-31T02:15:23.035 INFO:teuthology.kill:2022-05-31 02:15:23,035.035 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-05-31T02:15:23.178 INFO:teuthology.kill:2022-05-31 02:15:23,177.177 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com
2022-05-31T02:15:23.183 INFO:teuthology.kill:2022-05-31 02:15:23,183.183 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com
2022-05-31T02:15:23.184 INFO:teuthology.kill:2022-05-31 02:15:23,184.184 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com
2022-05-31T02:17:23.496 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15