2022-05-30T19:24:54.306 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f
2022-05-30T19:24:54.483 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2022-05-30T19:24:54.484 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T19:24:54.484 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-05-30T19:24:54.508 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete
2022-05-30T19:24:54.508 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2022-05-30T19:24:54.508 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T19:24:54.508 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2022-05-30T19:24:54.531 INFO:teuthology.lock.ops:Node 'smithi066.front.sepia.ceph.com' reimaging is complete
2022-05-30T19:24:54.531 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2022-05-30T19:24:54.531 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T19:24:54.531 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-05-30T19:24:54.551 INFO:teuthology.lock.ops:Node 'smithi136.front.sepia.ceph.com' reimaging is complete
2022-05-30T19:24:54.729 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.stream
2022-05-30T19:24:54.762 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 8.stream
2022-05-30T19:24:54.772 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream
2022-05-30T19:24:55.085 INFO:teuthology.orchestra.console:Power off smithi045
2022-05-30T19:24:55.104 INFO:teuthology.orchestra.console:Power off smithi066
2022-05-30T19:24:55.153 INFO:teuthology.orchestra.console:Power off smithi136
2022-05-30T19:25:03.460 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-05-30T19:25:03.517 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-05-30T19:25:03.562 INFO:teuthology.orchestra.console:Power on smithi045
2022-05-30T19:25:03.619 INFO:teuthology.orchestra.console:Power on smithi136
2022-05-30T19:25:07.594 INFO:teuthology.orchestra.console:Power off for smithi066 completed
2022-05-30T19:25:07.696 INFO:teuthology.orchestra.console:Power on smithi066
2022-05-30T19:25:11.933 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2022-05-30T19:25:11.985 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2022-05-30T19:25:12.035 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2022-05-30T19:25:12.086 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2022-05-30T19:25:16.063 INFO:teuthology.orchestra.console:Power on for smithi066 completed
2022-05-30T19:25:16.164 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2022-05-30T19:29:15.385 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T19:29:16.687 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T19:29:16.959 INFO:teuthology.provision.fog.smithi045:Node is ready
2022-05-30T19:29:16.976 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2022-05-30T19:29:17.034 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2022-05-30T19:29:17.407 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2022-05-30T19:29:40.353 INFO:teuthology.provision.fog.smithi136:Node is ready
2022-05-30T19:29:40.375 INFO:teuthology.orchestra.run.smithi136.stdout:smithi178
2022-05-30T19:29:40.435 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2022-05-30T19:29:40.816 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2022-05-30T19:30:41.186 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T19:31:06.402 INFO:teuthology.provision.fog.smithi066:Node is ready
2022-05-30T19:31:06.457 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2022-05-30T19:31:06.517 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2022-05-30T19:31:06.890 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2022-05-30T19:31:07.079 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2022-05-30T19:31:07.080 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T19:31:07.103 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2022-05-30T19:31:07.103 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T19:31:07.121 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2022-05-30T19:31:07.122 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T19:31:07.142 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2022-05-30T19:31:07.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-05-30T19:31:07.413 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream"
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8"
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos"
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora"
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8"
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T19:31:07.472 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2022-05-30T19:31:07.473 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T19:31:07.473 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/"
2022-05-30T19:31:07.473 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T19:31:07.473 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T19:31:07.473 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T19:31:07.474 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-05-30T19:31:07.494 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2022-05-30T19:31:07.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2022-05-30T19:31:07.658 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2022-05-30T19:31:07.715 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2022-05-30T19:31:07.716 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T19:31:07.717 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2022-05-30T19:31:07.717 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T19:31:07.717 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T19:31:07.717 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T19:31:07.717 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2022-05-30T19:31:07.735 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2022-05-30T19:31:07.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-05-30T19:31:08.017 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2022-05-30T19:31:08.075 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2022-05-30T19:31:08.075 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8"
2022-05-30T19:31:08.075 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2022-05-30T19:31:08.075 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T19:31:08.076 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T19:31:08.077 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-05-30T19:31:08.185 INFO:teuthology.dispatcher.supervisor:Running job 6853666
2022-05-30T19:31:08.185 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853666 --name rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853666/orig.config.yaml
2022-05-30T19:31:08.191 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-05-30_19:19:24-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853666
2022-05-30T19:31:08.191 INFO:teuthology.dispatcher.supervisor:Job PID: 29424
2022-05-30T19:31:08.191 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-31T02:01:36.158 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-31T02:01:36.544 INFO:teuthology.kill:Killing Pids: {29424}
2022-05-31T02:01:38.044 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2022-05-31T02:01:38.044 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['client.0']
2022-05-31T02:01:38.044 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['client.1']
2022-05-31T02:01:38.044 INFO:teuthology.misc:Compressing logs...
2022-05-31T02:01:38.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-05-31T02:01:38.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2022-05-31T02:01:38.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-05-31T02:01:38.860 INFO:teuthology.misc:Compressing logs...
2022-05-31T02:01:39.021 INFO:teuthology.misc:Compressing logs...
2022-05-31T02:04:16.578 INFO:teuthology.kill:No teuthology processes running
2022-05-31T02:04:17.848 INFO:teuthology.kill:Nuking machines: ['smithi045', 'smithi066', 'smithi136']
2022-05-31T02:04:18.933 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-31T02:04:18.934 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-31T02:04:18.934 INFO:teuthology.kill:2022-05-31 02:04:18,933.933 INFO:teuthology.nuke:targets:
2022-05-31T02:04:18.934 INFO:teuthology.kill:  smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC31UhPSl7J9ntPk5boCfBXcJItn+nxTBF5T48350AVFoemQqNS/zdJEk6PtrFsQcM/3XfF6RDAs18kaKcwJaYmvZw1NoJZWhzaD9kjXT9lgtGVbHgmdLnA+odrnX1HWaFXDBGq+D4k8fl5aw57DnXUW3lmuB3L0MzPtjfbhgvnSh71MHbbTNytYbjrvZHZK5S+gn/66msivDq/yofk1lTgsl+EHdG2ZBwWzTltpi91Y1LA6IfhwBvLyfLvF9Up8Tur8vLR22UP8svW5hbiurnKFo5UPyPPqdPrjYssfWkUiwGGcRB4aTho/SmMpH7XvAt8hk8Q8sT6cMBlF/GmlDX22sq+fLZsbQKi98qF5yCcpElvQPWYOtqjTWMrl403QJ8Hw4TqtonXdghGMRPinC2VxKSwOrxmuCSOr5R3e64MnYwKf5hsIo6O1DPuVCDGc6J/wqT219g/7RPnPgrySLkQwpnsUho//9705wLBCwNuBwZdJnthdV60K+MYvO2OX20=
2022-05-31T02:04:18.934 INFO:teuthology.kill:  smithi066.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa82x2Bkxb6CkltP4nrZVsh11L66sS6+wDlR+shrJAcLgFr5EmHs+WOn+YJ2IRM1R+WNSw6AGPF6hWPjcKeN5RyKlaxKRrTq2OegRUkUfgWi90+SiAvf8cVIHq07PNkgi+2zYgsTM8kzYwFwI0kQR0xElbUdmetUBtpDxBhTlOL22uvDfS/SmMbxDiz1fVDbXep7CGBd7DmlP5iT7p1rlJcgCe1Y9R/odEK0r9Q/aftBYKypVgg9hOZZicY/Qt7sK9dKDo+akmD+tmujJyOyn3MggIN/GREmpQ5A2IQzc4trxbXXazPldavn50rYy1Sa0L0Lzg8vEM34T4o8dDmRrsB254x2bBgdbPRRTl/jVnUIkTxTEycP7YPyxRSyeQyFg9mpmkOaaIR+nrRwDMApb/Bb+zh+DriNigoBYxmPVrNQvTfMKlW3CDUL7x10MdZkR5Z+cYX0rT5yG89GwR1obSnuUkLLlr4fT2ISIDVO7UyA4jjGMap0TQpsbhubDjQ1k=
2022-05-31T02:04:18.934 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6prftYmQBHloR//rMd/auoaT6OFfWg4nr7mqI8bKyLLDE/IdVWPME3JxrD5m7x69TThHKmeiUlbBtWaDh8mtVul3qJCunZZTaOvf2c84RJqnoIblIVqRwrThA8WH+kHJ98NbkRmHWJj86WOM7j7M+FTFPkVNiYPosYmcV5/lBSuCLiIt70bW677Blr3dY+se1Cdu+QWGRYFT8B5dzZqhwtOmmpwNMwjBwaITFJKXJXCOMrK5GBs4JWdaYl09jnet/DT7xYcO1kP7aDFUbLBSRj0c4kp3qNu4CrdZl/m4t0wEQg6j3Qvh5tOIVtqzf+UBBfO/EJz2aCQeqHtSd3h9gTnRndMKvGtBzsnf69nFtcppIhViF3u2zSyJk+ndoADhOknEeDxgOMP1T/DkBgYEm+oYkzP25wSdNfswcPAP8znx4nLsb4PRIg22o5ZlgPtwSzUjWqwpr0mu4ZgH4RFshDX+e/mPxfg1bJ3+RclmqP7pzanTQ5c1bSwhfER9u02k=
2022-05-31T02:04:18.963 INFO:teuthology.kill:2022-05-31 02:04:18,962.962 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-31T02:04:18.967 INFO:teuthology.kill:2022-05-31 02:04:18,966.966 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-31T02:04:18.968 INFO:teuthology.kill:2022-05-31 02:04:18,968.968 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-31T02:04:19.052 INFO:teuthology.kill:2022-05-31 02:04:19,052.052 INFO:teuthology.orchestra.console:Power off smithi045
2022-05-31T02:04:19.067 INFO:teuthology.kill:2022-05-31 02:04:19,066.066 INFO:teuthology.orchestra.console:Power off smithi136
2022-05-31T02:04:19.078 INFO:teuthology.kill:2022-05-31 02:04:19,078.078 INFO:teuthology.orchestra.console:Power off smithi066
2022-05-31T02:04:27.436 INFO:teuthology.kill:2022-05-31 02:04:27,436.436 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-05-31T02:04:27.440 INFO:teuthology.kill:2022-05-31 02:04:27,440.440 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-05-31T02:04:27.593 INFO:teuthology.kill:2022-05-31 02:04:27,592.592 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2022-05-31T02:04:27.595 INFO:teuthology.kill:2022-05-31 02:04:27,595.595 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2022-05-31T02:04:31.561 INFO:teuthology.kill:2022-05-31 02:04:31,560.560 INFO:teuthology.orchestra.console:Power off for smithi066 completed
2022-05-31T02:04:31.711 INFO:teuthology.kill:2022-05-31 02:04:31,711.711 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com
2022-05-31T02:06:32.031 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15