2022-05-30T08:33:49.647 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f
2022-05-30T08:33:49.859 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2022-05-30T08:33:49.859 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T08:33:49.860 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2022-05-30T08:33:49.878 INFO:teuthology.lock.ops:Node 'smithi154.front.sepia.ceph.com' reimaging is complete
2022-05-30T08:33:49.883 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2022-05-30T08:33:49.884 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T08:33:49.884 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-05-30T08:33:49.908 INFO:teuthology.lock.ops:Node 'smithi167.front.sepia.ceph.com' reimaging is complete
2022-05-30T08:33:49.908 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2022-05-30T08:33:49.909 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2022-05-30T08:33:49.909 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-05-30T08:33:49.930 INFO:teuthology.lock.ops:Node 'smithi176.front.sepia.ceph.com' reimaging is complete
2022-05-30T08:33:50.106 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream
2022-05-30T08:33:50.169 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.stream
2022-05-30T08:33:50.201 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 8.stream
2022-05-30T08:33:50.625 INFO:teuthology.orchestra.console:Power off smithi154
2022-05-30T08:33:50.739 INFO:teuthology.orchestra.console:Power off smithi176
2022-05-30T08:33:50.759 INFO:teuthology.orchestra.console:Power off smithi167
2022-05-30T08:33:59.096 INFO:teuthology.orchestra.console:Power off for smithi154 completed
2022-05-30T08:33:59.137 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-05-30T08:33:59.198 INFO:teuthology.orchestra.console:Power on smithi154
2022-05-30T08:33:59.247 INFO:teuthology.orchestra.console:Power on smithi167
2022-05-30T08:34:03.241 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-05-30T08:34:03.344 INFO:teuthology.orchestra.console:Power on smithi176
2022-05-30T08:34:07.593 INFO:teuthology.orchestra.console:Power on for smithi154 completed
2022-05-30T08:34:07.613 INFO:teuthology.orchestra.console:Power on for smithi176 completed
2022-05-30T08:34:07.629 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2022-05-30T08:34:07.694 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2022-05-30T08:34:07.714 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2022-05-30T08:34:07.729 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2022-05-30T08:36:40.462 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: Authentication failed.
2022-05-30T08:38:23.824 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T08:38:38.312 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T08:38:38.578 INFO:teuthology.provision.fog.smithi176:Node is ready
2022-05-30T08:38:38.637 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2022-05-30T08:38:38.695 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2022-05-30T08:38:39.054 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2022-05-30T08:38:48.789 INFO:teuthology.provision.fog.smithi154:Node is ready
2022-05-30T08:38:48.812 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2022-05-30T08:38:48.871 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2022-05-30T08:38:49.252 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2022-05-30T08:38:56.038 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-30T08:38:56.308 INFO:teuthology.provision.fog.smithi167:Node is ready
2022-05-30T08:38:56.325 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2022-05-30T08:38:56.383 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2022-05-30T08:38:56.728 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2022-05-30T08:38:57.006 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2022-05-30T08:38:57.007 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T08:38:57.027 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2022-05-30T08:38:57.027 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T08:38:57.050 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2022-05-30T08:38:57.050 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-30T08:38:57.070 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2022-05-30T08:38:57.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2022-05-30T08:38:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2022-05-30T08:38:57.346 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2022-05-30T08:38:57.346 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2022-05-30T08:38:57.346 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2022-05-30T08:38:57.346 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2022-05-30T08:38:57.347 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2022-05-30T08:38:57.347 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2022-05-30T08:38:57.347 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T08:38:57.347 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2022-05-30T08:38:57.347 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T08:38:57.348 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2022-05-30T08:38:57.348 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T08:38:57.348 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T08:38:57.348 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T08:38:57.350 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2022-05-30T08:38:57.372 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2022-05-30T08:38:57.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-05-30T08:38:57.579 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2022-05-30T08:38:57.636 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2022-05-30T08:38:57.636 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8"
2022-05-30T08:38:57.636 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2022-05-30T08:38:57.636 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T08:38:57.637 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T08:38:57.638 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-05-30T08:38:57.659 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2022-05-30T08:38:57.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-05-30T08:38:57.820 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2022-05-30T08:38:57.879 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2022-05-30T08:38:57.879 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2022-05-30T08:38:57.879 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2022-05-30T08:38:57.879 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2022-05-30T08:38:57.880 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2022-05-30T08:38:57.880 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2022-05-30T08:38:57.880 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-30T08:38:57.880 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2022-05-30T08:38:57.880 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-30T08:38:57.880 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2022-05-30T08:38:57.881 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-30T08:38:57.881 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-30T08:38:57.881 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-30T08:38:57.882 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-05-30T08:38:57.998 INFO:teuthology.dispatcher.supervisor:Running job 6853173
2022-05-30T08:38:57.998 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-05-30_06:01:21-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853173 --name rishabh-2022-05-30_06:01:21-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/rishabh-2022-05-30_06:01:21-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853173/orig.config.yaml
2022-05-30T08:38:58.004 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-05-30_06:01:21-fs-wip-vshankar-testing-20220527-073645-distro-basic-smithi/6853173
2022-05-30T08:38:58.004 INFO:teuthology.dispatcher.supervisor:Job PID: 13851
2022-05-30T08:38:58.005 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-30T15:09:09.965 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-30T15:09:10.130 INFO:teuthology.kill:Killing Pids: {13851}
2022-05-30T15:09:11.663 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2022-05-30T15:09:11.663 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['client.0']
2022-05-30T15:09:11.663 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['client.1']
2022-05-30T15:09:11.663 INFO:teuthology.misc:Compressing logs...
2022-05-30T15:09:11.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2022-05-30T15:09:11.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-05-30T15:09:12.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-05-30T15:09:12.444 INFO:teuthology.misc:Compressing logs...
2022-05-30T15:09:12.633 INFO:teuthology.misc:Compressing logs...
2022-05-30T15:11:36.725 INFO:teuthology.kill:No teuthology processes running
2022-05-30T15:11:38.258 INFO:teuthology.kill:Nuking machines: ['smithi154', 'smithi167', 'smithi176']
2022-05-30T15:11:39.464 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-30T15:11:39.465 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-30T15:11:39.465 INFO:teuthology.kill:2022-05-30 15:11:39,464.464 INFO:teuthology.nuke:targets:
2022-05-30T15:11:39.465 INFO:teuthology.kill:  smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOlbR+NGjnE90I52o/66tKmsg5ypKUiWTKFhGhEtvYKjkCX6zvoiCAZaAOl4JiqS76TQu+BHn1Cghsgz6f+cOuH6GLVchX9jSGIseeb5dM4aFenF3mfuGb+0Rg2t7yHWvq4SWP18k5kP+WpiycodOO6qIj+O7McQ+GCcBSF+IW3VhlV3m5czG4ercOFN/MCeKsedxtT6PWS4eitpH0FaOrrYZUbYZPBIJBD2H2WZSjj8Hi3fbzFIwN/FQiBLJMi9NGae8xWjoUjoyS3Z1sgRvT6nW88bnVSurnGGtiUO3Ta69Nm4bAEiWCghXgeIPV56DUPNwo0pQegn55PGtkGcDPY2hOOkQ4tEpOh5F4GWZuHaqXX7uxOCxWLAvNlw7Daq6d4XqG+inMDXhjhbhTP1RKgAljtAkvBlVIDCv+EA6B1IqKsvtU8lVVSFRsyddB4Ai6Bfi/zqtjJHPMOZmtAA900MFaQFTPHOvf8IV/ozhK0yHlT0cFbe5C56GnvbpazzE=
2022-05-30T15:11:39.465 INFO:teuthology.kill:  smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU8vOG2esux2OigfNM5avLlO55aehTSPW3OFGlQh8b0tqX1Gz/4ROo4q48jhtZp57r0OglB84vETzkTOIJ8bMFX4hn7c8nMeW1yAkMkgdCAQfskK6I0I7xjOngcuewqlQjp8+tFeFJ5rH8wSYbJUv9lgJGyIYu1rl20Gma6h0RrB1Gml3q9sl5d0Skckt0xIgprbc+nn6y8fT/hgCSwrauz/Ip01P51voVExz4cvYbnCkhZ/pG9YqyUpRSxN4W5WY+erXMVmNi0muMJD12wdiLIl+5R8+y7fUhWM4u2zMGLlNLoEsSeklfqKTTiaowf7tBqtEDEPVVSWMWJNm1Wn5SFzNtYLfYFoI9zx+7O4BzsFm4Geph4/21JBe7UXPHqKcYhWqkdRz8rCi8BdyrPBj4W/NBQTttu3tfXP6dEkj2bc9gm9EQ2W7whVwfpxu8XN5O7Vt+yrARzjNhmluPfAIKA4IMwTVwNRVQLu3LwS42e1uS2zJ3p0C491ybtZGJRds=
2022-05-30T15:11:39.465 INFO:teuthology.kill:  smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJRPmwV7FjzDODfudTpNYBzp5jhg5mxmjomCCOwMIbhQbX48eMEgNmgrKqXN6GTSoXLb4yraCEAPooKdTo1nJWYXYQngfIrmvUNxFatuKRr7mJ4H1D1VE/zcAcESyofbAKqgH8gMPqmx1gWpAENr6a86sbgiX17xlBrMpMkRaFARYHoxDdriS3s6FvXCOCMiFifZU+rXLQeBKFjHWKXswHoWaax/xOkTfKd6iVzcz5xPN6RDWsIoKf1frsV4KQA7DB16q8n5H0YaADdBUlSAlmovqW7SY7FnJmYmKydkp5PJjeNrxHgTiutr3GmJAguyO9Fpz34z8rd3ytkpL1Vua4tkG6a8uBsY4ESAuJmJMUukiedyK69SIIszb1ZfYA0UbM/Zws6+z0/7yEzLhKoeKc9BhLOGJFVbDgpWLlSXls6lBQg7g4dRM/hp2jgJus3aQawlZ4uuYRzMCM4STdyzQCuBfBKwGxUzwFhzHbrAfkgCKmA1V5AFn1kL3l5sHV/0s=
2022-05-30T15:11:39.495 INFO:teuthology.kill:2022-05-30 15:11:39,495.495 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-30T15:11:39.499 INFO:teuthology.kill:2022-05-30 15:11:39,499.499 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-30T15:11:39.500 INFO:teuthology.kill:2022-05-30 15:11:39,500.500 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-30T15:11:39.581 INFO:teuthology.kill:2022-05-30 15:11:39,580.580 INFO:teuthology.orchestra.console:Power off smithi176
2022-05-30T15:11:39.595 INFO:teuthology.kill:2022-05-30 15:11:39,594.594 INFO:teuthology.orchestra.console:Power off smithi154
2022-05-30T15:11:39.606 INFO:teuthology.kill:2022-05-30 15:11:39,606.606 INFO:teuthology.orchestra.console:Power off smithi167
2022-05-30T15:11:47.959 INFO:teuthology.kill:2022-05-30 15:11:47,959.959 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-05-30T15:11:47.965 INFO:teuthology.kill:2022-05-30 15:11:47,964.964 INFO:teuthology.orchestra.console:Power off for smithi154 completed
2022-05-30T15:11:47.971 INFO:teuthology.kill:2022-05-30 15:11:47,971.971 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-05-30T15:11:48.108 INFO:teuthology.kill:2022-05-30 15:11:48,107.107 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com
2022-05-30T15:11:48.112 INFO:teuthology.kill:2022-05-30 15:11:48,112.112 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com
2022-05-30T15:11:48.121 INFO:teuthology.kill:2022-05-30 15:11:48,121.121 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com
2022-05-30T15:13:48.341 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-05-30T15:13:48.546 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/nshelke-2022-05-30_10:45:51-fs:volumes-wip-nshelke-data-metadata-pools-testing-distro-default-smithi/6853457
2022-05-30T15:13:48.546 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi176 but it was locked by another job: /home/teuthworker/archive/nshelke-2022-05-30_10:45:51-fs:volumes-wip-nshelke-data-metadata-pools-testing-distro-default-smithi/6853457