2022-07-04T18:32:59.509 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-04T18:32:59.700 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2022-07-04T18:32:59.702 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2022-07-04T18:32:59.703 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-07-04T18:32:59.732 INFO:teuthology.lock.ops:Node 'smithi050.front.sepia.ceph.com' reimaging is complete
2022-07-04T18:32:59.733 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging
2022-07-04T18:32:59.734 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server
2022-07-04T18:32:59.734 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2022-07-04T18:32:59.762 INFO:teuthology.lock.ops:Node 'smithi089.front.sepia.ceph.com' reimaging is complete
2022-07-04T18:32:59.959 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream
2022-07-04T18:33:00.002 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream
2022-07-04T18:33:00.342 INFO:teuthology.orchestra.console:Power off smithi050
2022-07-04T18:33:00.382 INFO:teuthology.orchestra.console:Power off smithi089
2022-07-04T18:33:08.730 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-07-04T18:33:08.831 INFO:teuthology.orchestra.console:Power on smithi050
2022-07-04T18:33:12.879 INFO:teuthology.orchestra.console:Power off for smithi089 completed
2022-07-04T18:33:12.982 INFO:teuthology.orchestra.console:Power on smithi089
2022-07-04T18:33:17.209 INFO:teuthology.orchestra.console:Power on for smithi050 completed
2022-07-04T18:33:17.237 INFO:teuthology.orchestra.console:Power on for smithi089 completed
2022-07-04T18:33:17.312 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2022-07-04T18:33:17.338 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish
2022-07-04T18:35:33.485 ERROR:teuthology.orchestra.connection:Error authenticating with smithi050.front.sepia.ceph.com: Authentication failed.
2022-07-04T18:35:48.578 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: Authentication failed.
2022-07-04T18:36:59.744 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-04T18:37:20.320 INFO:teuthology.provision.fog.smithi050:Node is ready
2022-07-04T18:37:20.342 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2022-07-04T18:37:20.401 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2022-07-04T18:37:20.763 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2022-07-04T18:37:24.890 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-04T18:37:50.523 INFO:teuthology.provision.fog.smithi089:Node is ready
2022-07-04T18:37:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com
2022-07-04T18:37:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089
2022-07-04T18:37:50.968 INFO:teuthology.provision.fog.smithi089:Deploy complete!
2022-07-04T18:37:51.150 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2022-07-04T18:37:51.151 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-04T18:37:51.176 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com
2022-07-04T18:37:51.177 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-04T18:37:51.204 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2022-07-04T18:37:51.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-07-04T18:37:51.496 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2022-07-04T18:37:51.555 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2022-07-04T18:37:51.556 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2022-07-04T18:37:51.556 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2022-07-04T18:37:51.556 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2022-07-04T18:37:51.557 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2022-07-04T18:37:51.557 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2022-07-04T18:37:51.557 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-04T18:37:51.558 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2022-07-04T18:37:51.558 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-04T18:37:51.559 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2022-07-04T18:37:51.559 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-04T18:37:51.560 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-04T18:37:51.560 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-04T18:37:51.561 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-07-04T18:37:51.583 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server
2022-07-04T18:37:51.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2022-07-04T18:37:51.790 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64
2022-07-04T18:37:51.848 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream"
2022-07-04T18:37:51.848 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8"
2022-07-04T18:37:51.848 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos"
2022-07-04T18:37:51.848 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora"
2022-07-04T18:37:51.849 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8"
2022-07-04T18:37:51.849 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8"
2022-07-04T18:37:51.849 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-04T18:37:51.849 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2022-07-04T18:37:51.850 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-04T18:37:51.850 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/"
2022-07-04T18:37:51.850 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-04T18:37:51.850 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-04T18:37:51.851 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-04T18:37:51.851 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2022-07-04T18:37:51.965 INFO:teuthology.dispatcher.supervisor:Running job 6912709
2022-07-04T18:37:51.965 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6912709 --name dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi --description fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6912709/orig.config.yaml
2022-07-04T18:37:51.971 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6912709
2022-07-04T18:37:51.972 INFO:teuthology.dispatcher.supervisor:Job PID: 11493
2022-07-04T18:37:51.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-05T06:38:17.006 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-05T06:38:17.329 INFO:teuthology.kill:Killing Pids: {11493}
2022-07-05T06:38:21.281 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-07-05T06:38:21.293 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-07-05T06:38:21.293 INFO:teuthology.misc:Compressing logs...
2022-07-05T06:38:21.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-07-05T06:38:21.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2022-07-05T06:38:22.174 INFO:teuthology.misc:Compressing logs...
2022-07-05T06:38:22.596 INFO:teuthology.misc:Compressing logs...
2022-07-05T06:38:25.530 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-07-05T06:38:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-07-05T06:38:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-mgr.smithi050.qcuvbb.log: file size changed while zipping
2022-07-05T06:38:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-07-05T06:38:30.317 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-mon.smithi089.log: file size changed while zipping
2022-07-05T06:38:30.835 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-07-05T06:38:34.052 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-07-05T06:38:34.566 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-07-05T06:38:40.797 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/56b3a39e-fbc9-11ec-842c-001a4aab830c/ceph-mon.smithi050.log: file size changed while zipping
2022-07-05T06:39:54.346 INFO:teuthology.kill:No teuthology processes running
2022-07-05T06:39:57.218 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi089']
2022-07-05T06:39:59.295 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-05T06:39:59.296 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-05T06:39:59.297 INFO:teuthology.kill:2022-07-05 06:39:59,295.295 INFO:teuthology.nuke:targets:
2022-07-05T06:39:59.297 INFO:teuthology.kill:  smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpepZopCT97+97x5t1/b4Aa3oWQBgaswfkmsr4kKYDFT8OchCp1lEzG3n3HMQtrvMcfanwT9FNG85UReg0dlRtbcgqm3xPfmJxCG+GRmTtALRv+zn8kpx5c5WfUF3rzqOhGG6/QiqzPsmW0cskzfvPPOQJscDS6I3KtSKQCcqIJWyDsVlqKO8pmjmGSK4HGSiWvKIz8l2EixAuxljrf66fHo7a7CwzrpqSrWq4M0l+A5gRpdJcB6oBKpQartgk6xqE1JwAjfq8e+cUqPYGCR6VvzEKGtor6Qi7sN/XshiE0xw4F+SbqezMo4jwbAiM7UzPd4O04q8urjcrZfl1vUTPMhDAxonaXJ1NNWastCB7XL16LA/WxC6JTkNgMyVlfIaoLoQqYlyN6MP1z2WZEJxfdgLyBjmPHaRq/uUOG6PEOaFX/h+cyJ4/rZQ6h/c20Qv5ZpGnjKS7iSnY+uz8FoY2CYMO9BL/lU+BChjiPTyBYULiIyXExFC0XrqRPDhAveM=
2022-07-05T06:39:59.297 INFO:teuthology.kill:  smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyz6thM/Aoi/WAPdHJIv3TL9zvHTfrsrAyjHo5z2WQbzVAI2HSCHD/mMMgHQW/hI3IcllsOHVPs+nhSBL/HwvPb6K91NDZyJP1a9P27pQjdOp/0dQ4vFwDdeKykJ70RKMKNyZRhfc8W8Hq+EP9f/ySvW7F8WxMud/BrhSu7UNPxHGdZWXxglkJGl4JRnZt+oNa516cGeUWWVFEGZBBPjiKRy8tVnSQKgtAoY/2j5IiXD+1r0OBs0RoIvvzmD9vQJfuqAVuxDamotwq4kzaRPpgwCWshnj0AoJ0xczQ7vWQyngOAVkQu9jril96756rvb3r7kYurs6xPloEdOCKIA/UC+I6FbHixjOU+B7IMMNZ6G84Hx/lZstBudwSE6dWCprcgUXMSYEQHIppYYIRgPrKtl/G6H89HUqOBxw9w0l/dIWZnzKBaSbJblAS8S3gPCrnuBjhDoFMcPq2VwNYhougVfTrvp54IqY8al3sBBA5EhB3C5gY06O4q56A0So/5q0=
2022-07-05T06:39:59.297 INFO:teuthology.kill:2022-07-05 06:39:59,295.295 INFO:teuthology.nuke:Checking targets against current locks
2022-07-05T06:39:59.409 INFO:teuthology.kill:2022-07-05 06:39:59,408.408 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-05T06:39:59.448 INFO:teuthology.kill:2022-07-05 06:39:59,447.447 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-05T06:39:59.543 INFO:teuthology.kill:2022-07-05 06:39:59,542.542 INFO:teuthology.orchestra.console:Power off smithi050
2022-07-05T06:39:59.572 INFO:teuthology.kill:2022-07-05 06:39:59,570.570 INFO:teuthology.orchestra.console:Power off smithi089
2022-07-05T06:40:12.090 INFO:teuthology.kill:2022-07-05 06:40:12,089.089 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-07-05T06:40:12.109 INFO:teuthology.kill:2022-07-05 06:40:12,108.108 INFO:teuthology.orchestra.console:Power off for smithi089 completed
2022-07-05T06:40:12.264 INFO:teuthology.kill:2022-07-05 06:40:12,263.263 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2022-07-05T06:40:12.276 INFO:teuthology.kill:2022-07-05 06:40:12,274.274 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com
2022-07-05T06:42:12.649 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-05T06:42:12.921 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/dparmar-2022-07-05_05:21:58-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6913726
2022-07-05T06:42:12.922 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi089 but it was locked by another job: /home/teuthworker/archive/dparmar-2022-07-05_05:21:58-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6913726