2022-05-08T17:09:49.878 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166
2022-05-08T17:09:50.012 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2022-05-08T17:09:50.015 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2022-05-08T17:09:50.015 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2022-05-08T17:09:50.033 INFO:teuthology.lock.ops:Node 'smithi103.front.sepia.ceph.com' reimaging is complete
2022-05-08T17:09:50.034 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2022-05-08T17:09:50.034 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2022-05-08T17:09:50.034 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2022-05-08T17:09:50.054 INFO:teuthology.lock.ops:Node 'smithi152.front.sepia.ceph.com' reimaging is complete
2022-05-08T17:09:50.251 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.stream
2022-05-08T17:09:50.256 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream
2022-05-08T17:09:50.623 INFO:teuthology.orchestra.console:Power off smithi103
2022-05-08T17:09:50.645 INFO:teuthology.orchestra.console:Power off smithi152
2022-05-08T17:09:59.004 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2022-05-08T17:09:59.105 INFO:teuthology.orchestra.console:Power on smithi103
2022-05-08T17:10:03.121 INFO:teuthology.orchestra.console:Power off for smithi152 completed
2022-05-08T17:10:03.223 INFO:teuthology.orchestra.console:Power on smithi152
2022-05-08T17:10:07.479 INFO:teuthology.orchestra.console:Power on for smithi103 completed
2022-05-08T17:10:07.580 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2022-05-08T17:10:11.587 INFO:teuthology.orchestra.console:Power on for smithi152 completed
2022-05-08T17:10:11.688 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2022-05-08T17:14:58.455 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-08T17:14:58.733 INFO:teuthology.provision.fog.smithi152:Node is ready
2022-05-08T17:14:58.752 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2022-05-08T17:14:58.810 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2022-05-08T17:14:59.151 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2022-05-08T17:15:12.471 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-08T17:15:12.721 INFO:teuthology.provision.fog.smithi103:Node is ready
2022-05-08T17:15:12.738 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com
2022-05-08T17:15:12.796 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103
2022-05-08T17:15:13.142 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2022-05-08T17:15:13.320 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2022-05-08T17:15:13.321 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-08T17:15:13.339 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2022-05-08T17:15:13.340 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-08T17:15:13.370 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2022-05-08T17:15:13.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2022-05-08T17:15:13.567 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2022-05-08T17:15:13.622 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2022-05-08T17:15:13.623 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8"
2022-05-08T17:15:13.623 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2022-05-08T17:15:13.623 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2022-05-08T17:15:13.623 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8"
2022-05-08T17:15:13.624 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8"
2022-05-08T17:15:13.624 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-08T17:15:13.624 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2022-05-08T17:15:13.624 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-08T17:15:13.624 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2022-05-08T17:15:13.625 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-08T17:15:13.625 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-08T17:15:13.625 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-08T17:15:13.626 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2022-05-08T17:15:13.645 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2022-05-08T17:15:13.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2022-05-08T17:15:13.905 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2022-05-08T17:15:13.961 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2022-05-08T17:15:13.962 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8"
2022-05-08T17:15:13.962 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2022-05-08T17:15:13.962 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2022-05-08T17:15:13.963 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8"
2022-05-08T17:15:13.963 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2022-05-08T17:15:13.963 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-08T17:15:13.963 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2022-05-08T17:15:13.963 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-08T17:15:13.964 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2022-05-08T17:15:13.964 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-08T17:15:13.964 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-08T17:15:13.964 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-08T17:15:13.965 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2022-05-08T17:15:14.064 INFO:teuthology.dispatcher.supervisor:Running job 6819106
2022-05-08T17:15:14.065 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-05-03_03:15:03-fs-quincy-distro-default-smithi/6819106 --name teuthology-2022-05-03_03:15:03-fs-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/teuthology-2022-05-03_03:15:03-fs-quincy-distro-default-smithi/6819106/orig.config.yaml
2022-05-08T17:15:14.068 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-05-03_03:15:03-fs-quincy-distro-default-smithi/6819106
2022-05-08T17:15:14.069 INFO:teuthology.dispatcher.supervisor:Job PID: 16149
2022-05-08T17:15:14.069 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-08T23:45:43.668 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-08T23:45:43.847 INFO:teuthology.kill:Killing Pids: {16149}
2022-05-08T23:45:45.318 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-05-08T23:45:45.319 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-05-08T23:45:45.319 INFO:teuthology.misc:Compressing logs...
2022-05-08T23:45:45.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2022-05-08T23:45:45.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2022-05-08T23:45:45.848 INFO:teuthology.misc:Compressing logs...
2022-05-08T23:45:46.093 INFO:teuthology.misc:Compressing logs...
2022-05-08T23:45:53.371 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-05-08T23:45:53.904 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-05-08T23:45:59.392 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-mon.smithi152.log: file size changed while zipping
2022-05-08T23:46:09.694 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-05-08T23:46:12.018 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-mds.cephfs.smithi152.zcaqwe.log: file size changed while zipping
2022-05-08T23:46:17.209 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-mds.cephfs.smithi103.xrpxto.log: file size changed while zipping
2022-05-08T23:46:19.384 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-mgr.smithi103.uirrwh.log: file size changed while zipping
2022-05-08T23:46:20.865 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-05-08T23:46:21.759 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-mds.cephfs.smithi103.ymouzc.log: file size changed while zipping
2022-05-08T23:46:32.779 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-mon.smithi103.log: file size changed while zipping
2022-05-08T23:46:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-05-08T23:46:42.663 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-mds.cephfs.smithi152.htxdrg.log: file size changed while zipping
2022-05-08T23:46:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/45e22656-cef3-11ec-8c39-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-05-08T23:47:14.780 INFO:teuthology.kill:No teuthology processes running
2022-05-08T23:47:16.107 INFO:teuthology.kill:Nuking machines: ['smithi103', 'smithi152']
2022-05-08T23:47:17.239 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-08T23:47:17.239 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-08T23:47:17.240 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-05-08T23:47:17.240 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-05-08T23:47:17.240 INFO:teuthology.kill:2022-05-08 23:47:17,238.238 INFO:teuthology.nuke:targets:
2022-05-08T23:47:17.241 INFO:teuthology.kill:  smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/V0WRZTGozupPw102/q2kQ9kRMMJIAyJeXUEHB3xhT4QITh0ZLmEvTrdKJRHoAFrU1G4I6GKI28/MlUQdfZJN4TvZnCfDXewCNCnqhPNyt2r7OFkPVM1ysSZLIBYeIvM3J/GtVjUkhcCCaLxbePTmwynJlcWxqniFvTiDnFczh6uRNy+W5vD5xBrmfviYeWahY+flQWLpdfuLJ+QOqrKYwoWqP2yxbCbNi9fNTDVDYXunqR8ECvqx10BV2jUM56WA+GVPaJjneZajyrOrl92MR6cDG8lejGSmX8Y4IKC/JBTaLPKLA8F94deWDPA07VAVXOzADWL7rkVPtKbDM1ngb6DmYjr7hFZve+h0RdPa4BLWTXGiiQwHYkHimpxv8cFINqhG+sOcARIVqFsCnTEbl274WaOtH9UfOq8D15QXy8GHOk4zGbrMMu+dKSpw1nf/AcwwgG6TupKUWeVikWys+i1teXx3hgkHnbY17v+rryfdag3r488I2kdrHqM1lyk=
2022-05-08T23:47:17.241 INFO:teuthology.kill:  smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRuVhidaB8lIhd2PYTtqibRpuzKfv5zzUOzrMBXoMlbq8YQhXtrc4r1oBlc8AqQCzJLhQ7KrgnLmwsNdvW6hOpjqXshpQk+1CGJAIKsEp/LEaoni1BDFnUNIqbtlE0PTog2y0Z6GT8GEiD+AS80vSuvCgvH4OC+5dfKhWj/G3M45czX+2GurwRq2ezdarcLYN/x6q91E7pq9kEtw59v2z9n/V3M50+X3Z2ZmmsEh4d4F3T1rEp9NYjf2y/ZSmRA8yr5nYZSoHnz8Vkfoq+rs4emNKHWSGji4PTs4aFjO+D08DTmGBxfUgSAj7shM1XE/Ezim3XfHA2QnovPJY9AHuU1ieo+EnMUQp+1UOeiHJZg8KAn9PvQeMJHZcks83M8Ni+tr4s1AXaHglFlSMQeJExY6jcpFpy/nJqXAu29FcwIQlUZk24ovxMpBz3IuCz9404EDNMBq40Oc5dGHS7c3x/RRGu8DyFasi8komwn0O9hfVGlicoOcCt87RbjwSyhZE=
2022-05-08T23:47:17.267 INFO:teuthology.kill:2022-05-08 23:47:17,267.267 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-08T23:47:17.270 INFO:teuthology.kill:2022-05-08 23:47:17,270.270 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-08T23:47:17.344 INFO:teuthology.kill:2022-05-08 23:47:17,343.343 INFO:teuthology.orchestra.console:Power off smithi152
2022-05-08T23:47:17.355 INFO:teuthology.kill:2022-05-08 23:47:17,355.355 INFO:teuthology.orchestra.console:Power off smithi103
2022-05-08T23:47:25.715 INFO:teuthology.kill:2022-05-08 23:47:25,715.715 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2022-05-08T23:47:25.864 INFO:teuthology.kill:2022-05-08 23:47:25,863.863 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2022-05-08T23:47:29.822 INFO:teuthology.kill:2022-05-08 23:47:29,822.822 INFO:teuthology.orchestra.console:Power off for smithi152 completed
2022-05-08T23:47:29.969 INFO:teuthology.kill:2022-05-08 23:47:29,969.969 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com
2022-05-08T23:49:30.253 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-05-08T23:49:30.365 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-05_03:05:02-rgw-quincy-distro-default-smithi/6822552
2022-05-08T23:49:30.365 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi152 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-05_03:05:02-rgw-quincy-distro-default-smithi/6822552