2022-10-25T11:59:23.268 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-25T11:59:23.680 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging
2022-10-25T11:59:23.697 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server
2022-10-25T11:59:23.698 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2022-10-25T11:59:23.725 INFO:teuthology.lock.ops:Node 'smithi003.front.sepia.ceph.com' reimaging is complete
2022-10-25T11:59:23.726 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2022-10-25T11:59:23.726 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2022-10-25T11:59:23.726 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2022-10-25T11:59:23.846 INFO:teuthology.lock.ops:Node 'smithi040.front.sepia.ceph.com' reimaging is complete
2022-10-25T11:59:24.088 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream
2022-10-25T11:59:24.298 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream
2022-10-25T11:59:24.788 INFO:teuthology.orchestra.console:Power off smithi003
2022-10-25T11:59:24.990 INFO:teuthology.orchestra.console:Power off smithi040
2022-10-25T11:59:25.159 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2022-10-25T11:59:25.295 INFO:teuthology.orchestra.console:Power on smithi003
2022-10-25T11:59:25.319 INFO:teuthology.orchestra.console:Power off for smithi040 completed
2022-10-25T11:59:25.423 INFO:teuthology.orchestra.console:Power on smithi040
2022-10-25T11:59:29.614 INFO:teuthology.orchestra.console:Power on for smithi003 completed
2022-10-25T11:59:29.723 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish
2022-10-25T11:59:34.069 INFO:teuthology.orchestra.console:Power on for smithi040 completed
2022-10-25T11:59:34.178 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2022-10-25T12:03:15.466 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-25T12:03:34.873 INFO:teuthology.provision.fog.smithi003:Node is ready
2022-10-25T12:03:34.899 INFO:teuthology.orchestra.run.smithi003.stdout:smithi145
2022-10-25T12:03:34.970 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2022-10-25T12:03:35.395 INFO:teuthology.provision.fog.smithi003:Deploy complete!
2022-10-25T12:04:24.569 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-25T12:04:24.877 INFO:teuthology.provision.fog.smithi040:Node is ready
2022-10-25T12:04:24.901 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2022-10-25T12:04:24.963 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2022-10-25T12:04:25.333 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2022-10-25T12:04:25.607 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com
2022-10-25T12:04:25.609 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-25T12:04:25.632 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2022-10-25T12:04:25.632 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-25T12:04:25.659 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server
2022-10-25T12:04:25.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2022-10-25T12:04:25.984 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64
2022-10-25T12:04:26.046 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream"
2022-10-25T12:04:26.046 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8"
2022-10-25T12:04:26.047 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos"
2022-10-25T12:04:26.047 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora"
2022-10-25T12:04:26.047 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8"
2022-10-25T12:04:26.047 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2022-10-25T12:04:26.048 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8"
2022-10-25T12:04:26.048 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2022-10-25T12:04:26.048 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-10-25T12:04:26.048 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/"
2022-10-25T12:04:26.048 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-25T12:04:26.049 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-25T12:04:26.049 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-10-25T12:04:26.050 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2022-10-25T12:04:26.085 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2022-10-25T12:04:26.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2022-10-25T12:04:26.335 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2022-10-25T12:04:26.398 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2022-10-25T12:04:26.399 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8"
2022-10-25T12:04:26.399 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2022-10-25T12:04:26.399 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2022-10-25T12:04:26.399 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8"
2022-10-25T12:04:26.400 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8"
2022-10-25T12:04:26.400 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8"
2022-10-25T12:04:26.400 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2022-10-25T12:04:26.400 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-10-25T12:04:26.400 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2022-10-25T12:04:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-25T12:04:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-25T12:04:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-10-25T12:04:26.403 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2022-10-25T12:04:26.518 INFO:teuthology.dispatcher.supervisor:Running job 7078367
2022-10-25T12:04:26.519 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-10-23_07:07:02-orch-quincy-distro-default-smithi/7078367 --name teuthology-2022-10-23_07:07:02-orch-quincy-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/teuthology-2022-10-23_07:07:02-orch-quincy-distro-default-smithi/7078367/orig.config.yaml
2022-10-25T12:04:26.524 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-10-23_07:07:02-orch-quincy-distro-default-smithi/7078367
2022-10-25T12:04:26.525 INFO:teuthology.dispatcher.supervisor:Job PID: 3172
2022-10-25T12:04:26.526 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-10-26T00:05:22.193 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-10-26T00:05:22.391 INFO:teuthology.kill:Killing Pids: {3172}
2022-10-26T00:05:23.831 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-10-26T00:05:23.832 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-10-26T00:05:23.833 INFO:teuthology.misc:Compressing logs...
2022-10-26T00:05:23.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2022-10-26T00:05:24.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2022-10-26T00:05:24.345 INFO:teuthology.misc:Compressing logs...
2022-10-26T00:05:24.683 INFO:teuthology.misc:Compressing logs...
2022-10-26T00:05:33.330 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-mgr.smithi003.bbewkk.log: file size changed while zipping
2022-10-26T00:05:50.390 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-10-26T00:05:55.444 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-10-26T00:06:07.009 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-10-26T00:06:13.216 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-10-26T00:06:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-mon.smithi040.log: file size changed while zipping
2022-10-26T00:06:31.215 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-10-26T00:06:34.038 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-10-26T00:06:53.167 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-mon.smithi003.log: file size changed while zipping
2022-10-26T00:08:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-mds.cephfs.smithi003.arpiiz.log: file size changed while zipping
2022-10-26T00:08:51.178 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/9735c79c-545e-11ed-8438-001a4aab830c/ceph-mds.cephfs.smithi003.jbctsj.log: file size changed while zipping
2022-10-26T00:09:32.794 INFO:teuthology.orchestra.run.smithi003.stderr:tar: .: file changed as we read it
2022-10-26T00:09:46.108 INFO:teuthology.kill:No teuthology processes running
2022-10-26T00:09:47.397 INFO:teuthology.kill:Nuking machines: ['smithi003', 'smithi040']
2022-10-26T00:09:48.491 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-10-26T00:09:48.492 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-10-26T00:09:48.493 INFO:teuthology.kill:2022-10-26 00:09:48,491.491 INFO:teuthology.nuke:targets:
2022-10-26T00:09:48.493 INFO:teuthology.kill:  smithi003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mHyq1WEafu5Bz0eWa2uQfa39vH3bCXj7oZnhjquM4mGnW+87YATXRYP9LskiowtP63ChOd/+GcmTUz15VUFz+PdQYaP/OVy0lXM7qi9P9nS21dfvPPidW4HssmG6qxCasZLSMZyBj/imS4tnsUacNoSfNPlhYlGR2x98xZd2mWGE8X97Yt06bPLRkMj33kiisFtkKskSfiqUFzFJvOMeZsajU9QFsz2DqlqygRIYKCzaUaXPjbFjPaqTaGCXpzOEBZNUbCpTQKm1q9BH04fdUW4kgEaw7V8PymHXwH9JSgWDSKBBuBW0DdWmQlnzb6cXs9jbVvGVoUBs1Yq1Q7JCujM9rv9O4Q2isrdEzHnaIw1RBRjSPrn8+y8nZJN6scNL0+hB6XPFps53vHA9KOlAsAsMlD67BJlqhKZS1vRLDQEMc4tdNbMZ/rfXNQ1CuUwxNp8K+JH8sIZfAg2O6u4nRugsgjk0fkjqYaFi8orrqQrWZ/BGLB/M37WPcrx8res=
2022-10-26T00:09:48.493 INFO:teuthology.kill:  smithi040.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDg+qAu9AjPj0exRJwBsodATTBMRAlPtQAY7vm+pBjz4b3AeuWtg/B/itAFJtDm0qfGHWJqfFShXiNQimVflGpIg9Hrh9MdmjYGjaBuYo1eCGqVxeL6cf+GWNjTTWyzPK88mvmnckewxhzn40W2HCIN8EPrjNxHSPOYuqeR7qDWH3dJQNmq7OqCSWyWfFvxueKGuO8FPtvnst2fbN/ljUFAKPZdi6GSHgkdSZeCXY9tRWd1FA3J4jZE9o4GKaQB35A7vctO0bWHbbDM6GywIU9MTyNFcUAuHa19PHt7tvjN6xdK95yWaOBzdsBkx8J/b2UAlbtx9JZGMMUhxpea3/69ekgW2CnfuRUDjxJPhhdohUu50bUcCQk1bRpSxqxBB18Nwfay+w0wll/5mziTPcDwQdkfwLBGjSq+kQpqmsmphgJeT6XbsfAYNRRwnOD0bBe7oUFwEdlptwvaNVVjuuIVUQ8jyDJGylEGUbaZis5ZunIMXYibduEjHg73k59TRxE=
2022-10-26T00:09:48.494 INFO:teuthology.kill:2022-10-26 00:09:48,491.491 INFO:teuthology.nuke:Checking targets against current locks
2022-10-26T00:09:48.545 INFO:teuthology.kill:2022-10-26 00:09:48,545.545 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-26T00:09:48.568 INFO:teuthology.kill:2022-10-26 00:09:48,568.568 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-26T00:09:48.635 INFO:teuthology.kill:2022-10-26 00:09:48,634.634 INFO:teuthology.orchestra.console:Power off smithi003
2022-10-26T00:09:48.671 INFO:teuthology.kill:2022-10-26 00:09:48,671.671 INFO:teuthology.orchestra.console:Power off smithi040
2022-10-26T00:09:57.007 INFO:teuthology.kill:2022-10-26 00:09:57,007.007 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2022-10-26T00:09:57.161 INFO:teuthology.kill:2022-10-26 00:09:57,160.160 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com
2022-10-26T00:10:01.140 INFO:teuthology.kill:2022-10-26 00:10:01,139.139 INFO:teuthology.orchestra.console:Power off for smithi040 completed
2022-10-26T00:10:01.302 INFO:teuthology.kill:2022-10-26 00:10:01,302.302 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com
2022-10-26T00:12:01.607 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15