2022-05-19T15:01:27.836 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01
2022-05-19T15:01:28.051 INFO:teuthology.lock.ops:Start node 'smithi025.front.sepia.ceph.com' reimaging
2022-05-19T15:01:28.052 INFO:teuthology.lock.ops:Updating [smithi025.front.sepia.ceph.com]: reset os type and version on server
2022-05-19T15:01:28.052 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2022-05-19T15:01:28.075 INFO:teuthology.lock.ops:Node 'smithi025.front.sepia.ceph.com' reimaging is complete
2022-05-19T15:01:28.076 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2022-05-19T15:01:28.076 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2022-05-19T15:01:28.076 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2022-05-19T15:01:28.097 INFO:teuthology.lock.ops:Node 'smithi052.front.sepia.ceph.com' reimaging is complete
2022-05-19T15:01:28.300 INFO:teuthology.provision.fog.smithi025:Scheduling deploy of centos 8.stream
2022-05-19T15:01:28.318 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 8.stream
2022-05-19T15:01:28.686 INFO:teuthology.orchestra.console:Power off smithi052
2022-05-19T15:01:28.714 INFO:teuthology.orchestra.console:Power off smithi025
2022-05-19T15:01:37.074 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2022-05-19T15:01:37.176 INFO:teuthology.orchestra.console:Power on smithi052
2022-05-19T15:01:41.195 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2022-05-19T15:01:41.296 INFO:teuthology.orchestra.console:Power on smithi025
2022-05-19T15:01:45.547 INFO:teuthology.orchestra.console:Power on for smithi052 completed
2022-05-19T15:01:45.552 INFO:teuthology.orchestra.console:Power on for smithi025 completed
2022-05-19T15:01:45.649 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2022-05-19T15:01:45.653 INFO:teuthology.provision.fog.smithi025:Waiting for deploy to finish
2022-05-19T15:04:32.329 ERROR:teuthology.orchestra.connection:Error authenticating with smithi025.front.sepia.ceph.com: Authentication failed.
2022-05-19T15:05:53.551 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-19T15:05:53.845 INFO:teuthology.provision.fog.smithi052:Node is ready
2022-05-19T15:05:53.864 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2022-05-19T15:05:53.926 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2022-05-19T15:05:54.285 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2022-05-19T15:06:54.777 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-19T15:06:55.056 INFO:teuthology.provision.fog.smithi025:Node is ready
2022-05-19T15:06:55.075 INFO:teuthology.orchestra.run.smithi025.stdout:smithi025.front.sepia.ceph.com
2022-05-19T15:06:55.135 INFO:teuthology.orchestra.run.smithi025.stdout:172.21.15.25 smithi025.front.sepia.ceph.com smithi025
2022-05-19T15:06:55.501 INFO:teuthology.provision.fog.smithi025:Deploy complete!
2022-05-19T15:06:55.671 INFO:teuthology.lock.ops:Checking smithi025.front.sepia.ceph.com
2022-05-19T15:06:55.672 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-19T15:06:55.692 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2022-05-19T15:06:55.693 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-19T15:06:55.711 INFO:teuthology.lock.ops:Updating [smithi025.front.sepia.ceph.com]: set os type and version on server
2022-05-19T15:06:55.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi025.front.sepia.ceph.com'
2022-05-19T15:06:55.916 INFO:teuthology.orchestra.run.smithi025.stdout:x86_64
2022-05-19T15:06:55.974 INFO:teuthology.orchestra.run.smithi025.stdout:NAME="CentOS Stream"
2022-05-19T15:06:55.975 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION="8"
2022-05-19T15:06:55.975 INFO:teuthology.orchestra.run.smithi025.stdout:ID="centos"
2022-05-19T15:06:55.975 INFO:teuthology.orchestra.run.smithi025.stdout:ID_LIKE="rhel fedora"
2022-05-19T15:06:55.976 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION_ID="8"
2022-05-19T15:06:55.976 INFO:teuthology.orchestra.run.smithi025.stdout:PLATFORM_ID="platform:el8"
2022-05-19T15:06:55.976 INFO:teuthology.orchestra.run.smithi025.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-19T15:06:55.976 INFO:teuthology.orchestra.run.smithi025.stdout:ANSI_COLOR="0;31"
2022-05-19T15:06:55.977 INFO:teuthology.orchestra.run.smithi025.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-19T15:06:55.977 INFO:teuthology.orchestra.run.smithi025.stdout:HOME_URL="https://centos.org/"
2022-05-19T15:06:55.977 INFO:teuthology.orchestra.run.smithi025.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-19T15:06:55.977 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-19T15:06:55.978 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-19T15:06:55.979 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2022-05-19T15:06:55.999 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2022-05-19T15:06:55.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2022-05-19T15:06:56.211 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2022-05-19T15:06:56.272 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2022-05-19T15:06:56.273 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8"
2022-05-19T15:06:56.273 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2022-05-19T15:06:56.273 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2022-05-19T15:06:56.273 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8"
2022-05-19T15:06:56.274 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2022-05-19T15:06:56.274 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-19T15:06:56.274 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2022-05-19T15:06:56.274 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-19T15:06:56.275 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2022-05-19T15:06:56.275 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-19T15:06:56.275 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-19T15:06:56.275 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-19T15:06:56.276 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2022-05-19T15:06:56.400 INFO:teuthology.dispatcher.supervisor:Running job 6837402
2022-05-19T15:06:56.400 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-05-17_04:17:02-fs-pacific-distro-default-smithi/6837402 --name teuthology-2022-05-17_04:17:02-fs-pacific-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/teuthology-2022-05-17_04:17:02-fs-pacific-distro-default-smithi/6837402/orig.config.yaml
2022-05-19T15:06:56.406 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-05-17_04:17:02-fs-pacific-distro-default-smithi/6837402
2022-05-19T15:06:56.406 INFO:teuthology.dispatcher.supervisor:Job PID: 15489
2022-05-19T15:06:56.407 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-19T21:37:09.507 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-19T21:37:09.710 INFO:teuthology.kill:Killing Pids: {15489}
2022-05-19T21:37:11.132 INFO:teuthology.task.internal:roles: ubuntu@smithi025.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-05-19T21:37:11.133 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-05-19T21:37:11.134 INFO:teuthology.misc:Compressing logs...
2022-05-19T21:37:11.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi025.front.sepia.ceph.com'
2022-05-19T21:37:11.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2022-05-19T21:37:11.662 INFO:teuthology.misc:Compressing logs...
2022-05-19T21:37:12.005 INFO:teuthology.misc:Compressing logs...
2022-05-19T21:37:12.566 INFO:teuthology.orchestra.run.smithi025.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-mgr.smithi025.mzoemw.log: file size changed while zipping
2022-05-19T21:37:30.675 INFO:teuthology.orchestra.run.smithi025.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-05-19T21:37:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-05-19T21:37:39.208 INFO:teuthology.orchestra.run.smithi025.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-05-19T21:37:53.074 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-05-19T21:37:54.486 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-mon.smithi052.log: file size changed while zipping
2022-05-19T21:38:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-05-19T21:38:08.555 INFO:teuthology.orchestra.run.smithi025.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-05-19T21:38:12.447 INFO:teuthology.orchestra.run.smithi025.stderr:gzip: /var/log/ceph/b0ce6a06-d786-11ec-be40-001a4aab830c/ceph-mon.smithi025.log: file size changed while zipping
2022-05-19T21:38:32.971 INFO:teuthology.kill:No teuthology processes running
2022-05-19T21:38:34.461 INFO:teuthology.kill:Nuking machines: ['smithi025', 'smithi052']
2022-05-19T21:38:35.709 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-19T21:38:35.710 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-19T21:38:35.710 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-05-19T21:38:35.710 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-05-19T21:38:35.710 INFO:teuthology.kill:2022-05-19 21:38:35,708.708 INFO:teuthology.nuke:targets:
2022-05-19T21:38:35.711 INFO:teuthology.kill:  smithi025.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfW6RuwoILhB25f3B6/R2dcJdT52etBF7PWuSEnhZ2Sctwy2hSHRhstb3VcG1cfyKoBPnNfWKhmZWQmT5ybbmQ6WG4Oeed4Z4ty94pTgFDC/tP/7fPGgRUNC3DZtM6StVY0iZUai7IvY6sISj/QZw3d07OFyR/opdzLN6KLP5lPREYHRSXW2m/m5a+1sAANnaUSZ3m6FbMnos7fhScbfJmJNTgvQmnZirMOlEeTObI9E97ZsEYJlLMhqeh2QDC5z11tn3gUBTT05fug1X3iZplmwZdQSaH7kyqFAAvorOOlF7jzNvDXENnEhhqQCem6BihEu0GZ9N4V2v1yRJkAC+lC325dJYqoLXRWPK6ItJQVNRXSkMF7mQsiV58Hm4v6c9of1Ki01affHNfvbDngP/0S23zd6/gOLvdLLkiyYybUI3mOk99kXLf7ePCHImCgqx1mqvqoi0Fk487/J+9z15P0gndu0sQwBfaai0+WQNWVThKCnmkTB4cIHGwkEr6rT0=
2022-05-19T21:38:35.711 INFO:teuthology.kill:  smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVbiLprp6PKpwe9v5Jp0YLnJN167lDCJK/H01OKQxCQ+QkJdiUlSgfAsOuwp+f6/ZfsxUrC16CdpMmciQd/pCGb5rzN+bpAbE6emT32z1cak0crSpnxEnjIbZoinUUGneLeRFqyYO67m5lIrpFjTM9OTNdRYcCND5oNcY6W30dPplwJtM5TOyXVDC/iDYVdgdeUZPJ50YO0jdkeVdOa0gjhp5e8i/YtVhUZtrs0JUxvKsUvUiWY0bOx7SM448Ri+4W1RU+HlagCUqWs1yES/8zIbshs3ZFmT7z2dZ9mbFy5f2atUNDjiuJq+GW0woCQ9NWfloc1UIBkgjfh7J7MJZu9w9IVHwn/n0eI+09ECfb4edvwPSRXHmahS70g541NsLMa4oo7Zks9hXu0mSOPiczFJJeTILgCYZ79A5Ns/Y49b9NAzasiJiDzj5Bc4V/v8qSLjrk69ihasltpifAbZLj5GhWVTAq2JNpCmXLvYdVntnY31ULaKgt2r1zzWTK1pc=
2022-05-19T21:38:35.743 INFO:teuthology.kill:2022-05-19 21:38:35,743.743 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-19T21:38:35.748 INFO:teuthology.kill:2022-05-19 21:38:35,748.748 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-19T21:38:35.850 INFO:teuthology.kill:2022-05-19 21:38:35,849.849 INFO:teuthology.orchestra.console:Power off smithi052
2022-05-19T21:38:35.866 INFO:teuthology.kill:2022-05-19 21:38:35,866.866 INFO:teuthology.orchestra.console:Power off smithi025
2022-05-19T21:38:44.270 INFO:teuthology.kill:2022-05-19 21:38:44,269.269 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2022-05-19T21:38:44.423 INFO:teuthology.kill:2022-05-19 21:38:44,422.422 INFO:teuthology.lock.ops:unlocked: smithi025.front.sepia.ceph.com
2022-05-19T21:38:48.376 INFO:teuthology.kill:2022-05-19 21:38:48,376.376 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2022-05-19T21:38:48.534 INFO:teuthology.kill:2022-05-19 21:38:48,534.534 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com
2022-05-19T21:40:48.818 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-05-19T21:40:48.943 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi025 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-19_18:50:25-rados-wip-yuri4-testing-2022-05-19-0831-quincy-distro-default-smithi/6841698
2022-05-19T21:40:48.943 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi052 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-19_18:50:25-rados-wip-yuri4-testing-2022-05-19-0831-quincy-distro-default-smithi/6841700