2022-07-26T19:42:39.868 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1
2022-07-26T19:42:40.006 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2022-07-26T19:42:40.007 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2022-07-26T19:42:40.007 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2022-07-26T19:42:40.027 INFO:teuthology.lock.ops:Node 'smithi097.front.sepia.ceph.com' reimaging is complete
2022-07-26T19:42:40.028 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2022-07-26T19:42:40.028 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2022-07-26T19:42:40.028 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2022-07-26T19:42:40.050 INFO:teuthology.lock.ops:Node 'smithi169.front.sepia.ceph.com' reimaging is complete
2022-07-26T19:42:40.249 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 8.stream
2022-07-26T19:42:40.258 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream
2022-07-26T19:42:40.648 INFO:teuthology.orchestra.console:Power off smithi097
2022-07-26T19:42:40.666 INFO:teuthology.orchestra.console:Power off smithi169
2022-07-26T19:42:49.025 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2022-07-26T19:42:49.127 INFO:teuthology.orchestra.console:Power on smithi169
2022-07-26T19:42:53.130 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2022-07-26T19:42:53.232 INFO:teuthology.orchestra.console:Power on smithi097
2022-07-26T19:42:57.487 INFO:teuthology.orchestra.console:Power on for smithi097 completed
2022-07-26T19:42:57.493 INFO:teuthology.orchestra.console:Power on for smithi169 completed
2022-07-26T19:42:57.589 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2022-07-26T19:42:57.595 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2022-07-26T19:45:29.026 ERROR:teuthology.orchestra.connection:Error authenticating with smithi097.front.sepia.ceph.com: Authentication failed.
2022-07-26T19:47:09.949 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-26T19:47:19.465 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-26T19:47:30.496 INFO:teuthology.provision.fog.smithi097:Node is ready
2022-07-26T19:47:30.519 INFO:teuthology.orchestra.run.smithi097.stdout:smithi176
2022-07-26T19:47:30.579 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2022-07-26T19:47:30.961 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2022-07-26T19:47:44.326 INFO:teuthology.provision.fog.smithi169:Node is ready
2022-07-26T19:47:44.350 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2022-07-26T19:47:44.413 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2022-07-26T19:47:44.792 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2022-07-26T19:47:44.969 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2022-07-26T19:47:44.970 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-26T19:47:44.994 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2022-07-26T19:47:44.994 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-26T19:47:45.016 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2022-07-26T19:47:45.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2022-07-26T19:47:45.304 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2022-07-26T19:47:45.364 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2022-07-26T19:47:45.365 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8"
2022-07-26T19:47:45.365 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2022-07-26T19:47:45.365 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2022-07-26T19:47:45.365 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8"
2022-07-26T19:47:45.366 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2022-07-26T19:47:45.366 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-26T19:47:45.366 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2022-07-26T19:47:45.366 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-26T19:47:45.367 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2022-07-26T19:47:45.367 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-26T19:47:45.367 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-26T19:47:45.367 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-26T19:47:45.369 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2022-07-26T19:47:45.397 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2022-07-26T19:47:45.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2022-07-26T19:47:45.604 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2022-07-26T19:47:45.663 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2022-07-26T19:47:45.664 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2022-07-26T19:47:45.664 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2022-07-26T19:47:45.664 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2022-07-26T19:47:45.665 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2022-07-26T19:47:45.665 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2022-07-26T19:47:45.666 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-26T19:47:45.666 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2022-07-26T19:47:45.666 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-26T19:47:45.666 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2022-07-26T19:47:45.667 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-26T19:47:45.667 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-26T19:47:45.667 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-26T19:47:45.668 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2022-07-26T19:47:45.802 INFO:teuthology.dispatcher.supervisor:Running job 6948468
2022-07-26T19:47:45.802 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6948468 --name gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6948468/orig.config.yaml
2022-07-26T19:47:45.808 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6948468
2022-07-26T19:47:45.809 INFO:teuthology.dispatcher.supervisor:Job PID: 20960
2022-07-26T19:47:45.809 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-27T07:48:08.719 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-27T07:48:08.954 INFO:teuthology.kill:Killing Pids: {20960}
2022-07-27T07:48:10.864 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-07-27T07:48:10.865 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-07-27T07:48:10.866 INFO:teuthology.misc:Compressing logs...
2022-07-27T07:48:10.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2022-07-27T07:48:11.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2022-07-27T07:48:11.402 INFO:teuthology.misc:Compressing logs...
2022-07-27T07:48:11.754 INFO:teuthology.misc:Compressing logs...
2022-07-27T07:48:17.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-07-27T07:48:19.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-mon.smithi097.log: file size changed while zipping
2022-07-27T07:48:19.928 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-mon.smithi169.log: file size changed while zipping
2022-07-27T07:48:22.056 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-mgr.smithi097.kxuylt.log: file size changed while zipping
2022-07-27T07:48:27.006 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-07-27T07:48:27.566 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-mds.cephfs.smithi169.zpnwxt.log: file size changed while zipping
2022-07-27T07:48:29.042 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-07-27T07:48:31.711 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-07-27T07:48:32.066 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-mds.cephfs.smithi169.ofyjyy.log: file size changed while zipping
2022-07-27T07:48:33.271 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-07-27T07:48:34.677 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-mds.cephfs.smithi097.pqreej.log: file size changed while zipping
2022-07-27T07:48:35.297 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-mds.cephfs.smithi097.wrdajm.log: file size changed while zipping
2022-07-27T07:48:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/36b10874-0d1d-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-07-27T07:49:12.035 INFO:teuthology.orchestra.run.smithi097.stderr:tar: .: file changed as we read it
2022-07-27T07:49:36.994 INFO:teuthology.kill:No teuthology processes running
2022-07-27T07:49:38.800 INFO:teuthology.kill:Nuking machines: ['smithi097', 'smithi169']
2022-07-27T07:49:40.249 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-27T07:49:40.250 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-27T07:49:40.251 INFO:teuthology.kill:2022-07-27 07:49:40,248.248 INFO:teuthology.nuke:targets:
2022-07-27T07:49:40.251 INFO:teuthology.kill:  smithi097.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJoHe6YzEpDd6EJCcEvDr/b+hMk+b0Av8/FPf1ih2oFhDRwFmpHoQ3JTnKVT8RHmL1MP8xgaF6MgWMwQ0xApuLqsM/lchQtrf3ZjNJUc6eS1xdVD+oDYL7bYXUWtJ164QrKrytIQaK3+8B5eBP9CyDr5Eq1zbtgjUG+z5pfIj/hRnhROVe58F9Qm+0HTKPf9Kcw/tEesZms4cyugRNMXc/U4xlhCseky2/fUNUBvUfyhzcHUNOuIlBzU82WIvF34JXHNOKVY4wVFygNigc5vmBPUzwv8RtSa1uKWCRxiDJS4pX2bwDpCAa7TqeSqDgfXFz5VdpslpRoqYu12XTBAvLXna6WKe1hHqTIZjKO6Lqka4abljHMd+zcrvhG5gL1K0qoKfVr55CuzacL+I8yAuprTk2q0Y4VSq9VLkOanpN4MzP2C6BZvJAkUeMsiHViDpcTDo6/BiNW6Tuc6z+ksjQicGwFKZxs54wkaVPAz+6H3vFif/T+QgVE9wB7GBpRzU=
2022-07-27T07:49:40.252 INFO:teuthology.kill:  smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDN42tleJDbOWoDScmNFgrqRlHpiFbzJq4/OrQEbTm9AAMKDDLy7tFxYDMeVI39vVRX7eAQCwHX7J39Ysm1LFUZpWw/fJ/VjyKQXK2FGb5PVwqiNigh+3mvmtvgfQr+QLgF/XCrHLBfAgrNkfxK3K55ubdhjecDy+R6SyaequKn7mla4X+FfIgqhumC8ublnU55WVJ5fSVo7UXPFJdFfOFlOZUxV6L1376qENejVQrHwJj0mxjtW4uZoShxZPZ1NFDPhZliSK4vcuYpxYoCGr/dVwesC9yCvVCnFPbdXSaksUW1eXKc8XlGggnJFINBzbtbgStALYGDEI5VkKYmMdlbrMU4nTQcx445aCWbOkO7UH7HHiej4FK2fozOhUeI75bkOox6vQ1oQFaS739lv2Ny2PF7cwcKG6dJSeR+wjpl/OEOpFhQhtk1zJsEAqDdO/RUinpNRArG0+S0h8khDD2t7k2Y/abmi9+MAsqnajai9RG1vQtoNFK//xeSRBrHDMc=
2022-07-27T07:49:40.254 INFO:teuthology.kill:2022-07-27 07:49:40,252.252 INFO:teuthology.nuke:Checking targets against current locks
2022-07-27T07:49:40.315 INFO:teuthology.kill:2022-07-27 07:49:40,314.314 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-27T07:49:40.349 INFO:teuthology.kill:2022-07-27 07:49:40,348.348 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-27T07:49:40.422 INFO:teuthology.kill:2022-07-27 07:49:40,417.417 INFO:teuthology.orchestra.console:Power off smithi097
2022-07-27T07:49:40.502 INFO:teuthology.kill:2022-07-27 07:49:40,500.500 INFO:teuthology.orchestra.console:Power off smithi169
2022-07-27T07:49:52.969 INFO:teuthology.kill:2022-07-27 07:49:52,969.969 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2022-07-27T07:49:52.998 INFO:teuthology.kill:2022-07-27 07:49:52,997.997 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2022-07-27T07:49:53.129 INFO:teuthology.kill:2022-07-27 07:49:53,128.128 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com
2022-07-27T07:49:53.153 INFO:teuthology.kill:2022-07-27 07:49:53,152.152 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com
2022-07-27T07:51:53.475 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-27T07:51:53.688 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi097 but it was locked by another job: /home/teuthworker/archive/bhubbard-2022-07-27_07:20:47-ceph-ansible-wip-octopus-badone-testing-distro-basic-smithi/6949744
2022-07-27T07:51:53.689 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi169 but it was locked by another job: /home/teuthworker/archive/bhubbard-2022-07-27_07:20:47-ceph-ansible-wip-octopus-badone-testing-distro-basic-smithi/6949744