2022-07-04T18:13:15.818 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-04T18:13:15.979 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging
2022-07-04T18:13:15.981 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server
2022-07-04T18:13:15.981 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2022-07-04T18:13:16.010 INFO:teuthology.lock.ops:Node 'smithi003.front.sepia.ceph.com' reimaging is complete
2022-07-04T18:13:16.010 INFO:teuthology.lock.ops:Start node 'smithi197.front.sepia.ceph.com' reimaging
2022-07-04T18:13:16.011 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: reset os type and version on server
2022-07-04T18:13:16.011 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-07-04T18:13:16.059 INFO:teuthology.lock.ops:Node 'smithi197.front.sepia.ceph.com' reimaging is complete
2022-07-04T18:13:16.257 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream
2022-07-04T18:13:16.281 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.stream
2022-07-04T18:13:16.576 INFO:teuthology.orchestra.console:Power off smithi003
2022-07-04T18:13:16.621 INFO:teuthology.orchestra.console:Power off smithi197
2022-07-04T18:13:24.959 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2022-07-04T18:13:24.987 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-07-04T18:13:25.060 INFO:teuthology.orchestra.console:Power on smithi003
2022-07-04T18:13:25.095 INFO:teuthology.orchestra.console:Power on smithi197
2022-07-04T18:13:33.439 INFO:teuthology.orchestra.console:Power on for smithi003 completed
2022-07-04T18:13:33.464 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2022-07-04T18:13:33.541 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish
2022-07-04T18:13:33.566 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2022-07-04T18:15:49.823 ERROR:teuthology.orchestra.connection:Error authenticating with smithi003.front.sepia.ceph.com: Authentication failed.
2022-07-04T18:17:21.510 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-04T18:17:40.115 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-04T18:17:41.976 INFO:teuthology.provision.fog.smithi003:Node is ready
2022-07-04T18:17:42.001 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com
2022-07-04T18:17:42.060 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003
2022-07-04T18:17:42.422 INFO:teuthology.provision.fog.smithi003:Deploy complete!
2022-07-04T18:18:05.138 INFO:teuthology.provision.fog.smithi197:Node is ready
2022-07-04T18:18:05.163 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2022-07-04T18:18:05.225 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2022-07-04T18:18:05.614 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2022-07-04T18:18:05.789 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com
2022-07-04T18:18:05.790 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-04T18:18:05.812 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2022-07-04T18:18:05.813 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-04T18:18:05.835 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server
2022-07-04T18:18:05.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2022-07-04T18:18:06.049 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64
2022-07-04T18:18:06.111 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream"
2022-07-04T18:18:06.111 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8"
2022-07-04T18:18:06.111 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos"
2022-07-04T18:18:06.112 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora"
2022-07-04T18:18:06.112 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8"
2022-07-04T18:18:06.112 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2022-07-04T18:18:06.112 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-04T18:18:06.113 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2022-07-04T18:18:06.113 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-04T18:18:06.113 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/"
2022-07-04T18:18:06.113 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-04T18:18:06.114 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-04T18:18:06.114 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-04T18:18:06.115 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2022-07-04T18:18:06.138 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2022-07-04T18:18:06.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-07-04T18:18:06.343 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2022-07-04T18:18:06.402 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Stream"
2022-07-04T18:18:06.402 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8"
2022-07-04T18:18:06.403 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos"
2022-07-04T18:18:06.403 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora"
2022-07-04T18:18:06.403 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8"
2022-07-04T18:18:06.404 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8"
2022-07-04T18:18:06.404 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-04T18:18:06.404 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31"
2022-07-04T18:18:06.404 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-04T18:18:06.405 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://centos.org/"
2022-07-04T18:18:06.405 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-04T18:18:06.405 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-04T18:18:06.405 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-04T18:18:06.406 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-07-04T18:18:06.524 INFO:teuthology.dispatcher.supervisor:Running job 6912683
2022-07-04T18:18:06.525 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6912683 --name dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi --description fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6912683/orig.config.yaml
2022-07-04T18:18:06.530 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2022-07-04_17:09:23-fs:upgrade-wip-dparmar-cephadm-55715-testing-distro-default-smithi/6912683
2022-07-04T18:18:06.531 INFO:teuthology.dispatcher.supervisor:Job PID: 19671
2022-07-04T18:18:06.532 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-05T06:18:31.313 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-05T06:18:31.604 INFO:teuthology.kill:Killing Pids: {19671}
2022-07-05T06:18:33.525 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-07-05T06:18:33.525 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-07-05T06:18:33.526 INFO:teuthology.misc:Compressing logs...
2022-07-05T06:18:33.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2022-07-05T06:18:33.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-07-05T06:18:34.092 INFO:teuthology.misc:Compressing logs...
2022-07-05T06:18:34.411 INFO:teuthology.misc:Compressing logs...
2022-07-05T06:18:36.439 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-mon.smithi197.log: file size changed while zipping
2022-07-05T06:18:37.488 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-07-05T06:18:39.264 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-07-05T06:18:40.271 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-07-05T06:18:42.002 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-07-05T06:18:43.517 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-07-05T06:18:45.607 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-07-05T06:18:48.791 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-mon.smithi003.log: file size changed while zipping
2022-07-05T06:18:49.986 INFO:teuthology.orchestra.run.smithi003.stderr:gzip: /var/log/ceph/936ab622-fbc6-11ec-842c-001a4aab830c/ceph-mgr.smithi003.eanksh.log: file size changed while zipping
2022-07-05T06:19:40.437 INFO:teuthology.kill:No teuthology processes running
2022-07-05T06:19:41.967 INFO:teuthology.kill:Nuking machines: ['smithi003', 'smithi197']
2022-07-05T06:19:43.154 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-05T06:19:43.156 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-05T06:19:43.156 INFO:teuthology.kill:2022-07-05 06:19:43,154.154 INFO:teuthology.nuke:targets:
2022-07-05T06:19:43.157 INFO:teuthology.kill:  smithi003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWS8JyM8wJeyn0XxM2VwMiXBmiG8jOrJ+/ldogNZKBdhnrKxE/nF0HVsUcwZsbWY25XUY/UOOUReIUINZzGjDQUPG5jxCT3njqbbyUnZGJm+XwIrZwNiJENC0lan1ysIdQi0v5FWa0k5O3CTsqrgtqRk+yWgVdi7W2F0vhHWt74w9k5sRn8fs7GcGdzTe7PQD26/0vpeckl54yNDbHlQeeZVLzVIrk/NBRotTn5bmvSdbC0Di0W+r7cNIu3GPnk9jwHdWT6IU95N14pifg7SX5kStIqlIT8nMaIFrtM4qbPSKoKFtshlv/2D1NfrKOpEPeG9pC1eWY/ZjhZ10tsskUY56IawqeQcUc+P0nfxZsjs+LxpGsnIU0xMKX1gwHZ4hNzJF0FV8o7p3UBvqLQiNrBzTTfn736h2qvHy/wbiOgtpK1wyIp1HeNurgUhxBmnPb/IXzwQ9kPGu4XMy5zq5FjST591fuBgUC3cIhI90MVnm/3kKcDS0OeEPlVkRmZuM=
2022-07-05T06:19:43.157 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBr5Mwo6OlZQfJEBZZKulb3tLVmblFB0Q2vW+k02NT+my94+dGB8cb3cfg8xXPzXlzy0F24cboPEs88lbxr8Lhtap7DuOct3i/rq3sTfmtl+Sa/M1jRuLVLirWVjcMzz2MsJ5EuniCyd/94TKpG5XPc9mt6YTlTJ/Wq20uMrJCeTwGr22AK0lj25o01aqc3pYXI741ijo6uAwfuPn5xJzcP4lstatZc3VDQj30dRgmg2Qjiw//QW/yioooyTL2aC1bLOraFNkEi/auKIFeqLL0jqxN5/CIYXnxHh/z09d/B505VwrbIq9Sq32s0CIKYtbA0fEODAXFgDPQTcOFpnTPKx11TNQGIzKiACGHjjbxUnSZ0dG02UWGIJhtx4U6PMMLgPwsU0xPLhhqpJxxEjgIGRLPAdFPTK4AJKX/Gvwz7gYUTDjCJ+ObheJSYN2C04QK1fD8L0mWNVcuMTrlIBIMIDGwqA9/xUNII/QN3GSr6uaudqv8Q7J8uNvC4uO7Nfk=
2022-07-05T06:19:43.158 INFO:teuthology.kill:2022-07-05 06:19:43,154.154 INFO:teuthology.nuke:Checking targets against current locks
2022-07-05T06:19:43.221 INFO:teuthology.kill:2022-07-05 06:19:43,220.220 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-05T06:19:43.262 INFO:teuthology.kill:2022-07-05 06:19:43,260.260 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-05T06:19:43.343 INFO:teuthology.kill:2022-07-05 06:19:43,343.343 INFO:teuthology.orchestra.console:Power off smithi003
2022-07-05T06:19:43.365 INFO:teuthology.kill:2022-07-05 06:19:43,365.365 INFO:teuthology.orchestra.console:Power off smithi197
2022-07-05T06:19:51.734 INFO:teuthology.kill:2022-07-05 06:19:51,733.733 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2022-07-05T06:19:51.898 INFO:teuthology.kill:2022-07-05 06:19:51,896.896 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com
2022-07-05T06:19:55.852 INFO:teuthology.kill:2022-07-05 06:19:55,852.852 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-07-05T06:19:56.009 INFO:teuthology.kill:2022-07-05 06:19:56,009.009 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com
2022-07-05T06:21:56.292 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-05T06:21:56.455 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi003 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2022-07-05_05:48:04-rgw-wip-skoduri-dbstore-lc-distro-default-smithi/6913843
2022-07-05T06:21:56.456 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2022-07-05_05:48:04-rgw-wip-skoduri-dbstore-lc-distro-default-smithi/6913843