2023-06-08T21:04:26.166 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-08T21:04:26.334 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-06-08T21:04:26.335 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T21:04:26.335 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-06-08T21:04:26.366 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-06-08T21:04:26.367 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T21:04:26.367 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-06-08T21:04:26.536 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-06-08T21:04:26.543 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.stream 2023-06-08T21:04:26.779 INFO:teuthology.orchestra.console:Power off smithi114 2023-06-08T21:04:26.797 INFO:teuthology.orchestra.console:Power off smithi186 2023-06-08T21:04:35.172 INFO:teuthology.orchestra.console:Power off for smithi186 completed 2023-06-08T21:04:35.274 INFO:teuthology.orchestra.console:Power on smithi186 2023-06-08T21:04:39.282 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2023-06-08T21:04:39.384 INFO:teuthology.orchestra.console:Power on smithi114 2023-06-08T21:04:43.732 INFO:teuthology.orchestra.console:Power on for smithi186 completed 2023-06-08T21:04:43.833 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-06-08T21:04:47.754 INFO:teuthology.orchestra.console:Power on for smithi114 completed 2023-06-08T21:04:47.855 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-06-08T21:07:18.813 ERROR:teuthology.orchestra.connection:Error authenticating with smithi114.front.sepia.ceph.com: Authentication failed. 2023-06-08T21:07:32.752 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:07:41.809 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:07:50.868 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:07:59.920 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:08:08.976 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:08:18.032 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:08:19.817 WARNING:teuthology.provision.fog:timed out 2023-06-08T21:08:27.088 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:08:44.272 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-08T21:08:51.444 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:08:53.328 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-08T21:08:59.623 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T21:09:00.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-08T21:09:07.804 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T21:09:24.723 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-06-08T21:09:24.748 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2023-06-08T21:09:24.809 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-06-08T21:09:25.234 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-06-08T21:09:25.234 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2023-06-08T21:09:25.234 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-06-08T21:09:25.234 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:09:25.235 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2023-06-08T21:09:25.235 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:09:25.235 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:09:25.235 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-06-08T21:09:25.235 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:09:25.235 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:09:25.235 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:09:25.236 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:09:25.236 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:09:25.237 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-06-08T21:09:33.498 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-06-08T21:09:33.522 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-06-08T21:09:33.582 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-06-08T21:09:34.002 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-06-08T21:09:34.002 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-06-08T21:09:34.003 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-06-08T21:09:34.003 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:09:34.003 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-06-08T21:09:34.004 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:09:34.004 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:09:34.004 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-06-08T21:09:34.004 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:09:34.005 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:09:34.005 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:09:34.005 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:09:34.005 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:09:34.006 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-06-08T21:09:34.157 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-06-08T21:09:34.158 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T21:09:34.189 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-06-08T21:09:34.189 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T21:09:34.206 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-06-08T21:09:34.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-06-08T21:09:34.364 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-06-08T21:09:34.424 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-06-08T21:09:34.424 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2023-06-08T21:09:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-06-08T21:09:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:09:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2023-06-08T21:09:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:09:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:09:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-06-08T21:09:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:09:34.426 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:09:34.426 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:09:34.426 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:09:34.426 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:09:34.426 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-06-08T21:09:34.447 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-06-08T21:09:34.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-06-08T21:09:34.639 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-06-08T21:09:34.696 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-06-08T21:09:34.696 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-06-08T21:09:34.696 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-06-08T21:09:34.696 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:09:34.696 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-06-08T21:09:34.697 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:09:34.697 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:09:34.697 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-06-08T21:09:34.697 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:09:34.697 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:09:34.697 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:09:34.697 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:09:34.698 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:09:34.698 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-06-08T21:09:34.813 INFO:teuthology.dispatcher.supervisor:Running job 7299507 2023-06-08T21:09:34.813 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299507 --name yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299507/orig.config.yaml 2023-06-08T21:09:34.817 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299507 2023-06-08T21:09:34.818 INFO:teuthology.dispatcher.supervisor:Job PID: 6360 2023-06-08T21:09:34.818 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-08T22:05:36.978 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-08T22:05:37.215 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-08T22:05:37.216 INFO:teuthology.nuke:Checking targets against current locks 2023-06-08T22:05:37.273 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T22:05:37.297 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T22:05:37.357 INFO:teuthology.orchestra.console:Power off smithi114 2023-06-08T22:05:37.404 INFO:teuthology.orchestra.console:Power off smithi186 2023-06-08T22:05:37.517 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2023-06-08T22:05:37.549 INFO:teuthology.orchestra.console:Power off for smithi186 completed 2023-06-08T22:05:37.684 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2023-06-08T22:05:37.711 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com