2023-06-14T21:53:33.295 INFO:root:teuthology version: 0.0.1.dev124+g961f4fb 2023-06-14T21:53:43.264 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-06-14T21:53:43.265 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-06-14T21:53:43.266 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-06-14T21:53:43.283 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-06-14T21:53:43.284 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-06-14T21:53:43.284 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-06-14T21:53:43.441 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 8.stream 2023-06-14T21:53:43.479 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 8.stream 2023-06-14T21:54:18.777 INFO:teuthology.orchestra.console:Power off smithi060 2023-06-14T21:54:18.796 INFO:teuthology.orchestra.console:Power off smithi072 2023-06-14T21:54:54.600 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-06-14T21:54:54.701 INFO:teuthology.orchestra.console:Power on smithi072 2023-06-14T21:55:04.586 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-06-14T21:55:04.688 INFO:teuthology.orchestra.console:Power on smithi060 2023-06-14T21:55:08.946 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2023-06-14T21:55:09.049 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-06-14T21:55:19.129 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2023-06-14T21:55:19.230 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-06-14T21:55:24.236 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-14T21:55:24.916 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:55:40.249 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-14T21:55:43.252 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:55:51.184 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:55:53.360 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-14T21:56:07.197 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:56:22.288 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:56:36.368 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:56:47.488 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:56:53.600 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:56:59.677 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:05.753 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:11.759 WARNING:teuthology.provision.fog:timed out 2023-06-14T21:57:11.827 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:22.903 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:22.915 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:27.974 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:27.992 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:39.049 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:39.097 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:50.120 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:51.193 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:57:51.194 WARNING:teuthology.provision.fog:'connect to smithi072.front.sepia.ceph.com' reached maximum tries (11) after waiting for 10 seconds 2023-06-14T21:58:02.263 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-06-14T21:58:50.057 WARNING:teuthology.provision.fog:timed out 2023-06-14T21:59:08.269 WARNING:teuthology.provision.fog:timed out 2023-06-14T21:59:18.403 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-14T21:59:30.320 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:59:33.653 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-06-14T21:59:33.677 INFO:teuthology.orchestra.run.smithi060.stdout:smithi193 2023-06-14T21:59:33.738 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-06-14T21:59:34.202 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2023-06-14T21:59:34.202 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8" 2023-06-14T21:59:34.202 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2023-06-14T21:59:34.202 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2023-06-14T21:59:34.203 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8" 2023-06-14T21:59:34.203 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-06-14T21:59:34.203 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-14T21:59:34.203 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-06-14T21:59:34.203 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-14T21:59:34.203 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2023-06-14T21:59:34.203 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-14T21:59:34.204 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-14T21:59:34.204 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-14T21:59:34.204 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-06-14T21:59:39.376 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-06-14T21:59:53.320 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-14T22:00:18.427 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-06-14T22:00:18.445 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072 2023-06-14T22:00:18.504 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072 smithi072 2023-06-14T22:00:18.898 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-06-14T22:00:18.898 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-06-14T22:00:18.898 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-06-14T22:00:18.898 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-06-14T22:00:18.899 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-06-14T22:00:18.899 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-06-14T22:00:18.899 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-14T22:00:18.899 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-06-14T22:00:18.899 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-14T22:00:18.899 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-06-14T22:00:18.899 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-14T22:00:18.900 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-14T22:00:18.900 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-14T22:00:18.900 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-06-14T22:00:39.068 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-06-14T22:00:39.069 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-14T22:00:44.105 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-06-14T22:00:44.105 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-14T22:00:49.155 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-06-14T22:00:49.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-06-14T22:00:54.432 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-06-14T22:00:54.492 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2023-06-14T22:00:54.492 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8" 2023-06-14T22:00:54.492 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2023-06-14T22:00:54.492 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2023-06-14T22:00:54.492 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8" 2023-06-14T22:00:54.493 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-06-14T22:00:54.493 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-14T22:00:54.493 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-06-14T22:00:54.493 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-14T22:00:54.493 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2023-06-14T22:00:54.493 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-14T22:00:54.493 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-14T22:00:54.494 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-14T22:00:54.494 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-06-14T22:00:54.519 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-06-14T22:00:54.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-06-14T22:00:54.722 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-06-14T22:00:54.781 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-06-14T22:00:54.781 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-06-14T22:00:54.781 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-06-14T22:00:54.782 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-06-14T22:00:54.782 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-06-14T22:00:54.782 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-06-14T22:00:54.782 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-14T22:00:54.782 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-06-14T22:00:54.782 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-14T22:00:54.783 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-06-14T22:00:54.783 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-14T22:00:54.783 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-14T22:00:54.783 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-14T22:00:54.784 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-06-14T22:01:04.931 INFO:teuthology.dispatcher.supervisor:Running job 7304632 2023-06-14T22:01:04.932 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_961f4fb51318c373681de5844aadbc6dc0e58abc/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-14_21:24:34-orch:cephadm-wip-adk-testing-2023-06-14-1509-distro-default-smithi/7304632 --name adking-2023-06-14_21:24:34-orch:cephadm-wip-adk-testing-2023-06-14-1509-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2023-06-14_21:24:34-orch:cephadm-wip-adk-testing-2023-06-14-1509-distro-default-smithi/7304632/orig.config.yaml 2023-06-14T22:01:04.935 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-14_21:24:34-orch:cephadm-wip-adk-testing-2023-06-14-1509-distro-default-smithi/7304632 2023-06-14T22:01:04.936 INFO:teuthology.dispatcher.supervisor:Job PID: 8408 2023-06-14T22:01:04.936 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-15T00:31:52.100 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-15T00:32:02.278 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi072 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-06-14_22:07:31-rbd-wip-yuri6-testing-2023-06-14-0754-pacific-distro-default-smithi/7304797 2023-06-15T00:32:02.278 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-15T00:32:02.279 INFO:teuthology.nuke:Checking targets against current locks 2023-06-15T00:32:17.346 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-15T00:32:22.349 INFO:teuthology.nuke:Not nuking smithi072.front.sepia.ceph.com because description doesn't match: adking-2023-06-14_21:24:34-orch:cephadm-wip-adk-testing-2023-06-14-1509-distro-default-smithi != /home/teuthworker/archive/yuriw-2023-06-14_22:07:31-rbd-wip-yuri6-testing-2023-06-14-0754-pacific-distro-default-smithi/7304797 2023-06-15T00:32:27.437 INFO:teuthology.orchestra.console:Power off smithi060 2023-06-15T00:32:27.582 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-06-15T00:32:37.742 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com 2023-06-15T00:32:37.744 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJWi+8MGE7vOUYHDWCu9IWanJ2dKeEDgsDS6K3m+J5+e9sELhjcMA56Hm5ZzZbFIUwxnzG1QUPOEQOiGCRahExwXILSxPLVse8dgAcgA8hse9CQfUfmjYpKLUcj7Sj9ZPtmzNv/+JSp7eJlfUKOW9v9YA7PWYqx5olCFUxFjptUNPx69avJsPl2hcOzauW7hKVXyoWGqPRIsEvi5oxNf94DAnp/M4IAqg4Vpe0jSNqdIomQby97C1B1gJ+v5PGnKLOtGet3iBmY78mFyw2tzI2I9fIihOrSNfRzdjh2YwlqeFKK9rcCXkAY7AgAuIoIPyoxsxT670zsIIPPKmOJ1Nb5bqn3d89IN7DbHVzfV/G98+grKYMw9MrSmMV1GKXBHENPwEdAYRjgXoPpusv6Sdx9Bl/26wx00I95AgLpTQnriy00XYKNlo7IMutZxot5yW0+k3neJj4zQHtS2fcX+jnqVawgxa8KZnj9gRkctQydZNnBzhPe8knqoFuHuwv7ok=