2023-06-08T21:06:47.771 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-08T21:06:47.939 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-06-08T21:06:47.940 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T21:06:47.940 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-06-08T21:06:47.963 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-06-08T21:06:47.963 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T21:06:47.963 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-06-08T21:06:48.117 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream 2023-06-08T21:06:48.141 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream 2023-06-08T21:06:48.358 INFO:teuthology.orchestra.console:Power off smithi064 2023-06-08T21:06:48.401 INFO:teuthology.orchestra.console:Power off smithi089 2023-06-08T21:06:56.741 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-06-08T21:06:56.767 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2023-06-08T21:06:56.843 INFO:teuthology.orchestra.console:Power on smithi064 2023-06-08T21:06:56.873 INFO:teuthology.orchestra.console:Power on smithi089 2023-06-08T21:07:05.211 INFO:teuthology.orchestra.console:Power on for smithi064 completed 2023-06-08T21:07:05.239 INFO:teuthology.orchestra.console:Power on for smithi089 completed 2023-06-08T21:07:05.313 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-06-08T21:07:05.340 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-06-08T21:09:54.384 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:09:54.385 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-08T21:10:03.472 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:10:03.473 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-08T21:10:12.528 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:10:12.529 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-08T21:10:21.616 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:10:21.617 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-08T21:10:30.704 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:10:30.705 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-08T21:10:39.760 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:10:39.761 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-08T21:11:04.304 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:11:13.360 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-08T21:11:20.498 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T21:11:45.604 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-06-08T21:11:45.630 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-06-08T21:11:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-06-08T21:11:45.768 WARNING:teuthology.provision.fog:timed out 2023-06-08T21:11:46.107 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-06-08T21:11:46.107 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-06-08T21:11:46.108 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-06-08T21:11:46.108 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:11:46.108 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-06-08T21:11:46.108 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:11:46.108 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:11:46.108 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-06-08T21:11:46.108 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:11:46.109 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:11:46.109 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:11:46.109 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:11:46.109 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:11:46.110 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-06-08T21:11:52.038 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T21:11:52.298 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-06-08T21:11:52.319 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-06-08T21:11:52.379 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-06-08T21:11:52.783 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-06-08T21:11:52.783 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-06-08T21:11:52.784 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-06-08T21:11:52.784 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:11:52.784 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-06-08T21:11:52.784 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:11:52.784 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:11:52.784 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-06-08T21:11:52.785 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:11:52.785 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:11:52.785 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:11:52.785 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:11:52.785 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:11:52.785 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-06-08T21:11:52.970 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-06-08T21:11:52.971 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T21:11:52.994 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-06-08T21:11:52.994 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T21:11:53.012 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-06-08T21:11:53.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-06-08T21:11:53.204 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-06-08T21:11:53.262 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-06-08T21:11:53.262 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-06-08T21:11:53.263 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-06-08T21:11:53.263 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:11:53.263 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-06-08T21:11:53.263 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:11:53.263 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:11:53.263 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-06-08T21:11:53.264 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:11:53.264 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:11:53.264 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:11:53.264 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:11:53.264 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:11:53.265 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-06-08T21:11:53.286 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-06-08T21:11:53.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-08T21:11:53.445 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-06-08T21:11:53.505 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-06-08T21:11:53.506 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-06-08T21:11:53.506 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-06-08T21:11:53.506 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-06-08T21:11:53.506 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-06-08T21:11:53.506 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-06-08T21:11:53.506 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T21:11:53.506 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-06-08T21:11:53.507 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T21:11:53.507 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-06-08T21:11:53.507 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T21:11:53.507 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T21:11:53.507 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T21:11:53.508 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-06-08T21:11:53.619 INFO:teuthology.dispatcher.supervisor:Running job 7299510 2023-06-08T21:11:53.619 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299510 --name yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299510/orig.config.yaml 2023-06-08T21:11:53.623 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299510 2023-06-08T21:11:53.624 INFO:teuthology.dispatcher.supervisor:Job PID: 15428 2023-06-08T21:11:53.624 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-08T22:01:58.023 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-08T22:01:58.201 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-08T22:01:58.202 INFO:teuthology.nuke:Checking targets against current locks 2023-06-08T22:01:58.258 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T22:01:58.282 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T22:01:58.335 INFO:teuthology.orchestra.console:Power off smithi064 2023-06-08T22:01:58.379 INFO:teuthology.orchestra.console:Power off smithi089 2023-06-08T22:01:58.491 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-06-08T22:01:58.522 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2023-06-08T22:01:58.646 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-06-08T22:01:58.678 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com