2023-06-08T16:54:49.104 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-08T16:54:49.258 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-06-08T16:54:49.259 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T16:54:49.259 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-06-08T16:54:49.284 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-06-08T16:54:49.285 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T16:54:49.285 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-06-08T16:54:49.451 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of ubuntu 22.04 2023-06-08T16:54:49.472 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of ubuntu 22.04 2023-06-08T16:54:49.753 INFO:teuthology.orchestra.console:Power off smithi190 2023-06-08T16:54:49.771 INFO:teuthology.orchestra.console:Power off smithi061 2023-06-08T16:54:58.187 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-06-08T16:54:58.288 INFO:teuthology.orchestra.console:Power on smithi190 2023-06-08T16:55:02.294 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-06-08T16:55:02.397 INFO:teuthology.orchestra.console:Power on smithi061 2023-06-08T16:55:06.663 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2023-06-08T16:55:06.764 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-06-08T16:55:10.769 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2023-06-08T16:55:10.870 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-06-08T16:58:07.799 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: Authentication failed. 2023-06-08T16:58:45.236 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-08T16:58:54.288 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-08T16:59:03.344 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-08T16:59:08.804 WARNING:teuthology.provision.fog:timed out 2023-06-08T16:59:12.400 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-08T16:59:21.456 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-08T16:59:33.360 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-08T16:59:42.416 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-08T16:59:48.419 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-08T16:59:54.422 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-08T17:00:00.424 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-08T17:00:06.427 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-08T17:00:12.624 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T17:00:13.097 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-06-08T17:00:13.144 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-06-08T17:00:13.193 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-06-08T17:00:13.580 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-08T17:00:13.581 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2023-06-08T17:00:13.581 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2023-06-08T17:00:13.581 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-08T17:00:13.581 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2023-06-08T17:00:13.581 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2023-06-08T17:00:13.581 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2023-06-08T17:00:13.582 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-08T17:00:13.582 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-08T17:00:13.582 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-08T17:00:13.582 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-08T17:00:13.582 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2023-06-08T17:00:13.583 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-06-08T17:00:27.460 WARNING:teuthology.provision.fog:timed out 2023-06-08T17:00:33.672 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T17:00:34.129 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-06-08T17:00:34.175 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-06-08T17:00:34.228 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-06-08T17:00:34.584 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-08T17:00:34.584 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-06-08T17:00:34.584 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="22.04" 2023-06-08T17:00:34.585 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-08T17:00:34.585 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=jammy 2023-06-08T17:00:34.585 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-06-08T17:00:34.585 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-06-08T17:00:34.586 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-08T17:00:34.586 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-08T17:00:34.586 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-08T17:00:34.586 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-08T17:00:34.586 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=jammy 2023-06-08T17:00:34.587 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-06-08T17:00:34.788 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-06-08T17:00:34.789 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T17:00:34.816 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-06-08T17:00:34.816 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T17:00:34.833 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-06-08T17:00:34.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-06-08T17:00:35.051 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-06-08T17:00:35.102 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-08T17:00:35.103 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-06-08T17:00:35.103 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="22.04" 2023-06-08T17:00:35.103 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-08T17:00:35.103 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=jammy 2023-06-08T17:00:35.103 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-06-08T17:00:35.103 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-06-08T17:00:35.104 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-08T17:00:35.104 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-08T17:00:35.104 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-08T17:00:35.104 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-08T17:00:35.104 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=jammy 2023-06-08T17:00:35.105 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-06-08T17:00:35.132 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-06-08T17:00:35.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-06-08T17:00:35.468 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-06-08T17:00:35.516 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-08T17:00:35.517 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2023-06-08T17:00:35.517 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2023-06-08T17:00:35.517 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-08T17:00:35.517 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2023-06-08T17:00:35.517 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2023-06-08T17:00:35.518 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2023-06-08T17:00:35.518 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-08T17:00:35.518 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-08T17:00:35.518 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-08T17:00:35.518 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-08T17:00:35.518 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2023-06-08T17:00:35.519 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-06-08T17:00:35.634 INFO:teuthology.dispatcher.supervisor:Running job 7299400 2023-06-08T17:00:35.634 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-06-08_16:52:11-krbd:rbd-dcorruption:-wip-choffman-krbd-scale-test-distro-default-smithi/7299400 --name choffman-2023-06-08_16:52:11-krbd:rbd-dcorruption:-wip-choffman-krbd-scale-test-distro-default-smithi --description krbd:rbd-dcorruption:/{bluestore-bitmap clusters/2node conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_mirror_compare} -- /home/teuthworker/archive/choffman-2023-06-08_16:52:11-krbd:rbd-dcorruption:-wip-choffman-krbd-scale-test-distro-default-smithi/7299400/orig.config.yaml 2023-06-08T17:00:35.638 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-06-08_16:52:11-krbd:rbd-dcorruption:-wip-choffman-krbd-scale-test-distro-default-smithi/7299400 2023-06-08T17:00:35.638 INFO:teuthology.dispatcher.supervisor:Job PID: 14199 2023-06-08T17:00:35.639 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-08T17:14:36.164 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-08T17:14:36.257 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-08T17:14:36.257 INFO:teuthology.nuke:Checking targets against current locks 2023-06-08T17:14:36.308 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T17:14:36.338 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T17:14:36.379 INFO:teuthology.orchestra.console:Power off smithi061 2023-06-08T17:14:36.419 INFO:teuthology.orchestra.console:Power off smithi190 2023-06-08T17:14:36.530 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-06-08T17:14:36.564 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-06-08T17:14:36.686 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-06-08T17:14:36.713 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com