2023-02-11T14:25:19.151 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-11T14:25:19.329 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-02-11T14:25:19.330 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-02-11T14:25:19.330 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-02-11T14:25:19.347 INFO:teuthology.lock.ops:Node 'smithi103.front.sepia.ceph.com' reimaging is complete 2023-02-11T14:25:19.347 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-02-11T14:25:19.347 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-02-11T14:25:19.347 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-02-11T14:25:19.363 INFO:teuthology.lock.ops:Node 'smithi138.front.sepia.ceph.com' reimaging is complete 2023-02-11T14:25:19.528 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of ubuntu 20.04 2023-02-11T14:25:19.533 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of ubuntu 20.04 2023-02-11T14:25:19.735 INFO:teuthology.orchestra.console:Power off smithi103 2023-02-11T14:25:19.792 INFO:teuthology.orchestra.console:Power off smithi138 2023-02-11T14:25:28.397 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-02-11T14:25:28.404 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2023-02-11T14:25:28.498 INFO:teuthology.orchestra.console:Power on smithi138 2023-02-11T14:25:28.507 INFO:teuthology.orchestra.console:Power on smithi103 2023-02-11T14:25:36.864 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2023-02-11T14:25:36.871 INFO:teuthology.orchestra.console:Power on for smithi103 completed 2023-02-11T14:25:36.966 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-02-11T14:25:36.973 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-02-11T14:29:41.509 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-02-11T14:29:50.597 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-02-11T14:29:56.613 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-02-11T14:29:59.653 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-02-11T14:30:06.277 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-02-11T14:30:08.713 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-02-11T14:30:15.333 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-02-11T14:30:24.389 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-02-11T14:30:33.445 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-02-11T14:31:15.186 WARNING:teuthology.provision.fog:timed out 2023-02-11T14:31:21.424 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-11T14:31:21.936 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-02-11T14:31:21.942 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2023-02-11T14:31:21.949 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-02-11T14:31:22.172 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-02-11T14:31:39.458 WARNING:teuthology.provision.fog:timed out 2023-02-11T14:31:45.739 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-11T14:31:46.193 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-02-11T14:31:46.241 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-02-11T14:31:46.248 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-02-11T14:31:46.422 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-02-11T14:31:46.704 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-02-11T14:31:46.705 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-11T14:31:46.721 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-02-11T14:31:46.739 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-11T14:31:46.755 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-02-11T14:31:46.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-02-11T14:31:46.932 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-02-11T14:31:46.938 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="20.04" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=focal 2023-02-11T14:31:46.939 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=focal 2023-02-11T14:31:46.941 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-02-11T14:31:46.956 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-02-11T14:31:46.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-02-11T14:31:47.220 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-02-11T14:31:47.225 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2023-02-11T14:31:47.225 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-02-11T14:31:47.225 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2023-02-11T14:31:47.225 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2023-02-11T14:31:47.225 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-02-11T14:31:47.226 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="20.04" 2023-02-11T14:31:47.226 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2023-02-11T14:31:47.226 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-02-11T14:31:47.226 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-02-11T14:31:47.226 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-02-11T14:31:47.226 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=focal 2023-02-11T14:31:47.226 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=focal 2023-02-11T14:31:47.226 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-02-11T14:31:47.364 INFO:teuthology.dispatcher.supervisor:Running job 7160897 2023-02-11T14:31:47.364 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160897 --name yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi --description rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160897/orig.config.yaml 2023-02-11T14:31:47.370 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160897 2023-02-11T14:31:47.371 INFO:teuthology.dispatcher.supervisor:Job PID: 2436 2023-02-11T14:31:47.371 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-12T02:32:46.116 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-02-12T02:32:52.829 INFO:teuthology.kill:Killing Pids: {2436} 2023-02-12T02:32:55.914 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2023-02-12T02:32:55.915 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0'] 2023-02-12T02:32:55.922 INFO:teuthology.misc:Compressing logs... 2023-02-12T02:32:56.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-02-12T02:32:59.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-02-12T02:33:01.661 INFO:teuthology.kill:No teuthology processes running 2023-02-12T02:33:03.367 INFO:teuthology.kill:Nuking machines: ['smithi103', 'smithi138'] 2023-02-12T02:33:03.966 INFO:teuthology.kill:2023-02-12 02:33:03,966.966 INFO:teuthology.nuke:targets: 2023-02-12T02:33:03.966 INFO:teuthology.kill: smithi103.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw 2023-02-12T02:33:03.967 INFO:teuthology.kill: smithi138.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw 2023-02-12T02:33:03.967 INFO:teuthology.kill:2023-02-12 02:33:03,966.966 INFO:teuthology.nuke:Checking targets against current locks 2023-02-12T02:33:04.009 INFO:teuthology.kill:2023-02-12 02:33:04,009.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-02-12T02:33:04.031 INFO:teuthology.kill:2023-02-12 02:33:04,031.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-02-12T02:33:04.080 INFO:teuthology.kill:2023-02-12 02:33:04,080.080 INFO:teuthology.orchestra.console:Power off smithi103 2023-02-12T02:33:04.122 INFO:teuthology.kill:2023-02-12 02:33:04,122.122 INFO:teuthology.orchestra.console:Power off smithi138 2023-02-12T02:33:12.544 INFO:teuthology.kill:2023-02-12 02:33:12,543.543 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2023-02-12T02:33:12.554 INFO:teuthology.kill:2023-02-12 02:33:12,554.554 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-02-12T02:33:12.688 INFO:teuthology.kill:2023-02-12 02:33:12,687.687 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-02-12T02:33:12.694 INFO:teuthology.kill:2023-02-12 02:33:12,694.694 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2023-02-12T02:35:13.171 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-02-12T02:35:13.533 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161023 2023-02-12T02:35:13.533 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi138 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7161021