2023-02-11T20:16:36.676 INFO:root:teuthology version: 0.0.1.dev39+ga5875b2 2023-02-11T20:16:36.798 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-02-11T20:16:36.798 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-02-11T20:16:36.798 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-02-11T20:16:36.818 INFO:teuthology.lock.ops:Node 'smithi029.front.sepia.ceph.com' reimaging is complete 2023-02-11T20:16:36.818 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2023-02-11T20:16:36.818 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2023-02-11T20:16:36.818 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-02-11T20:16:36.836 INFO:teuthology.lock.ops:Node 'smithi042.front.sepia.ceph.com' reimaging is complete 2023-02-11T20:16:36.977 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of ubuntu 22.04 2023-02-11T20:16:36.992 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of ubuntu 22.04 2023-02-11T20:16:37.186 INFO:teuthology.orchestra.console:Power off smithi042 2023-02-11T20:16:37.200 INFO:teuthology.orchestra.console:Power off smithi029 2023-02-11T20:16:37.331 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-02-11T20:16:37.345 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-02-11T20:16:37.433 INFO:teuthology.orchestra.console:Power on smithi042 2023-02-11T20:16:37.446 INFO:teuthology.orchestra.console:Power on smithi029 2023-02-11T20:16:45.799 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2023-02-11T20:16:45.843 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2023-02-11T20:16:45.900 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2023-02-11T20:16:45.944 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-02-11T20:20:05.257 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-02-11T20:20:14.341 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-02-11T20:20:23.397 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-02-11T20:20:32.453 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-02-11T20:21:20.517 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-11T20:21:29.609 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-11T20:21:38.464 WARNING:teuthology.provision.fog:timed out 2023-02-11T20:21:38.693 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-11T20:21:47.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-11T20:21:51.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-02-11T20:21:57.977 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-11T20:21:58.427 INFO:teuthology.provision.fog.smithi042:Node is ready 2023-02-11T20:21:58.475 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2023-02-11T20:21:58.527 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2023-02-11T20:21:58.869 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2023-02-11T20:22:53.808 WARNING:teuthology.provision.fog:timed out 2023-02-11T20:23:07.013 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-11T20:23:13.352 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-11T20:23:13.870 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-02-11T20:23:13.916 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-02-11T20:23:13.965 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-02-11T20:23:14.332 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-02-11T20:23:14.645 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-02-11T20:23:14.645 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-11T20:23:14.665 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2023-02-11T20:23:14.666 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-11T20:23:14.683 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-02-11T20:23:14.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-02-11T20:23:14.925 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-02-11T20:23:14.973 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy 2023-02-11T20:23:14.975 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-02-11T20:23:14.995 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2023-02-11T20:23:14.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-02-11T20:23:15.354 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2023-02-11T20:23:15.406 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="22.04" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=jammy 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-02-11T20:23:15.407 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=jammy 2023-02-11T20:23:15.408 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-02-11T20:23:15.539 INFO:teuthology.dispatcher.supervisor:Running job 7169651 2023-02-11T20:23:15.539 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a5875b2da3506f26286d023ce2de3e75c0eb806d/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi/7169651 --name cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} -- /home/teuthworker/archive/cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi/7169651/orig.config.yaml 2023-02-11T20:23:15.549 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi/7169651 2023-02-11T20:23:15.550 INFO:teuthology.dispatcher.supervisor:Job PID: 17762 2023-02-11T20:23:15.550 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-12T08:24:16.308 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-02-12T08:24:21.430 INFO:teuthology.kill:Killing Pids: {17762} 2023-02-12T08:24:37.581 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-02-12T08:24:37.582 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-02-12T08:24:37.630 INFO:teuthology.misc:Compressing logs... 2023-02-12T08:24:37.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-02-12T08:24:46.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-02-12T08:24:48.579 INFO:teuthology.kill:No teuthology processes running 2023-02-12T08:24:51.235 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi042'] 2023-02-12T08:24:52.872 INFO:teuthology.kill:2023-02-12 08:24:52,872.872 INFO:teuthology.nuke:targets: 2023-02-12T08:24:52.876 INFO:teuthology.kill: smithi029.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAAVM46vMATQtCgDrXKFwNa/0dusaOxO+zw2R8BF4BFi 2023-02-12T08:24:52.876 INFO:teuthology.kill: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDl8fV8YOuu+9VhakBGmGuCylr0pbzVnSGJcuqlPTYcmIbZhyJIrwWsJhnXFMocnCzZTUUMJgXyahWwOJG59mfk= 2023-02-12T08:24:52.876 INFO:teuthology.kill:2023-02-12 08:24:52,872.872 INFO:teuthology.nuke:Checking targets against current locks 2023-02-12T08:24:52.922 INFO:teuthology.kill:2023-02-12 08:24:52,922.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-02-12T08:24:52.943 INFO:teuthology.kill:2023-02-12 08:24:52,943.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-02-12T08:24:52.996 INFO:teuthology.kill:2023-02-12 08:24:52,996.996 INFO:teuthology.orchestra.console:Power off smithi029 2023-02-12T08:24:53.039 INFO:teuthology.kill:2023-02-12 08:24:53,039.039 INFO:teuthology.orchestra.console:Power off smithi042 2023-02-12T08:25:01.384 INFO:teuthology.kill:2023-02-12 08:25:01,384.384 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-02-12T08:25:01.402 INFO:teuthology.kill:2023-02-12 08:25:01,401.401 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-02-12T08:25:01.535 INFO:teuthology.kill:2023-02-12 08:25:01,535.535 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-02-12T08:25:01.543 INFO:teuthology.kill:2023-02-12 08:25:01,543.543 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com 2023-02-12T08:27:01.980 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-02-12T08:27:02.363 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi029 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161141 2023-02-12T08:27:02.363 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161141