2022-02-03T19:38:19.981 INFO:root:teuthology version: 1.1.0-0f634dc1 2022-02-03T19:38:20.106 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging 2022-02-03T19:38:20.110 INFO:teuthology.lock.ops:Updating [ubuntu@smithi071.front.sepia.ceph.com]: reset os type and version on server 2022-02-03T19:38:20.110 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-02-03T19:38:20.135 INFO:teuthology.lock.ops:Node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging is complete 2022-02-03T19:38:20.136 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging 2022-02-03T19:38:20.136 INFO:teuthology.lock.ops:Updating [ubuntu@smithi074.front.sepia.ceph.com]: reset os type and version on server 2022-02-03T19:38:20.137 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-02-03T19:38:20.162 INFO:teuthology.lock.ops:Node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging is complete 2022-02-03T19:38:20.376 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of ubuntu 20.04 2022-02-03T19:38:20.395 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of ubuntu 20.04 2022-02-03T19:38:20.798 INFO:teuthology.orchestra.console:Power off smithi074 2022-02-03T19:38:20.836 INFO:teuthology.orchestra.console:Power off smithi071 2022-02-03T19:38:29.167 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-02-03T19:38:29.268 INFO:teuthology.orchestra.console:Power on smithi074 2022-02-03T19:38:33.319 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-02-03T19:38:33.420 INFO:teuthology.orchestra.console:Power on smithi071 2022-02-03T19:38:37.643 INFO:teuthology.orchestra.console:Power on for smithi074 completed 2022-02-03T19:38:37.744 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish 2022-02-03T19:38:41.786 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2022-02-03T19:38:41.888 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2022-02-03T19:43:35.389 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-03T19:43:35.830 INFO:teuthology.provision.fog.smithi071:Node is ready 2022-02-03T19:43:35.836 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2022-02-03T19:43:35.844 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2022-02-03T19:43:36.049 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2022-02-03T19:43:37.900 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-03T19:43:38.432 INFO:teuthology.provision.fog.smithi074:Node is ready 2022-02-03T19:43:38.479 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com 2022-02-03T19:43:38.486 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074 2022-02-03T19:43:38.688 INFO:teuthology.provision.fog.smithi074:Deploy complete! 2022-02-03T19:43:38.873 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2022-02-03T19:43:38.874 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-03T19:43:38.892 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com 2022-02-03T19:43:38.893 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-03T19:43:38.911 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2022-02-03T19:43:38.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-02-03T19:43:39.087 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2022-02-03T19:43:39.134 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2022-02-03T19:43:39.135 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-02-03T19:43:39.135 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2022-02-03T19:43:39.135 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2022-02-03T19:43:39.135 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-02-03T19:43:39.136 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="20.04" 2022-02-03T19:43:39.136 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2022-02-03T19:43:39.136 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-02-03T19:43:39.136 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-02-03T19:43:39.136 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-02-03T19:43:39.137 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=focal 2022-02-03T19:43:39.137 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=focal 2022-02-03T19:43:39.138 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-02-03T19:43:39.155 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server 2022-02-03T19:43:39.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-02-03T19:43:39.334 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2022-02-03T19:43:39.341 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="Ubuntu" 2022-02-03T19:43:39.342 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-02-03T19:43:39.342 INFO:teuthology.orchestra.run.smithi074.stdout:ID=ubuntu 2022-02-03T19:43:39.342 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE=debian 2022-02-03T19:43:39.342 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-02-03T19:43:39.343 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="20.04" 2022-02-03T19:43:39.344 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://www.ubuntu.com/" 2022-02-03T19:43:39.344 INFO:teuthology.orchestra.run.smithi074.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-02-03T19:43:39.345 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-02-03T19:43:39.345 INFO:teuthology.orchestra.run.smithi074.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-02-03T19:43:39.345 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_CODENAME=focal 2022-02-03T19:43:39.345 INFO:teuthology.orchestra.run.smithi074.stdout:UBUNTU_CODENAME=focal 2022-02-03T19:43:39.346 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-02-03T19:43:39.456 INFO:teuthology.dispatcher.supervisor:Running job 6658146 2022-02-03T19:43:39.457 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-02-03_05:07:02-rgw-pacific-distro-default-smithi/6658146 --name teuthology-2022-02-03_05:07:02-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/teuthology-2022-02-03_05:07:02-rgw-pacific-distro-default-smithi/6658146/orig.config.yaml 2022-02-03T19:43:39.460 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-02-03_05:07:02-rgw-pacific-distro-default-smithi/6658146 2022-02-03T19:43:39.461 INFO:teuthology.dispatcher.supervisor:Job PID: 1847 2022-02-03T19:43:39.461 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-04T02:13:50.292 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-04T02:13:50.502 INFO:teuthology.kill:Killing Pids: {1847} 2022-02-04T02:13:51.745 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-02-04T02:13:51.746 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-02-04T02:13:51.746 INFO:teuthology.misc:Compressing logs... 2022-02-04T02:13:51.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-02-04T02:13:51.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-02-04T02:13:52.253 INFO:teuthology.misc:Compressing logs... 2022-02-04T02:13:52.374 INFO:teuthology.misc:Compressing logs... 2022-02-04T02:14:01.017 INFO:teuthology.kill:No teuthology processes running 2022-02-04T02:14:02.186 INFO:teuthology.kill:Nuking machines: ['smithi071', 'smithi074'] 2022-02-04T02:14:03.183 INFO:teuthology.kill:2022-02-04 02:14:03,183.183 INFO:teuthology.nuke:targets: 2022-02-04T02:14:03.184 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2brDLM+0zuqBuZiy8VAEjqH0D8a08SBMSDDja+tQOslrysTIrUWqHrbzf3DgAmkCe/wxSHdDFDk1E/hW+Vy4td1hzYAUE6/YcXwIMLIj2qgV/v2HKrgif1u505DC0y/tld3hI7ccTe9wQrN+Hozm6mwSj0GQOpNCJPsR2oy9BxRTS8sjvr1fU1e/mbr/WSirql818B9uDHhHIMXaJ8Samim0onBxE50Jfv9wGAXC6cizlqemjV+Ui0SHJS091WAHKhxYClOz2SdXqIrzsmWNBZtts2HFLQVs9Bcorr2uVT+fL220kW0P+baIv4ka8him1kso/RgErTqTytgs/jsBzqfDS/knaMG8qZuuv/Br7jMSvO7IeeaIfHa71uFmtmyDXIdQKzguyVv7Cs0Uzl2kAmYpJTbajYTeAyjRXssQ3xS4BLPygrziAr4n7STSE6xpfiBQ1iJ/KB0vSDIbx67A12kR1G4exWpLq+AsLbYLwKg5eaFHZ4tbOO5UtCojJWn8= 2022-02-04T02:14:03.185 INFO:teuthology.kill: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeYpCeH5zt15/ZyRFzAi1NR1jvAEJ+BFaRyMYq1IhLQCL2B3AVzEKI/iCcOXt05xqMqRq8g0V6DFYvFS5+7rU/C/BX12CnKJAUTZiq/F2uM5ykJMA4JerfR1gboxPL4IwR1oCacPEFDP1dMJbEzzdhM7YVDVLhpQM0baCrBnqggk6tRXGoKX0A6u0W/az3L7d4vrzxo7TVeJZkjZ1iq/uibyC6NBJ/kbYaKhh82fGJo6P/jKF6RE+ohy6/DYplBIlNnKUP7ApF5HMuKYstMfaM8Ld+IKMh+Pp8vpCT1BnJkzdLC3KB1p0zN75x0vQlCME7iutQHv1aaXzi2ySO2OY8XL/zsSUZ4jORWENyPHq1xYqsMcAAof9PAjAaZx6Z57CLOk5IN11rxtDqye4g7fiVm2k0x2Ju0u5wydF08kalbv6SQLGMoNhiy5DUVCgaVzKSa9xHKcOEzb7qpVHYoiXd7VKi9T3RzmMaMDdxpC6BnMcxuOke4INgHphAFqprdmE= 2022-02-04T02:14:03.210 INFO:teuthology.kill:2022-02-04 02:14:03,210.210 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-04T02:14:03.214 INFO:teuthology.kill:2022-02-04 02:14:03,213.213 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-04T02:14:03.290 INFO:teuthology.kill:2022-02-04 02:14:03,289.289 INFO:teuthology.orchestra.console:Power off smithi071 2022-02-04T02:14:03.302 INFO:teuthology.kill:2022-02-04 02:14:03,301.301 INFO:teuthology.orchestra.console:Power off smithi074 2022-02-04T02:14:15.774 INFO:teuthology.kill:2022-02-04 02:14:15,774.774 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-02-04T02:14:15.779 INFO:teuthology.kill:2022-02-04 02:14:15,779.779 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-02-04T02:14:15.919 INFO:teuthology.kill:2022-02-04 02:14:15,918.918 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2022-02-04T02:14:15.923 INFO:teuthology.kill:2022-02-04 02:14:15,922.922 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com 2022-02-04T02:16:16.233 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15