2022-04-12T08:45:31.639 INFO:root:teuthology version: 1.1.0-a347b2ac 2022-04-12T08:45:31.837 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging 2022-04-12T08:45:31.838 INFO:teuthology.lock.ops:Updating [ubuntu@smithi107.front.sepia.ceph.com]: reset os type and version on server 2022-04-12T08:45:31.839 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-04-12T08:45:31.859 INFO:teuthology.lock.ops:Node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging is complete 2022-04-12T08:45:31.859 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi151.front.sepia.ceph.com' reimaging 2022-04-12T08:45:31.860 INFO:teuthology.lock.ops:Updating [ubuntu@smithi151.front.sepia.ceph.com]: reset os type and version on server 2022-04-12T08:45:31.860 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2022-04-12T08:45:31.885 INFO:teuthology.lock.ops:Node 'ubuntu@smithi151.front.sepia.ceph.com' reimaging is complete 2022-04-12T08:45:31.886 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging 2022-04-12T08:45:31.886 INFO:teuthology.lock.ops:Updating [ubuntu@smithi201.front.sepia.ceph.com]: reset os type and version on server 2022-04-12T08:45:31.887 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-04-12T08:45:31.908 INFO:teuthology.lock.ops:Node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging is complete 2022-04-12T08:45:32.085 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 20.04 2022-04-12T08:45:32.108 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 20.04 2022-04-12T08:45:32.127 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of ubuntu 20.04 2022-04-12T08:45:32.454 INFO:teuthology.orchestra.console:Power off smithi151 2022-04-12T08:45:32.474 INFO:teuthology.orchestra.console:Power off smithi107 2022-04-12T08:45:32.540 INFO:teuthology.orchestra.console:Power off smithi201 2022-04-12T08:45:40.876 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-04-12T08:45:40.975 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-04-12T08:45:40.977 INFO:teuthology.orchestra.console:Power on smithi107 2022-04-12T08:45:41.076 INFO:teuthology.orchestra.console:Power on smithi201 2022-04-12T08:45:44.959 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2022-04-12T08:45:45.060 INFO:teuthology.orchestra.console:Power on smithi151 2022-04-12T08:45:45.331 INFO:teuthology.orchestra.console:Power on for smithi201 completed 2022-04-12T08:45:45.432 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish 2022-04-12T08:45:49.325 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2022-04-12T08:45:49.342 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2022-04-12T08:45:49.427 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2022-04-12T08:45:49.443 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2022-04-12T08:48:51.301 ERROR:teuthology.orchestra.connection:Error authenticating with smithi107.front.sepia.ceph.com: Authentication failed. 2022-04-12T08:50:49.534 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-12T08:50:50.183 INFO:teuthology.provision.fog.smithi201:Node is ready 2022-04-12T08:50:50.229 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com 2022-04-12T08:50:50.236 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201 2022-04-12T08:50:50.362 INFO:teuthology.provision.fog.smithi201:Deploy complete! 2022-04-12T08:51:02.945 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-12T08:51:03.431 INFO:teuthology.provision.fog.smithi107:Node is ready 2022-04-12T08:51:03.438 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2022-04-12T08:51:03.445 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2022-04-12T08:51:03.643 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2022-04-12T08:51:07.038 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-12T08:51:07.533 INFO:teuthology.provision.fog.smithi151:Node is ready 2022-04-12T08:51:07.583 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2022-04-12T08:51:07.589 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2022-04-12T08:51:07.746 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2022-04-12T08:51:07.988 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2022-04-12T08:51:07.989 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-12T08:51:08.010 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2022-04-12T08:51:08.011 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-12T08:51:08.027 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com 2022-04-12T08:51:08.027 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-12T08:51:08.045 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2022-04-12T08:51:08.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-04-12T08:51:08.225 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2022-04-12T08:51:08.232 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2022-04-12T08:51:08.232 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-12T08:51:08.233 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2022-04-12T08:51:08.233 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2022-04-12T08:51:08.233 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-12T08:51:08.233 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2022-04-12T08:51:08.234 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-12T08:51:08.234 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-12T08:51:08.235 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-12T08:51:08.235 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-12T08:51:08.235 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2022-04-12T08:51:08.236 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2022-04-12T08:51:08.237 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-04-12T08:51:08.254 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2022-04-12T08:51:08.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2022-04-12T08:51:08.459 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2022-04-12T08:51:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2022-04-12T08:51:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-12T08:51:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2022-04-12T08:51:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2022-04-12T08:51:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-12T08:51:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2022-04-12T08:51:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-12T08:51:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-12T08:51:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-12T08:51:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-12T08:51:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2022-04-12T08:51:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2022-04-12T08:51:08.468 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2022-04-12T08:51:08.531 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server 2022-04-12T08:51:08.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com' 2022-04-12T08:51:08.715 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64 2022-04-12T08:51:08.764 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="Ubuntu" 2022-04-12T08:51:08.765 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-12T08:51:08.765 INFO:teuthology.orchestra.run.smithi201.stdout:ID=ubuntu 2022-04-12T08:51:08.765 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE=debian 2022-04-12T08:51:08.766 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-12T08:51:08.766 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="20.04" 2022-04-12T08:51:08.766 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-12T08:51:08.766 INFO:teuthology.orchestra.run.smithi201.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-12T08:51:08.767 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-12T08:51:08.767 INFO:teuthology.orchestra.run.smithi201.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-12T08:51:08.767 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_CODENAME=focal 2022-04-12T08:51:08.767 INFO:teuthology.orchestra.run.smithi201.stdout:UBUNTU_CODENAME=focal 2022-04-12T08:51:08.768 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-04-12T08:51:08.855 INFO:teuthology.dispatcher.supervisor:Running job 6789106 2022-04-12T08:51:08.856 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-04-12_08:32:39-rbd-wip-dis-testing-1-distro-default-smithi/6789106 --name dis-2022-04-12_08:32:39-rbd-wip-dis-testing-1-distro-default-smithi --description rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} -- /home/teuthworker/archive/dis-2022-04-12_08:32:39-rbd-wip-dis-testing-1-distro-default-smithi/6789106/orig.config.yaml 2022-04-12T08:51:08.860 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-04-12_08:32:39-rbd-wip-dis-testing-1-distro-default-smithi/6789106 2022-04-12T08:51:08.861 INFO:teuthology.dispatcher.supervisor:Job PID: 32257 2022-04-12T08:51:08.861 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-12T15:21:19.600 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-12T15:21:19.797 INFO:teuthology.kill:Killing Pids: {32257} 2022-04-12T15:21:20.937 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-04-12T15:21:20.938 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-04-12T15:21:20.938 INFO:teuthology.task.internal:roles: ubuntu@smithi201.front.sepia.ceph.com - ['client.0'] 2022-04-12T15:21:20.938 INFO:teuthology.misc:Compressing logs... 2022-04-12T15:21:20.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-04-12T15:21:21.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2022-04-12T15:21:21.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com' 2022-04-12T15:21:22.203 INFO:teuthology.misc:Compressing logs... 2022-04-12T15:21:22.361 INFO:teuthology.misc:Compressing logs... 2022-04-12T15:35:05.030 INFO:teuthology.kill:No teuthology processes running 2022-04-12T15:35:06.153 INFO:teuthology.kill:Nuking machines: ['smithi107', 'smithi151', 'smithi201'] 2022-04-12T15:35:07.102 INFO:teuthology.kill:2022-04-12 15:35:07,102.102 INFO:teuthology.nuke:targets: 2022-04-12T15:35:07.103 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCLPK1TwUqeireaA2w7WcNI37vg4BsZY6VQ2jgNKLIpj9fkzenJaXtu2eolMh1WsfnaShrBewLCCG/+BQyf9zDTdBeI56UyxrGNHmGdRtWwRAvx09IDqoH4ou/Zq7zWy8N+P5QQr+1c9LPQPNeasZrbZUta5/KOYP+VGyg8mImdOYL64sPklzPWuJmeqwTWd4w0mAMPpXK4NpJbFXwUTJXFt7cvyktJvv3VUi2BOtSAF50gczm/4gmrh4UO91L+UWBXojPqtYvzkkhYnQBx/KPDR/my+Q3CBVwjomCIxKM4SiDdrYJBRK/t6ZNMxfeA7FYxh4in+ZWFGWoOiQKZT2JxiQzBqaw2JiMqBVkDARlBrqO8oMnKEwMLHVvJulxRrDbprAuJR89kiCvG0YnzQeDulcUryo8JyxorLWRvIPss6pzEM1GWXvXSBilxZLBXzhDDFIogZ4N4FIVHYE1a25826KjtbuBYJS7j5VsmSxNhEixn3zEgKwufMnLevtcgEk= 2022-04-12T15:35:07.104 INFO:teuthology.kill: smithi151.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWCxS7BYWl07rQWGQ1V8cRW7KNY68KqfyPD7BQ33sVi8HyHGKKRxyBUbD7rskeHM6mW2pSf2+pSDtiEzTie07mV0f0qQkq2S/5mcg80fJHtqYqxB3YLSyco/V/M3mnZi21sq0s2DJRue/VH+9Nyd4JU2zmwODW40LRGwkQMWLBrNhF18UXsC9TofDXobsPTDuoV9Cc9NUo/ibKQWOJS5QjGqRdBtVfjcQMHa1SYDicWKSAL3Ybc66olQrbjMoJZWWcgb2Onq8wbeG375l5YzzADwXM8oWM3bo50S2qWaX5YdoFrNfq9fPT4p4MelalPCGThHQMzdtvPmg7OWQeT9/OmCGMDG4eBFNrZT61KX2L2AuShhuhvD4ZvM6goq0nY/nhuj57pOM4+a0eJeLlfhfIuXxirtwk9yyitLGswP9705ffRTIafBA6RzzDDQo4mWm8CJdmKLC7vxeTAV1IS67C1/G7JjLQ59JDA0kCMRmV0fFyTPvoV1d2jxPLUKBlJYU= 2022-04-12T15:35:07.104 INFO:teuthology.kill: smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDimzQ39Zf89IIzJWg60C2cQ+rIjnT1CJryiJdn/37zgf7CoX19AmWIupryHEZLYqJtumf1UlHw3uRzpzAB/PsZryXSQJV4ExsOg5TQyPo6Pnny0OBUI/bOL24HBSEZUnaiOFO/Z1kHxlYeYCiSQNXSIHyfhTI2W+Rx1jD461KdBBDnN2k3jRxOGvGDo7mFUQkuIl5O4EHhVCNJxwFASYwtZZuTLHG148IKjwFmxYCuZ/q1eoW3tsIIPykUC7Ay3m8zumU5rtcmlXqBhDxp17vIlxc7oxLC+GLZhvwLlDwwQ/iScWVzkfghEamZfCTcXc+EGpy6oKpNzu2sdabIwERt+uyXW5oKNETKCqDIHGmMZxl3RX6HYzJJ81WzuLfzY+84B2ttPCVATNymuUxRSvcWBoYdI+79aiy/DIRijcsOyFccI3wmQc1e1H35Yk46MQnYQqeHBb/PHMI12kxrWiyd89S3tlZFWcPhjZSS+aHW8qsqa83wP3p2ZqFSDXHCQkM= 2022-04-12T15:35:07.134 INFO:teuthology.kill:2022-04-12 15:35:07,133.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-12T15:35:07.135 INFO:teuthology.kill:2022-04-12 15:35:07,135.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-12T15:35:07.140 INFO:teuthology.kill:2022-04-12 15:35:07,140.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-12T15:35:07.208 INFO:teuthology.kill:2022-04-12 15:35:07,208.208 INFO:teuthology.orchestra.console:Power off smithi201 2022-04-12T15:35:07.224 INFO:teuthology.kill:2022-04-12 15:35:07,223.223 INFO:teuthology.orchestra.console:Power off smithi151 2022-04-12T15:35:07.235 INFO:teuthology.kill:2022-04-12 15:35:07,235.235 INFO:teuthology.orchestra.console:Power off smithi107 2022-04-12T15:35:19.710 INFO:teuthology.kill:2022-04-12 15:35:19,709.709 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-04-12T15:35:19.715 INFO:teuthology.kill:2022-04-12 15:35:19,715.715 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2022-04-12T15:35:19.720 INFO:teuthology.kill:2022-04-12 15:35:19,720.720 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-04-12T15:35:19.859 INFO:teuthology.kill:2022-04-12 15:35:19,859.859 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com 2022-04-12T15:35:19.863 INFO:teuthology.kill:2022-04-12 15:35:19,863.863 INFO:teuthology.lock.ops:unlocked: smithi201.front.sepia.ceph.com 2022-04-12T15:35:19.867 INFO:teuthology.kill:2022-04-12 15:35:19,867.867 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2022-04-12T15:37:20.061 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-12T15:37:20.180 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi107 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-12_15:25:49-rados-wip-yuri7-testing-2022-04-11-1139-distro-default-smithi/6789168 2022-04-12T15:37:20.180 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi151 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-12_15:25:49-rados-wip-yuri7-testing-2022-04-11-1139-distro-default-smithi/6789169 2022-04-12T15:37:20.181 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi201 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-12_15:25:49-rados-wip-yuri7-testing-2022-04-11-1139-distro-default-smithi/6789168