2021-12-01T18:47:58.107 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-01T18:47:58.275 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging 2021-12-01T18:47:58.276 INFO:teuthology.lock.ops:Updating [ubuntu@smithi055.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T18:47:58.277 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2021-12-01T18:47:58.297 INFO:teuthology.lock.ops:Node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging is complete 2021-12-01T18:47:58.297 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging 2021-12-01T18:47:58.298 INFO:teuthology.lock.ops:Updating [ubuntu@smithi089.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T18:47:58.298 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2021-12-01T18:47:58.318 INFO:teuthology.lock.ops:Node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging is complete 2021-12-01T18:47:58.319 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi132.front.sepia.ceph.com' reimaging 2021-12-01T18:47:58.320 INFO:teuthology.lock.ops:Updating [ubuntu@smithi132.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T18:47:58.320 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2021-12-01T18:47:58.339 INFO:teuthology.lock.ops:Node 'ubuntu@smithi132.front.sepia.ceph.com' reimaging is complete 2021-12-01T18:47:58.533 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of ubuntu 18.04 2021-12-01T18:47:58.537 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of ubuntu 18.04 2021-12-01T18:47:58.568 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of ubuntu 18.04 2021-12-01T18:47:58.938 INFO:teuthology.orchestra.console:Power off smithi055 2021-12-01T18:47:58.955 INFO:teuthology.orchestra.console:Power off smithi132 2021-12-01T18:47:58.967 INFO:teuthology.orchestra.console:Power off smithi089 2021-12-01T18:48:07.325 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2021-12-01T18:48:07.427 INFO:teuthology.orchestra.console:Power on smithi132 2021-12-01T18:48:11.446 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2021-12-01T18:48:11.453 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2021-12-01T18:48:11.547 INFO:teuthology.orchestra.console:Power on smithi055 2021-12-01T18:48:11.556 INFO:teuthology.orchestra.console:Power on smithi089 2021-12-01T18:48:15.805 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2021-12-01T18:48:15.811 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2021-12-01T18:48:15.816 INFO:teuthology.orchestra.console:Power on for smithi089 completed 2021-12-01T18:48:15.907 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2021-12-01T18:48:15.911 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2021-12-01T18:48:15.918 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2021-12-01T18:53:20.551 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T18:53:20.555 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T18:53:20.816 INFO:teuthology.provision.fog.smithi055:Node is ready 2021-12-01T18:53:20.817 INFO:teuthology.provision.fog.smithi132:Node is ready 2021-12-01T18:53:20.862 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2021-12-01T18:53:20.866 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2021-12-01T18:53:20.911 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2021-12-01T18:53:20.914 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2021-12-01T18:53:21.183 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2021-12-01T18:53:21.210 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2021-12-01T18:53:35.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T18:53:35.896 INFO:teuthology.provision.fog.smithi089:Node is ready 2021-12-01T18:53:35.946 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2021-12-01T18:53:35.994 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2021-12-01T18:53:36.294 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2021-12-01T18:53:36.488 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2021-12-01T18:53:36.489 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T18:53:36.509 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2021-12-01T18:53:36.509 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T18:53:36.528 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2021-12-01T18:53:36.528 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T18:53:36.549 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2021-12-01T18:53:36.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2021-12-01T18:53:36.839 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2021-12-01T18:53:36.887 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2021-12-01T18:53:36.887 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-12-01T18:53:36.887 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2021-12-01T18:53:36.887 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2021-12-01T18:53:36.888 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-12-01T18:53:36.888 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="18.04" 2021-12-01T18:53:36.888 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-01T18:53:36.888 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-01T18:53:36.889 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-01T18:53:36.889 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-01T18:53:36.889 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=bionic 2021-12-01T18:53:36.889 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=bionic 2021-12-01T18:53:36.891 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2021-12-01T18:53:36.908 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2021-12-01T18:53:36.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2021-12-01T18:53:37.141 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2021-12-01T18:53:37.189 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2021-12-01T18:53:37.190 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-12-01T18:53:37.190 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2021-12-01T18:53:37.190 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2021-12-01T18:53:37.191 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-12-01T18:53:37.191 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="18.04" 2021-12-01T18:53:37.191 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-01T18:53:37.191 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-01T18:53:37.191 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-01T18:53:37.192 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-01T18:53:37.192 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=bionic 2021-12-01T18:53:37.192 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=bionic 2021-12-01T18:53:37.193 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2021-12-01T18:53:37.211 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2021-12-01T18:53:37.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2021-12-01T18:53:37.474 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2021-12-01T18:53:37.522 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2021-12-01T18:53:37.522 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2021-12-01T18:53:37.522 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2021-12-01T18:53:37.523 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2021-12-01T18:53:37.523 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2021-12-01T18:53:37.523 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="18.04" 2021-12-01T18:53:37.523 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-01T18:53:37.524 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-01T18:53:37.524 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-01T18:53:37.524 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-01T18:53:37.524 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=bionic 2021-12-01T18:53:37.524 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=bionic 2021-12-01T18:53:37.525 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2021-12-01T18:53:37.624 INFO:teuthology.dispatcher.supervisor:Running job 6538547 2021-12-01T18:53:37.624 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-01_17:25:46-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi/6538547 --name yuriw-2021-12-01_17:25:46-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2021-12-01_17:25:46-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi/6538547/orig.config.yaml 2021-12-01T18:53:37.628 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-01_17:25:46-rados-wip-yuri8-testing-2021-11-30-0825-octopus-distro-default-smithi/6538547 2021-12-01T18:53:37.629 INFO:teuthology.dispatcher.supervisor:Job PID: 23641 2021-12-01T18:53:37.630 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-02T06:54:33.759 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-02T06:54:34.870 INFO:teuthology.kill:Killing Pids: {23641} 2021-12-02T06:54:36.968 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a'] 2021-12-02T06:54:36.971 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x'] 2021-12-02T06:54:36.972 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c'] 2021-12-02T06:54:36.977 INFO:teuthology.misc:Compressing logs... 2021-12-02T06:54:36.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2021-12-02T06:54:37.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2021-12-02T06:54:38.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2021-12-02T06:54:39.861 INFO:teuthology.kill:No teuthology processes running 2021-12-02T06:54:41.020 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi089', 'smithi132'] 2021-12-02T06:54:41.991 INFO:teuthology.kill:2021-12-02 06:54:41,991.991 INFO:teuthology.nuke:targets: 2021-12-02T06:54:41.992 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDTfZuHj7f6fcg0+Tgv5BNIwlSxlKU4H6dOY4//d8irRF10rBt7qFo9KWFpaee5CLTSicfHc6xJgVKWcaFMm9cIHIenLsOi7ebyWHfIC1/YOCb6dJ+URKIXeAw/mdWSaD3DDPlVMwTeFUjtCBNwCNNxW3/Ddh5MjGcEdmU0Mtx5OVe6DQNctx1/86tB4XZdeT1A3N1sFoBNUGY1rgF3ZxDcTVYXioO69bffBXsS4G2T7KOWIFTzWWAExAFdnsayj+qxcUXjEiDbXopyptOL+owTC2MXTFAmtxC5HaLRL202NJBk84OuHH2lvB4yXLPbOg+CNxSUG2fH1FwdsvH3CjCj 2021-12-02T06:54:41.992 INFO:teuthology.kill: smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+63ecZzBhduWkNXU8xbag+c2/UPuWaR8z00/6j+7WtrxMmyXqvSFK1DV7V1qovMQX03Y18RJV+GVaY5rSO/oszRQCy+wsbPVkYneHqs5Sk/Qep511JuzG6OuTA7kLIO8n7yhQ6WkvzSImHBRKW2TvpqeAs83onKP8ax9mE692X1kyUxajW8osGhDpxXw+iIfagwuqX0qjic4sG9rth/TltYHpxaVMNhZGjK91YoqaDGbMOZ1xY+exqFwUsEdDPk0OZqoEDttHc1x7Godr0IpQ55+Dwjogec3OVBhggwS5dI92n6ztm4EyA2JyUPB5vRq8LT3eMeA3+NtL4ZzOUzWL 2021-12-02T06:54:41.993 INFO:teuthology.kill: smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0+nYK8aodZQujojgvA7omw4+8nwqKSWyGLWg/hu8652j9blp9E5nW3Sn4ruBqDdqnYfK9X1zVyx9n+/+a9AMYJURmYG5dYF/d7mfM76kcj41JkfWZk5F6afvOGqYZj2fqauxmaThcHTkyy6pIRQrDILIM8o87HmYN1bmR7Tc+9EGY/69bnT2pDoUs4uidKF7n4Kph+9I8kDD2leqEssp9xPIrkJv2qnaTOChnOW8VaGTQ/Sjv9AhCXrZigrGqhCsw+EMG0y9cclIsQO2PjPzMN5ePDtHxNIBFb7hkfb9kW+C57SiInYYdsiE0OYtcghF7PyANwL0ps5xTRZCaecLx 2021-12-02T06:54:42.020 INFO:teuthology.kill:2021-12-02 06:54:42,019.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T06:54:42.023 INFO:teuthology.kill:2021-12-02 06:54:42,023.023 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T06:54:42.025 INFO:teuthology.kill:2021-12-02 06:54:42,025.025 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T06:54:42.102 INFO:teuthology.kill:2021-12-02 06:54:42,102.102 INFO:teuthology.orchestra.console:Power off smithi089 2021-12-02T06:54:42.115 INFO:teuthology.kill:2021-12-02 06:54:42,115.115 INFO:teuthology.orchestra.console:Power off smithi055 2021-12-02T06:54:42.126 INFO:teuthology.kill:2021-12-02 06:54:42,126.126 INFO:teuthology.orchestra.console:Power off smithi132 2021-12-02T06:54:50.501 INFO:teuthology.kill:2021-12-02 06:54:50,500.500 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2021-12-02T06:54:50.648 INFO:teuthology.kill:2021-12-02 06:54:50,647.647 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2021-12-02T06:54:54.601 INFO:teuthology.kill:2021-12-02 06:54:54,601.601 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2021-12-02T06:54:54.607 INFO:teuthology.kill:2021-12-02 06:54:54,607.607 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2021-12-02T06:54:54.753 INFO:teuthology.kill:2021-12-02 06:54:54,752.752 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2021-12-02T06:54:54.757 INFO:teuthology.kill:2021-12-02 06:54:54,757.757 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2021-12-02T06:56:54.986 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15