2022-01-10T04:18:17.519 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-10T04:18:17.694 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging
2022-01-10T04:18:17.696 INFO:teuthology.lock.ops:Updating [ubuntu@smithi111.front.sepia.ceph.com]: reset os type and version on server
2022-01-10T04:18:17.696 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2022-01-10T04:18:17.724 INFO:teuthology.lock.ops:Node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging is complete
2022-01-10T04:18:17.728 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi133.front.sepia.ceph.com' reimaging
2022-01-10T04:18:17.729 INFO:teuthology.lock.ops:Updating [ubuntu@smithi133.front.sepia.ceph.com]: reset os type and version on server
2022-01-10T04:18:17.730 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2022-01-10T04:18:17.751 INFO:teuthology.lock.ops:Node 'ubuntu@smithi133.front.sepia.ceph.com' reimaging is complete
2022-01-10T04:18:17.752 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi189.front.sepia.ceph.com' reimaging
2022-01-10T04:18:17.752 INFO:teuthology.lock.ops:Updating [ubuntu@smithi189.front.sepia.ceph.com]: reset os type and version on server
2022-01-10T04:18:17.752 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2022-01-10T04:18:17.775 INFO:teuthology.lock.ops:Node 'ubuntu@smithi189.front.sepia.ceph.com' reimaging is complete
2022-01-10T04:18:17.988 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.3
2022-01-10T04:18:18.021 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.3
2022-01-10T04:18:18.024 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 8.3
2022-01-10T04:18:18.361 INFO:teuthology.orchestra.console:Power off smithi111
2022-01-10T04:18:18.402 INFO:teuthology.orchestra.console:Power off smithi189
2022-01-10T04:18:18.446 INFO:teuthology.orchestra.console:Power off smithi133
2022-01-10T04:18:18.554 INFO:teuthology.orchestra.console:Power off for smithi189 completed
2022-01-10T04:18:18.584 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2022-01-10T04:18:18.656 INFO:teuthology.orchestra.console:Power on smithi189
2022-01-10T04:18:18.685 INFO:teuthology.orchestra.console:Power on smithi133
2022-01-10T04:18:22.942 INFO:teuthology.orchestra.console:Power on for smithi133 completed
2022-01-10T04:18:23.044 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2022-01-10T04:18:27.014 INFO:teuthology.orchestra.console:Power on for smithi189 completed
2022-01-10T04:18:27.115 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish
2022-01-10T04:18:30.856 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2022-01-10T04:18:30.957 INFO:teuthology.orchestra.console:Power on smithi111
2022-01-10T04:18:35.208 INFO:teuthology.orchestra.console:Power on for smithi111 completed
2022-01-10T04:18:35.309 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2022-01-10T04:23:28.212 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-10T04:23:28.547 INFO:teuthology.provision.fog.smithi133:Node is ready
2022-01-10T04:23:28.561 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2022-01-10T04:23:28.617 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2022-01-10T04:23:28.942 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2022-01-10T04:23:47.388 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-10T04:23:47.661 INFO:teuthology.provision.fog.smithi189:Node is ready
2022-01-10T04:23:47.678 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com
2022-01-10T04:23:47.733 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189
2022-01-10T04:23:48.071 INFO:teuthology.provision.fog.smithi189:Deploy complete!
2022-01-10T04:23:52.170 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-10T04:23:52.454 INFO:teuthology.provision.fog.smithi111:Node is ready
2022-01-10T04:23:52.510 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2022-01-10T04:23:52.564 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2022-01-10T04:23:52.892 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2022-01-10T04:23:53.053 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2022-01-10T04:23:53.054 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-10T04:23:53.072 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com
2022-01-10T04:23:53.073 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-10T04:23:53.089 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com
2022-01-10T04:23:53.089 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-10T04:23:53.108 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2022-01-10T04:23:53.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2022-01-10T04:23:53.362 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2022-01-10T04:23:53.416 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Linux"
2022-01-10T04:23:53.416 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2022-01-10T04:23:53.417 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2022-01-10T04:23:53.417 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2022-01-10T04:23:53.417 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2022-01-10T04:23:53.417 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2022-01-10T04:23:53.418 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-10T04:23:53.418 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2022-01-10T04:23:53.418 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-10T04:23:53.418 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2022-01-10T04:23:53.419 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-10T04:23:53.419 INFO:teuthology.orchestra.run.smithi111.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-10T04:23:53.419 INFO:teuthology.orchestra.run.smithi111.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-10T04:23:53.420 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2022-01-10T04:23:53.437 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server
2022-01-10T04:23:53.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2022-01-10T04:23:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64
2022-01-10T04:23:53.759 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Linux"
2022-01-10T04:23:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8"
2022-01-10T04:23:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos"
2022-01-10T04:23:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora"
2022-01-10T04:23:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8"
2022-01-10T04:23:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2022-01-10T04:23:53.761 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-10T04:23:53.761 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2022-01-10T04:23:53.761 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-10T04:23:53.761 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/"
2022-01-10T04:23:53.762 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-10T04:23:53.762 INFO:teuthology.orchestra.run.smithi133.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-10T04:23:53.762 INFO:teuthology.orchestra.run.smithi133.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-10T04:23:53.763 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2022-01-10T04:23:53.804 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server
2022-01-10T04:23:53.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com'
2022-01-10T04:23:54.012 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64
2022-01-10T04:23:54.068 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Linux"
2022-01-10T04:23:54.068 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8"
2022-01-10T04:23:54.069 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos"
2022-01-10T04:23:54.069 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora"
2022-01-10T04:23:54.069 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8"
2022-01-10T04:23:54.069 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8"
2022-01-10T04:23:54.070 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-10T04:23:54.070 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31"
2022-01-10T04:23:54.070 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-10T04:23:54.070 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/"
2022-01-10T04:23:54.071 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-10T04:23:54.071 INFO:teuthology.orchestra.run.smithi189.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-10T04:23:54.071 INFO:teuthology.orchestra.run.smithi189.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-10T04:23:54.072 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2022-01-10T04:23:54.163 INFO:teuthology.dispatcher.supervisor:Running job 6602384
2022-01-10T04:23:54.164 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-08_13:15:03-multimds-octopus-distro-default-smithi/6602384 --name teuthology-2022-01-08_13:15:03-multimds-octopus-distro-default-smithi --description multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} -- /home/teuthworker/archive/teuthology-2022-01-08_13:15:03-multimds-octopus-distro-default-smithi/6602384/orig.config.yaml
2022-01-10T04:23:54.168 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-08_13:15:03-multimds-octopus-distro-default-smithi/6602384
2022-01-10T04:23:54.169 INFO:teuthology.dispatcher.supervisor:Job PID: 1828
2022-01-10T04:23:54.169 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-10T16:24:48.457 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-10T16:24:48.655 INFO:teuthology.kill:Killing Pids: {1828}
2022-01-10T16:24:50.619 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2022-01-10T16:24:50.622 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'mds.b', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-10T16:24:50.622 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['client.0', 'client.1']
2022-01-10T16:24:50.622 INFO:teuthology.misc:Compressing logs...
2022-01-10T16:24:50.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2022-01-10T16:24:50.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2022-01-10T16:24:51.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com'
2022-01-10T16:24:51.827 INFO:teuthology.kill:No teuthology processes running
2022-01-10T16:24:52.964 INFO:teuthology.kill:Nuking machines: ['smithi111', 'smithi133', 'smithi189']
2022-01-10T16:24:53.962 INFO:teuthology.kill:2022-01-10 16:24:53,961.961 INFO:teuthology.nuke:targets:
2022-01-10T16:24:53.963 INFO:teuthology.kill:  smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/S7PC9Bd40B+mcXmb2UFruMOBRG9FL3ZJwdQQJRdZzqhZb2gRaK8HqVsobEShyJCJ6MJMZP4yhfIRFS0+KegIe+opf7m/jLuGWVKaiFWtAWlrmDspuh4CY/WtSn5wwXdfBVL4f08sVWVPXp0Xw0GzVxw2ql5/zcwgcILqwZ2nDW54KMVVL7oZNWSNmUE/qbdTT4E0hzIh5E9Y6jF4S/oJ3fXn4AmCbemZuIPX9uPx39+MczzkvkVmuRT5ESXzaiu/6f5PymqF+FqD2H/AbCy8k9ZxspbVUYmwmgJeBE7H1IMkq+Raon5xWvEJUBjVoWXsX3ZIcrvoq13M0YKdsw3TQ3kTddW3jw2HsdTUpmHlHBJOeiifxtG4zzLA8Wfgo0acGEA+9GNr/mafWrZisZW7DSAFpWgrUxVkN8puXd68/8FJqMV22HtBkCLN5Oba1g1csIkoGFgwRUB49xux1GyKTlar1DFfyomkOCuOEQKLNsTQBy3Lo++sLrfYUfhPx1U=
2022-01-10T16:24:53.963 INFO:teuthology.kill:  smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0guE6gXCiQgGl/bNCldh3l4C6pEgTV3YoqDg/gTqXgVDO1olj6pe/W/EKpjspoYClQ9iE3UGvpmEF4KrXeORGTPE+aSg2MDFalkaA+GuEuXpsNefyId/rmE1V1kZq91ltAq/mZXsjpz6w4G40iseNzXa3pXcJWgmgih770All8rJDhswewGYmLU1ChG/5zI0f0WmqxYG1ujHGo/A0gOfigLaetcvqPWWX3tL7OKTABtXTWPYlVXQF9U9FlglzRGm7M0pXPUVXUN5qHKkkJ6CaKh+oK/rvWI5Z3LBXKUiXoRWCF/VZCy8dC1/mNhLoJEsD6NWREs3lEVY0bpBcsEdCg7rbmeRvwFRsL+RAXxxNc0hUJZlBIEHr2qPMVVhxHllXdpc2Zy0cNE8UNOXBU61s5veq0uYbtq25COXfg9ak5tkT129+koJsPIWVGcmejs3QiGMUxvnB9fqMlZOHNcZNkaa/Wqo+8klHYxjjsfQfM7aXbPzAPiDOnFEBBcM1eg0=
2022-01-10T16:24:53.963 INFO:teuthology.kill:  smithi189.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+SjwouYxVQk7PNcVlFet2Rsf5KGRPPfJ6XLF6SULkQvzMcEgrDDgdLpXjds7pPrNrsvJOIGVtO4Aft/tV/di/3BAHPLEKHcYh3sPjtPsV5xmVrwr6sKDqq6mnqaDqRagFKp/nvr2Cd3txJCb968WZ6XImLqB9uheI3GNOHeX4A9mWsANu3w3EblBeVRrBokrIJCZQqzDIvItTYaRpj7ws5RUFQUd2lvBC6LdQ+ZTqN97Hvhd+lHtkV4xssC2S1oX/yOtLQaZlSikStlJWv4OjcHcP/1cVTHzUA5f0J4AWfcGum1E1arpHD0XG988Q4Dp7g5NxZPjIh07g23MGC/QOzrY++gfppnJu7JmQeAdTDYZxZzh4m2EdgEEnKB0tYrV4hfvxh/2LaAIAq4C9jaLxgFPQeoIvK4cq2Hgzw9gBl4ICGULBXxe1Oy5KReYFg+R56dCRNwngQbEy2DCfmJ7Gyg4dxyFctLfEL15x7y/A3H4DifPmEhSTVCSjuBKI0Js=
2022-01-10T16:24:53.992 INFO:teuthology.kill:2022-01-10 16:24:53,992.992 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-10T16:24:53.998 INFO:teuthology.kill:2022-01-10 16:24:53,998.998 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-10T16:24:53.999 INFO:teuthology.kill:2022-01-10 16:24:53,999.999 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-10T16:24:54.082 INFO:teuthology.kill:2022-01-10 16:24:54,082.082 INFO:teuthology.orchestra.console:Power off smithi189
2022-01-10T16:24:54.097 INFO:teuthology.kill:2022-01-10 16:24:54,096.096 INFO:teuthology.orchestra.console:Power off smithi133
2022-01-10T16:24:54.108 INFO:teuthology.kill:2022-01-10 16:24:54,107.107 INFO:teuthology.orchestra.console:Power off smithi111
2022-01-10T16:25:02.478 INFO:teuthology.kill:2022-01-10 16:25:02,478.478 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2022-01-10T16:25:02.624 INFO:teuthology.kill:2022-01-10 16:25:02,623.623 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2022-01-10T16:25:06.579 INFO:teuthology.kill:2022-01-10 16:25:06,578.578 INFO:teuthology.orchestra.console:Power off for smithi189 completed
2022-01-10T16:25:06.583 INFO:teuthology.kill:2022-01-10 16:25:06,583.583 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2022-01-10T16:25:06.734 INFO:teuthology.kill:2022-01-10 16:25:06,734.734 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2022-01-10T16:25:06.739 INFO:teuthology.kill:2022-01-10 16:25:06,739.739 INFO:teuthology.lock.ops:unlocked: smithi189.front.sepia.ceph.com
2022-01-10T16:27:07.050 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-10T16:27:07.181 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604334
2022-01-10T16:27:07.182 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604334
2022-01-10T16:27:07.182 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi189 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604334