2021-12-04T13:15:44.904 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-04T13:15:45.056 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging
2021-12-04T13:15:45.057 INFO:teuthology.lock.ops:Updating [ubuntu@smithi065.front.sepia.ceph.com]: reset os type and version on server
2021-12-04T13:15:45.057 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server
2021-12-04T13:15:45.075 INFO:teuthology.lock.ops:Node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging is complete
2021-12-04T13:15:45.076 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging
2021-12-04T13:15:45.076 INFO:teuthology.lock.ops:Updating [ubuntu@smithi121.front.sepia.ceph.com]: reset os type and version on server
2021-12-04T13:15:45.076 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2021-12-04T13:15:45.094 INFO:teuthology.lock.ops:Node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging is complete
2021-12-04T13:15:45.095 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging
2021-12-04T13:15:45.095 INFO:teuthology.lock.ops:Updating [ubuntu@smithi198.front.sepia.ceph.com]: reset os type and version on server
2021-12-04T13:15:45.095 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2021-12-04T13:15:45.112 INFO:teuthology.lock.ops:Node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging is complete
2021-12-04T13:15:45.304 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 8.3
2021-12-04T13:15:45.337 INFO:teuthology.provision.fog.smithi065:Scheduling deploy of centos 8.3
2021-12-04T13:15:45.340 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of centos 8.3
2021-12-04T13:15:45.979 INFO:teuthology.orchestra.console:Power off smithi121
2021-12-04T13:15:46.043 INFO:teuthology.orchestra.console:Power off smithi198
2021-12-04T13:15:46.055 INFO:teuthology.orchestra.console:Power off smithi065
2021-12-04T13:15:46.187 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2021-12-04T13:15:46.288 INFO:teuthology.orchestra.console:Power on smithi198
2021-12-04T13:15:50.536 INFO:teuthology.orchestra.console:Power on for smithi198 completed
2021-12-04T13:15:50.637 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish
2021-12-04T13:15:54.356 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2021-12-04T13:15:54.415 INFO:teuthology.orchestra.console:Power off for smithi065 completed
2021-12-04T13:15:54.458 INFO:teuthology.orchestra.console:Power on smithi121
2021-12-04T13:15:54.517 INFO:teuthology.orchestra.console:Power on smithi065
2021-12-04T13:16:02.823 INFO:teuthology.orchestra.console:Power on for smithi121 completed
2021-12-04T13:16:02.873 INFO:teuthology.orchestra.console:Power on for smithi065 completed
2021-12-04T13:16:02.924 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish
2021-12-04T13:16:02.974 INFO:teuthology.provision.fog.smithi065:Waiting for deploy to finish
2021-12-04T13:21:09.370 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-04T13:21:13.121 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-04T13:21:13.428 INFO:teuthology.provision.fog.smithi198:Node is ready
2021-12-04T13:21:13.443 INFO:teuthology.orchestra.run.smithi198.stdout:smithi198.front.sepia.ceph.com
2021-12-04T13:21:13.497 INFO:teuthology.orchestra.run.smithi198.stdout:172.21.15.198 smithi198.front.sepia.ceph.com smithi198
2021-12-04T13:21:13.809 INFO:teuthology.provision.fog.smithi198:Deploy complete!
2021-12-04T13:21:24.950 INFO:teuthology.provision.fog.smithi065:Node is ready
2021-12-04T13:21:24.969 INFO:teuthology.orchestra.run.smithi065.stdout:smithi133
2021-12-04T13:21:25.026 INFO:teuthology.orchestra.run.smithi065.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2021-12-04T13:21:25.382 INFO:teuthology.provision.fog.smithi065:Deploy complete!
2021-12-04T13:23:26.501 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-04T13:23:26.784 INFO:teuthology.provision.fog.smithi121:Node is ready
2021-12-04T13:23:26.799 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com
2021-12-04T13:23:26.855 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121
2021-12-04T13:23:27.178 INFO:teuthology.provision.fog.smithi121:Deploy complete!
2021-12-04T13:23:27.347 INFO:teuthology.lock.ops:Checking smithi065.front.sepia.ceph.com
2021-12-04T13:23:27.348 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-04T13:23:27.368 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com
2021-12-04T13:23:27.368 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-04T13:23:27.385 INFO:teuthology.lock.ops:Checking smithi198.front.sepia.ceph.com
2021-12-04T13:23:27.385 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-04T13:23:27.403 INFO:teuthology.lock.ops:Updating [smithi065.front.sepia.ceph.com]: set os type and version on server
2021-12-04T13:23:27.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi065.front.sepia.ceph.com'
2021-12-04T13:23:27.683 INFO:teuthology.orchestra.run.smithi065.stdout:x86_64
2021-12-04T13:23:27.739 INFO:teuthology.orchestra.run.smithi065.stdout:NAME="CentOS Linux"
2021-12-04T13:23:27.739 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION="8"
2021-12-04T13:23:27.740 INFO:teuthology.orchestra.run.smithi065.stdout:ID="centos"
2021-12-04T13:23:27.740 INFO:teuthology.orchestra.run.smithi065.stdout:ID_LIKE="rhel fedora"
2021-12-04T13:23:27.741 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_ID="8"
2021-12-04T13:23:27.741 INFO:teuthology.orchestra.run.smithi065.stdout:PLATFORM_ID="platform:el8"
2021-12-04T13:23:27.742 INFO:teuthology.orchestra.run.smithi065.stdout:PRETTY_NAME="CentOS Linux 8"
2021-12-04T13:23:27.742 INFO:teuthology.orchestra.run.smithi065.stdout:ANSI_COLOR="0;31"
2021-12-04T13:23:27.742 INFO:teuthology.orchestra.run.smithi065.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-04T13:23:27.743 INFO:teuthology.orchestra.run.smithi065.stdout:HOME_URL="https://centos.org/"
2021-12-04T13:23:27.743 INFO:teuthology.orchestra.run.smithi065.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-04T13:23:27.744 INFO:teuthology.orchestra.run.smithi065.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-04T13:23:27.744 INFO:teuthology.orchestra.run.smithi065.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-04T13:23:27.746 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server
2021-12-04T13:23:27.766 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server
2021-12-04T13:23:27.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2021-12-04T13:23:28.019 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64
2021-12-04T13:23:28.073 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Linux"
2021-12-04T13:23:28.073 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8"
2021-12-04T13:23:28.073 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos"
2021-12-04T13:23:28.074 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora"
2021-12-04T13:23:28.074 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8"
2021-12-04T13:23:28.074 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8"
2021-12-04T13:23:28.074 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Linux 8"
2021-12-04T13:23:28.075 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31"
2021-12-04T13:23:28.075 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-04T13:23:28.075 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/"
2021-12-04T13:23:28.075 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-04T13:23:28.076 INFO:teuthology.orchestra.run.smithi121.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-04T13:23:28.076 INFO:teuthology.orchestra.run.smithi121.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-04T13:23:28.076 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2021-12-04T13:23:28.095 INFO:teuthology.lock.ops:Updating [smithi198.front.sepia.ceph.com]: set os type and version on server
2021-12-04T13:23:28.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2021-12-04T13:23:28.364 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64
2021-12-04T13:23:28.419 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="CentOS Linux"
2021-12-04T13:23:28.420 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="8"
2021-12-04T13:23:28.420 INFO:teuthology.orchestra.run.smithi198.stdout:ID="centos"
2021-12-04T13:23:28.420 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE="rhel fedora"
2021-12-04T13:23:28.420 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="8"
2021-12-04T13:23:28.421 INFO:teuthology.orchestra.run.smithi198.stdout:PLATFORM_ID="platform:el8"
2021-12-04T13:23:28.421 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="CentOS Linux 8"
2021-12-04T13:23:28.421 INFO:teuthology.orchestra.run.smithi198.stdout:ANSI_COLOR="0;31"
2021-12-04T13:23:28.421 INFO:teuthology.orchestra.run.smithi198.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-04T13:23:28.422 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://centos.org/"
2021-12-04T13:23:28.422 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-04T13:23:28.422 INFO:teuthology.orchestra.run.smithi198.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-04T13:23:28.422 INFO:teuthology.orchestra.run.smithi198.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-04T13:23:28.423 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2021-12-04T13:23:28.513 INFO:teuthology.dispatcher.supervisor:Running job 6544515
2021-12-04T13:23:28.514 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-12-04_13:15:03-multimds-octopus-distro-default-smithi/6544515 --name teuthology-2021-12-04_13:15:03-multimds-octopus-distro-default-smithi --description multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} -- /home/teuthworker/archive/teuthology-2021-12-04_13:15:03-multimds-octopus-distro-default-smithi/6544515/orig.config.yaml
2021-12-04T13:23:28.516 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-12-04_13:15:03-multimds-octopus-distro-default-smithi/6544515
2021-12-04T13:23:28.517 INFO:teuthology.dispatcher.supervisor:Job PID: 25005
2021-12-04T13:23:28.517 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-05T01:24:23.878 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-05T01:24:24.052 INFO:teuthology.kill:Killing Pids: {25005}
2021-12-05T01:24:25.203 INFO:teuthology.task.internal:roles: ubuntu@smithi065.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2021-12-05T01:24:25.204 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'mds.e', 'mds.f', 'mds.g', 'mds.h', 'mds.i', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-05T01:24:25.204 INFO:teuthology.task.internal:roles: ubuntu@smithi198.front.sepia.ceph.com - ['client.0', 'client.1']
2021-12-05T01:24:25.204 INFO:teuthology.misc:Compressing logs...
2021-12-05T01:24:25.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi065.front.sepia.ceph.com'
2021-12-05T01:24:25.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2021-12-05T01:24:25.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2021-12-05T01:24:26.293 INFO:teuthology.kill:No teuthology processes running
2021-12-05T01:24:27.374 INFO:teuthology.kill:Nuking machines: ['smithi065', 'smithi121', 'smithi198']
2021-12-05T01:24:28.257 INFO:teuthology.kill:2021-12-05 01:24:28,257.257 INFO:teuthology.nuke:targets:
2021-12-05T01:24:28.258 INFO:teuthology.kill:  smithi065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8ufa98wX93Gq9fg2RIApM/1dIMZTsvQGYcCUgkwehSWUJFtYxYmf/wHI9BK87tihWz5KG4EysK7n5UimMShuG/ZvnA8ivXmV2F/p429QTh/y5hAzo7JBUDohYdahznLK7DTtTNQBTEwbvACJNi2E2trGapYRXwkQypAZqk2/mD0QAg0q5iKM/L1k9ElK0rRT/sSTSgPGMlUem+UsQoyHpP4vGwmoncPnbSys5NyqiBrEDBsECm88k5yYJJDOVQ0IX98zNpJZxyKE2QXt/P3X3GnhyOOdMLVFoZtVDI/A8giFOyeqXmtWaZvQFZ5KpWTE2hEA8ZFKKsWQS7wFpLc9wNX4IL2dM7YcSqTGc08pXN9+kEZKfOlkNGN83hBA0kVFU+afcgmX/5A2kh5kNFNy86QaD7UpGZNZv1gJ4AE1sIQUQoVyYuEYP2QV06r4IxDOlwR/eJvHrP149MW0ygaPizctrc7EjeA+G/ZSX4ORg6lkldsPTWtJVLWBWK+PVck=
2021-12-05T01:24:28.258 INFO:teuthology.kill:  smithi121.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Yvqt0iaylchz46ClmRrSgBs03cosE9xtdlZL9RetMVLncj82dwMFu7lBTK7WBZ+hxhJ2cSFwA2IShcpKpjtoWAt9BbdSSZv9OYoM9YGqdBElf+Ah9/vXSbcmhcHrXCA8urvwvk6ewvtF9lcB4iahSGFi2747iy+DIxqcFsmrYdeY9zqz8JFxiRimbameae5vbkqUUsOS+ob2kdE27fFR3K0xtzm99tI5WUXjaFB6dbFLoHess62R8XdvgNSuZ9B79AKJYbEj//tf/mwHWfTloVz70njTnNdhmWk8VCd01cibfZCzhS4kGwXJiekiWbNPkWH14rAnR5QPwGqJjGJ1876Apan3gnEoMoIrzYPA0AuExSql6q4DMg0Nu3UiLtkwojUGALK16E1FXJNp0cQC/G4jnd9NJ3amJhSz7UYRw2bt9H4zhAAjbCFa0cTClL0pCrNSLa8XDzQYPWcY9tMDCdKJeXvF4wC2zMLwkI5aGYQcwqV6n763sxPGLrut3iU=
2021-12-05T01:24:28.258 INFO:teuthology.kill:  smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEGM7muOp6OnQ1vOdvBGoSMiQWws68Lh3Z/ot57BEEvT7s1E5xUSya5UBoR4r7e17xI8nkPL5VhnWPvsJh28kLl/2l7oyi0aT/mmwk+DAV0XOWvgJJUlmJ9lxeD94AymX509nf9D1wo+r8xGzRDF3flehmAY6paS6AUlSnl6+Th7r7CRvI/WD72jYE3kAkzJ5jKwFSQQPpmEEfGivvhNy5MyMw6w3by1eitx9pJzV6G87Ap4N9YkvtRII5iFa4JXqrwqm41EDs/Qee/7rkAgNtPM+nL3cDhsCyCx9XF5GC42DAY2o5lxFArrkhb8UWTkDgev6FPWqyQYT3i6Ad99jsO7fc0qdDxBOyS80gwBXl+GTjBBBzRAarpC0aQ+O8JB2xe3C4gHxJNfIyqR8alIFGVZSEtikkD3HCTbZb7iWsMk0n4ZV9TkjKaFx+x4JaiCO+HerJJMcwSxFAVUK44YfHwvgRvml5g23zNt7zzs1frQgN6bCXedm+BeaY/YHaVYE=
2021-12-05T01:24:28.284 INFO:teuthology.kill:2021-12-05 01:24:28,284.284 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-05T01:24:28.287 INFO:teuthology.kill:2021-12-05 01:24:28,287.287 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-05T01:24:28.289 INFO:teuthology.kill:2021-12-05 01:24:28,288.288 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-05T01:24:28.369 INFO:teuthology.kill:2021-12-05 01:24:28,369.369 INFO:teuthology.orchestra.console:Power off smithi198
2021-12-05T01:24:28.382 INFO:teuthology.kill:2021-12-05 01:24:28,382.382 INFO:teuthology.orchestra.console:Power off smithi065
2021-12-05T01:24:28.392 INFO:teuthology.kill:2021-12-05 01:24:28,392.392 INFO:teuthology.orchestra.console:Power off smithi121
2021-12-05T01:24:36.750 INFO:teuthology.kill:2021-12-05 01:24:36,750.750 INFO:teuthology.orchestra.console:Power off for smithi065 completed
2021-12-05T01:24:36.898 INFO:teuthology.kill:2021-12-05 01:24:36,897.897 INFO:teuthology.lock.ops:unlocked: smithi065.front.sepia.ceph.com
2021-12-05T01:24:40.858 INFO:teuthology.kill:2021-12-05 01:24:40,858.858 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2021-12-05T01:24:40.867 INFO:teuthology.kill:2021-12-05 01:24:40,867.867 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2021-12-05T01:24:41.008 INFO:teuthology.kill:2021-12-05 01:24:41,007.007 INFO:teuthology.lock.ops:unlocked: smithi198.front.sepia.ceph.com
2021-12-05T01:24:41.018 INFO:teuthology.kill:2021-12-05 01:24:41,018.018 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com
2021-12-05T01:26:41.307 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-05T01:26:41.437 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi065 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-05_01:25:02-upgrade:pacific-p2p-pacific-distro-default-smithi/6545355
2021-12-05T01:26:41.438 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi121 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-05_01:25:02-upgrade:pacific-p2p-pacific-distro-default-smithi/6545355
2021-12-05T01:26:41.438 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi198 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-05_01:25:02-upgrade:pacific-p2p-pacific-distro-default-smithi/6545355