2021-12-09T04:37:12.598 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-09T04:37:12.738 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging
2021-12-09T04:37:12.739 INFO:teuthology.lock.ops:Updating [ubuntu@smithi157.front.sepia.ceph.com]: reset os type and version on server
2021-12-09T04:37:12.739 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2021-12-09T04:37:12.759 INFO:teuthology.lock.ops:Node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging is complete
2021-12-09T04:37:12.759 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging
2021-12-09T04:37:12.760 INFO:teuthology.lock.ops:Updating [ubuntu@smithi169.front.sepia.ceph.com]: reset os type and version on server
2021-12-09T04:37:12.760 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2021-12-09T04:37:12.778 INFO:teuthology.lock.ops:Node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging is complete
2021-12-09T04:37:12.978 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream
2021-12-09T04:37:12.983 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream
2021-12-09T04:37:13.311 INFO:teuthology.orchestra.console:Power off smithi157
2021-12-09T04:37:13.330 INFO:teuthology.orchestra.console:Power off smithi169
2021-12-09T04:37:21.694 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2021-12-09T04:37:21.698 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2021-12-09T04:37:21.796 INFO:teuthology.orchestra.console:Power on smithi157
2021-12-09T04:37:21.803 INFO:teuthology.orchestra.console:Power on smithi169
2021-12-09T04:37:26.054 INFO:teuthology.orchestra.console:Power on for smithi169 completed
2021-12-09T04:37:26.155 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2021-12-09T04:37:30.159 INFO:teuthology.orchestra.console:Power on for smithi157 completed
2021-12-09T04:37:30.561 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2021-12-09T04:42:28.099 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-09T04:42:28.384 INFO:teuthology.provision.fog.smithi169:Node is ready
2021-12-09T04:42:28.401 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169
2021-12-09T04:42:28.458 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2021-12-09T04:42:28.790 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2021-12-09T04:42:47.312 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-09T04:42:47.599 INFO:teuthology.provision.fog.smithi157:Node is ready
2021-12-09T04:42:47.617 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2021-12-09T04:42:47.674 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2021-12-09T04:42:48.015 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2021-12-09T04:42:48.164 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2021-12-09T04:42:48.166 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-09T04:42:48.188 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2021-12-09T04:42:48.188 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-09T04:42:48.214 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2021-12-09T04:42:48.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2021-12-09T04:42:48.403 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2021-12-09T04:42:48.459 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2021-12-09T04:42:48.459 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8"
2021-12-09T04:42:48.460 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2021-12-09T04:42:48.460 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2021-12-09T04:42:48.460 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8"
2021-12-09T04:42:48.460 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2021-12-09T04:42:48.461 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-09T04:42:48.461 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2021-12-09T04:42:48.461 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-09T04:42:48.461 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2021-12-09T04:42:48.461 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-09T04:42:48.462 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-09T04:42:48.462 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-09T04:42:48.463 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2021-12-09T04:42:48.480 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2021-12-09T04:42:48.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2021-12-09T04:42:48.728 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2021-12-09T04:42:48.784 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2021-12-09T04:42:48.785 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2021-12-09T04:42:48.785 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2021-12-09T04:42:48.785 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2021-12-09T04:42:48.786 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2021-12-09T04:42:48.786 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2021-12-09T04:42:48.786 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-09T04:42:48.786 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2021-12-09T04:42:48.786 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-09T04:42:48.787 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2021-12-09T04:42:48.787 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-09T04:42:48.787 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-09T04:42:48.787 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-09T04:42:48.788 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2021-12-09T04:42:48.891 INFO:teuthology.dispatcher.supervisor:Running job 6553040
2021-12-09T04:42:48.891 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553040 --name benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553040/orig.config.yaml
2021-12-09T04:42:48.894 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553040
2021-12-09T04:42:48.895 INFO:teuthology.dispatcher.supervisor:Job PID: 2558
2021-12-09T04:42:48.896 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-09T16:43:43.963 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-09T16:43:44.157 INFO:teuthology.kill:Killing Pids: {2558}
2021-12-09T16:43:45.309 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-12-09T16:43:45.310 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-12-09T16:43:45.310 INFO:teuthology.misc:Compressing logs...
2021-12-09T16:43:45.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2021-12-09T16:43:45.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2021-12-09T16:43:45.795 INFO:teuthology.misc:Compressing logs...
2021-12-09T16:43:46.568 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-09T16:43:46.862 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-09T16:43:47.380 INFO:teuthology.misc:Compressing logs...
2021-12-09T16:44:05.476 INFO:teuthology.kill:No teuthology processes running
2021-12-09T16:44:06.623 INFO:teuthology.kill:Nuking machines: ['smithi157', 'smithi169']
2021-12-09T16:44:07.645 INFO:teuthology.kill:2021-12-09 16:44:07,644.644 INFO:teuthology.nuke:targets:
2021-12-09T16:44:07.646 INFO:teuthology.kill:  smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCciDrLPWF8+HUgOd7nv4Z4Lq+pMEyxVUpTvgQkkQPERzm8fGgjgYvTAK0URRfNLADWo1qz9lLwHdTzmOFtv4z5wi2AuxVex3B3RxS60BV3I1Uno6/dihTy/tdnwlpq8CtYOAEfwLjHWkVYX2kLvBuYwBvfRoAcdQ5Z4aSSdWtS3ueUAKM/8CqN9O6jrQRM2+iVAJadgFrURgkGDDMd39kxWav7QpJQzHg/fu33M/0Htl01YFLMCOSkd1thjfAKmcpFXjpp+K9JXNZ3zk8sUCRWG3TiXHVFfll8WPoqSH95/twCWbOQtdYjBlM/EuZZrPWnRaYrI6TaXp2MWRawFCtghWnRYthkmSCDu2Me/IqWlmRfXOV3UEBZjn/PGoaZ1kjyi2z+04dA8rsu+wQzatsfz22eRXFXKhsss/4czIkjxRFFKIsuQNTlVY904VPkv4ZlAg7XfqZALGVsyMlHVkVgKoPaTlw+4AFh21WE1wUFiISUwgr9bLnYtY6qgkmAmac=
2021-12-09T16:44:07.646 INFO:teuthology.kill:  smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAkUA7vJUdQ5n1yS0ZqVrlRBUcoUS64lgXIVlQ+9MQXDgyXfS81U/WTuOoBCOJyH+9EQLTsevBfIpjao11NOEixw3V274+yU33N+4gBBFc1kJBsOnrr6gN50ZNubTGzwTaPXpCU080x3iCPQFhPPRma7Nu83abqPTf2ScnTlzYZxnLDjAkc69mQPn5aDa9SbrG06yvrRroL0d/l3fRt2xbOQFLqWMpevXDazWyaaaY7J+lI6UEbda7JxpYegbIjijlvDA/z5kZxKpxIhWoJWuxGUpvRqUFDbld1JVq6B3BqZvnlZXjSdTCakNa4agffkFODCnRtIGdJleHF7IWSQDACrtNKkQ5NtuVYQdw+RAadMZLczPdsgxji/3ve980Ei1OzSVY+dkEW3oSf/lAxATWYhjtHz6iRrIHFTSdQqPalw0Zqx95QVqsM79k29sXl3DwMTtM5q1kU5pBC2/l2tjEno3k67WvxVpaxrIWJsiQXmiz2pnZYsZoVwtxt1YBsdE=
2021-12-09T16:44:07.673 INFO:teuthology.kill:2021-12-09 16:44:07,673.673 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-09T16:44:07.677 INFO:teuthology.kill:2021-12-09 16:44:07,677.677 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-09T16:44:07.756 INFO:teuthology.kill:2021-12-09 16:44:07,756.756 INFO:teuthology.orchestra.console:Power off smithi157
2021-12-09T16:44:07.771 INFO:teuthology.kill:2021-12-09 16:44:07,770.770 INFO:teuthology.orchestra.console:Power off smithi169
2021-12-09T16:44:16.130 INFO:teuthology.kill:2021-12-09 16:44:16,129.129 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2021-12-09T16:44:16.135 INFO:teuthology.kill:2021-12-09 16:44:16,134.134 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2021-12-09T16:44:16.281 INFO:teuthology.kill:2021-12-09 16:44:16,280.280 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com
2021-12-09T16:44:16.284 INFO:teuthology.kill:2021-12-09 16:44:16,284.284 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com
2021-12-09T16:46:16.593 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-09T16:46:16.693 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/cbodley-2021-12-09_16:01:11-rgw-wip-cbodley-testing-distro-basic-smithi/6555408
2021-12-09T16:46:16.694 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi169 but it was locked by another job: /home/teuthworker/archive/cbodley-2021-12-09_16:01:11-rgw-wip-cbodley-testing-distro-basic-smithi/6555408