2021-12-05T15:09:07.823 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-05T15:09:07.955 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging
2021-12-05T15:09:07.956 INFO:teuthology.lock.ops:Updating [ubuntu@smithi060.front.sepia.ceph.com]: reset os type and version on server
2021-12-05T15:09:07.956 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2021-12-05T15:09:07.974 INFO:teuthology.lock.ops:Node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging is complete
2021-12-05T15:09:07.974 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging
2021-12-05T15:09:07.975 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server
2021-12-05T15:09:07.975 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-12-05T15:09:07.993 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete
2021-12-05T15:09:08.285 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 8.2
2021-12-05T15:09:08.290 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 8.2
2021-12-05T15:09:10.855 INFO:teuthology.orchestra.console:Power off smithi060
2021-12-05T15:09:10.996 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2021-12-05T15:09:11.097 INFO:teuthology.orchestra.console:Power on smithi060
2021-12-05T15:09:11.482 INFO:teuthology.orchestra.console:Power off smithi183
2021-12-05T15:09:11.627 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-12-05T15:09:11.729 INFO:teuthology.orchestra.console:Power on smithi183
2021-12-05T15:09:19.461 INFO:teuthology.orchestra.console:Power on for smithi060 completed
2021-12-05T15:09:19.562 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2021-12-05T15:09:20.152 INFO:teuthology.orchestra.console:Power on for smithi183 completed
2021-12-05T15:09:20.254 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2021-12-05T15:13:09.561 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-05T15:13:24.663 INFO:teuthology.provision.fog.smithi060:Node is ready
2021-12-05T15:13:24.684 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2021-12-05T15:13:24.742 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2021-12-05T15:13:25.106 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2021-12-05T15:16:43.306 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-05T15:16:43.604 INFO:teuthology.provision.fog.smithi183:Node is ready
2021-12-05T15:16:43.660 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2021-12-05T15:16:43.715 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2021-12-05T15:16:44.039 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2021-12-05T15:16:44.225 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2021-12-05T15:16:44.226 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-05T15:16:44.248 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2021-12-05T15:16:44.248 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-05T15:16:44.268 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2021-12-05T15:16:44.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2021-12-05T15:16:44.482 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2021-12-05T15:16:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Linux"
2021-12-05T15:16:44.539 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8 (Core)"
2021-12-05T15:16:44.539 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos"
2021-12-05T15:16:44.539 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora"
2021-12-05T15:16:44.539 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8"
2021-12-05T15:16:44.539 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2021-12-05T15:16:44.540 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-12-05T15:16:44.540 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2021-12-05T15:16:44.540 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-05T15:16:44.540 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.centos.org/"
2021-12-05T15:16:44.541 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-05T15:16:44.541 INFO:teuthology.orchestra.run.smithi060.stdout:
2021-12-05T15:16:44.541 INFO:teuthology.orchestra.run.smithi060.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-05T15:16:44.541 INFO:teuthology.orchestra.run.smithi060.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-05T15:16:44.541 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-12-05T15:16:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-12-05T15:16:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:
2021-12-05T15:16:44.543 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2021-12-05T15:16:44.561 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2021-12-05T15:16:44.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2021-12-05T15:16:44.827 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2021-12-05T15:16:44.880 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Linux"
2021-12-05T15:16:44.880 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8 (Core)"
2021-12-05T15:16:44.881 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2021-12-05T15:16:44.881 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2021-12-05T15:16:44.881 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8"
2021-12-05T15:16:44.881 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2021-12-05T15:16:44.882 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-12-05T15:16:44.882 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2021-12-05T15:16:44.882 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-05T15:16:44.882 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.centos.org/"
2021-12-05T15:16:44.883 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-05T15:16:44.883 INFO:teuthology.orchestra.run.smithi183.stdout:
2021-12-05T15:16:44.883 INFO:teuthology.orchestra.run.smithi183.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-05T15:16:44.883 INFO:teuthology.orchestra.run.smithi183.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-05T15:16:44.883 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-12-05T15:16:44.884 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-12-05T15:16:44.884 INFO:teuthology.orchestra.run.smithi183.stdout:
2021-12-05T15:16:44.884 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-12-05T15:16:44.991 INFO:teuthology.dispatcher.supervisor:Running job 6546561
2021-12-05T15:16:44.991 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546561 --name benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi --description rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} -- /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546561/orig.config.yaml
2021-12-05T15:16:44.995 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546561
2021-12-05T15:16:44.996 INFO:teuthology.dispatcher.supervisor:Job PID: 28440
2021-12-05T15:16:44.996 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-06T03:17:39.316 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-06T03:17:39.487 INFO:teuthology.kill:Killing Pids: {28440}
2021-12-06T03:17:40.656 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2021-12-06T03:17:40.658 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-12-06T03:17:40.658 INFO:teuthology.misc:Compressing logs...
2021-12-06T03:17:40.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2021-12-06T03:17:40.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2021-12-06T03:17:41.378 INFO:teuthology.misc:Compressing logs...
2021-12-06T03:17:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-06T03:17:42.376 INFO:teuthology.misc:Compressing logs...
2021-12-06T03:18:44.419 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-06T03:18:52.541 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-06T03:19:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2021-12-06T03:19:55.402 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-06T03:20:06.624 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-06T03:20:58.131 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-06T03:21:15.738 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2021-12-06T03:21:19.873 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-06T03:21:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2021-12-06T03:22:12.553 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2021-12-06T03:22:16.560 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-client.rgw.foo.a.log: file size changed while zipping
2021-12-06T03:22:32.610 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/3e721642-55e0-11ec-8c2e-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-06T03:24:24.990 INFO:teuthology.orchestra.run.smithi183.stderr:tar: .: file changed as we read it
2021-12-06T03:24:25.050 INFO:teuthology.kill:No teuthology processes running
2021-12-06T03:24:26.222 INFO:teuthology.kill:Nuking machines: ['smithi060', 'smithi183']
2021-12-06T03:24:27.232 INFO:teuthology.kill:2021-12-06 03:24:27,232.232 INFO:teuthology.nuke:targets:
2021-12-06T03:24:27.233 INFO:teuthology.kill:  smithi060.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXT5tk+2ZRw1EdPNb8Mou2+ahZ7RtEMdf2bh/4CZasmkR77qAQUX9jSJRoiP6M6111SremprpTAXH3yc9V1KWxqz9w+Bi/cNDVr3+JCZGNMlzoZyf2FoRyNicwpycLBZ/gDUZcG9yalNBm8wQmbGFlUZKecrs7Rs+Tx4n7UXrRYXTKBM6pybB4cP7m6QvlltbC01miM2Ju0unHJVj/F9NouLjF+oMeefcA8Hva7h3jAcHw9Q60qQee6HuC61IRourfC5tggbQpNn4Zxkn0hFjfikg6//kBQrnckvnPl4X/2U7Bvd43arXv69vJgvKy2WLPyDs+3aIkLNGpCnbOjNLP6kLEXAIAuGKZT1Z97WOrAzumswxI/4PGvAgTD7ErYfPcao66pNhYtNzZMHXngr2caDTLAHwL3H+bqNuw55kvd3ng8ybtmDjSX7RNA4qQsZAbHkUL79FfhdBbSsg7UmzGE/Wv3AvKs42UyDfHUdd8NWaxcsUlsyLaWeh+hHHGB2U=
2021-12-06T03:24:27.234 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeDyZ2TEVG69iPZ3UcGTUx6r9lDb6V2ozrMjXd70mBL83No7ObMj/bAbaasNEmucHt+A3xpcQLlmhFwXywqh2Jl33hKsidiToIQIt0MBqW5dhJTMKs8Fd0KtVCGzdBc4wRlIyoFe8NFkq9VXot3zOR3jbw62Pvewa15ZelCuwQ27eZ5gV4VRTSfJnZ9VpQvLgCApSBOL5Bv9GgzqJtjK/J2r30yjwRD/Lg0XnAUmcyb2tb6Zp0FvV4Nx7QEyrQARu9lHm6wRk1bLVzRhtMpgjnuAC7TCaKnnGzAxqWAoTZ+Xa7MlHLpH5n7dvdk2fV2k8tcL1PATRWUFVC++s9Wy83aTRF5OBHDapdYvlwkSIuQeu3NTJoJf5ARAAp0ZISg1dBFjl5v/c1oFxTyoOkkIGq/DW6H+Wu0qY8E7s7ngpC9RQrOW+EOZjXE4gWSNsrfpyic/JJhRYE6XXAd1oNHD1UsAwwypj0o8NfSERjW2zknBLsDA7CqoipLKAP5IT8oWc=
2021-12-06T03:24:27.261 INFO:teuthology.kill:2021-12-06 03:24:27,261.261 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-06T03:24:27.265 INFO:teuthology.kill:2021-12-06 03:24:27,265.265 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-06T03:24:27.342 INFO:teuthology.kill:2021-12-06 03:24:27,342.342 INFO:teuthology.orchestra.console:Power off smithi183
2021-12-06T03:24:27.355 INFO:teuthology.kill:2021-12-06 03:24:27,355.355 INFO:teuthology.orchestra.console:Power off smithi060
2021-12-06T03:24:39.832 INFO:teuthology.kill:2021-12-06 03:24:39,832.832 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-12-06T03:24:39.838 INFO:teuthology.kill:2021-12-06 03:24:39,838.838 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2021-12-06T03:24:39.978 INFO:teuthology.kill:2021-12-06 03:24:39,977.977 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2021-12-06T03:24:39.981 INFO:teuthology.kill:2021-12-06 03:24:39,981.981 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com
2021-12-06T03:26:40.298 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-06T03:26:40.431 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi060 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547074
2021-12-06T03:26:40.431 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-06_02:01:02-rbd-master-distro-default-smithi/6547075