2021-12-08T23:55:34.981 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-08T23:55:35.152 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging
2021-12-08T23:55:35.154 INFO:teuthology.lock.ops:Updating [ubuntu@smithi092.front.sepia.ceph.com]: reset os type and version on server
2021-12-08T23:55:35.154 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2021-12-08T23:55:35.182 INFO:teuthology.lock.ops:Node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging is complete
2021-12-08T23:55:35.182 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging
2021-12-08T23:55:35.183 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server
2021-12-08T23:55:35.183 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-12-08T23:55:35.206 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete
2021-12-08T23:55:35.393 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 8.2
2021-12-08T23:55:35.414 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.2
2021-12-08T23:55:35.709 INFO:teuthology.orchestra.console:Power off smithi092
2021-12-08T23:55:35.748 INFO:teuthology.orchestra.console:Power off smithi105
2021-12-08T23:55:48.197 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2021-12-08T23:55:48.223 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-12-08T23:55:48.299 INFO:teuthology.orchestra.console:Power on smithi092
2021-12-08T23:55:48.328 INFO:teuthology.orchestra.console:Power on smithi105
2021-12-08T23:55:52.555 INFO:teuthology.orchestra.console:Power on for smithi092 completed
2021-12-08T23:55:52.657 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2021-12-08T23:55:56.692 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2021-12-08T23:55:56.793 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2021-12-09T00:00:42.438 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-09T00:00:42.743 INFO:teuthology.provision.fog.smithi092:Node is ready
2021-12-09T00:00:42.799 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2021-12-09T00:00:42.855 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2021-12-09T00:00:43.174 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2021-12-09T00:00:46.278 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-09T00:00:46.603 INFO:teuthology.provision.fog.smithi105:Node is ready
2021-12-09T00:00:46.618 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2021-12-09T00:00:46.672 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2021-12-09T00:00:46.992 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2021-12-09T00:00:47.151 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2021-12-09T00:00:47.152 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-09T00:00:47.171 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2021-12-09T00:00:47.172 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-09T00:00:47.191 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2021-12-09T00:00:47.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2021-12-09T00:00:47.458 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2021-12-09T00:00:47.512 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Linux"
2021-12-09T00:00:47.513 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8 (Core)"
2021-12-09T00:00:47.513 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2021-12-09T00:00:47.513 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2021-12-09T00:00:47.513 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8"
2021-12-09T00:00:47.514 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2021-12-09T00:00:47.514 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-12-09T00:00:47.514 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2021-12-09T00:00:47.514 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-09T00:00:47.515 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.centos.org/"
2021-12-09T00:00:47.515 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-09T00:00:47.515 INFO:teuthology.orchestra.run.smithi092.stdout:
2021-12-09T00:00:47.515 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-09T00:00:47.515 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-09T00:00:47.516 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-12-09T00:00:47.516 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-12-09T00:00:47.517 INFO:teuthology.orchestra.run.smithi092.stdout:
2021-12-09T00:00:47.519 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2021-12-09T00:00:47.540 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2021-12-09T00:00:47.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2021-12-09T00:00:47.794 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2021-12-09T00:00:47.847 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux"
2021-12-09T00:00:47.848 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)"
2021-12-09T00:00:47.848 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2021-12-09T00:00:47.848 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2021-12-09T00:00:47.848 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8"
2021-12-09T00:00:47.849 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2021-12-09T00:00:47.849 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-12-09T00:00:47.849 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2021-12-09T00:00:47.849 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-09T00:00:47.850 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/"
2021-12-09T00:00:47.850 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-09T00:00:47.850 INFO:teuthology.orchestra.run.smithi105.stdout:
2021-12-09T00:00:47.850 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-09T00:00:47.851 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-09T00:00:47.851 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-12-09T00:00:47.851 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-12-09T00:00:47.851 INFO:teuthology.orchestra.run.smithi105.stdout:
2021-12-09T00:00:47.852 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-12-09T00:00:47.963 INFO:teuthology.dispatcher.supervisor:Running job 6552988
2021-12-09T00:00:47.963 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6552988 --name benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi --description rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} -- /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6552988/orig.config.yaml
2021-12-09T00:00:47.967 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6552988
2021-12-09T00:00:47.968 INFO:teuthology.dispatcher.supervisor:Job PID: 26466
2021-12-09T00:00:47.968 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-09T12:01:42.773 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-09T12:01:42.969 INFO:teuthology.kill:Killing Pids: {26466}
2021-12-09T12:01:44.149 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2021-12-09T12:01:44.150 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-12-09T12:01:44.151 INFO:teuthology.misc:Compressing logs...
2021-12-09T12:01:44.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2021-12-09T12:01:44.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2021-12-09T12:01:44.715 INFO:teuthology.misc:Compressing logs...
2021-12-09T12:01:45.307 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-09T12:01:45.641 INFO:teuthology.misc:Compressing logs...
2021-12-09T12:02:41.246 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-09T12:02:43.826 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-09T12:02:59.838 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2021-12-09T12:03:39.549 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-09T12:03:51.451 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-09T12:03:59.120 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2021-12-09T12:04:56.839 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-09T12:05:00.481 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-09T12:05:08.548 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2021-12-09T12:05:47.771 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2021-12-09T12:05:51.434 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-client.rgw.foo.a.log: file size changed while zipping
2021-12-09T12:07:04.056 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/b707cb1e-5884-11ec-8c30-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-09T12:08:10.042 INFO:teuthology.orchestra.run.smithi092.stderr:tar: .: file changed as we read it
2021-12-09T12:08:48.346 INFO:teuthology.kill:No teuthology processes running
2021-12-09T12:08:49.478 INFO:teuthology.kill:Nuking machines: ['smithi092', 'smithi105']
2021-12-09T12:08:50.457 INFO:teuthology.kill:2021-12-09 12:08:50,456.456 INFO:teuthology.nuke:targets:
2021-12-09T12:08:50.458 INFO:teuthology.kill:  smithi092.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgZsNQErdjwvjBObbpFw/oGjxFi8f70GKxDde+gu1iPLb7PoHq2lSowyGEF8U4DhY7uHGGm7xYFbjpHqscnfWPHVzNMoObU0c9Wisg2ND/FDrKmlwG7OhcCycgJUz5doKX/vSijmEy5NecwC+y7aSziI4KULop3bvybEuyYvRRA6T5hRjvOhBUh85P9GPrgb8wBH5gzWOHYRglrnH0Uphieo7BiOwSRVQcvuyBB1aivfm9l595lFMvuq1CoKxzBF1euqVGzReFoxA7eBHFxFQO4wCpvn1RCQYd8nj7TV5YE415wMia4pDc5hXp7Adw1Ryr21YZknkuk4n7I9ffBV7ogcu9D7MXzn5UO5LWKzqk0BNJw9vvUIU8Wz8lIcgeYeATraXkPi03JvzZx4V4tLGFUF/GMt/ilbtxxCkNlxIANkfsdcMksva2vu8aXZXv9+twu3nEjDkN/Vl/Nhtu6jLG3vny0b3vyCnCgBTN+LDzY1Zld+MbUTC/dEIEnfr/aYM=
2021-12-09T12:08:50.458 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjQ20tz1UzENYyCeNShgMH/dPf5Hs9iWWmNnPJJ7XMQ8fV+q29cdiZ6ApNzrsOXvnAuy/Vn8e/CiTUYki3T93BwEHUnVWx0n9smEZehx949tHcYYxrfih5XUaGoUyaNBURdc0RQoaYEXSqXbP3VjrvadKWPj5bx90ja1nn4wq+08814fQ4Xh2HOlB3/E7o5VD1R2NQCeT7bfp/SwPGad6zsXa8kheFAGwxA/YLDZqW+qxkdngDFPzDqgDvz8K3ZrVyWs/EWmkMj8ZmI5Wwv7Z9GpSq1M2FSFU5FdaqP+zAeFT5FHRK6DOq1rION8UWU+Uoot5BFMwSk7eyB3ULqg7cZPKNqrhzRwsQ4mFzlP6HHjGs8D+6t9B7fQPgyV9Fl2QIAJXKx9/D/HZ3ugt0WqC895lBKqwpwBCoNEF25etfC8d5KPS3GQzoGN76xQ4XvLXtEW6K9XKvU3DaogVG5fRn65cX/BlvZ0d+GXBOCtbKN2H0eDk+nLaigcKn8n+CVwE=
2021-12-09T12:08:50.484 INFO:teuthology.kill:2021-12-09 12:08:50,483.483 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-09T12:08:50.487 INFO:teuthology.kill:2021-12-09 12:08:50,487.487 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-09T12:08:50.567 INFO:teuthology.kill:2021-12-09 12:08:50,566.566 INFO:teuthology.orchestra.console:Power off smithi092
2021-12-09T12:08:50.580 INFO:teuthology.kill:2021-12-09 12:08:50,579.579 INFO:teuthology.orchestra.console:Power off smithi105
2021-12-09T12:09:03.048 INFO:teuthology.kill:2021-12-09 12:09:03,048.048 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2021-12-09T12:09:03.054 INFO:teuthology.kill:2021-12-09 12:09:03,054.054 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-12-09T12:09:03.199 INFO:teuthology.kill:2021-12-09 12:09:03,198.198 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com
2021-12-09T12:09:03.202 INFO:teuthology.kill:2021-12-09 12:09:03,202.202 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2021-12-09T12:11:03.505 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-09T12:11:03.596 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi092 but it was locked by another job: /home/teuthworker/archive/ideepika-2021-12-09_11:27:25-rbd-wip-deepika2-testing-pacific-distro-default-smithi/6554683
2021-12-09T12:11:03.597 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/ideepika-2021-12-09_11:27:25-rbd-wip-deepika2-testing-pacific-distro-default-smithi/6554683