2022-01-26T21:41:37.662 INFO:root:teuthology version: 1.1.0-7c0cb867
2022-01-26T21:41:37.802 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging
2022-01-26T21:41:37.803 INFO:teuthology.lock.ops:Updating [ubuntu@smithi027.front.sepia.ceph.com]: reset os type and version on server
2022-01-26T21:41:37.804 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-01-26T21:41:37.823 INFO:teuthology.lock.ops:Node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging is complete
2022-01-26T21:41:37.823 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging
2022-01-26T21:41:37.824 INFO:teuthology.lock.ops:Updating [ubuntu@smithi109.front.sepia.ceph.com]: reset os type and version on server
2022-01-26T21:41:37.825 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-01-26T21:41:37.846 INFO:teuthology.lock.ops:Node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging is complete
2022-01-26T21:41:38.042 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream
2022-01-26T21:41:38.051 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of centos 8.stream
2022-01-26T21:41:38.385 INFO:teuthology.orchestra.console:Power off smithi027
2022-01-26T21:41:38.425 INFO:teuthology.orchestra.console:Power off smithi109
2022-01-26T21:41:46.756 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-01-26T21:41:46.788 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-01-26T21:41:46.858 INFO:teuthology.orchestra.console:Power on smithi027
2022-01-26T21:41:46.891 INFO:teuthology.orchestra.console:Power on smithi109
2022-01-26T21:41:55.236 INFO:teuthology.orchestra.console:Power on for smithi027 completed
2022-01-26T21:41:55.272 INFO:teuthology.orchestra.console:Power on for smithi109 completed
2022-01-26T21:41:55.338 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2022-01-26T21:41:55.374 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish
2022-01-26T21:46:36.020 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-26T21:46:36.320 INFO:teuthology.provision.fog.smithi109:Node is ready
2022-01-26T21:46:36.337 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109
2022-01-26T21:46:36.394 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109
2022-01-26T21:46:36.723 INFO:teuthology.provision.fog.smithi109:Deploy complete!
2022-01-26T21:47:39.596 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-26T21:47:39.847 INFO:teuthology.provision.fog.smithi027:Node is ready
2022-01-26T21:47:39.905 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2022-01-26T21:47:39.963 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2022-01-26T21:47:40.301 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2022-01-26T21:47:40.456 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2022-01-26T21:47:40.457 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-26T21:47:40.476 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com
2022-01-26T21:47:40.476 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-26T21:47:40.496 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2022-01-26T21:47:40.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-01-26T21:47:40.685 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2022-01-26T21:47:40.743 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2022-01-26T21:47:40.743 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2022-01-26T21:47:40.744 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2022-01-26T21:47:40.744 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2022-01-26T21:47:40.744 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2022-01-26T21:47:40.744 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2022-01-26T21:47:40.744 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-26T21:47:40.745 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2022-01-26T21:47:40.745 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-26T21:47:40.745 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2022-01-26T21:47:40.745 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-26T21:47:40.746 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-26T21:47:40.746 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-26T21:47:40.747 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-01-26T21:47:40.767 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server
2022-01-26T21:47:40.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-01-26T21:47:41.017 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64
2022-01-26T21:47:41.075 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="CentOS Stream"
2022-01-26T21:47:41.076 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="8"
2022-01-26T21:47:41.076 INFO:teuthology.orchestra.run.smithi109.stdout:ID="centos"
2022-01-26T21:47:41.077 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE="rhel fedora"
2022-01-26T21:47:41.077 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="8"
2022-01-26T21:47:41.077 INFO:teuthology.orchestra.run.smithi109.stdout:PLATFORM_ID="platform:el8"
2022-01-26T21:47:41.078 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-26T21:47:41.078 INFO:teuthology.orchestra.run.smithi109.stdout:ANSI_COLOR="0;31"
2022-01-26T21:47:41.078 INFO:teuthology.orchestra.run.smithi109.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-26T21:47:41.079 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://centos.org/"
2022-01-26T21:47:41.079 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-26T21:47:41.081 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-26T21:47:41.081 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-26T21:47:41.083 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-01-26T21:47:41.179 INFO:teuthology.dispatcher.supervisor:Running job 6641867
2022-01-26T21:47:41.179 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-26_19:23:01-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi/6641867 --name yuriw-2022-01-26_19:23:01-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-26_19:23:01-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi/6641867/orig.config.yaml
2022-01-26T21:47:41.182 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-26_19:23:01-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi/6641867
2022-01-26T21:47:41.183 INFO:teuthology.dispatcher.supervisor:Job PID: 30337
2022-01-26T21:47:41.184 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-27T04:18:10.345 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-27T04:18:10.553 INFO:teuthology.kill:Killing Pids: {30337}
2022-01-27T04:18:11.939 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-27T04:18:11.940 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-27T04:18:11.940 INFO:teuthology.misc:Compressing logs...
2022-01-27T04:18:11.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-01-27T04:18:12.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-01-27T04:18:12.159 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-27T04:18:12.353 INFO:teuthology.orchestra.run.smithi109.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-27T04:18:12.409 INFO:teuthology.orchestra.run.smithi027.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-27T04:18:12.410 INFO:teuthology.orchestra.run.smithi027.stderr:tar: Error is not recoverable: exiting now
2022-01-27T04:18:12.539 INFO:teuthology.orchestra.run.smithi109.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-27T04:18:12.539 INFO:teuthology.orchestra.run.smithi109.stderr:tar: Error is not recoverable: exiting now
2022-01-27T04:18:12.541 INFO:teuthology.misc:Compressing logs...
2022-01-27T04:18:12.942 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-27T04:18:13.116 INFO:teuthology.misc:Compressing logs...
2022-01-27T04:18:14.495 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-27T04:18:14.705 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-27T04:18:15.982 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-27T04:18:16.237 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-27T04:18:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-mon.smithi027.log: file size changed while zipping
2022-01-27T04:18:17.276 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-27T04:18:18.281 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-27T04:18:19.295 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-27T04:18:19.474 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-mgr.smithi027.uhqqkz.log: file size changed while zipping
2022-01-27T04:18:21.137 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/e851b934-7ef2-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-27T04:18:53.324 INFO:teuthology.orchestra.run.smithi109.stderr:tar: .: file changed as we read it
2022-01-27T04:18:53.509 INFO:teuthology.kill:No teuthology processes running
2022-01-27T04:18:54.918 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi109']
2022-01-27T04:18:55.993 INFO:teuthology.kill:2022-01-27 04:18:55,992.992 INFO:teuthology.nuke:targets:
2022-01-27T04:18:55.994 INFO:teuthology.kill:  smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvNbrqWGLZfzZv6yMZQB0jgXJpvw4HyetsO7iUmkbrX11MpxJFpqE1HHv+jZpd6fgkdg6u4gbRX05xK+DS02LuTpDlGDQNnfZYXyIamnS3fnMLC4SEWytH+rBbBrGlNX0wdR/QV/T3rQWXnN+9XWBxka2K1vfTbKKHzB5U5NgTAmcV0acigBunaGydJG7Nz10HsNkJbh4EDh5wNxJBvkCMEu76ZYQltQ1OY/9DwcATDad3BzHf0k6b6EK4NRMZ0whc0LtQgRtWSEsmxZfQ8E97EhOLYz2cqMIqu+O/87hXt3C9934pyaSVaVePGv3jDiHC8emaPKYz+UfajZS085lzklrxvf6dqTHCOeaMExP4OA/ngIHriZG5Gf3txVZ0pIiusJmiZhxrLMQGZH8A7zf9eSTte5kC+swzZIQyLY+bWj1k1ZwhA6nEvW6h739nIM6FN+7LKM0zj4Kpitdp8vxAbmFkmnJkldgsk/WANpfFpPXAkoRH+kXkv03Vapeh2zc=
2022-01-27T04:18:55.994 INFO:teuthology.kill:  smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcxFtQRRYYd25uWduNOWxEPNbhE9GnsQZTJP635pghZYj1hIzBdmhnztH61GtMDw9gYs4ztIJ/pBGYpb/3QryFdfTTrS7N07lgcux2L1aI1SR/f0+1m8vaRST5UgTn+/clg/6DbKfgyA4Ibwq83j66ugbzcRYRKHNGnXJmbbAZ9UMyzvt5AFuGd3cBtz8IUnrdP9o3DSGk85jWem3l3PwG03By/YJEsejOgZyxIsbq9rahYM/hJ5NKs9oj2ZslTrdhsZjftrxKm7CWRGoy78wd5ix4gQENHgxYbgcwMymuXcgEQf/2c9W8WaGW2LZa7dfaf5mIMI/D/Bw8++uKOhbV0IpFkokWfDNI08q3qKKmuq7XmpyLbuh5tjtAK25pyU9Ck5HQt7VAeNsieX7cdo1mOy+MUWE+lRwkQ+wUr7q6JSgPn/UGJ1hl8Eq3JlG7NCwOTnUowC0Fj3fn833jV9DyBxpB+em0lrur6ZuI60mbozcUrVEK46dOyr7YfLtmNM=
2022-01-27T04:18:56.022 INFO:teuthology.kill:2022-01-27 04:18:56,022.022 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-27T04:18:56.025 INFO:teuthology.kill:2022-01-27 04:18:56,025.025 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-27T04:18:56.110 INFO:teuthology.kill:2022-01-27 04:18:56,109.109 INFO:teuthology.orchestra.console:Power off smithi027
2022-01-27T04:18:56.124 INFO:teuthology.kill:2022-01-27 04:18:56,123.123 INFO:teuthology.orchestra.console:Power off smithi109
2022-01-27T04:19:04.502 INFO:teuthology.kill:2022-01-27 04:19:04,501.501 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-01-27T04:19:04.661 INFO:teuthology.kill:2022-01-27 04:19:04,659.659 INFO:teuthology.lock.ops:unlocked: smithi109.front.sepia.ceph.com
2022-01-27T04:19:08.589 INFO:teuthology.kill:2022-01-27 04:19:08,589.589 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-01-27T04:19:08.744 INFO:teuthology.kill:2022-01-27 04:19:08,744.744 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2022-01-27T04:21:09.078 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-27T04:21:09.180 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-01-26_21:12:05-rados-WIP_GBH_NCB_new_alloc_map_A6-distro-basic-smithi/6642260
2022-01-27T04:21:09.180 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi109 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-01-26_21:12:05-rados-WIP_GBH_NCB_new_alloc_map_A6-distro-basic-smithi/6642260