2022-01-09T15:30:15.606 INFO:root:teuthology version: 1.1.0-00e09f05
2022-01-09T15:30:15.737 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging
2022-01-09T15:30:15.739 INFO:teuthology.lock.ops:Updating [ubuntu@smithi012.front.sepia.ceph.com]: reset os type and version on server
2022-01-09T15:30:15.739 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2022-01-09T15:30:15.764 INFO:teuthology.lock.ops:Node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging is complete
2022-01-09T15:30:15.764 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging
2022-01-09T15:30:15.764 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server
2022-01-09T15:30:15.765 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-01-09T15:30:15.783 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete
2022-01-09T15:30:15.985 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of rhel 8.4
2022-01-09T15:30:15.989 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of rhel 8.4
2022-01-09T15:30:16.380 INFO:teuthology.orchestra.console:Power off smithi012
2022-01-09T15:30:16.398 INFO:teuthology.orchestra.console:Power off smithi197
2022-01-09T15:30:24.770 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-01-09T15:30:24.873 INFO:teuthology.orchestra.console:Power on smithi197
2022-01-09T15:30:28.874 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2022-01-09T15:30:28.975 INFO:teuthology.orchestra.console:Power on smithi012
2022-01-09T15:30:33.235 INFO:teuthology.orchestra.console:Power on for smithi012 completed
2022-01-09T15:30:33.332 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2022-01-09T15:30:33.337 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2022-01-09T15:30:33.433 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2022-01-09T15:35:23.335 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-09T15:35:23.546 INFO:teuthology.provision.fog.smithi197:Node is ready
2022-01-09T15:35:23.601 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2022-01-09T15:35:23.657 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2022-01-09T15:35:23.989 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2022-01-09T15:36:24.076 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-09T15:36:24.331 INFO:teuthology.provision.fog.smithi012:Node is ready
2022-01-09T15:36:24.347 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2022-01-09T15:36:24.403 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2022-01-09T15:36:24.729 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2022-01-09T15:36:24.882 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2022-01-09T15:36:24.883 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-09T15:36:24.903 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2022-01-09T15:36:24.904 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-09T15:36:24.921 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2022-01-09T15:36:24.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2022-01-09T15:36:25.107 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2022-01-09T15:36:25.163 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Red Hat Enterprise Linux"
2022-01-09T15:36:25.163 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8.4 (Ootpa)"
2022-01-09T15:36:25.163 INFO:teuthology.orchestra.run.smithi012.stdout:ID="rhel"
2022-01-09T15:36:25.164 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="fedora"
2022-01-09T15:36:25.164 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8.4"
2022-01-09T15:36:25.164 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8"
2022-01-09T15:36:25.164 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-09T15:36:25.165 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2022-01-09T15:36:25.165 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-09T15:36:25.165 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.redhat.com/"
2022-01-09T15:36:25.165 INFO:teuthology.orchestra.run.smithi012.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-09T15:36:25.166 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-09T15:36:25.166 INFO:teuthology.orchestra.run.smithi012.stdout:
2022-01-09T15:36:25.166 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-09T15:36:25.166 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-09T15:36:25.166 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-09T15:36:25.167 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-09T15:36:25.171 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2022-01-09T15:36:25.192 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2022-01-09T15:36:25.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-01-09T15:36:25.424 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2022-01-09T15:36:25.479 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="Red Hat Enterprise Linux"
2022-01-09T15:36:25.479 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8.4 (Ootpa)"
2022-01-09T15:36:25.479 INFO:teuthology.orchestra.run.smithi197.stdout:ID="rhel"
2022-01-09T15:36:25.480 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="fedora"
2022-01-09T15:36:25.480 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8.4"
2022-01-09T15:36:25.480 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8"
2022-01-09T15:36:25.480 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-09T15:36:25.481 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31"
2022-01-09T15:36:25.481 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-09T15:36:25.481 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.redhat.com/"
2022-01-09T15:36:25.481 INFO:teuthology.orchestra.run.smithi197.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-09T15:36:25.481 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-09T15:36:25.482 INFO:teuthology.orchestra.run.smithi197.stdout:
2022-01-09T15:36:25.482 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-09T15:36:25.482 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-09T15:36:25.482 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-09T15:36:25.483 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-09T15:36:25.483 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-01-09T15:36:25.574 INFO:teuthology.dispatcher.supervisor:Running job 6604838
2022-01-09T15:36:25.575 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-09_15:16:51-rados-wip-yuriw-master-1.7.22-distro-default-smithi/6604838 --name yuriw-2022-01-09_15:16:51-rados-wip-yuriw-master-1.7.22-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-09_15:16:51-rados-wip-yuriw-master-1.7.22-distro-default-smithi/6604838/orig.config.yaml
2022-01-09T15:36:25.578 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-09_15:16:51-rados-wip-yuriw-master-1.7.22-distro-default-smithi/6604838
2022-01-09T15:36:25.579 INFO:teuthology.dispatcher.supervisor:Job PID: 24249
2022-01-09T15:36:25.579 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-10T03:36:44.945 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-10T03:36:45.090 INFO:teuthology.kill:Killing Pids: {24249}
2022-01-10T03:36:46.203 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-10T03:36:46.204 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-10T03:36:46.204 INFO:teuthology.misc:Compressing logs...
2022-01-10T03:36:46.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2022-01-10T03:36:46.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-01-10T03:36:46.414 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-10T03:36:46.643 INFO:teuthology.orchestra.run.smithi197.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-10T03:36:46.683 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-10T03:36:46.684 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now
2022-01-10T03:36:46.716 INFO:teuthology.orchestra.run.smithi197.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-10T03:36:46.716 INFO:teuthology.orchestra.run.smithi197.stderr:tar: Error is not recoverable: exiting now
2022-01-10T03:36:46.717 INFO:teuthology.misc:Compressing logs...
2022-01-10T03:36:46.982 INFO:teuthology.misc:Compressing logs...
2022-01-10T03:36:47.293 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-10T03:36:47.677 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-10T03:36:47.958 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-10T03:36:48.614 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-10T03:37:25.905 INFO:teuthology.orchestra.run.smithi197.stderr:tar: ./6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.4.log-20220110.gz: file changed as we read it
2022-01-10T03:37:59.743 INFO:teuthology.orchestra.run.smithi197.stderr:tar: ./6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.4.log-20220110: file changed as we read it
2022-01-10T03:38:35.188 INFO:teuthology.orchestra.run.smithi197.stderr:tar: ./6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.6.log-20220110: file changed as we read it
2022-01-10T03:38:35.614 INFO:teuthology.orchestra.run.smithi197.stderr:tar: ./6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-volume.log-20220110: File removed before we read it
2022-01-10T03:38:47.487 INFO:teuthology.orchestra.run.smithi197.stderr:tar: ./6ebd215e-7163-11ec-8c32-001a4aab830c/ceph-osd.2.log-20220110.gz: file changed as we read it
2022-01-10T03:38:47.488 INFO:teuthology.orchestra.run.smithi197.stderr:tar: ./6ebd215e-7163-11ec-8c32-001a4aab830c: file changed as we read it
2022-01-10T03:38:47.506 INFO:teuthology.orchestra.run.smithi197.stderr:tar: .: file changed as we read it
2022-01-10T03:38:47.569 INFO:teuthology.kill:No teuthology processes running
2022-01-10T03:38:48.818 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi197']
2022-01-10T03:38:49.811 INFO:teuthology.kill:2022-01-10 03:38:49,811.811 INFO:teuthology.nuke:targets:
2022-01-10T03:38:49.812 INFO:teuthology.kill:  smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhjihtT5+ynN/EC9QNeK78kwZo8nrkXQEdwQ6xYUFb/BA1cYl9TaxJToxg9+o4+/XyTmzZV4/6hGvXBCAa8sYvD363JDyAYweFMP0RGZ+WrVsg6IAc/3lMwrEgKloianeXjetnYaf06xMb8+zZgIjj2nODSY080evEImM/2Dyax6M2+VclncWAnOBRgflFrCi9yNKyHvD89yGhWclIFWULkCbAs3vMkbDowDMoM2H5Es90CeE3uzkREj8nbqd0NKUND00p3SL7wNNwuVThaCn+2ZawWwbEfdvQHgmUQGFlC6nNZj8w4d8jOFmGcDLSC4fL29GJwViEhWwic50NoMWb7mi1ySpdq0B0yWqKwswjdz5Lcmq5c1B5pJH2DmPTjnFqoypBgSUXoK6nSP+9x3BGK0s5F+zrNWMmFogRaywoIVUT2XA6nC7NwZsiI45vmyyEQlIyMPQ3NjuSpddSM4kZWKWrLY6SQTR4kkmJkAo7zsAXX1egWCLgTbWufU0E5M0=
2022-01-10T03:38:49.812 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc3adBAiQSR69I2U8jMV6ev39y8Zf03bav9QpgiUHRH/gQb9craV1pN0FrGnqS9NdikErh71ICW7sUA9uMM3DtUEYUBOzXBmLsPFuta8gHmiVIb9H8hmP6sCSJnau8M7aZV3wvQgLL4cdnD7jPGzFSFFA0+QmT06lWVGGBRKmGSAHAp7x1ICquv6spzWc45yuTbdLgtdw0TIIeETMvPpqxqgY+gOvES/Fu5pzxdpD3yWiYo4EpJLET3rP2AJpdX7GqA00HWJqv6CU064GLKTvEV92Jt1ymh/ZUb581fz8mVI/wIWyVFNmNbz+vNoQQdP7vuY2uKXBc+KmCzKQ1lvk7aWZ62X2DVGm5pCHVtuquO8zfJ94kTSHnffqf0mK5AuCx4i45BxspV+kKdGqb9rUqpuXkXsdOBaXoKxQF6/MYawgJLXQXgCGs/a+Z8GRM9kfvGsqfrZxuVma1JqLY8q5Oy4tKi2A9UofrcmIys3Nff4JARxRAGxliK0al6uhEx20=
2022-01-10T03:38:49.841 INFO:teuthology.kill:2022-01-10 03:38:49,841.841 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-10T03:38:49.844 INFO:teuthology.kill:2022-01-10 03:38:49,844.844 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-10T03:38:49.919 INFO:teuthology.kill:2022-01-10 03:38:49,918.918 INFO:teuthology.orchestra.console:Power off smithi012
2022-01-10T03:38:49.932 INFO:teuthology.kill:2022-01-10 03:38:49,932.932 INFO:teuthology.orchestra.console:Power off smithi197
2022-01-10T03:38:58.298 INFO:teuthology.kill:2022-01-10 03:38:58,297.297 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2022-01-10T03:38:58.305 INFO:teuthology.kill:2022-01-10 03:38:58,304.304 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-01-10T03:38:58.454 INFO:teuthology.kill:2022-01-10 03:38:58,453.453 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com
2022-01-10T03:38:58.457 INFO:teuthology.kill:2022-01-10 03:38:58,457.457 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com
2022-01-10T03:40:58.751 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-10T03:40:58.848 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi012 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601338
2022-01-10T03:40:58.848 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_14:23:01-upgrade:nautilus-x-octopus-distro-default-smithi/6601338