2023-04-04T14:32:58.725 INFO:root:teuthology version: 0.0.1.dev93+gd7c4062 2023-04-04T14:32:58.830 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-04-04T14:32:58.831 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-04-04T14:32:58.831 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-04-04T14:32:58.853 INFO:teuthology.lock.ops:Node 'smithi026.front.sepia.ceph.com' reimaging is complete 2023-04-04T14:32:59.014 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6 2023-04-04T14:32:59.381 INFO:teuthology.orchestra.console:Power off smithi026 2023-04-04T14:32:59.526 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-04-04T14:32:59.627 INFO:teuthology.orchestra.console:Power on smithi026 2023-04-04T14:33:03.883 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-04-04T14:33:03.984 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-04-04T14:35:54.757 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-04-04T14:36:03.845 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-04-04T14:36:12.937 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-04-04T14:36:50.653 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-04T14:36:50.935 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-04-04T14:36:50.959 INFO:teuthology.orchestra.run.smithi026.stdout:smithi022 2023-04-04T14:36:51.016 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-04-04T14:36:51.411 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-04-04T14:36:51.578 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-04-04T14:36:51.579 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-04T14:36:51.603 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-04-04T14:36:51.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-04-04T14:36:51.805 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-04-04T14:36:51.861 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-04-04T14:36:51.862 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-04-04T14:36:51.862 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-04-04T14:36:51.862 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-04-04T14:36:51.862 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-04-04T14:36:51.862 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-04-04T14:36:51.862 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-04T14:36:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-04-04T14:36:51.864 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-04-04T14:36:51.864 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-04-04T14:36:51.865 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-04-04T14:36:51.967 INFO:teuthology.dispatcher.supervisor:Running job 7230840 2023-04-04T14:36:51.968 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi/7230840 --name ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi --description rados:standalone/{supported-random-distro$/{rhel_8} workloads/mon-stretch} -- /home/teuthworker/archive/ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi/7230840/orig.config.yaml 2023-04-04T14:36:51.971 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi/7230840 2023-04-04T14:36:51.972 INFO:teuthology.dispatcher.supervisor:Job PID: 4237 2023-04-04T14:36:51.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-04-05T02:37:51.814 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-04-05T02:37:51.907 INFO:teuthology.kill:Killing Pids: {4237} 2023-04-05T02:37:52.816 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-04-05T02:37:52.817 INFO:teuthology.misc:Compressing logs... 2023-04-05T02:37:52.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-04-05T02:37:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.3.log 2023-04-05T02:37:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.2.log 2023-04-05T02:37:53.064 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.3.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.5.log 2023-04-05T02:37:53.065 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.2.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.4.log 2023-04-05T02:37:53.065 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.5.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.d.log 2023-04-05T02:37:53.065 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.4.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.b.log 2023-04-05T02:37:53.065 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/mon.d.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.e.log 2023-04-05T02:37:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/mon.b.log: /home/ubuntu/cephtest/archive/log/mon.e.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.a.log 2023-04-05T02:37:53.089 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/mon.a.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.6.log 2023-04-05T02:37:53.110 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.6.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mgr.x.log 2023-04-05T02:37:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/mgr.x.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.c.log 2023-04-05T02:37:53.130 INFO:teuthology.orchestra.run.smithi026.stderr: 92.9% -- replaced with /home/ubuntu/cephtest/archive/log/osd.5.log.gz 2023-04-05T02:37:53.137 INFO:teuthology.orchestra.run.smithi026.stderr: 93.1% -- replaced with /home/ubuntu/cephtest/archive/log/osd.4.log.gz 2023-04-05T02:37:53.154 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/mon.c.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.7.log 2023-04-05T02:37:53.167 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.7.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.0.log 2023-04-05T02:37:53.179 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.0.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mgr.y.log 2023-04-05T02:37:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/mgr.y.log: 93.3% -- replaced with /home/ubuntu/cephtest/archive/log/osd.6.log.gz 2023-04-05T02:37:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.1.log 2023-04-05T02:37:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/osd.1.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mgr.z.log 2023-04-05T02:37:53.241 INFO:teuthology.orchestra.run.smithi026.stderr: 93.2% -- replaced with /home/ubuntu/cephtest/archive/log/osd.7.log.gz 2023-04-05T02:37:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/log/mgr.z.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-05T02:37:53.266 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 80.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-05T02:37:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-05T02:37:53.321 INFO:teuthology.orchestra.run.smithi026.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 88.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-05T02:37:54.666 INFO:teuthology.orchestra.run.smithi026.stderr: 91.5% -- replaced with /home/ubuntu/cephtest/archive/log/osd.3.log.gz 2023-04-05T02:37:54.720 INFO:teuthology.orchestra.run.smithi026.stderr: 94.4% -- replaced with /home/ubuntu/cephtest/archive/log/mon.d.log.gz 2023-04-05T02:37:54.967 INFO:teuthology.orchestra.run.smithi026.stderr: 93.9% -- replaced with /home/ubuntu/cephtest/archive/log/mgr.x.log.gz 2023-04-05T02:37:54.982 INFO:teuthology.orchestra.run.smithi026.stderr: 94.3% -- replaced with /home/ubuntu/cephtest/archive/log/mon.c.log.gz 2023-04-05T02:37:55.051 INFO:teuthology.orchestra.run.smithi026.stderr: 91.7% -- replaced with /home/ubuntu/cephtest/archive/log/osd.2.log.gz 2023-04-05T02:37:55.054 INFO:teuthology.orchestra.run.smithi026.stderr: 91.5% -- replaced with /home/ubuntu/cephtest/archive/log/osd.0.log.gz 2023-04-05T02:37:55.134 INFO:teuthology.orchestra.run.smithi026.stderr: 93.9% -- replaced with /home/ubuntu/cephtest/archive/log/mgr.z.log.gz 2023-04-05T02:37:55.465 INFO:teuthology.orchestra.run.smithi026.stderr: 91.9% -- replaced with /home/ubuntu/cephtest/archive/log/osd.1.log.gz 2023-04-05T02:37:55.924 INFO:teuthology.orchestra.run.smithi026.stderr: 94.3% -- replaced with /home/ubuntu/cephtest/archive/log/mon.a.log.gz 2023-04-05T02:38:00.571 INFO:teuthology.orchestra.run.smithi026.stderr: 93.7% -- replaced with /home/ubuntu/cephtest/archive/log/mgr.y.log.gz 2023-04-05T02:38:02.498 INFO:teuthology.orchestra.run.smithi026.stderr: 94.2% -- replaced with /home/ubuntu/cephtest/archive/log/mon.e.log.gz 2023-04-05T02:38:02.727 INFO:teuthology.orchestra.run.smithi026.stderr: 94.1% -- replaced with /home/ubuntu/cephtest/archive/log/mon.b.log.gz 2023-04-05T02:38:09.927 INFO:teuthology.kill:No teuthology processes running 2023-04-05T02:38:10.764 INFO:teuthology.kill:Nuking machines: ['smithi026'] 2023-04-05T02:38:11.364 INFO:teuthology.kill:2023-04-05 02:38:11,363.363 INFO:teuthology.nuke:targets: 2023-04-05T02:38:11.365 INFO:teuthology.kill: smithi026.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-04-05T02:38:11.365 INFO:teuthology.kill:2023-04-05 02:38:11,364.364 INFO:teuthology.nuke:Checking targets against current locks 2023-04-05T02:38:11.418 INFO:teuthology.kill:2023-04-05 02:38:11,418.418 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-05T02:38:11.497 INFO:teuthology.kill:2023-04-05 02:38:11,497.497 INFO:teuthology.orchestra.console:Power off smithi026 2023-04-05T02:38:19.866 INFO:teuthology.kill:2023-04-05 02:38:19,866.866 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-04-05T02:38:20.015 INFO:teuthology.kill:2023-04-05 02:38:20,015.015 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-04-05T02:40:20.340 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-04-05T02:40:20.387 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi026 but it was locked by another job: /home/teuthworker/archive/dis-2023-04-04_23:04:34-rbd-wip-dis-testing-distro-default-smithi/7232374