2023-04-04T14:32:41.725 INFO:root:teuthology version: 0.0.1.dev93+gd7c4062 2023-04-04T14:32:41.820 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2023-04-04T14:32:41.821 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2023-04-04T14:32:41.822 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-04-04T14:32:41.845 INFO:teuthology.lock.ops:Node 'smithi042.front.sepia.ceph.com' reimaging is complete 2023-04-04T14:32:42.002 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of rhel 8.6 2023-04-04T14:32:42.297 INFO:teuthology.orchestra.console:Power off smithi042 2023-04-04T14:32:42.442 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-04-04T14:32:42.543 INFO:teuthology.orchestra.console:Power on smithi042 2023-04-04T14:32:46.795 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2023-04-04T14:32:46.896 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2023-04-04T14:35:37.605 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-04-04T14:35:46.693 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-04-04T14:35:55.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-04-04T14:36:04.837 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-04-04T14:37:10.906 WARNING:teuthology.provision.fog:timed out 2023-04-04T14:37:17.245 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-04T14:37:17.572 INFO:teuthology.provision.fog.smithi042:Node is ready 2023-04-04T14:37:17.590 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2023-04-04T14:37:17.648 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2023-04-04T14:37:18.000 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2023-04-04T14:37:18.145 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2023-04-04T14:37:18.146 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-04T14:37:18.175 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2023-04-04T14:37:18.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-04-04T14:37:18.361 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2023-04-04T14:37:18.417 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Red Hat Enterprise Linux" 2023-04-04T14:37:18.418 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8.6 (Ootpa)" 2023-04-04T14:37:18.418 INFO:teuthology.orchestra.run.smithi042.stdout:ID="rhel" 2023-04-04T14:37:18.418 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="fedora" 2023-04-04T14:37:18.418 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8.6" 2023-04-04T14:37:18.418 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2023-04-04T14:37:18.418 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-04-04T14:37:18.418 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2023-04-04T14:37:18.419 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-04-04T14:37:18.419 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.redhat.com/" 2023-04-04T14:37:18.419 INFO:teuthology.orchestra.run.smithi042.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-04-04T14:37:18.419 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-04T14:37:18.419 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-04-04T14:37:18.419 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-04T14:37:18.419 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-04-04T14:37:18.420 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-04-04T14:37:18.420 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-04-04T14:37:18.421 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-04-04T14:37:18.554 INFO:teuthology.dispatcher.supervisor:Running job 7230784 2023-04-04T14:37:18.554 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi/7230784 --name ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi --description rados:standalone/{supported-random-distro$/{rhel_8} workloads/mon-stretch} -- /home/teuthworker/archive/ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi/7230784/orig.config.yaml 2023-04-04T14:37:18.558 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2023-04-04_14:32:37-rados:standalone-wip-ksirivad-iswriteable-distro-default-smithi/7230784 2023-04-04T14:37:18.558 INFO:teuthology.dispatcher.supervisor:Job PID: 5245 2023-04-04T14:37:18.559 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-04-05T02:38:17.929 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-04-05T02:38:18.028 INFO:teuthology.kill:Killing Pids: {5245} 2023-04-05T02:38:18.883 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-04-05T02:38:18.884 INFO:teuthology.misc:Compressing logs... 2023-04-05T02:38:18.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-04-05T02:38:19.137 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.3.log 2023-04-05T02:38:19.137 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.2.log 2023-04-05T02:38:19.138 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.5.log 2023-04-05T02:38:19.139 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/osd.3.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.4.log 2023-04-05T02:38:19.139 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/osd.2.log: /home/ubuntu/cephtest/archive/log/osd.5.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.d.log 2023-04-05T02:38:19.139 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/osd.4.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.b.log 2023-04-05T02:38:19.142 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/mon.d.log: /home/ubuntu/cephtest/archive/log/mon.b.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.e.log 2023-04-05T02:38:19.146 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/mon.e.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.a.log 2023-04-05T02:38:19.157 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/mon.a.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.6.log 2023-04-05T02:38:19.182 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/osd.6.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mgr.x.log 2023-04-05T02:38:19.204 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/mgr.x.log: 92.8% -- replaced with /home/ubuntu/cephtest/archive/log/osd.5.log.gz 2023-04-05T02:38:19.204 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mon.c.log 2023-04-05T02:38:19.208 INFO:teuthology.orchestra.run.smithi042.stderr: 93.0% -- replaced with /home/ubuntu/cephtest/archive/log/osd.4.log.gz 2023-04-05T02:38:19.215 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/mon.c.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.7.log 2023-04-05T02:38:19.227 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.0.log 2023-04-05T02:38:19.249 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/osd.7.log: /home/ubuntu/cephtest/archive/log/osd.0.log: 93.2% -- replaced with /home/ubuntu/cephtest/archive/log/osd.6.log.gz 2023-04-05T02:38:19.249 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mgr.y.log 2023-04-05T02:38:19.272 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/mgr.y.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/osd.1.log 2023-04-05T02:38:19.279 INFO:teuthology.orchestra.run.smithi042.stderr: 93.1% -- replaced with /home/ubuntu/cephtest/archive/log/osd.7.log.gz 2023-04-05T02:38:19.295 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/osd.1.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/log/mgr.z.log 2023-04-05T02:38:19.307 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/log/mgr.z.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-05T02:38:19.319 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-05T02:38:19.329 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 79.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-05T02:38:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 88.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-05T02:38:20.535 INFO:teuthology.orchestra.run.smithi042.stderr: 94.4% -- replaced with /home/ubuntu/cephtest/archive/log/mon.c.log.gz 2023-04-05T02:38:20.603 INFO:teuthology.orchestra.run.smithi042.stderr: 94.2% -- replaced with /home/ubuntu/cephtest/archive/log/mon.d.log.gz 2023-04-05T02:38:20.909 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /home/ubuntu/cephtest/archive/log/mgr.y.log.gz 2023-04-05T02:38:20.934 INFO:teuthology.orchestra.run.smithi042.stderr: 91.7% -- replaced with /home/ubuntu/cephtest/archive/log/osd.0.log.gz 2023-04-05T02:38:20.988 INFO:teuthology.orchestra.run.smithi042.stderr: 91.7% -- replaced with /home/ubuntu/cephtest/archive/log/osd.2.log.gz 2023-04-05T02:38:21.004 INFO:teuthology.orchestra.run.smithi042.stderr: 91.8% -- replaced with /home/ubuntu/cephtest/archive/log/osd.3.log.gz 2023-04-05T02:38:21.274 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /home/ubuntu/cephtest/archive/log/mgr.z.log.gz 2023-04-05T02:38:21.738 INFO:teuthology.orchestra.run.smithi042.stderr: 91.9% -- replaced with /home/ubuntu/cephtest/archive/log/osd.1.log.gz 2023-04-05T02:38:21.857 INFO:teuthology.orchestra.run.smithi042.stderr: 94.3% -- replaced with /home/ubuntu/cephtest/archive/log/mon.a.log.gz 2023-04-05T02:38:26.690 INFO:teuthology.orchestra.run.smithi042.stderr: 93.7% -- replaced with /home/ubuntu/cephtest/archive/log/mgr.x.log.gz 2023-04-05T02:38:28.669 INFO:teuthology.orchestra.run.smithi042.stderr: 94.3% -- replaced with /home/ubuntu/cephtest/archive/log/mon.e.log.gz 2023-04-05T02:38:28.996 INFO:teuthology.orchestra.run.smithi042.stderr: 94.4% -- replaced with /home/ubuntu/cephtest/archive/log/mon.b.log.gz 2023-04-05T02:38:36.578 INFO:teuthology.kill:No teuthology processes running 2023-04-05T02:38:37.362 INFO:teuthology.kill:Nuking machines: ['smithi042'] 2023-04-05T02:38:37.933 INFO:teuthology.kill:2023-04-05 02:38:37,933.933 INFO:teuthology.nuke:targets: 2023-04-05T02:38:37.934 INFO:teuthology.kill: smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-04-05T02:38:37.934 INFO:teuthology.kill:2023-04-05 02:38:37,933.933 INFO:teuthology.nuke:Checking targets against current locks 2023-04-05T02:38:37.989 INFO:teuthology.kill:2023-04-05 02:38:37,988.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-05T02:38:38.069 INFO:teuthology.kill:2023-04-05 02:38:38,069.069 INFO:teuthology.orchestra.console:Power off smithi042 2023-04-05T02:38:46.432 INFO:teuthology.kill:2023-04-05 02:38:46,431.431 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-04-05T02:38:46.595 INFO:teuthology.kill:2023-04-05 02:38:46,594.594 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com 2023-04-05T02:40:46.937 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-04-05T02:40:46.998 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/dis-2023-04-04_23:04:34-rbd-wip-dis-testing-distro-default-smithi/7232374