2022-01-18T15:58:02.365 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-18T15:58:02.483 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging
2022-01-18T15:58:02.485 INFO:teuthology.lock.ops:Updating [ubuntu@smithi092.front.sepia.ceph.com]: reset os type and version on server
2022-01-18T15:58:02.485 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2022-01-18T15:58:02.506 INFO:teuthology.lock.ops:Node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging is complete
2022-01-18T15:58:02.506 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging
2022-01-18T15:58:02.507 INFO:teuthology.lock.ops:Updating [ubuntu@smithi173.front.sepia.ceph.com]: reset os type and version on server
2022-01-18T15:58:02.507 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2022-01-18T15:58:02.526 INFO:teuthology.lock.ops:Node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging is complete
2022-01-18T15:58:02.754 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of rhel 8.4
2022-01-18T15:58:02.764 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.4
2022-01-18T15:58:03.231 INFO:teuthology.orchestra.console:Power off smithi092
2022-01-18T15:58:03.247 INFO:teuthology.orchestra.console:Power off smithi173
2022-01-18T15:58:11.608 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2022-01-18T15:58:11.612 INFO:teuthology.orchestra.console:Power off for smithi173 completed
2022-01-18T15:58:11.710 INFO:teuthology.orchestra.console:Power on smithi092
2022-01-18T15:58:11.717 INFO:teuthology.orchestra.console:Power on smithi173
2022-01-18T15:58:20.094 INFO:teuthology.orchestra.console:Power on for smithi173 completed
2022-01-18T15:58:20.152 INFO:teuthology.orchestra.console:Power on for smithi092 completed
2022-01-18T15:58:20.196 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish
2022-01-18T15:58:20.253 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2022-01-18T16:03:09.961 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-18T16:03:09.975 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-18T16:03:10.191 INFO:teuthology.provision.fog.smithi173:Node is ready
2022-01-18T16:03:10.195 INFO:teuthology.provision.fog.smithi092:Node is ready
2022-01-18T16:03:10.206 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com
2022-01-18T16:03:10.210 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2022-01-18T16:03:10.262 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173
2022-01-18T16:03:10.267 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2022-01-18T16:03:10.588 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2022-01-18T16:03:10.592 INFO:teuthology.provision.fog.smithi173:Deploy complete!
2022-01-18T16:03:10.743 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2022-01-18T16:03:10.744 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-18T16:03:10.763 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com
2022-01-18T16:03:10.764 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-18T16:03:10.783 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2022-01-18T16:03:10.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2022-01-18T16:03:11.011 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2022-01-18T16:03:11.065 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux"
2022-01-18T16:03:11.066 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)"
2022-01-18T16:03:11.066 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel"
2022-01-18T16:03:11.066 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora"
2022-01-18T16:03:11.067 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4"
2022-01-18T16:03:11.067 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2022-01-18T16:03:11.067 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-18T16:03:11.068 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2022-01-18T16:03:11.068 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-18T16:03:11.069 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/"
2022-01-18T16:03:11.069 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-18T16:03:11.070 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-18T16:03:11.070 INFO:teuthology.orchestra.run.smithi092.stdout:
2022-01-18T16:03:11.070 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-18T16:03:11.070 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-18T16:03:11.071 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-18T16:03:11.071 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-18T16:03:11.072 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2022-01-18T16:03:11.090 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server
2022-01-18T16:03:11.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2022-01-18T16:03:11.315 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64
2022-01-18T16:03:11.371 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux"
2022-01-18T16:03:11.371 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.4 (Ootpa)"
2022-01-18T16:03:11.372 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel"
2022-01-18T16:03:11.372 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora"
2022-01-18T16:03:11.372 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.4"
2022-01-18T16:03:11.372 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8"
2022-01-18T16:03:11.372 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-18T16:03:11.373 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2022-01-18T16:03:11.373 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-18T16:03:11.373 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/"
2022-01-18T16:03:11.373 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-18T16:03:11.374 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-18T16:03:11.374 INFO:teuthology.orchestra.run.smithi173.stdout:
2022-01-18T16:03:11.374 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-18T16:03:11.374 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-18T16:03:11.375 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-18T16:03:11.375 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-18T16:03:11.376 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2022-01-18T16:03:11.472 INFO:teuthology.dispatcher.supervisor:Running job 6624252
2022-01-18T16:03:11.472 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi/6624252 --name swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi --description rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi/6624252/orig.config.yaml
2022-01-18T16:03:11.476 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi/6624252
2022-01-18T16:03:11.477 INFO:teuthology.dispatcher.supervisor:Job PID: 19915
2022-01-18T16:03:11.477 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-18T22:33:40.618 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-18T22:33:40.775 INFO:teuthology.kill:Killing Pids: {19915}
2022-01-18T22:33:41.919 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-18T22:33:41.920 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-18T22:33:41.920 INFO:teuthology.misc:Compressing logs...
2022-01-18T22:33:41.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2022-01-18T22:33:42.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2022-01-18T22:33:42.146 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-18T22:33:42.330 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-18T22:33:42.359 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-18T22:33:42.359 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now
2022-01-18T22:33:42.386 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-18T22:33:42.386 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now
2022-01-18T22:33:42.387 INFO:teuthology.misc:Compressing logs...
2022-01-18T22:33:42.628 INFO:teuthology.misc:Compressing logs...
2022-01-18T22:33:56.502 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-18T22:33:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-18T22:34:05.454 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-mon.smithi092.log: file size changed while zipping
2022-01-18T22:34:08.105 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-18T22:34:19.851 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-18T22:34:23.589 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-18T22:34:26.906 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-mon.smithi173.log: file size changed while zipping
2022-01-18T22:34:32.341 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-18T22:34:41.171 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-18T22:34:49.662 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-18T22:34:53.888 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/9d8bf510-7879-11ec-8c34-001a4aab830c/ceph-mgr.smithi092.yrbqkh.log: file size changed while zipping
2022-01-18T22:35:21.088 INFO:teuthology.kill:No teuthology processes running
2022-01-18T22:35:22.320 INFO:teuthology.kill:Nuking machines: ['smithi092', 'smithi173']
2022-01-18T22:35:23.282 INFO:teuthology.kill:2022-01-18 22:35:23,282.282 INFO:teuthology.nuke:targets:
2022-01-18T22:35:23.283 INFO:teuthology.kill:  smithi092.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7b5dvLjxani5UlFgNZerMQI/D+mKKSs8CfwPjqAZTfGycqMtA2M/aSLO5eLKqIUjIFkbmz3IAoNl/v7l9TJ+gsUfbOO3QqBGF+C311oJb5HWlXGvy8Y4M70brST769RuU9vMXXUcYkGZ0QsZWELch5bDF6JRE5sY2edAV71Yeb087u+7ZFm/fqj6yyVr+1b1XcYqKz9JvGMi+Uf8FyvraFaT6d0S4vdYkmMlqu0kOOk/sSFkwyKPaJqU4gLe7bIP4w/hNYsn4lidqzqumr0GXtSEfYFjgj2exGBU8w1T6obYp2//3JByuv3pSokoQzcHhBaS5339VFi9p6DpZw12gEVfgYZtvXxwVhWXO2jpxaP4zZMD5SWRwv+RV8kQYyBNgoKnbuhYphmpqJtIsIpZgN/zOHK3DT57ygKp0umG/Rzc/lZ1rH7YYDt5AOXy0oHN+klRn+Mo+qV+b0pAuNgMCXFkTejxpnxmx3ep/u8fEY7vwx53595rzK5w3iimT0bU=
2022-01-18T22:35:23.284 INFO:teuthology.kill:  smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTWvPV9QwzE9i0yxlFPyZyRmfq2+vBQcqyB67jgTvA+nySBVXpBNNc5c9ZedTttA5cMQqAPXLe8A1XfgceyP2TztJ2SQYJ57QCS86M7U8d4YgXjD1utvvIGfhQepeyswHvx4OlFzH0KY7cNhItqf426C6ivDBE6T61YnqRJ5vYURM05gLiTUCZTtjjIOydH6r9rU0dnttGjqg6Vw9JAf8P0lhX/QSfiuN5x+RYan4LYTeBdr4uhPlICvo9alUHcfsqIMOVAGn338v6qAKfqo4W7CAE7rho67vCHpXz9CGhl8YHv51W9YVYLgKcNc9IzzctzNgTCU0F5EN5zXkNhSEZBB6UoBQ/aOfukWinMfoM0Vjx59DeiOazxia5TF5+JwHgVbYVK8sYAYFJFhqWcbCBDFyKVlVameEICeQGWskDXFvUiRCHZE+rCI+czbAnpl/glxpyCRJbO0OFMPvd4akw5wPLQdBWfdzrI7iiMp0ABmI7AETVLY3rc5tVZYSMahU=
2022-01-18T22:35:23.310 INFO:teuthology.kill:2022-01-18 22:35:23,310.310 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-18T22:35:23.314 INFO:teuthology.kill:2022-01-18 22:35:23,313.313 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-18T22:35:23.399 INFO:teuthology.kill:2022-01-18 22:35:23,398.398 INFO:teuthology.orchestra.console:Power off smithi092
2022-01-18T22:35:23.413 INFO:teuthology.kill:2022-01-18 22:35:23,413.413 INFO:teuthology.orchestra.console:Power off smithi173
2022-01-18T22:35:35.885 INFO:teuthology.kill:2022-01-18 22:35:35,885.885 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2022-01-18T22:35:35.890 INFO:teuthology.kill:2022-01-18 22:35:35,890.890 INFO:teuthology.orchestra.console:Power off for smithi173 completed
2022-01-18T22:35:36.034 INFO:teuthology.kill:2022-01-18 22:35:36,034.034 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com
2022-01-18T22:35:36.040 INFO:teuthology.kill:2022-01-18 22:35:36,040.040 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com
2022-01-18T22:37:36.357 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-18T22:37:36.459 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi092 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-18_17:49:50-rbd-wip-yuri3-testing-2022-01-18-0829-octopus-distro-default-smithi/6624683
2022-01-18T22:37:36.460 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi173 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-18_17:49:50-rbd-wip-yuri3-testing-2022-01-18-0829-octopus-distro-default-smithi/6624683