2022-10-31T23:45:31.621 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-31T23:45:31.749 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2022-10-31T23:45:31.751 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2022-10-31T23:45:31.751 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-10-31T23:45:31.770 INFO:teuthology.lock.ops:Node 'smithi027.front.sepia.ceph.com' reimaging is complete 2022-10-31T23:45:31.770 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2022-10-31T23:45:31.770 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2022-10-31T23:45:31.771 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2022-10-31T23:45:31.790 INFO:teuthology.lock.ops:Node 'smithi046.front.sepia.ceph.com' reimaging is complete 2022-10-31T23:45:32.052 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream 2022-10-31T23:45:32.055 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 8.stream 2022-10-31T23:45:32.659 INFO:teuthology.orchestra.console:Power off smithi027 2022-10-31T23:45:32.716 INFO:teuthology.orchestra.console:Power off smithi046 2022-10-31T23:45:32.797 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-10-31T23:45:32.852 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2022-10-31T23:45:32.899 INFO:teuthology.orchestra.console:Power on smithi027 2022-10-31T23:45:32.954 INFO:teuthology.orchestra.console:Power on smithi046 2022-10-31T23:45:41.259 INFO:teuthology.orchestra.console:Power on for smithi027 completed 2022-10-31T23:45:41.310 INFO:teuthology.orchestra.console:Power on for smithi046 completed 2022-10-31T23:45:41.361 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2022-10-31T23:45:41.411 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2022-10-31T23:49:45.365 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-31T23:50:05.701 INFO:teuthology.provision.fog.smithi046:Node is ready 2022-10-31T23:50:05.726 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2022-10-31T23:50:05.787 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2022-10-31T23:50:06.169 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2022-10-31T23:51:23.033 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-31T23:51:23.283 INFO:teuthology.provision.fog.smithi027:Node is ready 2022-10-31T23:51:23.303 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2022-10-31T23:51:23.363 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2022-10-31T23:51:23.716 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2022-10-31T23:51:23.906 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2022-10-31T23:51:23.907 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-31T23:51:23.929 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2022-10-31T23:51:23.930 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-31T23:51:23.951 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2022-10-31T23:51:23.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-10-31T23:51:24.149 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2022-10-31T23:51:24.207 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2022-10-31T23:51:24.208 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8" 2022-10-31T23:51:24.208 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2022-10-31T23:51:24.208 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2022-10-31T23:51:24.208 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8" 2022-10-31T23:51:24.209 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2022-10-31T23:51:24.209 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8" 2022-10-31T23:51:24.209 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2022-10-31T23:51:24.209 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-10-31T23:51:24.210 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2022-10-31T23:51:24.210 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-31T23:51:24.210 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-31T23:51:24.210 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-10-31T23:51:24.212 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-10-31T23:51:24.232 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2022-10-31T23:51:24.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2022-10-31T23:51:24.494 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2022-10-31T23:51:24.552 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2022-10-31T23:51:24.552 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8" 2022-10-31T23:51:24.552 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2022-10-31T23:51:24.553 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2022-10-31T23:51:24.553 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8" 2022-10-31T23:51:24.553 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2022-10-31T23:51:24.553 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 8" 2022-10-31T23:51:24.554 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2022-10-31T23:51:24.554 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-10-31T23:51:24.554 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2022-10-31T23:51:24.554 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-31T23:51:24.555 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-31T23:51:24.555 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-10-31T23:51:24.556 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2022-10-31T23:51:24.660 INFO:teuthology.dispatcher.supervisor:Running job 7080297 2022-10-31T23:51:24.660 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080297 --name teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} -- /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080297/orig.config.yaml 2022-10-31T23:51:24.665 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080297 2022-10-31T23:51:24.666 INFO:teuthology.dispatcher.supervisor:Job PID: 32703 2022-10-31T23:51:24.666 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-11-01T11:52:12.410 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-11-01T11:52:12.648 INFO:teuthology.kill:Killing Pids: {32703} 2022-11-01T11:52:13.923 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-11-01T11:52:13.924 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-11-01T11:52:13.924 INFO:teuthology.misc:Compressing logs... 2022-11-01T11:52:13.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-11-01T11:52:14.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2022-11-01T11:52:14.518 INFO:teuthology.kill:No teuthology processes running 2022-11-01T11:52:15.726 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi046'] 2022-11-01T11:52:16.769 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-11-01T11:52:16.770 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-11-01T11:52:16.770 INFO:teuthology.kill:2022-11-01 11:52:16,768.768 INFO:teuthology.nuke:targets: 2022-11-01T11:52:16.770 INFO:teuthology.kill: smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3kbg2hqr/vYSKEO5O+jEA8vqegyJ7wp8AfxkBHkgLXBeZYP7LLUapixF+8YxmeLkLlWQVOhmLat2m3eQojv2AV63XDbGRXQPJ6ty5qsN7YFh5DlPvx1hjwzR2HH0L85nmG7pg/h2XwmoLlgjNgOFX11xzpbpeyvx4BEocsivB7tASZUTJ9Ser7oNK/CWd8Eg8M3CHSyThh9egrBzjBVXiGe0Uj5v6ZEroXhD7ur7gf4vvfalfX+cXz2Sw0rRSA41YdLjrMcq9XGWBk+URvFDNCOaqUiS1cbk/YJT1kyp/Dl1JXZU3ICRIbrjiHfN3bXzSyMkz4fAI6qh+1PjeFWmoAiM4BsvGqHYMe4UZZcTZP6NtuS+yX6WZDNeWU7NSLs/sNSV92e2MTLaVE+dhpc8CocJBLPmMWlBsY9pVDle6ILl8iyGZiFVPUp+vYClYtRcNSczRETlQugIGLeUZ+9jQdZ7W98cCfaqCQhVR/DO2FXjqPzTIpl2Nj0vGwVeKi7s= 2022-11-01T11:52:16.771 INFO:teuthology.kill: smithi046.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPsOgdcj2kHWU/TGs03I58LR9JvYlXYC3Mm7mTh1BY87CURVNkasjGrx+/fiJF7Am/mIvmaBEWn80oy8V1QoIybRyYrrDLPgV7oF+fkw/XsRQFTE1GS/8XG4n4XU0O0IfVf7YBkv94V+D5WdsPKBHcd71KgBo6EIPKdhRzlK1n5x211N54OJYc0FKTueJjvNHWMZtc4GgaukwLxhJC5c802+ZMHFm6WZnv3gKIjc8CxAwwA3KV7DgIFp/pD7A06i53pDuKLM0Z9fiKVUjhC6Cy+kWT6PTlyABQri8364z9/aCCN0MvFqS/myq/7/rbK3N0f3zab3KS6pGAUizjcrWHckKIEG0Tqvgk84cK+aBSU18GC8MUVbq9JVkbc+D4th82slhZ4Id98lCSNSfn7GUQZIWpEWafj1+WqtO6H4wGZ+hCQyLfZuMyIZOibEgq7q3XMaNM6rTl3VARfKFLK1MAJwQIEfrOVP7sP1uxTenLhEJd/RrbW3qVIyVhKlWCi88= 2022-11-01T11:52:16.771 INFO:teuthology.kill:2022-11-01 11:52:16,768.768 INFO:teuthology.nuke:Checking targets against current locks 2022-11-01T11:52:16.831 INFO:teuthology.kill:2022-11-01 11:52:16,831.831 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-01T11:52:16.851 INFO:teuthology.kill:2022-11-01 11:52:16,851.851 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-01T11:52:16.909 INFO:teuthology.kill:2022-11-01 11:52:16,909.909 INFO:teuthology.orchestra.console:Power off smithi027 2022-11-01T11:52:16.928 INFO:teuthology.kill:2022-11-01 11:52:16,928.928 INFO:teuthology.orchestra.console:Power off smithi046 2022-11-01T11:52:25.286 INFO:teuthology.kill:2022-11-01 11:52:25,285.285 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2022-11-01T11:52:25.434 INFO:teuthology.kill:2022-11-01 11:52:25,433.433 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2022-11-01T11:52:29.391 INFO:teuthology.kill:2022-11-01 11:52:29,390.390 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-11-01T11:52:29.537 INFO:teuthology.kill:2022-11-01 11:52:29,537.537 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2022-11-01T11:54:29.834 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-11-01T11:54:29.941 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080337 2022-11-01T11:54:29.941 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi046 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080337