2022-06-28T17:25:18.028 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-28T17:25:18.252 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2022-06-28T17:25:18.254 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T17:25:18.254 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-06-28T17:25:18.283 INFO:teuthology.lock.ops:Node 'smithi050.front.sepia.ceph.com' reimaging is complete 2022-06-28T17:25:18.284 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2022-06-28T17:25:18.284 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T17:25:18.285 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-06-28T17:25:18.310 INFO:teuthology.lock.ops:Node 'smithi133.front.sepia.ceph.com' reimaging is complete 2022-06-28T17:25:18.517 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream 2022-06-28T17:25:18.534 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2022-06-28T17:25:18.978 INFO:teuthology.orchestra.console:Power off smithi133 2022-06-28T17:25:19.064 INFO:teuthology.orchestra.console:Power off smithi050 2022-06-28T17:25:31.494 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-06-28T17:25:31.551 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-06-28T17:25:31.596 INFO:teuthology.orchestra.console:Power on smithi133 2022-06-28T17:25:31.652 INFO:teuthology.orchestra.console:Power on smithi050 2022-06-28T17:25:35.868 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2022-06-28T17:25:35.969 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2022-06-28T17:25:40.057 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2022-06-28T17:25:40.159 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2022-06-28T17:29:48.343 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T17:29:48.644 INFO:teuthology.provision.fog.smithi050:Node is ready 2022-06-28T17:29:48.665 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2022-06-28T17:29:48.734 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2022-06-28T17:29:49.122 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2022-06-28T17:30:17.454 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T17:30:17.763 INFO:teuthology.provision.fog.smithi133:Node is ready 2022-06-28T17:30:17.785 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2022-06-28T17:30:17.845 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2022-06-28T17:30:18.276 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2022-06-28T17:30:18.566 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2022-06-28T17:30:18.567 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T17:30:18.589 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2022-06-28T17:30:18.589 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T17:30:18.611 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2022-06-28T17:30:18.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-06-28T17:30:18.907 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2022-06-28T17:30:18.970 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2022-06-28T17:30:18.971 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2022-06-28T17:30:18.971 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2022-06-28T17:30:18.972 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2022-06-28T17:30:18.974 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2022-06-28T17:30:18.975 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2022-06-28T17:30:18.975 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T17:30:18.975 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2022-06-28T17:30:18.976 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T17:30:18.976 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2022-06-28T17:30:18.977 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T17:30:18.977 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T17:30:18.978 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T17:30:18.982 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-06-28T17:30:19.010 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2022-06-28T17:30:19.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-06-28T17:30:19.312 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2022-06-28T17:30:19.374 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2022-06-28T17:30:19.374 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2022-06-28T17:30:19.375 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2022-06-28T17:30:19.375 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2022-06-28T17:30:19.376 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2022-06-28T17:30:19.376 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2022-06-28T17:30:19.376 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T17:30:19.377 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2022-06-28T17:30:19.377 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T17:30:19.378 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2022-06-28T17:30:19.378 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T17:30:19.379 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T17:30:19.379 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T17:30:19.380 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-06-28T17:30:19.540 INFO:teuthology.dispatcher.supervisor:Running job 6901645 2022-06-28T17:30:19.540 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901645 --name lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901645/orig.config.yaml 2022-06-28T17:30:19.555 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901645 2022-06-28T17:30:19.557 INFO:teuthology.dispatcher.supervisor:Job PID: 7576 2022-06-28T17:30:19.557 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-29T05:31:25.673 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-06-29T05:31:26.286 INFO:teuthology.kill:Killing Pids: {7576} 2022-06-29T05:31:28.181 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-06-29T05:31:28.185 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-06-29T05:31:28.192 INFO:teuthology.misc:Compressing logs... 2022-06-29T05:31:28.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-06-29T05:31:29.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-06-29T05:31:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-29T05:31:30.481 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-29T05:31:31.449 INFO:teuthology.kill:No teuthology processes running 2022-06-29T05:31:33.993 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi133'] 2022-06-29T05:31:35.525 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-29T05:31:35.526 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-29T05:31:35.527 INFO:teuthology.kill:2022-06-29 05:31:35,525.525 INFO:teuthology.nuke:targets: 2022-06-29T05:31:35.527 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDue94NmycivuKVVW3AoJvamuvYsEyvl3W35Ocpzd6EX8EbqQ9Ds1o6E4gTyCyFxuwGf6itrdwICqTttyJxsS+ExcugSWOp3RadUJhA9muyMLw1pTeSE3VGzlkzR3kMqqkwx9XbiafEmjetEP2ksVkykm1D1DucVS3SqnYaiX1e6QT2Bw7aTFojS7PvHDEyd4auPY2oWxz7YLDrgc4ONxdtLucj8QZKu2GYzIvVfyUG0BdTgM5tNhxkxHPoyENg73rFeUYHKP4WM70fmqk9Xdgcn0dUaX7Xf6AonOfq4I1KVOuorynbqS/vwUrQV443pvtT5nLUHOz90jbsyfh9M+zD/ctrES9v5ZkDMyBgZDxhwkoQpUkToSCkKDG+zIrjDQtsIWXlJwWTtwO+dF4KQazBq5HPkH45CNToCaiKvBFnpy46/q/lj4M4ATc/dnhtUyR8lea/eHRepezQUUZ3AiLDWJ+4nky3xVev8n9h2eQY3SsQ3YOmaagRmPza92yDOc= 2022-06-29T05:31:35.528 INFO:teuthology.kill: smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYAtKT9D1UrL6Asc1jgXaqf4fYdU4Zol1tJV7bCQyUNzkSzwj/Iyo422M60mZ/Qx3tm8X8TfOMta5YKnNCBUj34RlKGPuriEN5wpvgF4chLN8b6GjGBXRaONTQ5FY5LFO+5q19ye9wdjuO6aYo8LSVvALCBm6mxOa4zSWAFIRZ93rtFigoEiV1uqRrbMzXgiU4aCdv0OInhJqlPCzdEj7wb9Ld29rqhFt4TuT66MWogL/4ciMj28VZXecabQns9pkvD5PkDGf5jaA0Gjwj28TPO5wUje5sQUH+YNK993Zjh7sSuRnf+PrgAhnUcvO2+8JSssQsulL7tMzqKbICLngBEKsFybO2yBniYXk8gEFOAYCwUYJ6lDSOIB+pQwbN7kCTi6t9jqhPYhaJRp+tOv6viImFNLlO5Hd7zp/Qb73cZaUu4MSjuGXORiB1xcoiSBmnWtY7IkNQpsJ6r+OVUwnvIRf8AmS35ioScepdj8T7IsWXmWY4TpngXBWT3UeQ8Es= 2022-06-29T05:31:35.530 INFO:teuthology.kill:2022-06-29 05:31:35,525.525 INFO:teuthology.nuke:Checking targets against current locks 2022-06-29T05:31:35.588 INFO:teuthology.kill:2022-06-29 05:31:35,587.587 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T05:31:35.624 INFO:teuthology.kill:2022-06-29 05:31:35,624.624 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T05:31:35.691 INFO:teuthology.kill:2022-06-29 05:31:35,691.691 INFO:teuthology.orchestra.console:Power off smithi050 2022-06-29T05:31:35.744 INFO:teuthology.kill:2022-06-29 05:31:35,744.744 INFO:teuthology.orchestra.console:Power off smithi133 2022-06-29T05:31:44.093 INFO:teuthology.kill:2022-06-29 05:31:44,093.093 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-06-29T05:31:44.134 INFO:teuthology.kill:2022-06-29 05:31:44,134.134 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-06-29T05:31:44.251 INFO:teuthology.kill:2022-06-29 05:31:44,250.250 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2022-06-29T05:31:44.303 INFO:teuthology.kill:2022-06-29 05:31:44,303.303 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2022-06-29T05:33:44.683 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-06-29T05:33:44.910 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-06-29_04:51:15-orch:cephadm-wip-guits-testing-2022-06-28-0505-distro-default-smithi/6904530 2022-06-29T05:33:44.911 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-06-29_04:51:15-orch:cephadm-wip-guits-testing-2022-06-28-0505-distro-default-smithi/6904530