2023-08-11T01:25:45.872 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-11T01:25:45.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:25:46.028 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc257c69730>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc257549f70>, signals=[15])
2023-08-11T01:25:46.029 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2023-08-11T01:25:46.030 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2023-08-11T01:25:46.030 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-08-11T01:25:46.054 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2023-08-11T01:25:46.055 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2023-08-11T01:25:46.055 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-08-11T01:25:46.058 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"}
2023-08-11T01:25:46.079 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"}
2023-08-11T01:25:46.128 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-11T01:25:46.140 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-11T01:25:46.162 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-11T01:25:46.162 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 7}
2023-08-11T01:25:46.189 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-11T01:25:46.189 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 7}
2023-08-11T01:25:46.211 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.4
2023-08-11T01:25:46.212 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:25:46.233 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.4
2023-08-11T01:25:46.234 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:25:46.274 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"}
2023-08-11T01:25:46.292 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"}
2023-08-11T01:25:46.309 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1}
2023-08-11T01:25:46.326 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1}
2023-08-11T01:25:46.359 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:25:46.392 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:25:46.458 INFO:teuthology.orchestra.console.smithi132:Power off
2023-08-11T01:25:46.459 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-11T01:25:46.484 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-08-11T01:25:46.485 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:46.505 INFO:teuthology.orchestra.console.smithi191:Power off
2023-08-11T01:25:46.506 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-11T01:25:46.521 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-08-11T01:25:46.532 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2023-08-11T01:25:46.532 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:46.555 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2023-08-11T01:25:50.527 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:50.557 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:50.639 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-08-11T01:25:50.669 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2023-08-11T01:25:54.641 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:54.671 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:54.752 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-08-11T01:25:54.782 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-08-11T01:25:54.853 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-08-11T01:25:54.883 INFO:teuthology.orchestra.console.smithi191:Power off completed
2023-08-11T01:25:54.955 INFO:teuthology.orchestra.console.smithi132:Power on
2023-08-11T01:25:54.955 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-11T01:25:54.975 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2023-08-11T01:25:54.976 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:54.984 INFO:teuthology.orchestra.console.smithi191:Power on
2023-08-11T01:25:54.985 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-11T01:25:54.999 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-08-11T01:25:55.006 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2023-08-11T01:25:55.007 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:55.029 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-08-11T01:25:59.004 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:59.031 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:25:59.117 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-08-11T01:25:59.142 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-08-11T01:26:03.121 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:26:03.143 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:26:03.232 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-08-11T01:26:03.253 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2023-08-11T01:26:03.334 INFO:teuthology.orchestra.console.smithi132:Power on completed
2023-08-11T01:26:03.355 INFO:teuthology.orchestra.console.smithi191:Power on completed
2023-08-11T01:26:03.435 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2023-08-11T01:26:03.435 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:26:03.456 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2023-08-11T01:26:03.456 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:26:18.529 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:26:18.531 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:26:33.616 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:26:33.618 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:26:48.704 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:26:48.706 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:27:03.796 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:27:03.797 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:27:18.882 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:27:18.885 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:27:33.973 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:27:33.975 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:27:49.072 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:27:49.073 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:28:04.160 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:28:04.161 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:28:19.236 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:28:19.237 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:28:34.312 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:28:34.313 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:28:49.384 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-08-11T01:28:49.385 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-08-11T01:28:49.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:28:49.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:28:52.500 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-08-11T01:28:52.501 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-08-11T01:28:58.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:28:58.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:01.584 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-08-11T01:29:01.585 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-08-11T01:29:07.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:07.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:10.644 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-08-11T01:29:10.645 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-08-11T01:29:16.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:16.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:19.728 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-08-11T01:29:19.729 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-08-11T01:29:25.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:25.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:28.784 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-08-11T01:29:28.785 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-08-11T01:29:34.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:34.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:29:37.872 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-08-11T01:29:43.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:30:34.844 WARNING:teuthology.provision.fog.smithi191:timed out
2023-08-11T01:30:40.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:30:41.085 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-11T01:30:41.086 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-11T01:30:41.400 INFO:teuthology.provision.fog.smithi191:Node is ready
2023-08-11T01:30:41.401 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2023-08-11T01:30:41.457 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2023-08-11T01:30:41.457 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2023-08-11T01:30:41.514 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2023-08-11T01:30:41.515 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-08-11T01:30:41.623 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2023-08-11T01:30:41.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2023-08-11T01:30:41.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2023-08-11T01:30:41.781 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-08-11T01:30:41.847 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2023-08-11T01:30:41.905 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux"
2023-08-11T01:30:41.905 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.4 (Ootpa)"
2023-08-11T01:30:41.905 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel"
2023-08-11T01:30:41.905 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora"
2023-08-11T01:30:41.905 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.4"
2023-08-11T01:30:41.906 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2023-08-11T01:30:41.906 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-11T01:30:41.906 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2023-08-11T01:30:41.906 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-11T01:30:41.906 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/"
2023-08-11T01:30:41.906 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-11T01:30:41.906 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-11T01:30:41.907 INFO:teuthology.orchestra.run.smithi191.stdout:
2023-08-11T01:30:41.907 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-11T01:30:41.907 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-11T01:30:41.907 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-11T01:30:41.907 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-11T01:30:41.908 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2023-08-11T01:30:41.909 DEBUG:teuthology.parallel:result is None
2023-08-11T01:30:43.882 WARNING:teuthology.provision.fog.smithi132:timed out
2023-08-11T01:30:49.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:30:50.235 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-11T01:30:50.235 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-11T01:30:50.477 INFO:teuthology.provision.fog.smithi132:Node is ready
2023-08-11T01:30:50.477 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2023-08-11T01:30:50.491 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2023-08-11T01:30:50.492 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2023-08-11T01:30:50.549 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2023-08-11T01:30:50.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-08-11T01:30:50.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2023-08-11T01:30:50.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2023-08-11T01:30:50.751 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2023-08-11T01:30:50.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-08-11T01:30:50.884 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-08-11T01:30:50.941 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2023-08-11T01:30:50.942 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)"
2023-08-11T01:30:50.942 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2023-08-11T01:30:50.942 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2023-08-11T01:30:50.943 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4"
2023-08-11T01:30:50.943 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-08-11T01:30:50.943 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-11T01:30:50.943 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-08-11T01:30:50.943 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-11T01:30:50.943 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2023-08-11T01:30:50.944 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-11T01:30:50.944 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-11T01:30:50.944 INFO:teuthology.orchestra.run.smithi132.stdout:
2023-08-11T01:30:50.944 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-11T01:30:50.944 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-11T01:30:50.944 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-11T01:30:50.945 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-11T01:30:50.945 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2023-08-11T01:30:50.946 DEBUG:teuthology.parallel:result is None
2023-08-11T01:30:51.091 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2023-08-11T01:30:51.092 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-11T01:30:51.116 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2023-08-11T01:30:51.116 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-11T01:30:51.133 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2023-08-11T01:30:51.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-08-11T01:30:51.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:30:51.198 DEBUG:teuthology.orchestra.run.smithi132:> true
2023-08-11T01:30:51.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-08-11T01:30:51.262 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2023-08-11T01:30:51.314 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2023-08-11T01:30:51.315 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-08-11T01:30:51.368 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2023-08-11T01:30:51.368 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)"
2023-08-11T01:30:51.368 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2023-08-11T01:30:51.369 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2023-08-11T01:30:51.369 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4"
2023-08-11T01:30:51.369 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-08-11T01:30:51.370 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-11T01:30:51.370 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-08-11T01:30:51.370 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-11T01:30:51.370 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2023-08-11T01:30:51.371 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-11T01:30:51.371 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-11T01:30:51.372 INFO:teuthology.orchestra.run.smithi132.stdout:
2023-08-11T01:30:51.372 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-11T01:30:51.372 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-11T01:30:51.372 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-11T01:30:51.373 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-11T01:30:51.373 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-08-11T01:30:51.391 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2023-08-11T01:30:51.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2023-08-11T01:30:51.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T01:30:51.458 DEBUG:teuthology.orchestra.run.smithi191:> true
2023-08-11T01:30:51.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2023-08-11T01:30:51.536 DEBUG:teuthology.orchestra.run.smithi191:> uname -m
2023-08-11T01:30:51.591 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2023-08-11T01:30:51.592 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2023-08-11T01:30:51.664 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux"
2023-08-11T01:30:51.664 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.4 (Ootpa)"
2023-08-11T01:30:51.665 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel"
2023-08-11T01:30:51.665 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora"
2023-08-11T01:30:51.665 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.4"
2023-08-11T01:30:51.667 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2023-08-11T01:30:51.667 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-11T01:30:51.668 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2023-08-11T01:30:51.668 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-11T01:30:51.668 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/"
2023-08-11T01:30:51.668 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-11T01:30:51.669 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-11T01:30:51.669 INFO:teuthology.orchestra.run.smithi191.stdout:
2023-08-11T01:30:51.669 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-11T01:30:51.670 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-11T01:30:51.670 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-11T01:30:51.670 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-11T01:30:51.671 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-08-11T01:30:51.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:30:51.780 INFO:teuthology.dispatcher.supervisor:Running job 7365656
2023-08-11T01:30:51.780 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-10_20:15:49-fs-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7365656 --name yuriw-2023-08-10_20:15:49-fs-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi --description fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} -- /home/teuthworker/archive/yuriw-2023-08-10_20:15:49-fs-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7365656/orig.config.yaml
2023-08-11T01:30:51.784 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-10_20:15:49-fs-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7365656
2023-08-11T01:30:51.785 INFO:teuthology.dispatcher.supervisor:Job PID: 20824
2023-08-11T01:30:51.786 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-11T01:32:51.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:34:52.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:36:52.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:38:52.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:40:52.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:42:52.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:44:52.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:46:53.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:48:53.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T01:48:53.332 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-11T01:48:53.431 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-11T01:48:53.432 INFO:teuthology.nuke:Checking targets against current locks
2023-08-11T01:48:53.483 DEBUG:teuthology.nuke:shortname: smithi132
2023-08-11T01:48:53.484 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-11T01:48:53.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-10_20:15:49-fs-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7365656', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 01:25:45.071938', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX3Sz4TvwQzb5sM/UFK7Nq2cCTWuIjM9Snch2Rqxl8hOM3Pfj+hBcqYIzLU/snsvtETEYPcqVlZHkFAeDV2/2gLrlro8uInSSoqPezaBMsduUnwLYGZBKefal3s5Si7usrMOOW+aZ9D/LZl9e9bbpxZK2g37ewTWPJhdtnU8Y2IISRUfmszj/DoSbrSw2ul85MnvJlUsIKNYGyd0o4u96rAp5iYyqh/pZVsCkHVC0DgR1EiJU7iN7KoJPzaf1oolu1mIFMN58iJyjXMStHDisYc0/vXc8+GViPZ6IFw3Up2x6Gb2phXim3AmSMGJMTduPdygWqfwI7pBYbyXckmEYAqoENuqW/hwLRtf0XZPVO5zSF33ijGt4HEamQLbzsIIuviTh7aIpk0aSDv4Z0woxE9wlWLOGGYlQrHwZrwu5q58Dq8iDNLfp/25LJRATDD0w/JBJcqxEG3pi08Wqtk9nv6P+VLr1BbvuAU5939t08HelErOio8/49CULU1C7jaKM='}
2023-08-11T01:48:53.511 DEBUG:teuthology.nuke:shortname: smithi191
2023-08-11T01:48:53.512 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-11T01:48:53.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-10_20:15:49-fs-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7365656', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 01:25:45.070923', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD190LZrshB3A11BU9OAGm8p6zR5LKKfqoCjqCKpZ+TBxsh2zfIHQGbg4YBTQaVbdCnA5GIpNNFiNiiD7HR7mT7gfPsRw2rrY0pbIom78vPXFm34gFI7ck6s1IwQEU+7TXnv4DV2eAHajRzihO+UmwFisl0H3pxXGX6uEcS3aGxKGVMpTcE7B9PeD2f4qDZX+EjZo2zoCViDxIlgd9t/HtOlZcTHKmUzkv5xzo98sl4OO7XdpKEkbMPcWsyKgNd5tB8hROFdQ0Vn/1R5ia152a/vs8slWhALSVlDcENXe+sEKXQm2M67bZo0Ji8PQRW0nFbevtepRqRqCShUt1fonPCaDpJtLTH+hZAl0xjWOrjIcqqewTtL2F7gepWb/XFug/vIFxcql2wkxA9cBZ0zBsaqqcP5FRxOP1tZqPWXkekk9Sc9I43v7nI4PWw808DamUlsErFZ6KFZU255oFa/FBxjShsvo6im9nDlg0N6N6dBmnkc/FEjCkEZrj4ahRQF7s='}
2023-08-11T01:48:53.568 INFO:teuthology.orchestra.console.smithi132:Power off
2023-08-11T01:48:53.569 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-11T01:48:53.591 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-08-11T01:48:53.592 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:48:53.615 INFO:teuthology.orchestra.console.smithi191:Power off
2023-08-11T01:48:53.616 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-11T01:48:53.627 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-08-11T01:48:53.639 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2023-08-11T01:48:53.639 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T01:48:53.662 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-08-11T01:48:53.729 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-08-11T01:48:53.764 INFO:teuthology.orchestra.console.smithi191:Power off completed
2023-08-11T01:48:53.881 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com
2023-08-11T01:48:53.907 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com