2024-01-12T13:09:48.704 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-12T13:09:48.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:09:48.855 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9dcff79f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9dd0fdfc10>, signals=[15])
2024-01-12T13:09:48.855 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-01-12T13:09:48.856 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-01-12T13:09:48.856 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-01-12T13:09:48.879 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2024-01-12T13:09:48.879 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2024-01-12T13:09:48.879 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-12T13:09:48.990 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-12T13:09:49.017 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-12T13:09:49.032 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6
2024-01-12T13:09:49.059 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.6
2024-01-12T13:09:49.223 INFO:teuthology.orchestra.console.smithi027:Power off
2024-01-12T13:09:49.224 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-12T13:09:49.246 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-01-12T13:09:49.246 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T13:09:49.265 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-01-12T13:09:49.307 INFO:teuthology.orchestra.console.smithi159:Power off
2024-01-12T13:09:49.307 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-12T13:09:49.329 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2024-01-12T13:09:49.329 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T13:09:49.350 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-12T13:09:49.366 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-01-12T13:09:49.451 INFO:teuthology.orchestra.console.smithi159:Power off completed
2024-01-12T13:09:49.467 INFO:teuthology.orchestra.console.smithi027:Power on
2024-01-12T13:09:49.467 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-12T13:09:49.487 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-01-12T13:09:49.488 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T13:09:49.508 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-01-12T13:09:49.552 INFO:teuthology.orchestra.console.smithi159:Power on
2024-01-12T13:09:49.552 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-12T13:09:49.573 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2024-01-12T13:09:49.573 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T13:09:49.592 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-12T13:09:53.509 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T13:09:53.594 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T13:09:53.619 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-01-12T13:09:53.702 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2024-01-12T13:09:53.803 INFO:teuthology.orchestra.console.smithi159:Power on completed
2024-01-12T13:09:53.903 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2024-01-12T13:09:57.623 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-12T13:09:57.732 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-01-12T13:09:57.832 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-01-12T13:09:57.933 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-01-12T13:12:54.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:12:58.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:13.276 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-12T13:13:17.116 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:13:19.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:22.332 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-12T13:13:23.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:26.172 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:13:28.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:31.388 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-12T13:13:32.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:35.228 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:13:37.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:40.444 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-12T13:13:41.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:44.284 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:13:46.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:49.500 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-12T13:13:50.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:53.404 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:13:55.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:13:59.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:14:02.460 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:14:08.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:14:11.548 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:14:17.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:14:35.964 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:14:41.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:14:45.020 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:14:51.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:14:54.108 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-01-12T13:14:55.508 WARNING:teuthology.provision.fog.smithi159:timed out
2024-01-12T13:15:00.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:15:00.343 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-12T13:15:00.344 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-12T13:15:01.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:15:01.774 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-12T13:15:01.775 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-12T13:15:02.064 INFO:teuthology.provision.fog.smithi159:Node is ready
2024-01-12T13:15:02.065 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2024-01-12T13:15:02.084 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2024-01-12T13:15:02.084 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2024-01-12T13:15:02.144 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2024-01-12T13:15:02.144 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-12T13:15:02.269 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2024-01-12T13:15:02.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2024-01-12T13:15:02.368 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2024-01-12T13:15:02.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-12T13:15:02.504 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-12T13:15:02.561 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2024-01-12T13:15:02.561 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2024-01-12T13:15:02.561 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2024-01-12T13:15:02.561 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2024-01-12T13:15:02.561 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2024-01-12T13:15:02.561 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-12T13:15:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-12T13:15:02.563 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2024-01-12T13:15:02.564 DEBUG:teuthology.parallel:result is None
2024-01-12T13:15:16.283 INFO:teuthology.provision.fog.smithi027:Node is ready
2024-01-12T13:15:16.284 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2024-01-12T13:15:16.306 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2024-01-12T13:15:16.306 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2024-01-12T13:15:16.366 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2024-01-12T13:15:16.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-01-12T13:15:16.501 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2024-01-12T13:15:16.533 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2024-01-12T13:15:16.603 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2024-01-12T13:15:16.673 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-01-12T13:15:16.742 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-01-12T13:15:16.800 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux"
2024-01-12T13:15:16.800 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)"
2024-01-12T13:15:16.800 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel"
2024-01-12T13:15:16.800 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora"
2024-01-12T13:15:16.800 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-12T13:15:16.801 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-12T13:15:16.801 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2024-01-12T13:15:16.802 DEBUG:teuthology.parallel:result is None
2024-01-12T13:15:16.965 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2024-01-12T13:15:16.965 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-12T13:15:16.991 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2024-01-12T13:15:16.992 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-12T13:15:17.009 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2024-01-12T13:15:17.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-01-12T13:15:17.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:15:17.079 DEBUG:teuthology.orchestra.run.smithi027:> true
2024-01-12T13:15:17.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-01-12T13:15:17.146 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2024-01-12T13:15:17.203 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2024-01-12T13:15:17.203 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-01-12T13:15:17.260 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux"
2024-01-12T13:15:17.260 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)"
2024-01-12T13:15:17.260 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel"
2024-01-12T13:15:17.260 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora"
2024-01-12T13:15:17.260 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6"
2024-01-12T13:15:17.260 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-12T13:15:17.261 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-12T13:15:17.261 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-01-12T13:15:17.283 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2024-01-12T13:15:17.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-12T13:15:17.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-12T13:15:17.354 DEBUG:teuthology.orchestra.run.smithi159:> true
2024-01-12T13:15:17.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-12T13:15:17.489 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2024-01-12T13:15:17.547 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2024-01-12T13:15:17.547 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-12T13:15:17.604 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:
2024-01-12T13:15:17.605 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-12T13:15:17.606 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-12T13:15:17.606 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-12T13:15:17.606 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-12T13:15:17.606 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-12T13:15:17.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:15:17.714 INFO:teuthology.dispatcher.supervisor:Running job 7514129
2024-01-12T13:15:17.714 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-01-12_13:08:48-fs:volumes-rishabh-clone-stats-testing-default-smithi/7514129 --name rishabh-2024-01-12_13:08:48-fs:volumes-rishabh-clone-stats-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}} -- /home/teuthworker/archive/rishabh-2024-01-12_13:08:48-fs:volumes-rishabh-clone-stats-testing-default-smithi/7514129/orig.config.yaml
2024-01-12T13:15:17.717 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-01-12_13:08:48-fs:volumes-rishabh-clone-stats-testing-default-smithi/7514129
2024-01-12T13:15:17.717 INFO:teuthology.dispatcher.supervisor:Job PID: 2473094
2024-01-12T13:15:17.717 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-12T13:17:17.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:19:17.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:21:18.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:23:18.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:25:18.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:27:18.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:29:18.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:31:18.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:33:19.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:35:19.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:37:19.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:39:19.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:41:19.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:43:19.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:45:19.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:47:20.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:49:20.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:51:20.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:53:20.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:55:20.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:57:20.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T13:59:21.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:01:21.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:03:21.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:05:21.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:07:21.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:09:21.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:11:22.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:13:22.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:15:22.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:17:22.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:19:22.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:21:22.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:23:22.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:25:23.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:27:23.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:29:23.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:31:23.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:33:23.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:35:23.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:37:24.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:39:24.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:41:24.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:43:24.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:45:24.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:47:25.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:49:25.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:51:25.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:53:25.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:55:25.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:57:25.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T14:59:25.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:01:26.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:03:26.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:05:26.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:07:26.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:09:26.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:11:26.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:13:27.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:15:27.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:17:27.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:19:27.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:21:27.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:23:27.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:25:27.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:27:28.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:29:28.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:31:28.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:33:28.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:35:28.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:37:28.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:39:29.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:41:29.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-12T15:41:29.358 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-12T15:41:29.475 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi/7514171
2024-01-12T15:41:29.475 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi159 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-01-12_15:17:53-fs-main-distro-default-smithi/7514171