2023-10-11T04:09:39.061 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-11T04:09:39.062 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} --archive /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047 --owner scheduled_yingxin@teuthology -- /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/orig.config.yaml 2023-10-11T04:09:39.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-11T04:09:39.173 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047 branch: wip-yingxin-crimson-osd-crosscore-pg-submission description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: yingxin.cheng@intel.com first_in_suite: false job_id: '7421047' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yingxin-crimson-osd-crosscore-pg-submission ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson seastar smp: 3 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: crimson sha1: 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 workunit: branch: wip-yingxin-crimson-osd-crosscore-pg-submission env: CRIMSON_COMPAT: '1' sha1: 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 owner: scheduled_yingxin@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b sha1: 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-yingxin-crimson-osd-crosscore-pg-submission suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHH5ZT9sWcQ8M4I8bkHT3BMU232ofSnO8QLN7IgAcS2FY9NQNErb1d4QN2P0rhrFLcjfsVPAOeFyTCYAIbJImXw= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/b3CFSmLCP42k6y/5pgjPhbw7SHls1sk0jQCh9vjQNd3Pw15xxVZSYGGV7GAKD7Oyj35Z1gvanyBWDdqpo3PE= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-11_02:17:04 tube: smithi user: yingxin verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-11T04:09:39.173 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa; will attempt to use it 2023-10-11T04:09:39.174 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks 2023-10-11T04:09:39.174 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-11T04:09:39.176 INFO:teuthology.task.internal:Checking packages... 2023-10-11T04:09:39.202 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5' 2023-10-11T04:09:39.202 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-11T04:09:39.203 INFO:teuthology.packaging:ref: None 2023-10-11T04:09:39.203 INFO:teuthology.packaging:tag: None 2023-10-11T04:09:39.203 INFO:teuthology.packaging:branch: wip-yingxin-crimson-osd-crosscore-pg-submission 2023-10-11T04:09:39.204 INFO:teuthology.packaging:sha1: 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 2023-10-11T04:09:39.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-yingxin-crimson-osd-crosscore-pg-submission 2023-10-11T04:09:39.352 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6684.g9587ffdf 2023-10-11T04:09:39.352 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-11T04:09:39.359 INFO:teuthology.task.internal:no buildpackages task found 2023-10-11T04:09:39.359 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-11T04:09:39.369 INFO:teuthology.task.internal:Saving configuration 2023-10-11T04:09:39.381 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-11T04:09:39.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-11T04:09:39.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 04:04:25.077623', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHH5ZT9sWcQ8M4I8bkHT3BMU232ofSnO8QLN7IgAcS2FY9NQNErb1d4QN2P0rhrFLcjfsVPAOeFyTCYAIbJImXw='} 2023-10-11T04:09:39.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 04:04:25.076117', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/b3CFSmLCP42k6y/5pgjPhbw7SHls1sk0jQCh9vjQNd3Pw15xxVZSYGGV7GAKD7Oyj35Z1gvanyBWDdqpo3PE='} 2023-10-11T04:09:39.437 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-11T04:09:39.444 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2023-10-11T04:09:39.445 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-10-11T04:09:39.445 INFO:teuthology.run_tasks:Running task console_log... 2023-10-11T04:09:39.518 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe127917940>, signals=[15]) 2023-10-11T04:09:39.519 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-11T04:09:39.525 INFO:teuthology.task.internal:Opening connections... 2023-10-11T04:09:39.525 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-10-11T04:09:39.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:09:39.626 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-10-11T04:09:39.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:09:39.709 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-11T04:09:39.716 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-10-11T04:09:39.735 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-10-11T04:09:39.736 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-10-11T04:09:39.794 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-10-11T04:09:39.794 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2023-10-11T04:09:39.794 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-10-11T04:09:39.794 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-10-11T04:09:39.795 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2023-10-11T04:09:39.795 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2023-10-11T04:09:39.795 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-11T04:09:39.795 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-10-11T04:09:39.795 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2023-10-11T04:09:39.796 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-11T04:09:39.796 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-10-11T04:09:39.796 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-11T04:09:39.796 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-11T04:09:39.796 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-11T04:09:39.797 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-10-11T04:09:39.816 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-11T04:09:39.833 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-11T04:09:39.833 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-11T04:09:39.889 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-10-11T04:09:39.890 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-10-11T04:09:39.890 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-10-11T04:09:39.890 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-10-11T04:09:39.890 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-10-11T04:09:39.891 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-10-11T04:09:39.891 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-11T04:09:39.891 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-10-11T04:09:39.891 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-10-11T04:09:39.891 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-11T04:09:39.892 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-10-11T04:09:39.892 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-11T04:09:39.892 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-11T04:09:39.892 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-11T04:09:39.893 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-11T04:09:39.915 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-11T04:09:39.924 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-11T04:09:39.931 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-11T04:09:39.931 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-10-11T04:09:39.934 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-10-11T04:09:39.950 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-11T04:09:39.955 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-11T04:09:39.956 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-10-11T04:09:39.992 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-10-11T04:09:40.020 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-11T04:09:40.072 INFO:teuthology.run_tasks:Running task kernel... 2023-10-11T04:09:40.087 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-11T04:09:40.088 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-11T04:09:40.088 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-11T04:09:40.089 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-11T04:09:40.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T04:09:40.105 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-11T04:09:40.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T04:09:40.107 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-11T04:09:40.161 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-361.el9.x86_64 2023-10-11T04:09:40.161 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.14.0-361.el9.x86_64 2023-10-11T04:09:40.161 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum install -y kernel 2023-10-11T04:09:40.165 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-361.el9.x86_64 2023-10-11T04:09:40.165 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-361.el9.x86_64 2023-10-11T04:09:40.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2023-10-11T04:09:42.301 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-10-11T04:09:42.384 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-10-11T04:09:43.693 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2023-10-11T04:09:43.959 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2023-10-11T04:09:44.992 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 7.9 MB 00:00 2023-10-11T04:09:45.541 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 7.9 MB 00:01 2023-10-11T04:09:47.837 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-10-11T04:09:48.234 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-10-11T04:09:52.793 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 5.7 MB 00:01 2023-10-11T04:09:52.877 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.7 MB 00:01 2023-10-11T04:09:54.235 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 14 kB 00:00 2023-10-11T04:09:55.395 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-10-11T04:09:55.402 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 14 kB 00:01 2023-10-11T04:09:56.829 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 14 MB/s | 19 MB 00:01 2023-10-11T04:09:59.987 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-10-11T04:10:01.504 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2023-10-11T04:10:02.043 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-11T04:10:02.044 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-11T04:10:02.133 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:10:02.149 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:10:02.149 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:10:02.150 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:10:02.150 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:10:02.150 INFO:teuthology.orchestra.run.smithi151.stdout: kernel x86_64 5.14.0-373.el9 CentOS-BaseOS 5.2 M 2023-10-11T04:10:02.150 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:10:02.150 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-core x86_64 5.14.0-373.el9 CentOS-BaseOS 20 M 2023-10-11T04:10:02.151 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules x86_64 5.14.0-373.el9 CentOS-BaseOS 37 M 2023-10-11T04:10:02.151 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules-core x86_64 5.14.0-373.el9 CentOS-BaseOS 32 M 2023-10-11T04:10:02.151 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:10:02.151 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:10:02.151 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:10:02.152 INFO:teuthology.orchestra.run.smithi151.stdout:Install 4 Packages 2023-10-11T04:10:02.152 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:10:02.152 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 94 M 2023-10-11T04:10:02.152 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 120 M 2023-10-11T04:10:02.152 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:10:02.480 INFO:teuthology.orchestra.run.smithi151.stdout:(1/4): kernel-5.14.0-373.el9.x86_64.rpm 16 MB/s | 5.2 MB 00:00 2023-10-11T04:10:03.113 INFO:teuthology.orchestra.run.smithi151.stdout:(2/4): kernel-core-5.14.0-373.el9.x86_64.rpm 21 MB/s | 20 MB 00:00 2023-10-11T04:10:03.530 INFO:teuthology.orchestra.run.smithi151.stdout:(3/4): kernel-modules-5.14.0-373.el9.x86_64.rpm 27 MB/s | 37 MB 00:01 2023-10-11T04:10:03.636 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-11T04:10:03.636 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-11T04:10:03.733 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:10:03.739 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:10:03.740 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:10:03.740 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:10:03.740 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:10:03.740 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-373.el9 CentOS-BaseOS 5.2 M 2023-10-11T04:10:03.741 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:10:03.741 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-373.el9 CentOS-BaseOS 20 M 2023-10-11T04:10:03.741 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-373.el9 CentOS-BaseOS 37 M 2023-10-11T04:10:03.741 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-373.el9 CentOS-BaseOS 32 M 2023-10-11T04:10:03.741 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:10:03.741 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:10:03.742 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:10:03.742 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2023-10-11T04:10:03.742 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:10:03.743 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 94 M 2023-10-11T04:10:03.743 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 120 M 2023-10-11T04:10:03.743 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:10:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:(4/4): kernel-modules-core-5.14.0-373.el9.x86_6 22 MB/s | 32 MB 00:01 2023-10-11T04:10:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:10:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:Total 52 MB/s | 94 MB 00:01 2023-10-11T04:10:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:10:04.063 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-373.el9.x86_64.rpm 16 MB/s | 5.2 MB 00:00 2023-10-11T04:10:04.329 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:10:04.329 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:10:04.514 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-core-5.14.0-373.el9.x86_64.rpm 26 MB/s | 20 MB 00:00 2023-10-11T04:10:05.114 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-core-5.14.0-373.el9.x86_6 31 MB/s | 32 MB 00:01 2023-10-11T04:10:05.314 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:10:05.315 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:10:05.556 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-modules-5.14.0-373.el9.x86_64.rpm 21 MB/s | 37 MB 00:01 2023-10-11T04:10:05.559 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:10:05.559 INFO:teuthology.orchestra.run.smithi050.stdout:Total 52 MB/s | 94 MB 00:01 2023-10-11T04:10:05.560 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:10:05.992 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:10:05.992 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:10:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:10:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:10:07.715 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:10:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-modules-core-5.14.0-373.el9.x86_64 1/4 2023-10-11T04:10:08.539 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-core-5.14.0-373.el9.x86_64 2/4 2023-10-11T04:10:09.556 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:10:10.214 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-373.el9.x86_64 1/4 2023-10-11T04:10:10.331 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-373.el9.x86_64 2/4 2023-10-11T04:10:11.266 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-core-5.14.0-373.el9.x86_64 2/4 2023-10-11T04:10:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-modules-5.14.0-373.el9.x86_64 3/4 2023-10-11T04:10:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-373.el9.x86_64 2/4 2023-10-11T04:10:13.427 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-373.el9.x86_64 3/4 2023-10-11T04:10:16.026 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-modules-5.14.0-373.el9.x86_64 3/4 2023-10-11T04:10:16.360 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : kernel-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-373.el9.x86_64 3/4 2023-10-11T04:10:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:20.999 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-modules-core-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-core-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-modules-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-5.14.0-373.el9.x86_64 1/4 2023-10-11T04:10:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-core-5.14.0-373.el9.x86_64 2/4 2023-10-11T04:10:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-modules-5.14.0-373.el9.x86_64 3/4 2023-10-11T04:10:50.562 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-modules-core-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:50.562 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:10:50.562 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:10:50.563 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-5.14.0-373.el9.x86_64 2023-10-11T04:10:50.563 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-core-5.14.0-373.el9.x86_64 2023-10-11T04:10:50.563 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules-5.14.0-373.el9.x86_64 2023-10-11T04:10:50.563 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-modules-core-5.14.0-373.el9.x86_64 2023-10-11T04:10:50.563 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:10:50.564 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:10:51.048 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T04:10:51.178 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-5.14.0-373.el9.x86_64 2023-10-11T04:10:51.178 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-373.el9.x86_64 2023-10-11T04:10:51.178 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-373.el9.x86_64 2023-10-11T04:10:51.179 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-11T04:10:51.179 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-11T04:10:51.179 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-10-11T04:10:51.179 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2023-10-11T04:10:51.180 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T04:10:51.284 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-5.14.0-373.el9.x86_64 2023-10-11T04:10:51.285 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-373.el9.x86_64 2023-10-11T04:10:51.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-10-11T04:10:51.326 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-10-11T04:10:51.326 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-10-11T04:10:51.326 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2023-10-11T04:10:51.327 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 68.el9 2023-10-11T04:10:51.327 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-10-11T04:10:51.327 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-11T04:10:51.327 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2023-10-11T04:10:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8264254 2023-10-11T04:10:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-10-11T04:10:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-11T04:10:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-11T04:10:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-11T04:10:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-11T04:10:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2023-10-11T04:10:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2023-10-11T04:10:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-11T04:10:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-10-11T04:10:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-10-11T04:10:51.330 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:10:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-11T04:10:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-11T04:10:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-11T04:10:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-10-11T04:10:51.331 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:10:51.331 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-10-11T04:10:51.332 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-11T04:10:51.332 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 5.14.0-373.el9.x86_64 2023-10-11T04:10:51.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-11T04:10:51.936 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-10-11T04:10:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-11T04:10:53.509 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-10-11T04:10:53.511 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-10-11T04:10:53.568 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.MXcutTC3HG 2023-10-11T04:10:53.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MXcutTC3HG 2023-10-11T04:10:53.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.MXcutTC3HG 2023-10-11T04:10:53.785 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.MXcutTC3HG is 6KB 2023-10-11T04:10:53.835 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.MXcutTC3HG 2023-10-11T04:10:53.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-10-11T04:10:53.914 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-11T04:10:53.914 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-11T04:10:53.914 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-11T04:10:53.915 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-373.el9.x86_64.conf 2023-10-11T04:10:53.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-373.el9.x86_64 2023-10-11T04:10:53.965 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:54.010 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:54.064 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-10-11T04:10:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-373.el9.x86_64 1/4 2023-10-11T04:10:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-373.el9.x86_64 2/4 2023-10-11T04:10:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-373.el9.x86_64 3/4 2023-10-11T04:10:54.798 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-373.el9.x86_64 4/4 2023-10-11T04:10:54.799 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:10:54.799 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:10:54.799 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-373.el9.x86_64 2023-10-11T04:10:54.800 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-373.el9.x86_64 2023-10-11T04:10:54.800 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-373.el9.x86_64 2023-10-11T04:10:54.800 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-373.el9.x86_64 2023-10-11T04:10:54.801 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:10:54.801 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:10:55.334 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T04:10:55.464 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-373.el9.x86_64 2023-10-11T04:10:55.464 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-373.el9.x86_64 2023-10-11T04:10:55.465 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-373.el9.x86_64 2023-10-11T04:10:55.465 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-11T04:10:55.465 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-11T04:10:55.465 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-11T04:10:55.465 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2023-10-11T04:10:55.466 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T04:10:55.575 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-373.el9.x86_64 2023-10-11T04:10:55.575 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-373.el9.x86_64 2023-10-11T04:10:55.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2023-10-11T04:10:55.613 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2023-10-11T04:10:55.614 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2023-10-11T04:10:55.614 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2023-10-11T04:10:55.614 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 68.el9 2023-10-11T04:10:55.614 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2023-10-11T04:10:55.615 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-11T04:10:55.615 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2023-10-11T04:10:55.615 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8264254 2023-10-11T04:10:55.615 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2023-10-11T04:10:55.615 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-11T04:10:55.616 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-11T04:10:55.616 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-11T04:10:55.616 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-11T04:10:55.616 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2023-10-11T04:10:55.616 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2023-10-11T04:10:55.617 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-11T04:10:55.617 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2023-10-11T04:10:55.617 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2023-10-11T04:10:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:10:55.617 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-11T04:10:55.618 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-11T04:10:55.618 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-11T04:10:55.618 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2023-10-11T04:10:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:10:55.618 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2023-10-11T04:10:55.619 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-11T04:10:55.619 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-373.el9.x86_64 2023-10-11T04:10:55.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-11T04:10:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-10-11T04:10:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-11T04:10:57.548 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-10-11T04:10:57.551 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-11T04:10:57.566 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.L72hszyxPT 2023-10-11T04:10:57.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.L72hszyxPT 2023-10-11T04:10:57.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.L72hszyxPT 2023-10-11T04:10:57.786 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.L72hszyxPT is 6KB 2023-10-11T04:10:57.835 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.L72hszyxPT 2023-10-11T04:10:57.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2023-10-11T04:10:57.918 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-11T04:10:57.918 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-11T04:10:57.918 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-11T04:10:57.919 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-373.el9.x86_64.conf 2023-10-11T04:10:57.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-373.el9.x86_64 2023-10-11T04:10:58.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-10-11T04:11:24.090 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-10-11T04:11:24.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-11T04:11:24.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:11:28.082 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-11T04:11:28.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-11T04:11:28.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:11:42.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-11T04:11:51.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-11T04:11:51.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:11:54.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-11T04:12:06.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-11T04:12:06.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:12:28.106 DEBUG:teuthology.orchestra.remote:timed out 2023-10-11T04:12:37.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-11T04:12:37.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:12:37.482 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-11T04:12:37.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-11T04:12:37.846 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-373.el9.x86_64"... 2023-10-11T04:12:37.846 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-11T04:12:37.861 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-373.el9.x86_64 2023-10-11T04:12:37.862 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-373.el9.x86_64 vs 5.14.0-373.el9.x86_64 2023-10-11T04:12:37.862 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-11T04:12:37.862 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-11T04:12:38.863 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-11T04:12:38.864 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-11T04:12:38.940 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2023-10-11T04:12:38.984 DEBUG:teuthology.parallel:result is None 2023-10-11T04:13:06.665 DEBUG:teuthology.orchestra.remote:timed out 2023-10-11T04:13:21.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-11T04:13:21.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:13:22.035 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-11T04:13:22.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-11T04:13:22.401 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-373.el9.x86_64"... 2023-10-11T04:13:22.401 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-11T04:13:22.416 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-373.el9.x86_64 2023-10-11T04:13:22.416 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-373.el9.x86_64 vs 5.14.0-373.el9.x86_64 2023-10-11T04:13:22.416 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-11T04:13:22.417 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-11T04:13:23.418 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-10-11T04:13:23.419 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-11T04:13:23.493 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2023-10-11T04:13:23.532 DEBUG:teuthology.parallel:result is None 2023-10-11T04:13:23.533 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-11T04:13:23.540 INFO:teuthology.task.internal:Creating test directory... 2023-10-11T04:13:23.540 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-11T04:13:23.544 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-11T04:13:23.561 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-11T04:13:23.568 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-11T04:13:23.575 INFO:teuthology.task.internal:Creating archive directory... 2023-10-11T04:13:23.575 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-11T04:13:23.602 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-11T04:13:23.631 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-11T04:13:23.639 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-11T04:13:23.639 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-11T04:13:23.664 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-11T04:13:23.702 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T04:13:23.703 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T04:13:23.717 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T04:13:23.720 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T04:13:23.721 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-11T04:13:23.728 INFO:teuthology.task.internal:Configuring sudo... 2023-10-11T04:13:23.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-11T04:13:23.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-11T04:13:23.795 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-11T04:13:23.804 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-11T04:13:23.805 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-11T04:13:23.838 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-11T04:13:23.854 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T04:13:23.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T04:13:23.995 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T04:13:24.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T04:13:24.127 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:13:24.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-11T04:13:24.200 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T04:13:24.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T04:13:24.298 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T04:13:24.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T04:13:24.423 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:13:24.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-11T04:13:24.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-10-11T04:13:24.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-10-11T04:13:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-11T04:13:24.575 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-11T04:13:24.986 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-11T04:13:24.994 INFO:teuthology.task.internal:Starting timer... 2023-10-11T04:13:24.994 INFO:teuthology.run_tasks:Running task pcp... 2023-10-11T04:13:25.009 INFO:teuthology.run_tasks:Running task selinux... 2023-10-11T04:13:25.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-10-11T04:13:25.097 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2023-10-11T04:13:25.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-10-11T04:13:25.155 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-10-11T04:13:25.157 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-11T04:13:25.157 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-10-11T04:13:25.177 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-10-11T04:13:25.178 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-10-11T04:13:25.201 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-10-11T04:13:25.201 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-10-11T04:13:25.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-11T04:13:25.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T04:13:25.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-11T04:13:25.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T04:13:25.279 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-11T04:13:25.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-10-11T04:13:25.338 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-10-11T04:13:25.376 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-11T04:13:25.386 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-11T04:13:25.387 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-11T04:13:25.404 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-11T04:13:25.405 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-11T04:18:53.814 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-10-11T04:18:53.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-11T04:18:53.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:18:53.914 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-11T04:18:53.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-11T04:18:53.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-11T04:18:53.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T04:18:54.064 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-11T04:18:54.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-11T04:18:54.135 INFO:teuthology.run_tasks:Running task clock... 2023-10-11T04:18:54.145 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-11T04:18:54.146 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-11T04:18:54.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-11T04:18:54.149 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-11T04:18:54.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-11T04:18:54.183 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-11T04:18:54.204 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-11T04:18:54.206 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-11T04:18:54.222 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-11T04:18:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-10-11T04:18:54.252 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-10-11T04:18:54.257 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-10-11T04:18:54.266 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-10-11T04:18:54.277 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-11T04:18:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-11T04:18:54.296 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-11T04:18:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-11T04:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-10-11T04:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-10-11T04:18:54.345 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-11T04:18:54.345 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-11T04:18:54.346 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.346 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.346 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.346 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.348 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-11T04:18:54.348 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-11T04:18:54.348 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.348 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.348 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.349 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T04:18:54.350 INFO:teuthology.run_tasks:Running task install... 2023-10-11T04:18:54.358 DEBUG:teuthology.task.install:project ceph 2023-10-11T04:18:54.359 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5'}} 2023-10-11T04:18:54.359 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5'} 2023-10-11T04:18:54.359 INFO:teuthology.task.install:Using flavor: crimson 2023-10-11T04:18:54.365 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-11T04:18:54.365 INFO:teuthology.task.install:extra packages: [] 2023-10-11T04:18:54.366 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5', 'tag': None, 'wait_for_package': False} 2023-10-11T04:18:54.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 2023-10-11T04:18:54.368 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5', 'tag': None, 'wait_for_package': False} 2023-10-11T04:18:54.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 2023-10-11T04:18:54.514 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/ 2023-10-11T04:18:54.514 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6684.g9587ffdf 2023-10-11T04:18:54.519 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/ 2023-10-11T04:18:54.519 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6684.g9587ffdf 2023-10-11T04:18:54.625 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-11T04:18:54.625 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:18:54.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-11T04:18:54.658 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-11T04:18:54.659 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-11T04:18:54.687 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yingxin-crimson-osd-crosscore-pg-submission/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-11T04:18:54.687 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:18:54.687 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-11T04:18:54.716 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-11T04:18:54.717 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-11T04:18:54.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-11T04:18:54.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-11T04:18:54.818 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-11T04:18:54.847 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-10-11T04:18:54.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-10-11T04:18:54.865 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-11T04:18:54.930 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-10-11T04:18:54.932 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-10-11T04:18:55.108 INFO:teuthology.orchestra.run.smithi050.stdout:70 files removed 2023-10-11T04:18:55.135 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw 2023-10-11T04:18:55.174 INFO:teuthology.orchestra.run.smithi151.stdout:70 files removed 2023-10-11T04:18:55.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw 2023-10-11T04:18:55.799 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 247 kB/s | 81 kB 00:00 2023-10-11T04:18:55.918 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 204 kB/s | 81 kB 00:00 2023-10-11T04:18:56.249 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2023-10-11T04:18:56.301 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-11T04:18:56.625 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 5.8 kB/s | 2.0 kB 00:00 2023-10-11T04:18:56.719 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 5.1 kB/s | 2.0 kB 00:00 2023-10-11T04:18:57.044 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 17 MB/s | 6.3 MB 00:00 2023-10-11T04:18:57.129 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 17 MB/s | 6.3 MB 00:00 2023-10-11T04:18:58.478 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2023-10-11T04:18:58.713 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-10-11T04:18:59.777 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 7.9 MB 00:00 2023-10-11T04:18:59.920 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 7.9 MB 00:00 2023-10-11T04:19:01.563 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 28 MB/s | 18 MB 00:00 2023-10-11T04:19:04.437 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 18 MB 00:03 2023-10-11T04:19:06.291 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.7 MB 00:01 2023-10-11T04:19:07.681 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 14 kB 00:00 2023-10-11T04:19:08.255 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 15 MB/s | 5.7 MB 00:00 2023-10-11T04:19:08.483 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 27 MB/s | 19 MB 00:00 2023-10-11T04:19:09.639 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 14 kB 00:00 2023-10-11T04:19:11.617 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 10 MB/s | 19 MB 00:01 2023-10-11T04:19:13.166 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-10-11T04:19:15.557 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:19:15.572 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:19:15.572 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:19:15.573 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:19:15.573 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:19:15.573 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 8.4 M 2023-10-11T04:19:15.573 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-10-11T04:19:15.573 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 3.1 M 2023-10-11T04:19:15.574 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 3.0 M 2023-10-11T04:19:15.574 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:19:15.574 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options 2023-10-11T04:19:15.574 INFO:teuthology.orchestra.run.smithi151.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-11T04:19:15.574 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 6.6 M 2023-10-11T04:19:15.575 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 17 M 2023-10-11T04:19:15.575 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 24 k 2023-10-11T04:19:15.575 INFO:teuthology.orchestra.run.smithi151.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-11T04:19:15.575 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-11T04:19:15.575 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-11T04:19:15.576 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-11T04:19:15.576 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 727 k 2023-10-11T04:19:15.576 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-11T04:19:15.576 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-11T04:19:15.576 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-11T04:19:15.577 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 469 k 2023-10-11T04:19:15.577 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-11T04:19:15.577 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 4.5 M 2023-10-11T04:19:15.577 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-11T04:19:15.577 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-11T04:19:15.577 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-11T04:19:15.578 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse 2023-10-11T04:19:15.578 INFO:teuthology.orchestra.run.smithi151.stdout: x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 45 k 2023-10-11T04:19:15.578 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 127 k 2023-10-11T04:19:15.578 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 162 k 2023-10-11T04:19:15.578 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-11T04:19:15.579 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 321 k 2023-10-11T04:19:15.579 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 298 k 2023-10-11T04:19:15.579 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 99 k 2023-10-11T04:19:15.579 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-11T04:19:15.579 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-11T04:19:15.580 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:15.580 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:19:15.580 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:19:15.580 INFO:teuthology.orchestra.run.smithi151.stdout:Install 28 Packages 2023-10-11T04:19:15.580 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 2 Packages 2023-10-11T04:19:15.580 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:15.581 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 54 M 2023-10-11T04:19:15.581 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:19:16.165 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2023-10-11T04:19:16.509 INFO:teuthology.orchestra.run.smithi151.stdout:(1/30): ceph-base-18.0.0-6684.g9587ffdf.el9.x86 9.4 MB/s | 6.6 MB 00:00 2023-10-11T04:19:16.559 INFO:teuthology.orchestra.run.smithi151.stdout:(2/30): ceph-selinux-18.0.0-6684.g9587ffdf.el9. 481 kB/s | 24 kB 00:00 2023-10-11T04:19:16.659 INFO:teuthology.orchestra.run.smithi151.stdout:(3/30): libcephfs2-18.0.0-6684.g9587ffdf.el9.x8 7.1 MB/s | 727 kB 00:00 2023-10-11T04:19:16.751 INFO:teuthology.orchestra.run.smithi151.stdout:(4/30): libradosstriper1-18.0.0-6684.g9587ffdf. 5.0 MB/s | 469 kB 00:00 2023-10-11T04:19:17.277 INFO:teuthology.orchestra.run.smithi151.stdout:(5/30): librgw2-18.0.0-6684.g9587ffdf.el9.x86_6 8.6 MB/s | 4.5 MB 00:00 2023-10-11T04:19:17.352 INFO:teuthology.orchestra.run.smithi151.stdout:(6/30): python3-ceph-argparse-18.0.0-6684.g9587 604 kB/s | 45 kB 00:00 2023-10-11T04:19:17.402 INFO:teuthology.orchestra.run.smithi151.stdout:(7/30): python3-ceph-common-18.0.0-6684.g9587ff 2.5 MB/s | 127 kB 00:00 2023-10-11T04:19:17.469 INFO:teuthology.orchestra.run.smithi151.stdout:(8/30): python3-cephfs-18.0.0-6684.g9587ffdf.el 2.4 MB/s | 162 kB 00:00 2023-10-11T04:19:17.544 INFO:teuthology.orchestra.run.smithi151.stdout:(9/30): python3-rados-18.0.0-6684.g9587ffdf.el9 4.2 MB/s | 321 kB 00:00 2023-10-11T04:19:17.611 INFO:teuthology.orchestra.run.smithi151.stdout:(10/30): python3-rbd-18.0.0-6684.g9587ffdf.el9. 4.4 MB/s | 298 kB 00:00 2023-10-11T04:19:17.661 INFO:teuthology.orchestra.run.smithi151.stdout:(11/30): python3-rgw-18.0.0-6684.g9587ffdf.el9. 2.0 MB/s | 99 kB 00:00 2023-10-11T04:19:17.770 INFO:teuthology.orchestra.run.smithi151.stdout:(12/30): boost-program-options-1.75.0-8.el9.x86 977 kB/s | 106 kB 00:00 2023-10-11T04:19:17.812 INFO:teuthology.orchestra.run.smithi151.stdout:(13/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-10-11T04:19:17.870 INFO:teuthology.orchestra.run.smithi151.stdout:(14/30): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-10-11T04:19:17.912 INFO:teuthology.orchestra.run.smithi151.stdout:(15/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-10-11T04:19:17.954 INFO:teuthology.orchestra.run.smithi151.stdout:(16/30): python3-prettytable-0.7.2-27.el9.noarc 983 kB/s | 41 kB 00:00 2023-10-11T04:19:18.592 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:19:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:19:18.600 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:19:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:19:18.601 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:19:18.601 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 8.4 M 2023-10-11T04:19:18.601 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-10-11T04:19:18.601 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 3.1 M 2023-10-11T04:19:18.602 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 3.0 M 2023-10-11T04:19:18.602 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:19:18.602 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options 2023-10-11T04:19:18.602 INFO:teuthology.orchestra.run.smithi050.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-11T04:19:18.603 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 6.6 M 2023-10-11T04:19:18.603 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 17 M 2023-10-11T04:19:18.603 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 24 k 2023-10-11T04:19:18.603 INFO:teuthology.orchestra.run.smithi050.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-11T04:19:18.603 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-11T04:19:18.604 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-11T04:19:18.604 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-11T04:19:18.604 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 727 k 2023-10-11T04:19:18.604 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-11T04:19:18.605 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-11T04:19:18.605 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-11T04:19:18.605 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 469 k 2023-10-11T04:19:18.605 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-11T04:19:18.605 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 4.5 M 2023-10-11T04:19:18.606 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-11T04:19:18.606 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-11T04:19:18.606 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-11T04:19:18.606 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse 2023-10-11T04:19:18.607 INFO:teuthology.orchestra.run.smithi050.stdout: x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 45 k 2023-10-11T04:19:18.607 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 127 k 2023-10-11T04:19:18.607 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 162 k 2023-10-11T04:19:18.607 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-11T04:19:18.607 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 321 k 2023-10-11T04:19:18.608 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 298 k 2023-10-11T04:19:18.608 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 99 k 2023-10-11T04:19:18.608 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-11T04:19:18.608 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-11T04:19:18.609 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:18.609 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:19:18.609 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:19:18.609 INFO:teuthology.orchestra.run.smithi050.stdout:Install 28 Packages 2023-10-11T04:19:18.610 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2023-10-11T04:19:18.610 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:18.611 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 54 M 2023-10-11T04:19:18.611 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:19:18.629 INFO:teuthology.orchestra.run.smithi151.stdout:(17/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2023-10-11T04:19:18.697 INFO:teuthology.orchestra.run.smithi151.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2023-10-11T04:19:18.747 INFO:teuthology.orchestra.run.smithi151.stdout:(19/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 6.1 MB/s | 309 kB 00:00 2023-10-11T04:19:18.855 INFO:teuthology.orchestra.run.smithi151.stdout:(20/30): libarrow-9.0.0-9.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2023-10-11T04:19:18.881 INFO:teuthology.orchestra.run.smithi151.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 977 kB/s | 24 kB 00:00 2023-10-11T04:19:18.906 INFO:teuthology.orchestra.run.smithi151.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2023-10-11T04:19:18.939 INFO:teuthology.orchestra.run.smithi151.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2023-10-11T04:19:18.981 INFO:teuthology.orchestra.run.smithi151.stdout:(24/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 20 MB/s | 837 kB 00:00 2023-10-11T04:19:19.015 INFO:teuthology.orchestra.run.smithi151.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 5.6 MB/s | 192 kB 00:00 2023-10-11T04:19:19.057 INFO:teuthology.orchestra.run.smithi151.stdout:(26/30): thrift-0.15.0-2.el9.x86_64.rpm 38 MB/s | 1.6 MB 00:00 2023-10-11T04:19:19.992 INFO:teuthology.orchestra.run.smithi050.stdout:(1/30): ceph-base-18.0.0-6684.g9587ffdf.el9.x86 5.4 MB/s | 6.6 MB 00:01 2023-10-11T04:19:20.059 INFO:teuthology.orchestra.run.smithi050.stdout:(2/30): ceph-selinux-18.0.0-6684.g9587ffdf.el9. 361 kB/s | 24 kB 00:00 2023-10-11T04:19:20.182 INFO:teuthology.orchestra.run.smithi151.stdout:(27/30): librados2-18.0.0-6684.g9587ffdf.el9.x8 2.8 MB/s | 3.1 MB 00:01 2023-10-11T04:19:20.251 INFO:teuthology.orchestra.run.smithi050.stdout:(3/30): ceph-common-18.0.0-6684.g9587ffdf.el9.x 12 MB/s | 17 MB 00:01 2023-10-11T04:19:20.284 INFO:teuthology.orchestra.run.smithi050.stdout:(4/30): libcephfs2-18.0.0-6684.g9587ffdf.el9.x8 3.2 MB/s | 727 kB 00:00 2023-10-11T04:19:20.309 INFO:teuthology.orchestra.run.smithi050.stdout:(5/30): libradosstriper1-18.0.0-6684.g9587ffdf. 7.9 MB/s | 469 kB 00:00 2023-10-11T04:19:20.351 INFO:teuthology.orchestra.run.smithi050.stdout:(6/30): python3-ceph-argparse-18.0.0-6684.g9587 1.1 MB/s | 45 kB 00:00 2023-10-11T04:19:20.410 INFO:teuthology.orchestra.run.smithi050.stdout:(7/30): python3-ceph-common-18.0.0-6684.g9587ff 2.1 MB/s | 127 kB 00:00 2023-10-11T04:19:20.477 INFO:teuthology.orchestra.run.smithi050.stdout:(8/30): python3-cephfs-18.0.0-6684.g9587ffdf.el 2.4 MB/s | 162 kB 00:00 2023-10-11T04:19:20.552 INFO:teuthology.orchestra.run.smithi050.stdout:(9/30): python3-rados-18.0.0-6684.g9587ffdf.el9 4.2 MB/s | 321 kB 00:00 2023-10-11T04:19:20.628 INFO:teuthology.orchestra.run.smithi050.stdout:(10/30): python3-rbd-18.0.0-6684.g9587ffdf.el9. 3.9 MB/s | 298 kB 00:00 2023-10-11T04:19:20.695 INFO:teuthology.orchestra.run.smithi050.stdout:(11/30): python3-rgw-18.0.0-6684.g9587ffdf.el9. 1.5 MB/s | 99 kB 00:00 2023-10-11T04:19:20.699 INFO:teuthology.orchestra.run.smithi151.stdout:(28/30): librbd1-18.0.0-6684.g9587ffdf.el9.x86_ 5.9 MB/s | 3.0 MB 00:00 2023-10-11T04:19:20.795 INFO:teuthology.orchestra.run.smithi050.stdout:(12/30): librgw2-18.0.0-6684.g9587ffdf.el9.x86_ 8.8 MB/s | 4.5 MB 00:00 2023-10-11T04:19:20.912 INFO:teuthology.orchestra.run.smithi050.stdout:(13/30): ceph-radosgw-18.0.0-6684.g9587ffdf.el9 3.9 MB/s | 8.4 MB 00:02 2023-10-11T04:19:20.971 INFO:teuthology.orchestra.run.smithi050.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 914 kB/s | 159 kB 00:00 2023-10-11T04:19:20.996 INFO:teuthology.orchestra.run.smithi050.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 352 kB/s | 106 kB 00:00 2023-10-11T04:19:21.063 INFO:teuthology.orchestra.run.smithi050.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 661 kB 00:00 2023-10-11T04:19:21.088 INFO:teuthology.orchestra.run.smithi050.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 282 kB 00:00 2023-10-11T04:19:21.113 INFO:teuthology.orchestra.run.smithi050.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 353 kB/s | 41 kB 00:00 2023-10-11T04:19:21.213 INFO:teuthology.orchestra.run.smithi050.stdout:(19/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 302 kB/s | 45 kB 00:00 2023-10-11T04:19:21.482 INFO:teuthology.orchestra.run.smithi151.stdout:(29/30): ceph-radosgw-18.0.0-6684.g9587ffdf.el9 1.5 MB/s | 8.4 MB 00:05 2023-10-11T04:19:21.514 INFO:teuthology.orchestra.run.smithi050.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 277 kB/s | 111 kB 00:00 2023-10-11T04:19:21.622 INFO:teuthology.orchestra.run.smithi050.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 225 kB/s | 24 kB 00:00 2023-10-11T04:19:21.648 INFO:teuthology.orchestra.run.smithi050.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 578 kB/s | 309 kB 00:00 2023-10-11T04:19:21.856 INFO:teuthology.orchestra.run.smithi050.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 208 kB/s | 49 kB 00:00 2023-10-11T04:19:21.881 INFO:teuthology.orchestra.run.smithi050.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 288 kB/s | 67 kB 00:00 2023-10-11T04:19:22.015 INFO:teuthology.orchestra.run.smithi050.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-10-11T04:19:22.207 INFO:teuthology.orchestra.run.smithi050.stdout:(26/30): libarrow-9.0.0-9.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:00 2023-10-11T04:19:22.249 INFO:teuthology.orchestra.run.smithi050.stdout:(27/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.1 MB/s | 837 kB 00:00 2023-10-11T04:19:22.349 INFO:teuthology.orchestra.run.smithi050.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2023-10-11T04:19:22.566 INFO:teuthology.orchestra.run.smithi050.stdout:(29/30): librados2-18.0.0-6684.g9587ffdf.el9.x8 8.7 MB/s | 3.1 MB 00:00 2023-10-11T04:19:22.625 INFO:teuthology.orchestra.run.smithi050.stdout:(30/30): librbd1-18.0.0-6684.g9587ffdf.el9.x86_ 8.1 MB/s | 3.0 MB 00:00 2023-10-11T04:19:22.628 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:19:22.629 INFO:teuthology.orchestra.run.smithi050.stdout:Total 13 MB/s | 54 MB 00:04 2023-10-11T04:19:22.641 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:19:22.684 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:19:22.684 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:19:23.235 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:19:23.236 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:19:24.041 INFO:teuthology.orchestra.run.smithi151.stdout:(30/30): ceph-common-18.0.0-6684.g9587ffdf.el9. 2.1 MB/s | 17 MB 00:08 2023-10-11T04:19:24.044 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:19:24.044 INFO:teuthology.orchestra.run.smithi151.stdout:Total 6.4 MB/s | 54 MB 00:08 2023-10-11T04:19:24.056 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:19:24.094 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:19:24.094 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:19:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:19:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:19:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:19:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-10-11T04:19:25.094 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/32 2023-10-11T04:19:25.186 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/32 2023-10-11T04:19:25.285 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 3/32 2023-10-11T04:19:25.312 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/32 2023-10-11T04:19:25.391 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/32 2023-10-11T04:19:25.440 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/32 2023-10-11T04:19:25.466 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/32 2023-10-11T04:19:25.496 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/32 2023-10-11T04:19:25.540 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:18.0.0-6684.g9587ffdf.el9. 8/32 2023-10-11T04:19:25.617 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 9/32 2023-10-11T04:19:25.640 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_6 10/32 2023-10-11T04:19:25.730 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_6 10/32 2023-10-11T04:19:25.765 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/32 2023-10-11T04:19:25.875 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-10-11T04:19:25.907 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-10-11T04:19:25.949 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-10-11T04:19:25.997 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-10-11T04:19:26.024 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-10-11T04:19:26.055 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-10-11T04:19:26.064 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:19:26.088 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T04:19:26.423 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-10-11T04:19:26.451 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 20/32 2023-10-11T04:19:26.484 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-10-11T04:19:26.526 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/32 2023-10-11T04:19:26.542 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 20/32 2023-10-11T04:19:26.572 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 21/32 2023-10-11T04:19:26.601 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/32 2023-10-11T04:19:26.609 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-10-11T04:19:26.690 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 3/32 2023-10-11T04:19:26.719 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/32 2023-10-11T04:19:26.781 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/32 2023-10-11T04:19:26.823 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/32 2023-10-11T04:19:26.856 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/32 2023-10-11T04:19:26.886 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/32 2023-10-11T04:19:26.930 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.0.0-6684.g9587ffdf.el9. 8/32 2023-10-11T04:19:27.007 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 9/32 2023-10-11T04:19:27.030 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_6 10/32 2023-10-11T04:19:27.064 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-10-11T04:19:27.095 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 24/32 2023-10-11T04:19:27.119 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_6 10/32 2023-10-11T04:19:27.150 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 24/32 2023-10-11T04:19:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/32 2023-10-11T04:19:27.230 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 25/32 2023-10-11T04:19:27.264 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:18.0.0-6684.g9587ffdf.el9.x8 26/32 2023-10-11T04:19:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-10-11T04:19:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-10-11T04:19:27.354 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-10-11T04:19:27.386 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-10-11T04:19:27.413 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-10-11T04:19:27.440 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-10-11T04:19:27.473 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T04:19:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-10-11T04:19:27.828 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 20/32 2023-10-11T04:19:27.917 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 20/32 2023-10-11T04:19:27.949 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 21/32 2023-10-11T04:19:27.984 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-10-11T04:19:28.444 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-10-11T04:19:28.471 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 24/32 2023-10-11T04:19:28.525 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 24/32 2023-10-11T04:19:28.593 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 25/32 2023-10-11T04:19:28.624 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.0.0-6684.g9587ffdf.el9.x8 26/32 2023-10-11T04:19:29.499 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 27/32 2023-10-11T04:19:29.536 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 27/32 2023-10-11T04:19:30.315 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 27/32 2023-10-11T04:19:30.370 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 28/32 2023-10-11T04:19:30.444 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 28/32 2023-10-11T04:19:30.444 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-11T04:19:30.445 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-11T04:19:30.445 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/32 2023-10-11T04:19:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 27/32 2023-10-11T04:19:30.695 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 27/32 2023-10-11T04:19:31.436 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 27/32 2023-10-11T04:19:31.476 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 28/32 2023-10-11T04:19:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 28/32 2023-10-11T04:19:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-11T04:19:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-11T04:19:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/32 2023-10-11T04:19:40.495 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/32 2023-10-11T04:19:40.495 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-10-11T04:19:40.496 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-10-11T04:19:40.496 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-10-11T04:19:40.496 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-10-11T04:19:40.496 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-10-11T04:19:40.496 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2023-10-11T04:19:40.497 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-10-11T04:19:40.497 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:41.355 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/32 2023-10-11T04:19:41.380 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/32 2023-10-11T04:19:41.381 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:19:41.381 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-11T04:19:41.381 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T04:19:41.381 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T04:19:41.382 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:41.382 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T04:19:41.458 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/32 2023-10-11T04:19:41.458 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-10-11T04:19:41.458 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-10-11T04:19:41.458 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-10-11T04:19:41.459 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-10-11T04:19:41.459 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-10-11T04:19:41.459 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2023-10-11T04:19:41.459 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-10-11T04:19:41.459 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:41.466 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T04:19:41.466 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T04:19:42.322 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/32 2023-10-11T04:19:42.346 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/32 2023-10-11T04:19:42.346 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:19:42.346 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-11T04:19:42.347 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T04:19:42.347 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T04:19:42.347 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:42.348 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T04:19:42.433 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T04:19:42.434 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T04:19:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T04:19:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/32 2023-10-11T04:19:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/32 2023-10-11T04:19:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 3/32 2023-10-11T04:19:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/32 2023-10-11T04:19:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 5/32 2023-10-11T04:19:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_6 6/32 2023-10-11T04:19:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 7/32 2023-10-11T04:19:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6684.g9587ffdf.el9. 8/32 2023-10-11T04:19:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:18.0.0-6684.g9587ffdf.el9.x8 9/32 2023-10-11T04:19:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 10/32 2023-10-11T04:19:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 11/32 2023-10-11T04:19:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 12/32 2023-10-11T04:19:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 13/32 2023-10-11T04:19:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-10-11T04:19:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-10-11T04:19:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-10-11T04:19:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-10-11T04:19:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T04:19:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-10-11T04:19:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-10-11T04:19:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-10-11T04:19:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-10-11T04:19:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-10-11T04:19:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-10-11T04:19:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-10-11T04:19:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-10-11T04:19:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-10-11T04:19:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-10-11T04:19:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/32 2023-10-11T04:19:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-10-11T04:19:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 31/32 2023-10-11T04:19:43.555 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T04:19:43.556 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/32 2023-10-11T04:19:43.556 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/32 2023-10-11T04:19:43.556 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 3/32 2023-10-11T04:19:43.556 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/32 2023-10-11T04:19:43.557 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 5/32 2023-10-11T04:19:43.557 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_6 6/32 2023-10-11T04:19:43.557 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 7/32 2023-10-11T04:19:43.557 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6684.g9587ffdf.el9. 8/32 2023-10-11T04:19:43.557 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.0.0-6684.g9587ffdf.el9.x8 9/32 2023-10-11T04:19:43.558 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 10/32 2023-10-11T04:19:43.558 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 11/32 2023-10-11T04:19:43.558 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 12/32 2023-10-11T04:19:43.558 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 13/32 2023-10-11T04:19:43.558 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-10-11T04:19:43.559 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-10-11T04:19:43.559 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-10-11T04:19:43.559 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-10-11T04:19:43.559 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T04:19:43.559 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-10-11T04:19:43.559 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-10-11T04:19:43.560 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-10-11T04:19:43.560 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-10-11T04:19:43.560 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-10-11T04:19:43.561 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-10-11T04:19:43.561 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-10-11T04:19:43.562 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-10-11T04:19:43.562 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-10-11T04:19:43.562 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-10-11T04:19:43.562 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/32 2023-10-11T04:19:43.562 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-10-11T04:19:43.563 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 31/32 2023-10-11T04:19:43.805 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T04:19:43.806 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:43.806 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-10-11T04:19:43.806 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.806 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.807 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:19:43.807 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-11T04:19:43.807 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.807 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.807 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.808 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.808 INFO:teuthology.orchestra.run.smithi050.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-11T04:19:43.808 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-11T04:19:43.808 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-11T04:19:43.808 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-11T04:19:43.809 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.809 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-11T04:19:43.809 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-11T04:19:43.809 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-11T04:19:43.809 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.810 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-11T04:19:43.810 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.810 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-11T04:19:43.810 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-11T04:19:43.811 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-11T04:19:43.811 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.811 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.811 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-11T04:19:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-3.el9.x86_64 2023-10-11T04:19:43.813 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-11T04:19:43.813 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:43.813 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:19:44.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-test 2023-10-11T04:19:44.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T04:19:44.734 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:44.734 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-10-11T04:19:44.734 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.735 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.735 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:19:44.735 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-11T04:19:44.735 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.735 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.736 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.736 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.736 INFO:teuthology.orchestra.run.smithi151.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-11T04:19:44.736 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-11T04:19:44.736 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-11T04:19:44.737 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-11T04:19:44.737 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.737 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-11T04:19:44.737 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-11T04:19:44.737 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-11T04:19:44.738 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.738 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-11T04:19:44.738 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.738 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-11T04:19:44.738 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-11T04:19:44.739 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-11T04:19:44.739 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.739 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.739 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.739 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-11T04:19:44.740 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.740 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.740 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:19:44.740 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2023-10-11T04:19:44.740 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-11T04:19:44.741 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:44.741 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:19:44.751 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:19:44.901 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:19:44.902 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:19:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:19:44.902 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:19:44.902 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:19:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 117 M 2023-10-11T04:19:44.903 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:19:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-10-11T04:19:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-11T04:19:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-10-11T04:19:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 161 k 2023-10-11T04:19:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-10-11T04:19:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-11T04:19:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-11T04:19:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-11T04:19:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-10-11T04:19:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:44.905 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:19:44.905 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:19:44.905 INFO:teuthology.orchestra.run.smithi050.stdout:Install 10 Packages 2023-10-11T04:19:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:19:44.906 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 120 M 2023-10-11T04:19:44.906 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.1 G 2023-10-11T04:19:44.907 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:19:45.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-test 2023-10-11T04:19:45.502 INFO:teuthology.orchestra.run.smithi050.stdout:(1/10): libasan-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 418 kB 00:00 2023-10-11T04:19:45.544 INFO:teuthology.orchestra.run.smithi050.stdout:(2/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-10-11T04:19:45.586 INFO:teuthology.orchestra.run.smithi050.stdout:(3/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-10-11T04:19:45.628 INFO:teuthology.orchestra.run.smithi050.stdout:(4/10): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2023-10-11T04:19:45.653 INFO:teuthology.orchestra.run.smithi050.stdout:(5/10): libcephsqlite-18.0.0-6684.g9587ffdf.el9 509 kB/s | 161 kB 00:00 2023-10-11T04:19:45.670 INFO:teuthology.orchestra.run.smithi050.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-10-11T04:19:45.710 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:32 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:19:45.850 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:19:45.851 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:19:45.851 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:19:45.852 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:19:45.852 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:19:45.852 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 117 M 2023-10-11T04:19:45.852 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:19:45.852 INFO:teuthology.orchestra.run.smithi151.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-10-11T04:19:45.853 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-11T04:19:45.853 INFO:teuthology.orchestra.run.smithi151.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-10-11T04:19:45.853 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 161 k 2023-10-11T04:19:45.853 INFO:teuthology.orchestra.run.smithi151.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-10-11T04:19:45.853 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-11T04:19:45.854 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-11T04:19:45.854 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-11T04:19:45.854 INFO:teuthology.orchestra.run.smithi151.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-10-11T04:19:45.854 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:45.854 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:19:45.855 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:19:45.855 INFO:teuthology.orchestra.run.smithi151.stdout:Install 10 Packages 2023-10-11T04:19:45.855 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:19:45.856 INFO:teuthology.orchestra.run.smithi050.stdout:(7/10): jq-1.6-15.el9.x86_64.rpm 934 kB/s | 187 kB 00:00 2023-10-11T04:19:45.856 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 120 M 2023-10-11T04:19:45.856 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 1.1 G 2023-10-11T04:19:45.857 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:19:46.150 INFO:teuthology.orchestra.run.smithi151.stdout:(1/10): libasan-11.4.1-2.3.el9.x86_64.rpm 2.2 MB/s | 418 kB 00:00 2023-10-11T04:19:46.192 INFO:teuthology.orchestra.run.smithi151.stdout:(2/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-10-11T04:19:46.204 INFO:teuthology.orchestra.run.smithi050.stdout:(8/10): cryptopp-8.6.0-1.el9.x86_64.rpm 2.4 MB/s | 1.3 MB 00:00 2023-10-11T04:19:46.221 INFO:teuthology.orchestra.run.smithi050.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 332 kB/s | 122 kB 00:00 2023-10-11T04:19:46.234 INFO:teuthology.orchestra.run.smithi151.stdout:(3/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-10-11T04:19:46.276 INFO:teuthology.orchestra.run.smithi151.stdout:(4/10): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-10-11T04:19:46.301 INFO:teuthology.orchestra.run.smithi151.stdout:(5/10): libcephsqlite-18.0.0-6684.g9587ffdf.el9 482 kB/s | 161 kB 00:00 2023-10-11T04:19:46.327 INFO:teuthology.orchestra.run.smithi151.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-10-11T04:19:46.477 INFO:teuthology.orchestra.run.smithi151.stdout:(7/10): jq-1.6-15.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-10-11T04:19:47.119 INFO:teuthology.orchestra.run.smithi151.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 190 kB/s | 122 kB 00:00 2023-10-11T04:19:47.311 INFO:teuthology.orchestra.run.smithi151.stdout:(9/10): cryptopp-8.6.0-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:00 2023-10-11T04:19:54.821 INFO:teuthology.orchestra.run.smithi050.stdout:(10/10): ceph-test-18.0.0-6684.g9587ffdf.el9.x8 12 MB/s | 117 MB 00:09 2023-10-11T04:19:54.825 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:19:54.825 INFO:teuthology.orchestra.run.smithi050.stdout:Total 12 MB/s | 120 MB 00:09 2023-10-11T04:19:54.839 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:19:54.865 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:19:54.865 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:19:55.720 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:19:55.721 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:19:56.860 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:19:56.946 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-10-11T04:19:56.979 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-10-11T04:19:57.024 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-10-11T04:19:57.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-10-11T04:19:57.097 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-11T04:19:57.128 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-15.el9.x86_64 6/10 2023-10-11T04:19:57.160 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-10-11T04:19:57.199 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-10-11T04:19:57.226 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 9/10 2023-10-11T04:20:02.510 INFO:teuthology.orchestra.run.smithi151.stdout:(10/10): ceph-test-18.0.0-6684.g9587ffdf.el9.x8 7.1 MB/s | 117 MB 00:16 2023-10-11T04:20:02.515 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:20:02.516 INFO:teuthology.orchestra.run.smithi151.stdout:Total 7.2 MB/s | 120 MB 00:16 2023-10-11T04:20:02.528 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:20:02.551 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:20:02.552 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:20:03.368 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:20:03.369 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:20:04.478 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:20:04.563 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-10-11T04:20:04.610 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-10-11T04:20:04.658 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-10-11T04:20:04.702 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-10-11T04:20:04.738 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-11T04:20:04.769 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-15.el9.x86_64 6/10 2023-10-11T04:20:04.801 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-10-11T04:20:04.840 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-10-11T04:20:04.867 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 9/10 2023-10-11T04:20:14.412 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 9/10 2023-10-11T04:20:14.484 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 10/10 2023-10-11T04:20:21.149 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 9/10 2023-10-11T04:20:21.225 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 10/10 2023-10-11T04:20:22.672 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 10/10 2023-10-11T04:20:22.673 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/10 2023-10-11T04:20:22.673 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/10 2023-10-11T04:20:22.673 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 3/10 2023-10-11T04:20:22.673 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 4/10 2023-10-11T04:20:22.674 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-11T04:20:22.674 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 6/10 2023-10-11T04:20:22.674 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 7/10 2023-10-11T04:20:22.674 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-15.el9.x86_64 8/10 2023-10-11T04:20:22.674 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-10-11T04:20:23.156 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-10-11T04:20:23.156 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:20:23.156 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:20:23.157 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:20:23.157 INFO:teuthology.orchestra.run.smithi050.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-10-11T04:20:23.157 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.6-15.el9.x86_64 2023-10-11T04:20:23.157 INFO:teuthology.orchestra.run.smithi050.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-10-11T04:20:23.157 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:20:23.157 INFO:teuthology.orchestra.run.smithi050.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-10-11T04:20:23.158 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-11T04:20:23.158 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-11T04:20:23.158 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-11T04:20:23.158 INFO:teuthology.orchestra.run.smithi050.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-10-11T04:20:23.159 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:20:23.159 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:20:23.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph 2023-10-11T04:20:24.069 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:08 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:20:24.226 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:20:24.228 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================= 2023-10-11T04:20:24.228 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:20:24.229 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================= 2023-10-11T04:20:24.229 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:20:24.229 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 6.5 k 2023-10-11T04:20:24.229 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:20:24.230 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 2.0 M 2023-10-11T04:20:24.230 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 1.5 M 2023-10-11T04:20:24.230 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 242 k 2023-10-11T04:20:24.230 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 8.8 M 2023-10-11T04:20:24.230 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 117 M 2023-10-11T04:20:24.231 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-11T04:20:24.231 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-11T04:20:24.231 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-11T04:20:24.231 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-11T04:20:24.231 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-11T04:20:24.232 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-11T04:20:24.232 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-11T04:20:24.232 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-11T04:20:24.232 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-11T04:20:24.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-11T04:20:24.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-11T04:20:24.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-11T04:20:24.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-11T04:20:24.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-11T04:20:24.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-11T04:20:24.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-11T04:20:24.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-11T04:20:24.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-11T04:20:24.235 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-11T04:20:24.235 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-11T04:20:24.235 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-11T04:20:24.235 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-11T04:20:24.235 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-11T04:20:24.236 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-11T04:20:24.236 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-11T04:20:24.236 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-11T04:20:24.236 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-11T04:20:24.236 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:20:24.236 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:20:24.237 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================= 2023-10-11T04:20:24.237 INFO:teuthology.orchestra.run.smithi050.stdout:Install 33 Packages 2023-10-11T04:20:24.237 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:20:24.238 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 134 M 2023-10-11T04:20:24.238 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.4 G 2023-10-11T04:20:24.238 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:20:25.084 INFO:teuthology.orchestra.run.smithi050.stdout:(1/33): ceph-18.0.0-6684.g9587ffdf.el9.x86_64.r 21 kB/s | 6.5 kB 00:00 2023-10-11T04:20:25.809 INFO:teuthology.orchestra.run.smithi050.stdout:(2/33): ceph-mds-18.0.0-6684.g9587ffdf.el9.x86_ 1.9 MB/s | 2.0 MB 00:01 2023-10-11T04:20:25.868 INFO:teuthology.orchestra.run.smithi050.stdout:(3/33): ceph-mgr-18.0.0-6684.g9587ffdf.el9.x86_ 1.3 MB/s | 1.5 MB 00:01 2023-10-11T04:20:25.985 INFO:teuthology.orchestra.run.smithi050.stdout:(4/33): ceph-mgr-modules-core-18.0.0-6684.g9587 2.0 MB/s | 242 kB 00:00 2023-10-11T04:20:26.094 INFO:teuthology.orchestra.run.smithi050.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-10-11T04:20:26.127 INFO:teuthology.orchestra.run.smithi050.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 951 kB/s | 32 kB 00:00 2023-10-11T04:20:26.161 INFO:teuthology.orchestra.run.smithi050.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-11T04:20:26.211 INFO:teuthology.orchestra.run.smithi050.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-10-11T04:20:26.253 INFO:teuthology.orchestra.run.smithi050.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 103 kB 00:00 2023-10-11T04:20:26.295 INFO:teuthology.orchestra.run.smithi050.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 2.9 MB/s | 124 kB 00:00 2023-10-11T04:20:26.337 INFO:teuthology.orchestra.run.smithi050.stdout:(11/33): python3-requests-2.25.1-7.el9.noarch.r 2.6 MB/s | 113 kB 00:00 2023-10-11T04:20:26.379 INFO:teuthology.orchestra.run.smithi050.stdout:(12/33): python3-urllib3-1.26.5-3.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2023-10-11T04:20:26.611 INFO:teuthology.orchestra.run.smithi050.stdout:(13/33): python3-cryptography-36.0.1-4.el9.x86_ 5.3 MB/s | 1.2 MB 00:00 2023-10-11T04:20:26.663 INFO:teuthology.orchestra.run.smithi050.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 997 kB/s | 51 kB 00:00 2023-10-11T04:20:26.988 INFO:teuthology.orchestra.run.smithi050.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 134 kB/s | 43 kB 00:00 2023-10-11T04:20:27.238 INFO:teuthology.orchestra.run.smithi050.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 688 kB/s | 172 kB 00:00 2023-10-11T04:20:27.447 INFO:teuthology.orchestra.run.smithi050.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2023-10-11T04:20:27.547 INFO:teuthology.orchestra.run.smithi050.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2023-10-11T04:20:27.689 INFO:teuthology.orchestra.run.smithi050.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 125 kB/s | 18 kB 00:00 2023-10-11T04:20:27.798 INFO:teuthology.orchestra.run.smithi050.stdout:(20/33): ceph-mon-18.0.0-6684.g9587ffdf.el9.x86 3.3 MB/s | 8.8 MB 00:02 2023-10-11T04:20:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 173 kB/s | 23 kB 00:00 2023-10-11T04:20:27.923 INFO:teuthology.orchestra.run.smithi050.stdout:(22/33): python3-jaraco-text-3.2.0-6.el9.noarch 197 kB/s | 20 kB 00:00 2023-10-11T04:20:28.023 INFO:teuthology.orchestra.run.smithi050.stdout:(23/33): python3-logutils-0.3.5-21.el9.noarch.r 464 kB/s | 46 kB 00:00 2023-10-11T04:20:28.049 INFO:teuthology.orchestra.run.smithi050.stdout:(24/33): python3-jaraco-functools-3.5.0-2.el9.n 77 kB/s | 19 kB 00:00 2023-10-11T04:20:28.132 INFO:teuthology.orchestra.run.smithi050.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 726 kB/s | 79 kB 00:00 2023-10-11T04:20:28.232 INFO:teuthology.orchestra.run.smithi050.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2023-10-11T04:20:28.341 INFO:teuthology.orchestra.run.smithi050.stdout:(27/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 830 kB/s | 90 kB 00:00 2023-10-11T04:20:28.416 INFO:teuthology.orchestra.run.smithi050.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 741 kB/s | 272 kB 00:00 2023-10-11T04:20:28.433 INFO:teuthology.orchestra.run.smithi050.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 389 kB/s | 36 kB 00:00 2023-10-11T04:20:28.559 INFO:teuthology.orchestra.run.smithi050.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2023-10-11T04:20:28.584 INFO:teuthology.orchestra.run.smithi050.stdout:(31/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.8 MB/s | 427 kB 00:00 2023-10-11T04:20:28.659 INFO:teuthology.orchestra.run.smithi050.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 199 kB/s | 20 kB 00:00 2023-10-11T04:20:29.862 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 10/10 2023-10-11T04:20:29.863 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/10 2023-10-11T04:20:29.863 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/10 2023-10-11T04:20:29.863 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 3/10 2023-10-11T04:20:29.863 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 4/10 2023-10-11T04:20:29.864 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-11T04:20:29.864 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 6/10 2023-10-11T04:20:29.864 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 7/10 2023-10-11T04:20:29.864 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-15.el9.x86_64 8/10 2023-10-11T04:20:29.864 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-10-11T04:20:30.349 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-10-11T04:20:30.349 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:20:30.350 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:20:30.350 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:20:30.350 INFO:teuthology.orchestra.run.smithi151.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-10-11T04:20:30.350 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-15.el9.x86_64 2023-10-11T04:20:30.350 INFO:teuthology.orchestra.run.smithi151.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-10-11T04:20:30.351 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:20:30.351 INFO:teuthology.orchestra.run.smithi151.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-10-11T04:20:30.351 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-11T04:20:30.351 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-11T04:20:30.351 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-11T04:20:30.352 INFO:teuthology.orchestra.run.smithi151.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-10-11T04:20:30.352 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:20:30.352 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:20:30.654 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph 2023-10-11T04:20:31.249 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:18 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:20:31.398 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:20:31.400 INFO:teuthology.orchestra.run.smithi151.stdout:========================================================================================= 2023-10-11T04:20:31.401 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:20:31.401 INFO:teuthology.orchestra.run.smithi151.stdout:========================================================================================= 2023-10-11T04:20:31.401 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:20:31.401 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 6.5 k 2023-10-11T04:20:31.402 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:20:31.402 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 2.0 M 2023-10-11T04:20:31.402 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 1.5 M 2023-10-11T04:20:31.402 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 242 k 2023-10-11T04:20:31.403 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 8.8 M 2023-10-11T04:20:31.403 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 117 M 2023-10-11T04:20:31.403 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-11T04:20:31.403 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-11T04:20:31.404 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-11T04:20:31.404 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-11T04:20:31.404 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-11T04:20:31.404 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-11T04:20:31.405 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-11T04:20:31.405 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-11T04:20:31.405 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-11T04:20:31.405 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-11T04:20:31.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-11T04:20:31.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-11T04:20:31.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-11T04:20:31.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-11T04:20:31.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-11T04:20:31.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-11T04:20:31.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-11T04:20:31.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-11T04:20:31.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-11T04:20:31.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-11T04:20:31.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-11T04:20:31.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-11T04:20:31.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-11T04:20:31.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-11T04:20:31.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-11T04:20:31.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-11T04:20:31.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-11T04:20:31.409 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:20:31.410 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:20:31.410 INFO:teuthology.orchestra.run.smithi151.stdout:========================================================================================= 2023-10-11T04:20:31.410 INFO:teuthology.orchestra.run.smithi151.stdout:Install 33 Packages 2023-10-11T04:20:31.410 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:20:31.411 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 134 M 2023-10-11T04:20:31.411 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 1.4 G 2023-10-11T04:20:31.412 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:20:32.487 INFO:teuthology.orchestra.run.smithi151.stdout:(1/33): ceph-18.0.0-6684.g9587ffdf.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2023-10-11T04:20:32.746 INFO:teuthology.orchestra.run.smithi151.stdout:(2/33): ceph-mds-18.0.0-6684.g9587ffdf.el9.x86_ 4.7 MB/s | 2.0 MB 00:00 2023-10-11T04:20:32.804 INFO:teuthology.orchestra.run.smithi151.stdout:(3/33): ceph-mgr-18.0.0-6684.g9587ffdf.el9.x86_ 3.0 MB/s | 1.5 MB 00:00 2023-10-11T04:20:32.905 INFO:teuthology.orchestra.run.smithi151.stdout:(4/33): ceph-mgr-modules-core-18.0.0-6684.g9587 2.4 MB/s | 242 kB 00:00 2023-10-11T04:20:33.005 INFO:teuthology.orchestra.run.smithi151.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2023-10-11T04:20:33.038 INFO:teuthology.orchestra.run.smithi151.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 944 kB/s | 32 kB 00:00 2023-10-11T04:20:33.072 INFO:teuthology.orchestra.run.smithi151.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-11T04:20:33.114 INFO:teuthology.orchestra.run.smithi151.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-10-11T04:20:33.148 INFO:teuthology.orchestra.run.smithi151.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-10-11T04:20:33.190 INFO:teuthology.orchestra.run.smithi151.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 2.9 MB/s | 124 kB 00:00 2023-10-11T04:20:33.224 INFO:teuthology.orchestra.run.smithi151.stdout:(11/33): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-10-11T04:20:33.266 INFO:teuthology.orchestra.run.smithi151.stdout:(12/33): python3-urllib3-1.26.5-3.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2023-10-11T04:20:33.449 INFO:teuthology.orchestra.run.smithi151.stdout:(13/33): python3-cryptography-36.0.1-4.el9.x86_ 6.7 MB/s | 1.2 MB 00:00 2023-10-11T04:20:33.808 INFO:teuthology.orchestra.run.smithi151.stdout:(14/33): ceph-mon-18.0.0-6684.g9587ffdf.el9.x86 6.7 MB/s | 8.8 MB 00:01 2023-10-11T04:20:33.833 INFO:teuthology.orchestra.run.smithi151.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 133 kB/s | 51 kB 00:00 2023-10-11T04:20:34.109 INFO:teuthology.orchestra.run.smithi151.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 145 kB/s | 43 kB 00:00 2023-10-11T04:20:34.226 INFO:teuthology.orchestra.run.smithi151.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 438 kB/s | 172 kB 00:00 2023-10-11T04:20:34.301 INFO:teuthology.orchestra.run.smithi151.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2023-10-11T04:20:34.352 INFO:teuthology.orchestra.run.smithi151.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2023-10-11T04:20:34.377 INFO:teuthology.orchestra.run.smithi151.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2023-10-11T04:20:34.429 INFO:teuthology.orchestra.run.smithi151.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2023-10-11T04:20:34.452 INFO:teuthology.orchestra.run.smithi151.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 259 kB/s | 19 kB 00:00 2023-10-11T04:20:34.503 INFO:teuthology.orchestra.run.smithi151.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 259 kB/s | 20 kB 00:00 2023-10-11T04:20:34.537 INFO:teuthology.orchestra.run.smithi151.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 550 kB/s | 46 kB 00:00 2023-10-11T04:20:34.570 INFO:teuthology.orchestra.run.smithi151.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2023-10-11T04:20:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 246 kB/s | 16 kB 00:00 2023-10-11T04:20:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2023-10-11T04:20:34.722 INFO:teuthology.orchestra.run.smithi151.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2023-10-11T04:20:34.739 INFO:teuthology.orchestra.run.smithi151.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2023-10-11T04:20:34.823 INFO:teuthology.orchestra.run.smithi151.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-10-11T04:20:34.848 INFO:teuthology.orchestra.run.smithi151.stdout:(31/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2023-10-11T04:20:34.898 INFO:teuthology.orchestra.run.smithi151.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 265 kB/s | 20 kB 00:00 2023-10-11T04:20:39.398 INFO:teuthology.orchestra.run.smithi151.stdout:(33/33): ceph-osd-18.0.0-6684.g9587ffdf.el9.x86 18 MB/s | 117 MB 00:06 2023-10-11T04:20:39.404 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:20:39.404 INFO:teuthology.orchestra.run.smithi151.stdout:Total 17 MB/s | 134 MB 00:08 2023-10-11T04:20:39.437 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:20:39.477 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:20:39.478 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:20:40.175 INFO:teuthology.orchestra.run.smithi050.stdout:(33/33): ceph-osd-18.0.0-6684.g9587ffdf.el9.x86 8.2 MB/s | 117 MB 00:14 2023-10-11T04:20:40.179 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:20:40.180 INFO:teuthology.orchestra.run.smithi050.stdout:Total 8.4 MB/s | 134 MB 00:15 2023-10-11T04:20:40.213 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:20:40.256 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:20:40.256 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:20:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:20:40.450 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:20:41.268 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:20:41.268 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:20:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:20:42.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-10-11T04:20:42.367 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-10-11T04:20:42.400 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-10-11T04:20:42.491 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-10-11T04:20:42.578 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-10-11T04:20:42.620 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-10-11T04:20:42.658 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-10-11T04:20:42.726 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-10-11T04:20:42.780 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 9/33 2023-10-11T04:20:42.818 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-10-11T04:20:42.867 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T04:20:42.923 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T04:20:43.108 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-10-11T04:20:43.127 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:20:43.159 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-10-11T04:20:43.186 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-10-11T04:20:43.198 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-10-11T04:20:43.219 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-10-11T04:20:43.233 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-10-11T04:20:43.252 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-10-11T04:20:43.263 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-10-11T04:20:43.339 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-10-11T04:20:43.348 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-10-11T04:20:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-10-11T04:20:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-10-11T04:20:43.425 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-10-11T04:20:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-10-11T04:20:43.481 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-10-11T04:20:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-10-11T04:20:43.519 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-10-11T04:20:43.580 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-10-11T04:20:43.597 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-10-11T04:20:43.615 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-10-11T04:20:43.658 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 9/33 2023-10-11T04:20:43.687 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-10-11T04:20:43.695 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-10-11T04:20:43.753 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T04:20:43.817 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T04:20:43.825 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-10-11T04:20:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T04:20:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-10-11T04:20:44.066 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-10-11T04:20:44.105 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-10-11T04:20:44.139 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-10-11T04:20:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6684.g9587ffdf.el9. 28/33 2023-10-11T04:20:44.160 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-10-11T04:20:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/33 2023-10-11T04:20:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/33 2023-10-11T04:20:44.198 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:20:44.198 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-11T04:20:44.198 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T04:20:44.198 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T04:20:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:20:44.240 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-10-11T04:20:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-10-11T04:20:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-10-11T04:20:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-10-11T04:20:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-10-11T04:20:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-10-11T04:20:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-10-11T04:20:44.602 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-10-11T04:20:44.742 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-10-11T04:20:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T04:20:45.038 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6684.g9587ffdf.el9. 28/33 2023-10-11T04:20:45.065 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/33 2023-10-11T04:20:45.092 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 29/33 2023-10-11T04:20:45.092 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:20:45.092 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-11T04:20:45.093 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T04:20:45.093 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T04:20:45.093 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:02.388 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/33 2023-10-11T04:21:02.415 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/33 2023-10-11T04:21:02.415 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:02.416 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-11T04:21:02.416 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T04:21:02.416 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T04:21:02.417 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 31/33 2023-10-11T04:21:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 31/33 2023-10-11T04:21:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-11T04:21:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T04:21:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T04:21:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:03.515 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 32/33 2023-10-11T04:21:03.538 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 32/33 2023-10-11T04:21:03.538 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:03.538 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-11T04:21:03.539 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T04:21:03.539 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T04:21:03.539 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 33/33 2023-10-11T04:21:04.373 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/33 2023-10-11T04:21:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 30/33 2023-10-11T04:21:04.401 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:04.401 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-11T04:21:04.402 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T04:21:04.402 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T04:21:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 31/33 2023-10-11T04:21:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 31/33 2023-10-11T04:21:05.357 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:05.357 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-11T04:21:05.357 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T04:21:05.357 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T04:21:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 32/33 2023-10-11T04:21:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 32/33 2023-10-11T04:21:05.591 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:05.591 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-11T04:21:05.591 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T04:21:05.591 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T04:21:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 33/33 2023-10-11T04:21:13.961 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 33/33 2023-10-11T04:21:13.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/33 2023-10-11T04:21:13.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/33 2023-10-11T04:21:13.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 3/33 2023-10-11T04:21:13.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/33 2023-10-11T04:21:13.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 5/33 2023-10-11T04:21:13.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6684.g9587ffdf.el9. 6/33 2023-10-11T04:21:13.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-10-11T04:21:13.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-10-11T04:21:13.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-10-11T04:21:13.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-10-11T04:21:13.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T04:21:13.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T04:21:13.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-10-11T04:21:13.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 14/33 2023-10-11T04:21:13.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-10-11T04:21:13.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-10-11T04:21:13.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-10-11T04:21:13.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-10-11T04:21:13.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-10-11T04:21:13.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-10-11T04:21:13.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-10-11T04:21:13.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-10-11T04:21:13.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-10-11T04:21:13.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-10-11T04:21:13.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-10-11T04:21:13.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-10-11T04:21:13.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T04:21:13.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-10-11T04:21:13.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-10-11T04:21:13.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-10-11T04:21:13.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-10-11T04:21:13.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-10-11T04:21:15.036 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-10-11T04:21:15.037 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:15.037 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:15.037 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:15.037 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:15.038 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:15.038 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:15.038 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:15.038 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:15.038 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-11T04:21:15.039 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-11T04:21:15.039 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-11T04:21:15.039 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-11T04:21:15.039 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-11T04:21:15.039 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-11T04:21:15.040 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-11T04:21:15.040 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-11T04:21:15.040 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-11T04:21:15.040 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-11T04:21:15.040 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-11T04:21:15.040 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-11T04:21:15.041 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-11T04:21:15.041 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-11T04:21:15.041 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-11T04:21:15.041 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2023-10-11T04:21:15.041 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-11T04:21:15.042 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-11T04:21:15.042 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-11T04:21:15.043 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-11T04:21:15.043 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-11T04:21:15.044 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-11T04:21:15.044 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-11T04:21:15.044 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-11T04:21:15.045 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-11T04:21:15.045 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-11T04:21:15.045 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-11T04:21:15.045 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:15.046 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:15.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-base 2023-10-11T04:21:15.821 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 33/33 2023-10-11T04:21:15.821 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/33 2023-10-11T04:21:15.821 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/33 2023-10-11T04:21:15.822 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 3/33 2023-10-11T04:21:15.822 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 4/33 2023-10-11T04:21:15.822 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 5/33 2023-10-11T04:21:15.822 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6684.g9587ffdf.el9. 6/33 2023-10-11T04:21:15.822 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-10-11T04:21:15.823 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-10-11T04:21:15.823 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-10-11T04:21:15.823 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-10-11T04:21:15.823 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T04:21:15.823 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T04:21:15.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-10-11T04:21:15.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 14/33 2023-10-11T04:21:15.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-10-11T04:21:15.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-10-11T04:21:15.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-10-11T04:21:15.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-10-11T04:21:15.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-10-11T04:21:15.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-10-11T04:21:15.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-10-11T04:21:15.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-10-11T04:21:15.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-10-11T04:21:15.826 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-10-11T04:21:15.826 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-10-11T04:21:15.826 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-10-11T04:21:15.826 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T04:21:15.827 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-10-11T04:21:15.827 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-10-11T04:21:15.828 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-10-11T04:21:15.828 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-10-11T04:21:15.828 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-10-11T04:21:15.914 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:02 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:16.008 INFO:teuthology.orchestra.run.smithi151.stdout:Package ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:16.058 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:16.059 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:16.062 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:16.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install cephadm 2023-10-11T04:21:16.708 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-10-11T04:21:16.708 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:16.708 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:16.709 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:16.709 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:16.709 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:16.709 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:16.710 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:16.710 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:16.710 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-11T04:21:16.710 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-11T04:21:16.710 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-11T04:21:16.711 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-11T04:21:16.711 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-11T04:21:16.711 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-11T04:21:16.711 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-11T04:21:16.711 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-11T04:21:16.711 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-11T04:21:16.712 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-11T04:21:16.712 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-11T04:21:16.712 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-11T04:21:16.712 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-11T04:21:16.712 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-11T04:21:16.713 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-11T04:21:16.713 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2023-10-11T04:21:16.713 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-11T04:21:16.713 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-11T04:21:16.713 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-11T04:21:16.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-11T04:21:16.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-11T04:21:16.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-11T04:21:16.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-11T04:21:16.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-11T04:21:16.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-11T04:21:16.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-11T04:21:16.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-11T04:21:16.715 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:16.715 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:16.726 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:03 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:16.864 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:16.865 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:16.865 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:21:16.865 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:16.865 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:16.866 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 269 k 2023-10-11T04:21:16.866 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:16.866 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:16.866 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:16.867 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:21:16.867 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:16.867 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 269 k 2023-10-11T04:21:16.867 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 264 k 2023-10-11T04:21:16.867 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:16.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-base 2023-10-11T04:21:17.094 INFO:teuthology.orchestra.run.smithi151.stdout:cephadm-18.0.0-6684.g9587ffdf.el9.noarch.rpm 1.2 MB/s | 269 kB 00:00 2023-10-11T04:21:17.095 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:17.095 INFO:teuthology.orchestra.run.smithi151.stdout:Total 1.1 MB/s | 269 kB 00:00 2023-10-11T04:21:17.095 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:17.100 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:17.102 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:17.103 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:17.175 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:17.583 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:01 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:17.616 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:17.677 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-base-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:17.698 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:17.728 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:17.729 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:21:17.729 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:17.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install cephadm 2023-10-11T04:21:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:18.383 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:18.384 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:18.384 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:18.384 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:18.384 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:18.385 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:18.408 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:02 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:18.551 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:18.552 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:18.553 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:21:18.553 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:18.553 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:18.553 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 269 k 2023-10-11T04:21:18.553 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:18.554 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:18.554 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:18.554 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:21:18.554 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:18.554 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 269 k 2023-10-11T04:21:18.555 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 264 k 2023-10-11T04:21:18.555 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:18.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-immutable-object-cache 2023-10-11T04:21:18.782 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm-18.0.0-6684.g9587ffdf.el9.noarch.rpm 1.2 MB/s | 269 kB 00:00 2023-10-11T04:21:18.782 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:18.783 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.1 MB/s | 269 kB 00:00 2023-10-11T04:21:18.783 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:18.788 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:18.788 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:18.791 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:18.792 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:18.865 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:06 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:19.263 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:19.343 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2023-10-11T04:21:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:19.343 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 144 k 2023-10-11T04:21:19.343 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:21:19.344 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 144 k 2023-10-11T04:21:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 438 k 2023-10-11T04:21:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:19.357 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-immutable-object-cache-18.0.0-6684.g9587ff 471 kB/s | 144 kB 00:00 2023-10-11T04:21:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:Total 469 kB/s | 144 kB 00:00 2023-10-11T04:21:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:19.849 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf. 1/1 2023-10-11T04:21:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf. 1/1 2023-10-11T04:21:19.932 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:19.932 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-11T04:21:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:20.045 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:20.045 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:20.046 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:20.046 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:20.046 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:20.047 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:20.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-immutable-object-cache 2023-10-11T04:21:20.871 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:04 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:20.929 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf. 1/1 2023-10-11T04:21:20.930 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:20.930 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:20.930 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:20.931 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:20.931 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:21.014 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:21.015 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:21.015 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-10-11T04:21:21.015 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:21.016 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:21.016 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 144 k 2023-10-11T04:21:21.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:21.016 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:21.016 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:21.017 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:21:21.017 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:21.017 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 144 k 2023-10-11T04:21:21.017 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 438 k 2023-10-11T04:21:21.017 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:21.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr 2023-10-11T04:21:21.337 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-immutable-object-cache-18.0.0-6684.g9587ff 450 kB/s | 144 kB 00:00 2023-10-11T04:21:21.338 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:21.338 INFO:teuthology.orchestra.run.smithi050.stdout:Total 448 kB/s | 144 kB 00:00 2023-10-11T04:21:21.338 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:21.346 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:21.346 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:21.401 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:21.401 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:21.551 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:21.655 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf. 1/1 2023-10-11T04:21:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf. 1/1 2023-10-11T04:21:21.681 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:21.681 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-11T04:21:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:21.776 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:08 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:21.865 INFO:teuthology.orchestra.run.smithi151.stdout:Package ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:21.913 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:21.914 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:21.914 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:21.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-dashboard 2023-10-11T04:21:22.567 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:09 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:22.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf. 1/1 2023-10-11T04:21:22.694 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:22.694 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:22.694 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:22.694 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:22.694 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:22.706 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:22.707 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:22.707 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:21:22.708 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:22.708 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:22.708 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 1.8 M 2023-10-11T04:21:22.708 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:21:22.708 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 23 k 2023-10-11T04:21:22.709 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 15 k 2023-10-11T04:21:22.709 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-11T04:21:22.709 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-11T04:21:22.710 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-11T04:21:22.710 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2023-10-11T04:21:22.710 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-11T04:21:22.710 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:22.710 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:22.711 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:22.711 INFO:teuthology.orchestra.run.smithi151.stdout:Install 7 Packages 2023-10-11T04:21:22.711 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:22.712 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 2.1 M 2023-10-11T04:21:22.712 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 8.6 M 2023-10-11T04:21:22.712 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:22.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr 2023-10-11T04:21:22.955 INFO:teuthology.orchestra.run.smithi151.stdout:(1/7): ceph-grafana-dashboards-18.0.0-6684.g958 124 kB/s | 23 kB 00:00 2023-10-11T04:21:22.997 INFO:teuthology.orchestra.run.smithi151.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 217 kB/s | 9.0 kB 00:00 2023-10-11T04:21:23.022 INFO:teuthology.orchestra.run.smithi151.stdout:(3/7): ceph-prometheus-alerts-18.0.0-6684.g9587 58 kB/s | 15 kB 00:00 2023-10-11T04:21:23.056 INFO:teuthology.orchestra.run.smithi151.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 695 kB/s | 41 kB 00:00 2023-10-11T04:21:23.081 INFO:teuthology.orchestra.run.smithi151.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 524 kB/s | 31 kB 00:00 2023-10-11T04:21:23.115 INFO:teuthology.orchestra.run.smithi151.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2023-10-11T04:21:23.173 INFO:teuthology.orchestra.run.smithi151.stdout:(7/7): ceph-mgr-dashboard-18.0.0-6684.g9587ffdf 4.4 MB/s | 1.8 MB 00:00 2023-10-11T04:21:23.175 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:23.175 INFO:teuthology.orchestra.run.smithi151.stdout:Total 4.4 MB/s | 2.1 MB 00:00 2023-10-11T04:21:23.176 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:23.184 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:23.184 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:23.249 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:23.250 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:23.543 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:23.552 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:07 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:23.617 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-10-11T04:21:23.645 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-mgr-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:23.650 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-10-11T04:21:23.696 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:23.697 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-10-11T04:21:23.698 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:21:23.698 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-10-11T04:21:23.758 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6684.g9587ffdf.el9.n 5/7 2023-10-11T04:21:23.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-dashboard 2023-10-11T04:21:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6684.g9587ffdf.el9. 6/7 2023-10-11T04:21:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarc 7/7 2023-10-11T04:21:24.380 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:08 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:24.525 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:24.526 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:24.526 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:21:24.526 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:24.526 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 1.8 M 2023-10-11T04:21:24.527 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:21:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 23 k 2023-10-11T04:21:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 15 k 2023-10-11T04:21:24.527 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-11T04:21:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-11T04:21:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-11T04:21:24.528 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2023-10-11T04:21:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-11T04:21:24.528 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:24.529 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:24.529 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:24.529 INFO:teuthology.orchestra.run.smithi050.stdout:Install 7 Packages 2023-10-11T04:21:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:24.530 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 2.1 M 2023-10-11T04:21:24.530 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 8.6 M 2023-10-11T04:21:24.530 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:24.617 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarc 7/7 2023-10-11T04:21:24.617 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6684.g9587ffdf.el9. 1/7 2023-10-11T04:21:24.617 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarc 2/7 2023-10-11T04:21:24.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6684.g9587ffdf.el9.n 3/7 2023-10-11T04:21:24.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-10-11T04:21:24.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-10-11T04:21:24.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-10-11T04:21:24.791 INFO:teuthology.orchestra.run.smithi050.stdout:(1/7): ceph-prometheus-alerts-18.0.0-6684.g9587 79 kB/s | 15 kB 00:00 2023-10-11T04:21:24.857 INFO:teuthology.orchestra.run.smithi050.stdout:(2/7): ceph-grafana-dashboards-18.0.0-6684.g958 92 kB/s | 23 kB 00:00 2023-10-11T04:21:24.932 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-10-11T04:21:24.932 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:24.933 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:24.933 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:24.933 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:24.933 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:24.933 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-11T04:21:24.934 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-11T04:21:24.934 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-11T04:21:24.934 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-11T04:21:24.934 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:24.934 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:25.016 INFO:teuthology.orchestra.run.smithi050.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 40 kB/s | 9.0 kB 00:00 2023-10-11T04:21:25.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-11T04:21:25.134 INFO:teuthology.orchestra.run.smithi050.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 266 kB/s | 31 kB 00:00 2023-10-11T04:21:25.167 INFO:teuthology.orchestra.run.smithi050.stdout:(5/7): ceph-mgr-dashboard-18.0.0-6684.g9587ffdf 3.1 MB/s | 1.8 MB 00:00 2023-10-11T04:21:25.183 INFO:teuthology.orchestra.run.smithi050.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 136 kB/s | 41 kB 00:00 2023-10-11T04:21:25.334 INFO:teuthology.orchestra.run.smithi050.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 941 kB/s | 188 kB 00:00 2023-10-11T04:21:25.337 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:25.337 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.5 MB/s | 2.1 MB 00:00 2023-10-11T04:21:25.337 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:25.346 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:25.346 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:25.416 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:25.417 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:25.732 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:12 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:25.733 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:25.802 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-10-11T04:21:25.828 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-10-11T04:21:25.871 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:25.872 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-10-11T04:21:25.872 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:21:25.872 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-10-11T04:21:25.873 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:25.873 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 7.4 M 2023-10-11T04:21:25.873 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:21:25.873 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-11T04:21:25.874 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-11T04:21:25.874 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-11T04:21:25.874 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-11T04:21:25.874 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-11T04:21:25.874 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-11T04:21:25.875 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-11T04:21:25.875 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-11T04:21:25.875 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-11T04:21:25.875 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-11T04:21:25.875 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-11T04:21:25.876 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:25.876 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:25.877 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-10-11T04:21:25.877 INFO:teuthology.orchestra.run.smithi151.stdout:Install 12 Packages 2023-10-11T04:21:25.877 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:25.878 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-10-11T04:21:25.878 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 37 M 2023-10-11T04:21:25.879 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 209 M 2023-10-11T04:21:25.879 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-10-11T04:21:25.926 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6684.g9587ffdf.el9.n 5/7 2023-10-11T04:21:26.024 INFO:teuthology.orchestra.run.smithi151.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 212 kB/s | 32 kB 00:00 2023-10-11T04:21:26.049 INFO:teuthology.orchestra.run.smithi151.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 691 kB/s | 17 kB 00:00 2023-10-11T04:21:26.101 INFO:teuthology.orchestra.run.smithi151.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 682 kB/s | 34 kB 00:00 2023-10-11T04:21:26.173 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6684.g9587ffdf.el9. 6/7 2023-10-11T04:21:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarc 7/7 2023-10-11T04:21:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.5 MB/s | 3.0 MB 00:00 2023-10-11T04:21:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-10-11T04:21:26.483 INFO:teuthology.orchestra.run.smithi151.stdout:(6/12): python3-devel-3.9.17-2.el9.x86_64.rpm 993 kB/s | 205 kB 00:00 2023-10-11T04:21:26.593 INFO:teuthology.orchestra.run.smithi151.stdout:(7/12): ceph-mgr-diskprediction-local-18.0.0-66 10 MB/s | 7.4 MB 00:00 2023-10-11T04:21:26.693 INFO:teuthology.orchestra.run.smithi151.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2023-10-11T04:21:26.718 INFO:teuthology.orchestra.run.smithi151.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 927 kB/s | 217 kB 00:00 2023-10-11T04:21:26.765 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarc 7/7 2023-10-11T04:21:26.765 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6684.g9587ffdf.el9. 1/7 2023-10-11T04:21:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarc 2/7 2023-10-11T04:21:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6684.g9587ffdf.el9.n 3/7 2023-10-11T04:21:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-10-11T04:21:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-10-11T04:21:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-10-11T04:21:27.002 INFO:teuthology.orchestra.run.smithi151.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 694 kB/s | 195 kB 00:00 2023-10-11T04:21:27.044 INFO:teuthology.orchestra.run.smithi151.stdout:(11/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 803 kB 00:00 2023-10-11T04:21:27.100 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-10-11T04:21:27.100 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:27.101 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:27.101 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:27.101 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:27.101 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:27.101 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-11T04:21:27.102 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-11T04:21:27.102 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-11T04:21:27.102 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-11T04:21:27.102 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:27.102 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:27.236 INFO:teuthology.orchestra.run.smithi151.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2023-10-11T04:21:27.239 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:27.239 INFO:teuthology.orchestra.run.smithi151.stdout:Total 27 MB/s | 37 MB 00:01 2023-10-11T04:21:27.239 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:27.261 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:27.261 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:27.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-11T04:21:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:27.685 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:27.939 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:28.085 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:28.086 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================ 2023-10-11T04:21:28.087 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:21:28.087 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================ 2023-10-11T04:21:28.087 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:28.087 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 7.4 M 2023-10-11T04:21:28.087 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:21:28.088 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-11T04:21:28.088 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-11T04:21:28.088 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-11T04:21:28.088 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-11T04:21:28.088 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-11T04:21:28.089 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-11T04:21:28.089 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-11T04:21:28.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-11T04:21:28.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-11T04:21:28.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-11T04:21:28.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-11T04:21:28.090 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:28.090 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:28.090 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================ 2023-10-11T04:21:28.090 INFO:teuthology.orchestra.run.smithi050.stdout:Install 12 Packages 2023-10-11T04:21:28.090 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:28.091 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 37 M 2023-10-11T04:21:28.091 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 209 M 2023-10-11T04:21:28.092 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:28.232 INFO:teuthology.orchestra.run.smithi050.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 221 kB/s | 32 kB 00:00 2023-10-11T04:21:28.282 INFO:teuthology.orchestra.run.smithi050.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 345 kB/s | 17 kB 00:00 2023-10-11T04:21:28.316 INFO:teuthology.orchestra.run.smithi050.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-10-11T04:21:28.375 INFO:teuthology.orchestra.run.smithi050.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2023-10-11T04:21:28.386 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:28.460 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-10-11T04:21:28.467 INFO:teuthology.orchestra.run.smithi050.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 205 kB 00:00 2023-10-11T04:21:28.491 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-10-11T04:21:28.542 INFO:teuthology.orchestra.run.smithi050.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-10-11T04:21:28.583 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-10-11T04:21:28.619 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-10-11T04:21:28.634 INFO:teuthology.orchestra.run.smithi050.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2023-10-11T04:21:28.659 INFO:teuthology.orchestra.run.smithi050.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.9 MB/s | 217 kB 00:00 2023-10-11T04:21:28.776 INFO:teuthology.orchestra.run.smithi050.stdout:(9/12): ceph-mgr-diskprediction-local-18.0.0-66 11 MB/s | 7.4 MB 00:00 2023-10-11T04:21:28.797 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T04:21:28.835 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T04:21:28.901 INFO:teuthology.orchestra.run.smithi050.stdout:(10/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2023-10-11T04:21:28.925 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-10-11T04:21:29.060 INFO:teuthology.orchestra.run.smithi050.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2023-10-11T04:21:29.085 INFO:teuthology.orchestra.run.smithi050.stdout:(12/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 637 kB/s | 195 kB 00:00 2023-10-11T04:21:29.088 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:29.088 INFO:teuthology.orchestra.run.smithi050.stdout:Total 37 MB/s | 37 MB 00:00 2023-10-11T04:21:29.089 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:29.112 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:29.112 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:29.568 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:29.568 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:29.572 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-10-11T04:21:29.683 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T04:21:30.298 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:30.384 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-10-11T04:21:30.415 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-10-11T04:21:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-10-11T04:21:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-10-11T04:21:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T04:21:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T04:21:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-10-11T04:21:30.903 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-10-11T04:21:31.570 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-10-11T04:21:31.683 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T04:21:31.927 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-10-11T04:21:31.958 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587f 12/12 2023-10-11T04:21:33.003 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-10-11T04:21:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-10-11T04:21:34.100 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587f 12/12 2023-10-11T04:21:34.569 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587f 12/12 2023-10-11T04:21:34.569 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587f 1/12 2023-10-11T04:21:34.569 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-10-11T04:21:34.570 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-10-11T04:21:34.570 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-10-11T04:21:34.570 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T04:21:34.570 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T04:21:34.570 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-10-11T04:21:34.571 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-10-11T04:21:34.571 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T04:21:34.571 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-10-11T04:21:34.571 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-10-11T04:21:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-10-11T04:21:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:35.009 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-11T04:21:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-11T04:21:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-11T04:21:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-11T04:21:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-11T04:21:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-11T04:21:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-11T04:21:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-11T04:21:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-11T04:21:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-11T04:21:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-11T04:21:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:35.012 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:35.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-rook 2023-10-11T04:21:36.015 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:23 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:36.154 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:36.155 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================== 2023-10-11T04:21:36.155 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:21:36.156 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================== 2023-10-11T04:21:36.156 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:36.156 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 47 k 2023-10-11T04:21:36.156 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:21:36.156 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-11T04:21:36.157 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-11T04:21:36.157 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-11T04:21:36.157 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-11T04:21:36.157 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-11T04:21:36.157 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-11T04:21:36.157 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-11T04:21:36.158 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-11T04:21:36.158 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-11T04:21:36.158 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-11T04:21:36.158 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-11T04:21:36.158 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-11T04:21:36.159 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:36.159 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:36.159 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================== 2023-10-11T04:21:36.159 INFO:teuthology.orchestra.run.smithi151.stdout:Install 13 Packages 2023-10-11T04:21:36.159 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:36.160 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 2.0 M 2023-10-11T04:21:36.160 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 26 M 2023-10-11T04:21:36.160 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:36.488 INFO:teuthology.orchestra.run.smithi151.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 207 kB/s | 24 kB 00:00 2023-10-11T04:21:36.513 INFO:teuthology.orchestra.run.smithi151.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 126 kB/s | 18 kB 00:00 2023-10-11T04:21:36.564 INFO:teuthology.orchestra.run.smithi151.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2023-10-11T04:21:36.589 INFO:teuthology.orchestra.run.smithi151.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-10-11T04:21:36.614 INFO:teuthology.orchestra.run.smithi151.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-10-11T04:21:36.639 INFO:teuthology.orchestra.run.smithi151.stdout:(6/13): ceph-mgr-rook-18.0.0-6684.g9587ffdf.el9 176 kB/s | 47 kB 00:00 2023-10-11T04:21:36.665 INFO:teuthology.orchestra.run.smithi151.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 567 kB/s | 43 kB 00:00 2023-10-11T04:21:36.689 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587f 12/12 2023-10-11T04:21:36.690 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587f 1/12 2023-10-11T04:21:36.690 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-10-11T04:21:36.690 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-10-11T04:21:36.690 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-10-11T04:21:36.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T04:21:36.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T04:21:36.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-10-11T04:21:36.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-10-11T04:21:36.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T04:21:36.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-10-11T04:21:36.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-10-11T04:21:36.898 INFO:teuthology.orchestra.run.smithi151.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 64 kB/s | 15 kB 00:00 2023-10-11T04:21:36.923 INFO:teuthology.orchestra.run.smithi151.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 104 kB/s | 32 kB 00:00 2023-10-11T04:21:37.049 INFO:teuthology.orchestra.run.smithi151.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 472 kB/s | 59 kB 00:00 2023-10-11T04:21:37.108 INFO:teuthology.orchestra.run.smithi151.stdout:(11/13): python3-google-auth-2.23.2-1.el9.noarc 444 kB/s | 196 kB 00:00 2023-10-11T04:21:37.141 INFO:teuthology.orchestra.run.smithi151.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 976 kB/s | 90 kB 00:00 2023-10-11T04:21:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-10-11T04:21:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:37.201 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-11T04:21:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-11T04:21:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-11T04:21:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-11T04:21:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-11T04:21:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-11T04:21:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-11T04:21:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-11T04:21:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-11T04:21:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-11T04:21:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-11T04:21:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:37.204 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:37.241 INFO:teuthology.orchestra.run.smithi151.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.0 MB/s | 1.0 MB 00:00 2023-10-11T04:21:37.246 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:37.246 INFO:teuthology.orchestra.run.smithi151.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2023-10-11T04:21:37.246 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:37.258 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:37.259 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:37.356 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:37.358 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:37.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-rook 2023-10-11T04:21:37.884 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:38.055 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-10-11T04:21:38.110 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-10-11T04:21:38.161 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:22 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:38.165 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-10-11T04:21:38.203 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-10-11T04:21:38.245 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-10-11T04:21:38.310 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:38.311 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-10-11T04:21:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:21:38.312 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-10-11T04:21:38.312 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 47 k 2023-10-11T04:21:38.312 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:21:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-11T04:21:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-11T04:21:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-11T04:21:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-11T04:21:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-11T04:21:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-11T04:21:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-11T04:21:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-11T04:21:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-11T04:21:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-11T04:21:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-11T04:21:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-11T04:21:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:38.315 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:38.315 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-10-11T04:21:38.315 INFO:teuthology.orchestra.run.smithi050.stdout:Install 13 Packages 2023-10-11T04:21:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:38.316 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 2.0 M 2023-10-11T04:21:38.317 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 26 M 2023-10-11T04:21:38.317 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:38.336 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-10-11T04:21:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 7/13 2023-10-11T04:21:38.505 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-10-11T04:21:38.884 INFO:teuthology.orchestra.run.smithi050.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 134 kB/s | 24 kB 00:00 2023-10-11T04:21:38.909 INFO:teuthology.orchestra.run.smithi050.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 87 kB/s | 18 kB 00:00 2023-10-11T04:21:38.934 INFO:teuthology.orchestra.run.smithi050.stdout:(3/13): ceph-mgr-rook-18.0.0-6684.g9587ffdf.el9 204 kB/s | 47 kB 00:00 2023-10-11T04:21:39.018 INFO:teuthology.orchestra.run.smithi050.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 174 kB 00:00 2023-10-11T04:21:39.043 INFO:teuthology.orchestra.run.smithi050.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 987 kB/s | 132 kB 00:00 2023-10-11T04:21:39.085 INFO:teuthology.orchestra.run.smithi050.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 211 kB 00:00 2023-10-11T04:21:39.111 INFO:teuthology.orchestra.run.smithi050.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 466 kB/s | 43 kB 00:00 2023-10-11T04:21:39.229 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-10-11T04:21:39.236 INFO:teuthology.orchestra.run.smithi050.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 100 kB/s | 15 kB 00:00 2023-10-11T04:21:39.261 INFO:teuthology.orchestra.run.smithi050.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 183 kB/s | 32 kB 00:00 2023-10-11T04:21:39.287 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-10-11T04:21:39.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-10-11T04:21:39.367 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-10-11T04:21:39.391 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 13/13 2023-10-11T04:21:39.470 INFO:teuthology.orchestra.run.smithi050.stdout:(10/13): python3-google-auth-2.23.2-1.el9.noarc 547 kB/s | 196 kB 00:00 2023-10-11T04:21:39.495 INFO:teuthology.orchestra.run.smithi050.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 253 kB/s | 59 kB 00:00 2023-10-11T04:21:39.545 INFO:teuthology.orchestra.run.smithi050.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2023-10-11T04:21:39.721 INFO:teuthology.orchestra.run.smithi050.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.1 MB/s | 1.0 MB 00:00 2023-10-11T04:21:39.723 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:39.723 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2023-10-11T04:21:39.724 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:39.740 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:39.740 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:39.854 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:39.855 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:40.202 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 13/13 2023-10-11T04:21:40.202 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 1/13 2023-10-11T04:21:40.202 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-10-11T04:21:40.202 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-10-11T04:21:40.203 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-10-11T04:21:40.203 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-10-11T04:21:40.203 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-10-11T04:21:40.203 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-10-11T04:21:40.203 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-10-11T04:21:40.204 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-10-11T04:21:40.204 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 10/13 2023-10-11T04:21:40.204 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-10-11T04:21:40.204 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-10-11T04:21:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:40.559 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-10-11T04:21:40.588 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-10-11T04:21:40.588 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:40.588 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:40.588 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:40.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-11T04:21:40.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-11T04:21:40.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-11T04:21:40.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-11T04:21:40.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-11T04:21:40.590 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-11T04:21:40.590 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-11T04:21:40.590 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-11T04:21:40.590 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-11T04:21:40.590 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-11T04:21:40.591 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-11T04:21:40.591 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-11T04:21:40.591 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:40.591 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:40.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-10-11T04:21:40.688 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-10-11T04:21:40.724 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-10-11T04:21:40.774 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-10-11T04:21:40.803 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-cephadm 2023-10-11T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-10-11T04:21:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 7/13 2023-10-11T04:21:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-10-11T04:21:41.397 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:28 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:41.535 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:41.536 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================== 2023-10-11T04:21:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:21:41.536 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================== 2023-10-11T04:21:41.536 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 132 k 2023-10-11T04:21:41.537 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:21:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-11T04:21:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-11T04:21:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-11T04:21:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-11T04:21:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-11T04:21:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:41.538 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:41.539 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================== 2023-10-11T04:21:41.539 INFO:teuthology.orchestra.run.smithi151.stdout:Install 6 Packages 2023-10-11T04:21:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:41.540 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 6.8 M 2023-10-11T04:21:41.540 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 33 M 2023-10-11T04:21:41.540 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:41.799 INFO:teuthology.orchestra.run.smithi151.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-10-11T04:21:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-10-11T04:21:41.855 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-10-11T04:21:41.892 INFO:teuthology.orchestra.run.smithi151.stdout:(2/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 5.9 MB/s | 548 kB 00:00 2023-10-11T04:21:41.905 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-10-11T04:21:41.917 INFO:teuthology.orchestra.run.smithi151.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.4 MB/s | 58 kB 00:00 2023-10-11T04:21:41.942 INFO:teuthology.orchestra.run.smithi151.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 2.0 MB/s | 51 kB 00:00 2023-10-11T04:21:41.961 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-10-11T04:21:41.983 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 13/13 2023-10-11T04:21:42.051 INFO:teuthology.orchestra.run.smithi151.stdout:(5/6): ceph-mgr-cephadm-18.0.0-6684.g9587ffdf.e 326 kB/s | 132 kB 00:00 2023-10-11T04:21:42.126 INFO:teuthology.orchestra.run.smithi151.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 5.8 MB 00:00 2023-10-11T04:21:42.128 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:42.129 INFO:teuthology.orchestra.run.smithi151.stdout:Total 11 MB/s | 6.8 MB 00:00 2023-10-11T04:21:42.129 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:42.138 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:42.139 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:42.227 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:42.227 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:42.525 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:42.703 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-10-11T04:21:42.762 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-10-11T04:21:42.784 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 13/13 2023-10-11T04:21:42.785 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 1/13 2023-10-11T04:21:42.785 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-10-11T04:21:42.785 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-10-11T04:21:42.785 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-10-11T04:21:42.785 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-10-11T04:21:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-10-11T04:21:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-10-11T04:21:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-10-11T04:21:42.786 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-10-11T04:21:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 10/13 2023-10-11T04:21:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-10-11T04:21:42.787 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-10-11T04:21:43.181 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-10-11T04:21:43.182 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:43.182 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:43.182 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:43.182 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-11T04:21:43.183 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-11T04:21:43.183 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-11T04:21:43.183 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-11T04:21:43.183 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-11T04:21:43.183 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-11T04:21:43.184 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-11T04:21:43.184 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-11T04:21:43.184 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-11T04:21:43.185 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-11T04:21:43.185 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-11T04:21:43.185 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-11T04:21:43.185 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:43.185 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:43.275 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-10-11T04:21:43.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-10-11T04:21:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-10-11T04:21:43.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-cephadm 2023-10-11T04:21:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 6/6 2023-10-11T04:21:44.038 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:28 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:44.185 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:44.186 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-10-11T04:21:44.186 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:21:44.187 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-10-11T04:21:44.187 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:44.187 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 132 k 2023-10-11T04:21:44.187 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:21:44.188 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-11T04:21:44.188 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-11T04:21:44.188 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-11T04:21:44.188 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-11T04:21:44.188 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-11T04:21:44.189 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:44.189 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:44.189 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-10-11T04:21:44.189 INFO:teuthology.orchestra.run.smithi050.stdout:Install 6 Packages 2023-10-11T04:21:44.189 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:44.190 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 6.8 M 2023-10-11T04:21:44.190 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 33 M 2023-10-11T04:21:44.191 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 6/6 2023-10-11T04:21:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/6 2023-10-11T04:21:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-10-11T04:21:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-10-11T04:21:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-10-11T04:21:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-10-11T04:21:44.431 INFO:teuthology.orchestra.run.smithi050.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-10-11T04:21:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-10-11T04:21:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:44.537 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-11T04:21:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-11T04:21:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-11T04:21:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-11T04:21:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-11T04:21:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:44.539 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:44.573 INFO:teuthology.orchestra.run.smithi050.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2023-10-11T04:21:44.598 INFO:teuthology.orchestra.run.smithi050.stdout:(3/6): ceph-mgr-cephadm-18.0.0-6684.g9587ffdf.e 398 kB/s | 132 kB 00:00 2023-10-11T04:21:44.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-fuse 2023-10-11T04:21:44.891 INFO:teuthology.orchestra.run.smithi050.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 174 kB/s | 51 kB 00:00 2023-10-11T04:21:44.916 INFO:teuthology.orchestra.run.smithi050.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 169 kB/s | 58 kB 00:00 2023-10-11T04:21:44.991 INFO:teuthology.orchestra.run.smithi050.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 980 kB/s | 548 kB 00:00 2023-10-11T04:21:44.993 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:44.994 INFO:teuthology.orchestra.run.smithi050.stdout:Total 8.4 MB/s | 6.8 MB 00:00 2023-10-11T04:21:44.994 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:45.004 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:45.005 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:45.102 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:45.103 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:45.385 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:32 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:45.529 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:45.530 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:45.530 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:21:45.530 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:45.530 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:45.531 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 832 k 2023-10-11T04:21:45.531 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-11T04:21:45.531 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-11T04:21:45.531 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:45.531 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:45.532 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:45.532 INFO:teuthology.orchestra.run.smithi151.stdout:Install 2 Packages 2023-10-11T04:21:45.532 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:45.533 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 911 k 2023-10-11T04:21:45.533 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 3.0 M 2023-10-11T04:21:45.533 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:45.583 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-10-11T04:21:45.635 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-10-11T04:21:45.674 INFO:teuthology.orchestra.run.smithi151.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 555 kB/s | 79 kB 00:00 2023-10-11T04:21:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-10-11T04:21:46.199 INFO:teuthology.orchestra.run.smithi151.stdout:(2/2): ceph-fuse-18.0.0-6684.g9587ffdf.el9.x86_ 1.2 MB/s | 832 kB 00:00 2023-10-11T04:21:46.200 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:46.201 INFO:teuthology.orchestra.run.smithi151.stdout:Total 1.3 MB/s | 911 kB 00:00 2023-10-11T04:21:46.201 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:46.220 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:46.220 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-10-11T04:21:46.296 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:46.296 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:46.349 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-10-11T04:21:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 6/6 2023-10-11T04:21:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:46.607 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-10-11T04:21:46.674 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/2 2023-10-11T04:21:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 6/6 2023-10-11T04:21:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 1/6 2023-10-11T04:21:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-10-11T04:21:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-10-11T04:21:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-10-11T04:21:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-10-11T04:21:47.442 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/2 2023-10-11T04:21:47.442 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/2 2023-10-11T04:21:47.493 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-10-11T04:21:47.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:47.493 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:47.494 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:47.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-11T04:21:47.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-11T04:21:47.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-11T04:21:47.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-11T04:21:47.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-11T04:21:47.495 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:47.495 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:47.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-fuse 2023-10-11T04:21:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-10-11T04:21:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:47.774 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-10-11T04:21:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:47.775 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:48.033 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-volume 2023-10-11T04:21:48.343 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:32 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:48.486 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:48.487 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:48.487 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:21:48.487 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:48.488 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:48.488 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 832 k 2023-10-11T04:21:48.488 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-11T04:21:48.488 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-11T04:21:48.489 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:48.489 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:48.489 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:48.489 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2023-10-11T04:21:48.489 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:48.490 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 911 k 2023-10-11T04:21:48.490 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 3.0 M 2023-10-11T04:21:48.491 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:48.602 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 694 kB/s | 79 kB 00:00 2023-10-11T04:21:48.640 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:35 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:48.779 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:48.780 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-11T04:21:48.781 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:48.781 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 262 k 2023-10-11T04:21:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:48.782 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:48.782 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:48.782 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:21:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:48.782 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 262 k 2023-10-11T04:21:48.783 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 1.2 M 2023-10-11T04:21:48.783 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:49.007 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-volume-18.0.0-6684.g9587ffdf.el9.noarch.rp 1.1 MB/s | 262 kB 00:00 2023-10-11T04:21:49.008 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:49.008 INFO:teuthology.orchestra.run.smithi151.stdout:Total 1.1 MB/s | 262 kB 00:00 2023-10-11T04:21:49.009 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:49.016 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:49.017 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:49.035 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): ceph-fuse-18.0.0-6684.g9587ffdf.el9.x86_ 1.5 MB/s | 832 kB 00:00 2023-10-11T04:21:49.037 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:49.037 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.6 MB/s | 911 kB 00:00 2023-10-11T04:21:49.037 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:49.054 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:49.054 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:49.058 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:49.059 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:49.138 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:49.139 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:49.333 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:49.342 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:49.343 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-11T04:21:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-10-11T04:21:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/2 2023-10-11T04:21:50.203 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2/2 2023-10-11T04:21:50.203 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/2 2023-10-11T04:21:50.371 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:50.371 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:50.372 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:50.372 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:50.372 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:50.373 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:50.522 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-10-11T04:21:50.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:50.522 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:50.522 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-10-11T04:21:50.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:50.523 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:50.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librados-devel 2023-10-11T04:21:50.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-volume 2023-10-11T04:21:51.294 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:38 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:51.418 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:35 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:51.432 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:51.433 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:51.433 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2023-10-11T04:21:51.433 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:51.433 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 127 k 2023-10-11T04:21:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:51.434 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:51.434 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:51.434 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:21:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:51.435 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 127 k 2023-10-11T04:21:51.435 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 460 k 2023-10-11T04:21:51.435 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:51.563 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:51.564 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-11T04:21:51.564 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:51.564 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:18.0.0-6684.g9587ffdf.el9 ceph-noarch 262 k 2023-10-11T04:21:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:51.565 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:51.565 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:51.565 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:21:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:51.566 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 262 k 2023-10-11T04:21:51.566 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.2 M 2023-10-11T04:21:51.566 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:51.650 INFO:teuthology.orchestra.run.smithi151.stdout:librados-devel-18.0.0-6684.g9587ffdf.el9.x86_64 586 kB/s | 127 kB 00:00 2023-10-11T04:21:51.651 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:51.651 INFO:teuthology.orchestra.run.smithi151.stdout:Total 582 kB/s | 127 kB 00:00 2023-10-11T04:21:51.652 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:51.657 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:51.657 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:51.717 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:51.717 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:51.874 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:51.915 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-volume-18.0.0-6684.g9587ffdf.el9.noarch.rp 750 kB/s | 262 kB 00:00 2023-10-11T04:21:51.915 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:51.916 INFO:teuthology.orchestra.run.smithi050.stdout:Total 746 kB/s | 262 kB 00:00 2023-10-11T04:21:51.916 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:51.924 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:51.924 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:51.964 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:51.965 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:51.965 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:52.191 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:52.266 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:52.283 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:52.283 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:21:52.283 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-11T04:21:52.284 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:52.450 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:52.767 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:52.767 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:52.768 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:52.768 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:52.768 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:52.768 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:52.990 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install libcephfs2 2023-10-11T04:21:53.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 1/1 2023-10-11T04:21:53.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:53.338 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:53.338 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:18.0.0-6684.g9587ffdf.el9.noarch 2023-10-11T04:21:53.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:53.339 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:53.599 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:40 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:53.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados-devel 2023-10-11T04:21:53.689 INFO:teuthology.orchestra.run.smithi151.stdout:Package libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:53.739 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:53.740 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:53.740 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:53.805 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install libcephfs-devel 2023-10-11T04:21:54.292 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:38 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:54.403 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:41 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:54.438 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:54.439 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-10-11T04:21:54.439 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:54.439 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 127 k 2023-10-11T04:21:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:54.440 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:54.440 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:54.440 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:21:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:54.441 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 127 k 2023-10-11T04:21:54.441 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 460 k 2023-10-11T04:21:54.441 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:54.543 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:54.544 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:54.544 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2023-10-11T04:21:54.545 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:54.545 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:21:54.545 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 31 k 2023-10-11T04:21:54.545 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:54.545 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:21:54.546 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:21:54.546 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:21:54.546 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:54.546 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 31 k 2023-10-11T04:21:54.546 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 139 k 2023-10-11T04:21:54.547 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:21:54.636 INFO:teuthology.orchestra.run.smithi050.stdout:librados-devel-18.0.0-6684.g9587ffdf.el9.x86_64 645 kB/s | 127 kB 00:00 2023-10-11T04:21:54.637 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:54.637 INFO:teuthology.orchestra.run.smithi050.stdout:Total 640 kB/s | 127 kB 00:00 2023-10-11T04:21:54.638 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:54.643 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:54.644 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:54.708 INFO:teuthology.orchestra.run.smithi151.stdout:libcephfs-devel-18.0.0-6684.g9587ffdf.el9.x86_6 191 kB/s | 31 kB 00:00 2023-10-11T04:21:54.709 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:54.710 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:54.710 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:54.710 INFO:teuthology.orchestra.run.smithi151.stdout:Total 190 kB/s | 31 kB 00:00 2023-10-11T04:21:54.710 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:21:54.712 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:21:54.712 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:21:54.738 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:21:54.739 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:21:54.828 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:21:54.875 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:54.970 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:55.361 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:55.380 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:55.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:55.619 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:55.619 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:21:55.619 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:55.619 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:21:55.620 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:55.728 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:55.728 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:55.728 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:55.729 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:55.729 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:55.729 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:55.797 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librados2 2023-10-11T04:21:55.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs2 2023-10-11T04:21:56.397 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:43 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:56.489 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:56.539 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:56.540 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:56.540 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:56.563 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:40 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:56.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librbd1 2023-10-11T04:21:56.656 INFO:teuthology.orchestra.run.smithi050.stdout:Package libcephfs2-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:56.709 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:56.710 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:21:56.710 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:56.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs-devel 2023-10-11T04:21:57.187 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:44 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:57.277 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:57.327 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:57.328 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:57.328 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:57.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rados 2023-10-11T04:21:57.398 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:41 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:57.543 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:57.544 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-10-11T04:21:57.545 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:57.545 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:21:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 31 k 2023-10-11T04:21:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:57.545 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:21:57.546 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:21:57.546 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:21:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:57.546 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 31 k 2023-10-11T04:21:57.547 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 139 k 2023-10-11T04:21:57.547 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:21:57.715 INFO:teuthology.orchestra.run.smithi050.stdout:libcephfs-devel-18.0.0-6684.g9587ffdf.el9.x86_6 184 kB/s | 31 kB 00:00 2023-10-11T04:21:57.716 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:21:57.716 INFO:teuthology.orchestra.run.smithi050.stdout:Total 182 kB/s | 31 kB 00:00 2023-10-11T04:21:57.716 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:21:57.719 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:21:57.719 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:21:57.756 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:21:57.756 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:21:57.849 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:21:57.976 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:57.994 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:44 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:58.083 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:58.133 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:58.134 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:58.134 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:58.199 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rgw 2023-10-11T04:21:58.349 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:58.638 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:21:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:58.639 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:21:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:21:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:21:58.640 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:58.792 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:45 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:58.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados2 2023-10-11T04:21:58.881 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:58.931 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:58.932 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:58.932 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:58.996 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-cephfs 2023-10-11T04:21:59.472 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:43 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:21:59.564 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:59.593 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:46 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:21:59.616 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:21:59.618 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:21:59.618 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:21:59.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librbd1 2023-10-11T04:21:59.684 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:21:59.733 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:21:59.734 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:21:59.734 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:21:59.800 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rbd 2023-10-11T04:22:00.301 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:44 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:00.393 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:22:00.394 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:47 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:22:00.446 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:00.447 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:22:00.447 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:00.481 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:22:00.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rados 2023-10-11T04:22:00.531 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:22:00.532 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-11T04:22:00.532 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:22:00.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-fuse 2023-10-11T04:22:01.127 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:45 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:01.191 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:48 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:22:01.220 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rados-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:22:01.274 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:01.275 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:22:01.275 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:01.330 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:22:01.331 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:01.331 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2023-10-11T04:22:01.332 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:01.332 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:22:01.332 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 87 k 2023-10-11T04:22:01.332 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:01.333 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:22:01.333 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:01.333 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:22:01.333 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:01.333 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 87 k 2023-10-11T04:22:01.334 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 252 k 2023-10-11T04:22:01.334 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:22:01.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rgw 2023-10-11T04:22:01.537 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-fuse-18.0.0-6684.g9587ffdf.el9.x86_64.rpm 422 kB/s | 87 kB 00:00 2023-10-11T04:22:01.538 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:22:01.538 INFO:teuthology.orchestra.run.smithi151.stdout:Total 419 kB/s | 87 kB 00:00 2023-10-11T04:22:01.539 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:22:01.545 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:22:01.545 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:22:01.600 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:22:01.601 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:22:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:22:01.836 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:01.964 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:45 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:02.057 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rgw-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:22:02.112 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:02.113 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:22:02.113 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:02.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-cephfs 2023-10-11T04:22:02.232 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:02.490 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:02.490 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:02.490 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:22:02.491 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:22:02.491 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:02.491 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:22:02.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-mirror 2023-10-11T04:22:02.806 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:46 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:02.900 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-cephfs-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:22:02.953 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:02.954 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:22:02.954 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:03.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rbd 2023-10-11T04:22:03.371 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:50 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:22:03.513 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:22:03.514 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:03.514 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2023-10-11T04:22:03.515 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:03.515 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:22:03.515 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 3.0 M 2023-10-11T04:22:03.515 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:03.515 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:22:03.515 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:22:03.516 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 3.0 M 2023-10-11T04:22:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 13 M 2023-10-11T04:22:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:22:03.628 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:47 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:03.719 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 is already installed. 2023-10-11T04:22:03.774 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:03.775 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-11T04:22:03.775 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:03.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-fuse 2023-10-11T04:22:04.458 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:48 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:04.602 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:04.603 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:04.603 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-10-11T04:22:04.603 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:04.603 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:22:04.604 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 87 k 2023-10-11T04:22:04.604 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:04.604 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:22:04.604 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:04.604 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:22:04.605 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:04.605 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 87 k 2023-10-11T04:22:04.605 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 252 k 2023-10-11T04:22:04.605 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:22:04.819 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-mirror-18.0.0-6684.g9587ffdf.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2023-10-11T04:22:04.819 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:22:04.820 INFO:teuthology.orchestra.run.smithi151.stdout:Total 2.3 MB/s | 3.0 MB 00:01 2023-10-11T04:22:04.820 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:22:04.829 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:22:04.829 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:22:04.903 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:22:04.903 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:22:04.909 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-fuse-18.0.0-6684.g9587ffdf.el9.x86_64.rpm 283 kB/s | 87 kB 00:00 2023-10-11T04:22:04.910 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:22:04.911 INFO:teuthology.orchestra.run.smithi050.stdout:Total 282 kB/s | 87 kB 00:00 2023-10-11T04:22:04.911 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:22:04.918 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:22:04.919 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:22:04.977 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:22:04.978 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:22:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:22:05.227 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:05.324 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:22:05.386 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:05.410 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:05.410 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:22:05.410 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-11T04:22:05.411 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T04:22:05.411 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T04:22:05.412 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:05.905 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:22:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:22:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:05.906 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:06.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-mirror 2023-10-11T04:22:06.551 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:06.551 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:06.551 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:22:06.551 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:22:06.552 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:06.552 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:22:06.751 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:50 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:06.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-nbd 2023-10-11T04:22:06.896 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:06.897 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-10-11T04:22:06.897 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:06.897 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:22:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 3.0 M 2023-10-11T04:22:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:06.898 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:22:06.898 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:06.898 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:22:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:06.899 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 3.0 M 2023-10-11T04:22:06.899 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 13 M 2023-10-11T04:22:06.899 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:22:07.271 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-mirror-18.0.0-6684.g9587ffdf.el9.x86_64.rpm 8.0 MB/s | 3.0 MB 00:00 2023-10-11T04:22:07.272 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:22:07.272 INFO:teuthology.orchestra.run.smithi050.stdout:Total 8.0 MB/s | 3.0 MB 00:00 2023-10-11T04:22:07.273 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:22:07.282 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:22:07.283 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:22:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:22:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:22:07.422 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:54 ago on Wed 11 Oct 2023 04:19:13 AM UTC. 2023-10-11T04:22:07.561 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-11T04:22:07.562 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2023-10-11T04:22:07.562 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:07.562 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-11T04:22:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 168 k 2023-10-11T04:22:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:07.563 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-11T04:22:07.563 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-11T04:22:07.563 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2023-10-11T04:22:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:07.564 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 168 k 2023-10-11T04:22:07.564 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 533 k 2023-10-11T04:22:07.564 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-11T04:22:07.796 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:22:07.864 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:07.876 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-nbd-18.0.0-6684.g9587ffdf.el9.x86_64.rpm 537 kB/s | 168 kB 00:00 2023-10-11T04:22:07.877 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:22:07.877 INFO:teuthology.orchestra.run.smithi151.stdout:Total 534 kB/s | 168 kB 00:00 2023-10-11T04:22:07.878 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-11T04:22:07.885 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-11T04:22:07.885 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-11T04:22:07.889 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:07.889 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T04:22:07.889 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-11T04:22:07.890 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T04:22:07.891 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T04:22:07.891 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:07.945 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-11T04:22:07.945 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-11T04:22:08.102 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-11T04:22:08.191 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:08.619 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:08.916 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:08.916 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:08.917 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-11T04:22:08.917 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:22:08.917 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:08.917 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-11T04:22:09.011 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:09.011 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:09.012 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:22:09.012 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:22:09.012 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:09.012 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:09.163 DEBUG:teuthology.parallel:result is None 2023-10-11T04:22:09.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-nbd 2023-10-11T04:22:09.863 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:53 ago on Wed 11 Oct 2023 04:19:16 AM UTC. 2023-10-11T04:22:10.007 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-11T04:22:10.008 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:10.009 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-10-11T04:22:10.009 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:10.009 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-11T04:22:10.009 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:18.0.0-6684.g9587ffdf.el9 ceph 168 k 2023-10-11T04:22:10.009 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:10.010 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-11T04:22:10.010 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-11T04:22:10.010 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-10-11T04:22:10.010 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:10.010 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 168 k 2023-10-11T04:22:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 533 k 2023-10-11T04:22:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-11T04:22:10.459 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-nbd-18.0.0-6684.g9587ffdf.el9.x86_64.rpm 374 kB/s | 168 kB 00:00 2023-10-11T04:22:10.460 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-11T04:22:10.460 INFO:teuthology.orchestra.run.smithi050.stdout:Total 373 kB/s | 168 kB 00:00 2023-10-11T04:22:10.460 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-11T04:22:10.468 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-11T04:22:10.469 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-11T04:22:10.533 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-11T04:22:10.533 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-11T04:22:10.696 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-11T04:22:10.785 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:11.257 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:11.577 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 1/1 2023-10-11T04:22:11.578 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:11.578 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-11T04:22:11.578 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:18.0.0-6684.g9587ffdf.el9.x86_64 2023-10-11T04:22:11.578 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:11.579 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-11T04:22:11.855 DEBUG:teuthology.parallel:result is None 2023-10-11T04:22:11.856 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 2023-10-11T04:22:12.002 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-11T04:22:12.024 INFO:teuthology.orchestra.run.smithi050.stdout:18.0.0-6684.g9587ffdf.el9 2023-10-11T04:22:12.025 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6684.g9587ffdf.el9 2023-10-11T04:22:12.025 INFO:teuthology.task.install:The correct ceph version 18.0.0-6684.g9587ffdf is installed. 2023-10-11T04:22:12.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 2023-10-11T04:22:13.061 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-11T04:22:13.086 INFO:teuthology.orchestra.run.smithi151.stdout:18.0.0-6684.g9587ffdf.el9 2023-10-11T04:22:13.087 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6684.g9587ffdf.el9 2023-10-11T04:22:13.087 INFO:teuthology.task.install:The correct ceph version 18.0.0-6684.g9587ffdf is installed. 2023-10-11T04:22:13.087 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-11T04:22:13.088 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:13.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-11T04:22:13.126 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:13.126 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-11T04:22:13.158 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-11T04:22:13.158 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:13.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-10-11T04:22:13.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-11T04:22:13.273 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:13.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-10-11T04:22:13.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-11T04:22:13.374 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-11T04:22:13.375 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:13.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-11T04:22:13.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-11T04:22:13.482 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:13.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-11T04:22:13.512 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-11T04:22:13.582 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-11T04:22:13.582 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:13.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-10-11T04:22:13.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-11T04:22:13.688 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:13.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-10-11T04:22:13.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-11T04:22:13.786 INFO:teuthology.run_tasks:Running task ceph... 2023-10-11T04:22:13.866 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-11T04:22:13.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-10-11T04:22:13.869 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-10-11T04:22:13.899 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-11T04:22:13.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-11T04:22:13.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-11T04:22:13.972 INFO:tasks.ceph:Creating extra log directories... 2023-10-11T04:22:13.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-11T04:22:14.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-11T04:22:14.052 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-11T04:22:14.053 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-11T04:22:14.053 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047', 'branch': 'wip-yingxin-crimson-osd-crosscore-pg-submission', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': 'yingxin.cheng@intel.com', 'first_in_suite': False, 'job_id': '7421047', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yingxin-crimson-osd-crosscore-pg-submission'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5'}}, 'workunit': {'branch': 'wip-yingxin-crimson-osd-crosscore-pg-submission', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5'}}, 'owner': 'scheduled_yingxin@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-yingxin-crimson-osd-crosscore-pg-submission', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5', 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHH5ZT9sWcQ8M4I8bkHT3BMU232ofSnO8QLN7IgAcS2FY9NQNErb1d4QN2P0rhrFLcjfsVPAOeFyTCYAIbJImXw=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/b3CFSmLCP42k6y/5pgjPhbw7SHls1sk0jQCh9vjQNd3Pw15xxVZSYGGV7GAKD7Oyj35Z1gvanyBWDdqpo3PE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-11_02:17:04', 'tube': 'smithi', 'user': 'yingxin', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-11T04:22:14.054 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-11T04:22:14.086 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-11T04:22:14.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-10-11T04:22:14.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-10-11T04:22:14.171 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:14.171 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-10-11T04:22:14.227 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-11T04:22:14.227 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-10-11T04:22:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-11T04:22:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:14.285 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-10-11T04:22:14.285 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:14.285 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:14.285 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-11 04:22:08.119120622 +0000 2023-10-11T04:22:14.286 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-11 04:18:30.391589489 +0000 2023-10-11T04:22:14.286 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-11 04:18:30.391589489 +0000 2023-10-11T04:22:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-11 04:18:30.391589489 +0000 2023-10-11T04:22:14.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-11T04:22:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-11T04:22:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-11T04:22:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000101901 s, 5.0 MB/s 2023-10-11T04:22:14.354 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-11T04:22:14.411 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-10-11T04:22:14.466 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-11T04:22:14.466 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:14.466 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-10-11T04:22:14.466 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-11 04:22:08.120120596 +0000 2023-10-11T04:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-11 04:18:30.908576353 +0000 2023-10-11T04:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-11 04:18:30.908576353 +0000 2023-10-11T04:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-11 04:18:30.908576353 +0000 2023-10-11T04:22:14.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-11T04:22:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-11T04:22:14.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-11T04:22:14.535 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.7893e-05 s, 5.2 MB/s 2023-10-11T04:22:14.536 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-11T04:22:14.592 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-10-11T04:22:14.647 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-11T04:22:14.647 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:14.648 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-10-11T04:22:14.648 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:14.648 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:14.648 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-11 04:22:08.120120596 +0000 2023-10-11T04:22:14.648 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-11 04:18:31.427563165 +0000 2023-10-11T04:22:14.648 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-11 04:18:31.427563165 +0000 2023-10-11T04:22:14.649 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-11 04:18:31.427563165 +0000 2023-10-11T04:22:14.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-11T04:22:14.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-11T04:22:14.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-11T04:22:14.716 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 8.9557e-05 s, 5.7 MB/s 2023-10-11T04:22:14.717 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-11T04:22:14.775 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-10-11T04:22:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-11T04:22:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:14.830 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-10-11T04:22:14.830 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:14.830 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:14.831 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-11 04:22:08.120120596 +0000 2023-10-11T04:22:14.831 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-11 04:18:31.903551070 +0000 2023-10-11T04:22:14.831 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-11 04:18:31.903551070 +0000 2023-10-11T04:22:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-11 04:18:31.903551070 +0000 2023-10-11T04:22:14.832 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-11T04:22:14.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-11T04:22:14.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-11T04:22:14.899 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.4028e-05 s, 5.4 MB/s 2023-10-11T04:22:14.900 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-11T04:22:14.955 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-11T04:22:14.956 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:14.956 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-10-11T04:22:14.974 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-11T04:22:14.974 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-10-11T04:22:15.030 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-11T04:22:15.030 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:15.031 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-10-11T04:22:15.031 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:15.031 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:15.031 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-11 04:22:05.644480956 +0000 2023-10-11T04:22:15.031 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-11 04:18:22.381233761 +0000 2023-10-11T04:22:15.031 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-11 04:18:22.381233761 +0000 2023-10-11T04:22:15.032 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-11 04:18:22.381233761 +0000 2023-10-11T04:22:15.032 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-11T04:22:15.098 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-11T04:22:15.098 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-11T04:22:15.099 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000213047 s, 2.4 MB/s 2023-10-11T04:22:15.100 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-11T04:22:15.156 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-10-11T04:22:15.213 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-11T04:22:15.213 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:15.214 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-10-11T04:22:15.214 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:15.214 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:15.214 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-11 04:22:05.644480956 +0000 2023-10-11T04:22:15.214 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-11 04:18:22.878227766 +0000 2023-10-11T04:22:15.215 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-11 04:18:22.878227766 +0000 2023-10-11T04:22:15.215 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-11 04:18:22.878227766 +0000 2023-10-11T04:22:15.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-11T04:22:15.280 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-11T04:22:15.281 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-11T04:22:15.281 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000193303 s, 2.6 MB/s 2023-10-11T04:22:15.282 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-11T04:22:15.339 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-10-11T04:22:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-11T04:22:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:15.395 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-10-11T04:22:15.396 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:15.396 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:15.396 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-11 04:22:05.644480956 +0000 2023-10-11T04:22:15.396 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-11 04:18:23.371221819 +0000 2023-10-11T04:22:15.396 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-11 04:18:23.371221819 +0000 2023-10-11T04:22:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-11 04:18:23.371221819 +0000 2023-10-11T04:22:15.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-11T04:22:15.461 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-11T04:22:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-11T04:22:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000180339 s, 2.8 MB/s 2023-10-11T04:22:15.463 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-11T04:22:15.519 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-10-11T04:22:15.575 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-11T04:22:15.575 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T04:22:15.576 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-10-11T04:22:15.576 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T04:22:15.576 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T04:22:15.577 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-11 04:22:05.645480944 +0000 2023-10-11T04:22:15.577 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-11 04:18:23.882215655 +0000 2023-10-11T04:22:15.577 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-11 04:18:23.882215655 +0000 2023-10-11T04:22:15.578 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-11 04:18:23.882215655 +0000 2023-10-11T04:22:15.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-11T04:22:15.640 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-11T04:22:15.641 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-11T04:22:15.641 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000204361 s, 2.5 MB/s 2023-10-11T04:22:15.642 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-11T04:22:15.697 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-11T04:22:15.697 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-10-11T04:22:15.697 INFO:tasks.ceph:Generating config... 2023-10-11T04:22:15.699 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-10-11T04:22:15.699 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-10-11T04:22:15.699 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-10-11T04:22:15.700 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-10-11T04:22:15.700 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-10-11T04:22:15.700 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-11T04:22:15.700 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-11T04:22:15.701 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-11T04:22:15.701 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2023-10-11T04:22:15.701 INFO:tasks.ceph:[mon] osd pool default crimson = True 2023-10-11T04:22:15.701 INFO:tasks.ceph:[osd] debug monc = 20 2023-10-11T04:22:15.702 INFO:tasks.ceph:[osd] crimson seastar smp = 3 2023-10-11T04:22:15.702 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-11T04:22:15.702 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-11T04:22:15.703 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-10-11T04:22:15.703 INFO:tasks.ceph:[osd] osd class default list = * 2023-10-11T04:22:15.703 INFO:tasks.ceph:[osd] osd class load list = * 2023-10-11T04:22:15.703 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-10-11T04:22:15.704 INFO:tasks.ceph:[client] debug ms = 1 2023-10-11T04:22:15.704 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2023-10-11T04:22:15.704 INFO:tasks.ceph:[global] ms client mode = crc 2023-10-11T04:22:15.704 INFO:tasks.ceph:[global] ms cluster mode = crc 2023-10-11T04:22:15.705 INFO:tasks.ceph:[global] ms mon client mode = crc 2023-10-11T04:22:15.705 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2023-10-11T04:22:15.705 INFO:tasks.ceph:[global] ms mon service mode = crc 2023-10-11T04:22:15.705 INFO:tasks.ceph:[global] ms service mode = crc 2023-10-11T04:22:15.706 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-11T04:22:15.706 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-11T04:22:15.706 INFO:tasks.ceph:Setting up mon.a... 2023-10-11T04:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-11T04:22:15.777 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2023-10-11T04:22:15.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-11T04:22:15.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-11T04:22:15.868 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50')] 2023-10-11T04:22:15.869 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}} 2023-10-11T04:22:15.870 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:15.870 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-11T04:22:15.923 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --print /home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:16.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:16.007+0000 7f46b2e4fe80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:16.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:16.007+0000 7f46b2e4fe80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:16.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:16.008+0000 7f46b2e4fe80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:16.010 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:16.010 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:16.011 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = pacific 2023-10-11T04:22:16.011 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2023-10-11T04:22:16.011 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:16.011 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2023-10-11T04:22:16.009422+0000 2023-10-11T04:22:16.011 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-10-11T04:22:16.009422+0000 2023-10-11T04:22:16.012 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 16 (pacific) 2023-10-11T04:22:16.012 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2023-10-11T04:22:16.012 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2023-10-11T04:22:16.012 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-10-11T04:22:16.013 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-11T04:22:16.028 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 56da8739-9c2f-410c-8b66-6ff166a3873a... 2023-10-11T04:22:16.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-11T04:22:16.073 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-11T04:22:16.124 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-11T04:22:16.124 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-11T04:22:16.124 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-11T04:22:16.125 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-11T04:22:16.125 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.125 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-11T04:22:16.125 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.125 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-11T04:22:16.126 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.126 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-11T04:22:16.126 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-11T04:22:16.126 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.126 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-11T04:22:16.127 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-11T04:22:16.127 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.127 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-11T04:22:16.127 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-11T04:22:16.127 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.128 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-11T04:22:16.128 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-11T04:22:16.128 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.128 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-11T04:22:16.128 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.129 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-11T04:22:16.129 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-11T04:22:16.129 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-11T04:22:16.129 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-11T04:22:16.129 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-11T04:22:16.129 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-11T04:22:16.130 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-11T04:22:16.130 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-11T04:22:16.130 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-11T04:22:16.131 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-11T04:22:16.132 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.132 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-11T04:22:16.132 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.132 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-11T04:22:16.132 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.133 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-11T04:22:16.133 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.133 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-11T04:22:16.133 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-11T04:22:16.133 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-11T04:22:16.134 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = 172.21.15.50 2023-10-11T04:22:16.134 INFO:teuthology.orchestra.run.smithi151.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-10-11T04:22:16.134 INFO:teuthology.orchestra.run.smithi151.stdout: ms client mode = crc 2023-10-11T04:22:16.134 INFO:teuthology.orchestra.run.smithi151.stdout: ms cluster mode = crc 2023-10-11T04:22:16.134 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon client mode = crc 2023-10-11T04:22:16.135 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon cluster mode = crc 2023-10-11T04:22:16.135 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon service mode = crc 2023-10-11T04:22:16.135 INFO:teuthology.orchestra.run.smithi151.stdout: ms service mode = crc 2023-10-11T04:22:16.135 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:16.135 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.135 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-11T04:22:16.136 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-11T04:22:16.136 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.136 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-11T04:22:16.136 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-11T04:22:16.136 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-11T04:22:16.137 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.137 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-11T04:22:16.137 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-11T04:22:16.137 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.137 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-11T04:22:16.137 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-11T04:22:16.138 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-11T04:22:16.138 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.138 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-11T04:22:16.138 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-11T04:22:16.139 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.139 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-11T04:22:16.139 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.139 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-11T04:22:16.139 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.140 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-11T04:22:16.140 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.140 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-11T04:22:16.140 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-11T04:22:16.140 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.141 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-11T04:22:16.141 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-11T04:22:16.141 INFO:teuthology.orchestra.run.smithi151.stdout: debug monc = 20 2023-10-11T04:22:16.141 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar smp = 3 2023-10-11T04:22:16.141 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-11T04:22:16.142 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-11T04:22:16.142 INFO:teuthology.orchestra.run.smithi151.stdout: osd blocked scrub grace period = 3600 2023-10-11T04:22:16.142 INFO:teuthology.orchestra.run.smithi151.stdout: osd class default list = * 2023-10-11T04:22:16.142 INFO:teuthology.orchestra.run.smithi151.stdout: osd class load list = * 2023-10-11T04:22:16.142 INFO:teuthology.orchestra.run.smithi151.stdout: osd shutdown pgref assert = True 2023-10-11T04:22:16.143 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.143 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-11T04:22:16.143 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-11T04:22:16.143 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-11T04:22:16.143 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-11T04:22:16.143 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-11T04:22:16.144 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-11T04:22:16.144 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-11T04:22:16.144 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-11T04:22:16.144 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.144 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-11T04:22:16.145 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-11T04:22:16.145 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-11T04:22:16.145 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-11T04:22:16.145 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-11T04:22:16.145 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-11T04:22:16.146 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-11T04:22:16.146 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-11T04:22:16.146 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-11T04:22:16.146 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-11T04:22:16.146 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-11T04:22:16.147 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.147 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-11T04:22:16.147 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-11T04:22:16.147 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-11T04:22:16.147 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.147 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-11T04:22:16.148 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-11T04:22:16.148 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-11T04:22:16.148 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.148 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-11T04:22:16.148 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-11T04:22:16.148 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.149 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-11T04:22:16.149 INFO:teuthology.orchestra.run.smithi151.stdout: mon min osdmap epochs = 50 2023-10-11T04:22:16.149 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune interval = 2 2023-10-11T04:22:16.149 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune min = 15 2023-10-11T04:22:16.149 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune txsize = 2 2023-10-11T04:22:16.150 INFO:teuthology.orchestra.run.smithi151.stdout: paxos service trim min = 10 2023-10-11T04:22:16.150 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on pool no app = False 2023-10-11T04:22:16.150 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default crimson = True 2023-10-11T04:22:16.150 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-11T04:22:16.150 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-11T04:22:16.151 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-11T04:22:16.151 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-11T04:22:16.151 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-11T04:22:16.151 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-11T04:22:16.151 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-11T04:22:16.151 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-11T04:22:16.152 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-11T04:22:16.153 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-10-11T04:22:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-10-11T04:22:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-11T04:22:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-10-11T04:22:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-10-11T04:22:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-10-11T04:22:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-10-11T04:22:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-10-11T04:22:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-10-11T04:22:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-10-11T04:22:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-11T04:22:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-10-11T04:22:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-10-11T04:22:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-11T04:22:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-10-11T04:22:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-10-11T04:22:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-10-11T04:22:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-10-11T04:22:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-10-11T04:22:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-10-11T04:22:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-10-11T04:22:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-10-11T04:22:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-11T04:22:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-11T04:22:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-10-11T04:22:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-11T04:22:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-10-11T04:22:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-10-11T04:22:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-10-11T04:22:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-10-11T04:22:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-10-11T04:22:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = 172.21.15.50 2023-10-11T04:22:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-10-11T04:22:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: ms client mode = crc 2023-10-11T04:22:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: ms cluster mode = crc 2023-10-11T04:22:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: ms mon client mode = crc 2023-10-11T04:22:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: ms mon cluster mode = crc 2023-10-11T04:22:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: ms mon service mode = crc 2023-10-11T04:22:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: ms service mode = crc 2023-10-11T04:22:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.163 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-10-11T04:22:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-10-11T04:22:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-10-11T04:22:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-10-11T04:22:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-10-11T04:22:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-10-11T04:22:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-10-11T04:22:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-10-11T04:22:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-10-11T04:22:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-10-11T04:22:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-10-11T04:22:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-10-11T04:22:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-10-11T04:22:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-10-11T04:22:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-10-11T04:22:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-10-11T04:22:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-10-11T04:22:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-10-11T04:22:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-10-11T04:22:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: debug monc = 20 2023-10-11T04:22:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: crimson seastar smp = 3 2023-10-11T04:22:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-11T04:22:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-10-11T04:22:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: osd blocked scrub grace period = 3600 2023-10-11T04:22:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: osd class default list = * 2023-10-11T04:22:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: osd class load list = * 2023-10-11T04:22:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: osd shutdown pgref assert = True 2023-10-11T04:22:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.170 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-10-11T04:22:16.170 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-11T04:22:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-10-11T04:22:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-11T04:22:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-11T04:22:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-11T04:22:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-11T04:22:16.171 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-10-11T04:22:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.172 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-10-11T04:22:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-11T04:22:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-11T04:22:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-10-11T04:22:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-11T04:22:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-10-11T04:22:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-10-11T04:22:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-11T04:22:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-10-11T04:22:16.173 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-10-11T04:22:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-11T04:22:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-11T04:22:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-10-11T04:22:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-10-11T04:22:16.174 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-10-11T04:22:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-11T04:22:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-11T04:22:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.175 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-10-11T04:22:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-10-11T04:22:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-10-11T04:22:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: mon min osdmap epochs = 50 2023-10-11T04:22:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: mon osdmap full prune interval = 2 2023-10-11T04:22:16.176 INFO:teuthology.orchestra.run.smithi050.stdout: mon osdmap full prune min = 15 2023-10-11T04:22:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: mon osdmap full prune txsize = 2 2023-10-11T04:22:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: paxos service trim min = 10 2023-10-11T04:22:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2023-10-11T04:22:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default crimson = True 2023-10-11T04:22:16.177 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:16.178 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-10-11T04:22:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-10-11T04:22:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-10-11T04:22:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-10-11T04:22:16.178 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-11T04:22:16.179 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-11T04:22:16.179 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-11T04:22:16.179 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-10-11T04:22:16.179 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-11T04:22:16.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-11T04:22:16.246 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-11T04:22:16.247 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:16.247 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-11T04:22:16.262 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:16.262 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-11T04:22:16.318 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-10-11T04:22:16.319 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:16.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-11T04:22:16.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-11T04:22:16.406 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:16.407 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:16.462 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-10-11T04:22:16.488 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:16.488 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-11T04:22:16.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-11T04:22:16.529 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:16.529 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:16.583 INFO:tasks.ceph:Setting up mon nodes... 2023-10-11T04:22:16.584 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-11T04:22:16.584 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-11T04:22:16.724 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-11T04:22:16.727 INFO:tasks.ceph:Setting up mds nodes... 2023-10-11T04:22:16.727 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-11T04:22:16.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-11T04:22:16.780 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-11T04:22:16.799 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-11T04:22:16.847 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-11T04:22:16.862 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-11T04:22:16.863 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-10-11T04:22:16.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-11T04:22:16.893 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-11T04:22:16.894 INFO:tasks.ceph:role: osd.0 2023-10-11T04:22:16.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-11T04:22:16.894 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-11T04:22:16.963 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T04:22:16.964 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T04:22:16.964 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T04:22:16.964 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T04:22:16.964 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T04:22:16.965 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-11T04:22:16.965 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T04:22:16.965 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T04:22:16.965 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T04:22:16.965 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T04:22:16.996 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-11T04:22:16.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-11T04:22:16.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-11T04:22:17.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-11T04:22:17.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-11T04:22:17.218 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-11T04:22:17.218 INFO:tasks.ceph:role: osd.1 2023-10-11T04:22:17.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-11T04:22:17.219 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-11T04:22:17.287 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T04:22:17.288 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T04:22:17.288 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T04:22:17.288 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T04:22:17.288 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T04:22:17.289 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-11T04:22:17.289 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T04:22:17.289 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T04:22:17.289 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T04:22:17.290 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T04:22:17.320 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-11T04:22:17.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-11T04:22:17.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-11T04:22:17.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-11T04:22:17.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:18.044 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,044 seastar - Reactor backend: linux-aio 2023-10-11T04:22:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,059 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,059 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,059 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:18.060 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,059 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:18.061 INFO:teuthology.orchestra.run.smithi050.stderr:==79671==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:18.068 INFO:teuthology.orchestra.run.smithi050.stderr:==79671==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcd3799000; bottom 0x7f9b6ef66000; size: 0x006164833000 (418298146816) 2023-10-11T04:22:18.068 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-10-11T04:22:18.068 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,105 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-11T04:22:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,105 [shard 0] osd - get_early_config: set --smp 3 2023-10-11T04:22:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-10-11T04:22:18.625 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-10-11T04:22:18.625 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:18.625 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T04:22:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,676 seastar - Reactor backend: linux-aio 2023-10-11T04:22:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,710 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,710 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,710 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:18,710 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:==79669==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:==79669==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcd3799000; bottom 0x7f9b6cd4f000; size: 0x006166a4a000 (418333892608) 2023-10-11T04:22:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-10-11T04:22:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:Reactor stalled for 33 ms on shard 0. Backtrace: 0x45d5d 0x2c844dd6 0x2c846184 0x2c8476d2 0x2c847a56 0x2c847ba0 0x2c847ff6 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x2640d0dc 0x2640f725 0x26411536 0x26413d9b 0x2624394f 0x1ee15204 0x1ed896f5 0x1ed8d661 0x2cbc8a39 2023-10-11T04:22:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff942621d2 0xffffffff9426266d 0xffffffff9374ea9a 0xffffffff9425318c 0xffffffff944000aa 2023-10-11T04:22:22.310 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:22.311 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-10-11T04:22:22.311 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-10-11T04:22:22.311 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:22.311 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:22.311 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T04:22:22.312 INFO:teuthology.orchestra.run.smithi050.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:22.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-11T04:22:22.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:22,923 seastar - Reactor backend: linux-aio 2023-10-11T04:22:22.940 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:22,939 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:22.940 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:22,939 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:22.941 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:22,939 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:22.941 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:22,939 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:22.942 INFO:teuthology.orchestra.run.smithi050.stderr:==80479==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:==80479==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff2a1db000; bottom 0x7f10124ab000; size: 0x00ef17d30000 (1026896887808) 2023-10-11T04:22:22.949 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-10-11T04:22:22.949 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c844dd6 0x2c846184 0x2c8476d2 0x2c847a56 0x2c847ba0 0x2c847ff6 0x54daf 0x1e8b40d6 0x2027edab 0x22ef6f35 0x22d61515 0x22bb9b84 0x22be75d7 0x24ba4ba1 0x24baa706 0x24bad054 0x24bae22d 0x22774737 0x227c88fe 0x227e84fb 0x2c7e70f1 0x2c884f0c 0x2caa8d0e 0x2caaab59 0x2c5030d4 0x2c504fd5 0x1eed4f0c 0x1eedf079 0x1ed59731 0x3feaf 0x3ff5f 0x1e812a04 2023-10-11T04:22:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:kernel callstack: 2023-10-11T04:22:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:22,984 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-11T04:22:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:22,984 [shard 0] osd - get_early_config: set --smp 3 2023-10-11T04:22:23.482 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:23.482 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-10-11T04:22:23.482 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-10-11T04:22:23.483 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:23.483 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:23.485 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T04:22:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:23,536 seastar - Reactor backend: linux-aio 2023-10-11T04:22:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:23,554 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:23,554 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:23,554 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-10-11 04:22:23,562 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:==80477==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:==80477==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff2a1db000; bottom 0x7f1010294000; size: 0x00ef19f47000 (1026932633600) 2023-10-11T04:22:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-10-11T04:22:23.571 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:23.654 INFO:teuthology.orchestra.run.smithi050.stderr:Reactor stalled for 33 ms on shard 0. Backtrace: 0x45d5d 0x2c844dd6 0x2c846184 0x2c8476d2 0x2c847a56 0x2c847ba0 0x2c847ff6 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x2640d0dc 0x2640f725 0x26411536 0x26413d9b 0x2624394f 0x1ee15204 0x1ed896f5 0x1ed8d661 0x2cbc8a39 2023-10-11T04:22:23.654 INFO:teuthology.orchestra.run.smithi050.stderr:kernel callstack: 2023-10-11T04:22:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-10-11T04:22:27.196 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-10-11T04:22:27.196 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-10-11T04:22:27.197 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T04:22:27.197 INFO:teuthology.orchestra.run.smithi050.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:27.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-11T04:22:27.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-11T04:22:27.311 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-11T04:22:27.312 INFO:tasks.ceph:role: osd.2 2023-10-11T04:22:27.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-11T04:22:27.312 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-11T04:22:27.389 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T04:22:27.389 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T04:22:27.389 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T04:22:27.390 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T04:22:27.390 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T04:22:27.390 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-11T04:22:27.390 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T04:22:27.390 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T04:22:27.391 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T04:22:27.391 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T04:22:27.901 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-11T04:22:27.903 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-11T04:22:27.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-10-11T04:22:28.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-11T04:22:28.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-11T04:22:28.159 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-11T04:22:28.159 INFO:tasks.ceph:role: osd.3 2023-10-11T04:22:28.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-11T04:22:28.160 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-11T04:22:28.235 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T04:22:28.235 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T04:22:28.236 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T04:22:28.236 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T04:22:28.236 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T04:22:28.236 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-11T04:22:28.236 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T04:22:28.237 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T04:22:28.237 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T04:22:28.237 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T04:22:28.702 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-11T04:22:28.704 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-11T04:22:28.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-10-11T04:22:28.808 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-11T04:22:28.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:29.366 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:29.366 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,366 seastar - Reactor backend: linux-aio 2023-10-11T04:22:29.382 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,382 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:29.383 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,382 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:29.383 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,382 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:29.383 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,382 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:29.384 INFO:teuthology.orchestra.run.smithi151.stderr:==79462==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:29.391 INFO:teuthology.orchestra.run.smithi151.stderr:==79462==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fffc4818000; bottom 0x7fbae33df000; size: 0x0044e1439000 (295837077504) 2023-10-11T04:22:29.391 INFO:teuthology.orchestra.run.smithi151.stderr:False positive error reports may follow 2023-10-11T04:22:29.391 INFO:teuthology.orchestra.run.smithi151.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:29.425 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,425 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-11T04:22:29.426 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,425 [shard 0] osd - get_early_config: set --smp 3 2023-10-11T04:22:29.913 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:29.914 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2023-10-11T04:22:29.914 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2023-10-11T04:22:29.914 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:29.915 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:29.915 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-10-11T04:22:29.976 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:29.977 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,977 seastar - Reactor backend: linux-aio 2023-10-11T04:22:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,995 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,995 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:29,995 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:30.002 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:30,002 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:30.005 INFO:teuthology.orchestra.run.smithi151.stderr:==79460==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:30.011 INFO:teuthology.orchestra.run.smithi151.stderr:==79460==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fffc4818000; bottom 0x7fbae11c8000; size: 0x0044e3650000 (295872823296) 2023-10-11T04:22:30.011 INFO:teuthology.orchestra.run.smithi151.stderr:False positive error reports may follow 2023-10-11T04:22:30.011 INFO:teuthology.orchestra.run.smithi151.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:33.088 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2023-10-11T04:22:33.089 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2023-10-11T04:22:33.089 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:33.090 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:33.090 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-10-11T04:22:33.091 INFO:teuthology.orchestra.run.smithi151.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:33.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-11T04:22:33.155 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:33.655 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:33.656 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:33,656 seastar - Reactor backend: linux-aio 2023-10-11T04:22:33.672 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:33,672 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:33.673 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:33,672 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:33.673 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:33,672 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:33.673 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:33,672 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:33.674 INFO:teuthology.orchestra.run.smithi151.stderr:==80270==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:33.680 INFO:teuthology.orchestra.run.smithi151.stderr:==80270==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffef5424000; bottom 0x7f311fde3000; size: 0x00cdd5641000 (884048400384) 2023-10-11T04:22:33.680 INFO:teuthology.orchestra.run.smithi151.stderr:False positive error reports may follow 2023-10-11T04:22:33.681 INFO:teuthology.orchestra.run.smithi151.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:33.715 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:33,715 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-11T04:22:33.715 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:33,715 [shard 0] osd - get_early_config: set --smp 3 2023-10-11T04:22:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2023-10-11T04:22:34.204 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2023-10-11T04:22:34.205 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:34.205 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:34.205 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-10-11T04:22:34.263 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-11T04:22:34.264 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:34,264 seastar - Reactor backend: linux-aio 2023-10-11T04:22:34.283 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:34,281 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-11T04:22:34.283 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:34,281 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-11T04:22:34.283 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:34,282 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-11T04:22:34.289 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2023-10-11 04:22:34,289 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-11T04:22:34.291 INFO:teuthology.orchestra.run.smithi151.stderr:==80268==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-11T04:22:34.297 INFO:teuthology.orchestra.run.smithi151.stderr:==80268==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffef5424000; bottom 0x7f311dbcc000; size: 0x00cdd7858000 (884084146176) 2023-10-11T04:22:34.297 INFO:teuthology.orchestra.run.smithi151.stderr:False positive error reports may follow 2023-10-11T04:22:34.298 INFO:teuthology.orchestra.run.smithi151.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-11T04:22:37.624 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:37.625 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2023-10-11T04:22:37.625 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2023-10-11T04:22:37.625 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2023-10-11T04:22:37.625 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2023-10-11T04:22:37.625 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-10-11T04:22:37.626 INFO:teuthology.orchestra.run.smithi151.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:22:37.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-11T04:22:37.705 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-11T04:22:37.706 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:37.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-11T04:22:37.742 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:37.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-11T04:22:37.817 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:37.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-11T04:22:37.844 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:37.845 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-11T04:22:37.911 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:37.911 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-11T04:22:37.977 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:37.978 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-11T04:22:37.996 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:37.996 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-11T04:22:38.032 INFO:tasks.ceph:Adding keys to all mons... 2023-10-11T04:22:38.033 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-11T04:22:38.070 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-10-11T04:22:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6IiZluNzwLRAAihr9jedJ2cLuTo+641I0Ww== 2023-10-11T04:22:38.070 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-10-11T04:22:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD/IiZl5/QFJRAAJ6mqeQMkAIDcf9nNMoPSYQ== 2023-10-11T04:22:38.071 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-10-11T04:22:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD4IiZltVYsKxAApBWuuGZ3IVkLCs3aoJa5bA== 2023-10-11T04:22:38.071 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-10-11T04:22:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAGIyZlX5KKAxAAZN2XSQqFps4JuvToV5kjsw== 2023-10-11T04:22:38.072 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-10-11T04:22:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAKIyZlmyQkFRAArdvJtEAXtycnnokEN/VqNA== 2023-10-11T04:22:38.072 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-10-11T04:22:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD4IiZl156HLhAA0HfptHWyPdWfb3kEtaxvfg== 2023-10-11T04:22:38.072 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-10-11T04:22:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD4IiZlZlGIMhAA/CYipdh53kEmuvN6jem/og== 2023-10-11T04:22:38.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T04:22:38.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T04:22:38.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-11T04:22:38.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T04:22:38.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T04:22:38.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-11T04:22:38.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-11T04:22:38.563 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-11T04:22:38.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-11T04:22:38.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-11T04:22:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.696+0000 7fce6b431980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.696+0000 7fce6b431980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-11T04:22:38.743 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-11T04:22:38.799 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-11T04:22:38.799 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-11T04:22:38.800 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-11T04:22:38.841 INFO:tasks.ceph.mon.a:Started 2023-10-11T04:22:38.842 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-11T04:22:38.842 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-11T04:22:38.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-11T04:22:38.845 INFO:tasks.ceph.mgr.x:Started 2023-10-11T04:22:38.845 INFO:tasks.ceph:Setting crush tunables to default 2023-10-11T04:22:38.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2023-10-11T04:22:38.925 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:22:38.924+0000 7ff936436980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.926 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:22:38.924+0000 7ff936436980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.926 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:22:38.924+0000 7ff936436980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.937 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:38.936+0000 7fa52701df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.951+0000 7f49d159e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.957+0000 7f49d159e640 1 Processor -- start 2023-10-11T04:22:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.957+0000 7f49d159e640 1 -- start start 2023-10-11T04:22:38.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49d159e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 0x7f49cc133440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49d159e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc06c210 con 0x7f49cc133980 2023-10-11T04:22:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49d159e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc06cdb0 con 0x7f49cc06d140 2023-10-11T04:22:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49caffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 0x7f49cc133440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49c3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49cc133980 0x7f49cc12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35072/0 (socket says 172.21.15.50:35072) 2023-10-11T04:22:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49c3fff640 1 -- 172.21.15.50:0/183489190 learned_addr learned my addr 172.21.15.50:0/183489190 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49caffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 0x7f49cc133440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33460/0 (socket says 172.21.15.50:33460) 2023-10-11T04:22:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49caffd640 1 -- 172.21.15.50:0/183489190 >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 msgr2=0x7f49cc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-11T04:22:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49caffd640 1 -- 172.21.15.50:0/183489190 >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 msgr2=0x7f49cc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-11T04:22:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49caffd640 1 --2- 172.21.15.50:0/183489190 >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 0x7f49cc133440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-11T04:22:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.958+0000 7f49caffd640 1 --2- 172.21.15.50:0/183489190 >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 0x7f49cc133440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T04:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215735497 0 0) 0x7f49cc06c210 con 0x7f49cc133980 2023-10-11T04:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b80034f0 con 0x7f49cc133980 2023-10-11T04:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469072261 0 0) 0x7f49b80034f0 con 0x7f49cc133980 2023-10-11T04:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 msgr2=0x7f49cc133440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T04:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 --2- 172.21.15.50:0/183489190 >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 0x7f49cc133440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc06d550 con 0x7f49cc133980 2023-10-11T04:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 1108167525 0 0) 0x7f49b40015a0 con 0x7f49cc133980 2023-10-11T04:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 >> v1:172.21.15.50:6789/0 conn(0x7f49cc133980 legacy=0x7f49cc12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 --2- 172.21.15.50:0/183489190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc06cdb0 con 0x7f49b8003940 2023-10-11T04:22:38.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49caffd640 1 --2- 172.21.15.50:0/183489190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:38.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.966+0000 7f49caffd640 1 -- 172.21.15.50:0/183489190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80034f0 con 0x7f49b8003940 2023-10-11T04:22:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49caffd640 1 --2- 172.21.15.50:0/183489190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49b8003d90 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54463e90ce53a5f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f49bc00b5b0 con 0x7f49b8003940 2023-10-11T04:22:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f49bc00baf0 con 0x7f49b8003940 2023-10-11T04:22:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49ca7fc640 1 -- 172.21.15.50:0/183489190 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f49bc00bd90 con 0x7f49b8003940 2023-10-11T04:22:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49d159e640 1 -- 172.21.15.50:0/183489190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 msgr2=0x7f49b8003d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49d159e640 1 --2- 172.21.15.50:0/183489190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49b8003d90 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49d159e640 1 -- 172.21.15.50:0/183489190 shutdown_connections 2023-10-11T04:22:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49d159e640 1 --2- 172.21.15.50:0/183489190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49b8003d90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49d159e640 1 --2- 172.21.15.50:0/183489190 >> v2:172.21.15.50:3300/0 conn(0x7f49cc06d140 0x7f49cc133440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.968+0000 7f49d159e640 1 -- 172.21.15.50:0/183489190 >> 172.21.15.50:0/183489190 conn(0x7f49cc0a2d60 msgr2=0x7f49cc0a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.969+0000 7f49d159e640 1 -- 172.21.15.50:0/183489190 shutdown_connections 2023-10-11T04:22:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.969+0000 7f49d159e640 1 -- 172.21.15.50:0/183489190 wait complete. 2023-10-11T04:22:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.969+0000 7f49d159e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.970+0000 7f49d159e640 1 Processor -- start 2023-10-11T04:22:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.970+0000 7f49d159e640 1 -- start start 2023-10-11T04:22:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.970+0000 7f49d159e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49cc06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.970+0000 7f49d159e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc067db0 con 0x7f49b8003940 2023-10-11T04:22:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49caffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49cc06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49caffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49cc06ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33476/0 (socket says 172.21.15.50:33476) 2023-10-11T04:22:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49caffd640 1 -- 172.21.15.50:0/2186235057 learned_addr learned my addr 172.21.15.50:0/2186235057 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49caffd640 1 -- 172.21.15.50:0/2186235057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc06f980 con 0x7f49b8003940 2023-10-11T04:22:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49caffd640 1 --2- 172.21.15.50:0/2186235057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49cc06ff20 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49c37fe640 1 -- 172.21.15.50:0/2186235057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f49bc003710 con 0x7f49b8003940 2023-10-11T04:22:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49c37fe640 1 -- 172.21.15.50:0/2186235057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f49bc003870 con 0x7f49b8003940 2023-10-11T04:22:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc11bee0 con 0x7f49b8003940 2023-10-11T04:22:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49c37fe640 1 -- 172.21.15.50:0/2186235057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f49bc003b10 con 0x7f49b8003940 2023-10-11T04:22:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc11c830 con 0x7f49b8003940 2023-10-11T04:22:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49c37fe640 1 -- 172.21.15.50:0/2186235057 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f49bc016430 con 0x7f49b8003940 2023-10-11T04:22:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.971+0000 7f49c37fe640 1 -- 172.21.15.50:0/2186235057 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (crc 0 0 0) 0x7f49bc0157b0 con 0x7f49b8003940 2023-10-11T04:22:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.972+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc071120 con 0x7f49b8003940 2023-10-11T04:22:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:38.974+0000 7f49c37fe640 1 -- 172.21.15.50:0/2186235057 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f49bc015a10 con 0x7f49b8003940 2023-10-11T04:22:39.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.039+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f49cc11c0d0 con 0x7f49b8003940 2023-10-11T04:22:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.040+0000 7f49c37fe640 1 -- 172.21.15.50:0/2186235057 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (crc 0 0 0) 0x7f49bc015bb0 con 0x7f49b8003940 2023-10-11T04:22:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-10-11T04:22:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.041+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 msgr2=0x7f49cc06ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.041+0000 7f49d159e640 1 --2- 172.21.15.50:0/2186235057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49cc06ff20 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.041+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 shutdown_connections 2023-10-11T04:22:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.041+0000 7f49d159e640 1 --2- 172.21.15.50:0/2186235057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49b8003940 0x7f49cc06ff20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.041+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 >> 172.21.15.50:0/2186235057 conn(0x7f49cc0a2d60 msgr2=0x7f49cc1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.041+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 shutdown_connections 2023-10-11T04:22:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.041+0000 7f49d159e640 1 -- 172.21.15.50:0/2186235057 wait complete. 2023-10-11T04:22:39.052 INFO:tasks.ceph:check_enable_crimson: True 2023-10-11T04:22:39.053 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2023-10-11T04:22:39.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2023-10-11T04:22:39.142 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:39.141+0000 7fa52701df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:39.142 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:39.141+0000 7fa52701df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:39.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.157+0000 7fa231e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:39.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.162+0000 7fa231e2d640 1 Processor -- start 2023-10-11T04:22:39.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.162+0000 7fa231e2d640 1 -- start start 2023-10-11T04:22:39.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa231e2d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa22c06cb00 0x7fa22c12fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:39.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa231e2d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c06c280 con 0x7fa22c130320 2023-10-11T04:22:39.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa231e2d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c06c6c0 con 0x7fa22c06cb00 2023-10-11T04:22:39.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa22b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa22c06cb00 0x7fa22c12fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:39.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa22b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa22c06cb00 0x7fa22c12fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33488/0 (socket says 172.21.15.50:33488) 2023-10-11T04:22:39.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa22affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa22c130320 0x7fa22c132cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35088/0 (socket says 172.21.15.50:35088) 2023-10-11T04:22:39.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa22b7fe640 1 -- 172.21.15.50:0/33389301 learned_addr learned my addr 172.21.15.50:0/33389301 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:39.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.163+0000 7fa22b7fe640 1 -- 172.21.15.50:0/33389301 >> v1:172.21.15.50:6789/0 conn(0x7fa22c130320 legacy=0x7fa22c132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:39.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa22b7fe640 1 -- 172.21.15.50:0/33389301 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c06d8b0 con 0x7fa22c06cb00 2023-10-11T04:22:39.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa22b7fe640 1 --2- 172.21.15.50:0/33389301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c12fde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8e06a38476f70c server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:39.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa22a7fc640 1 -- 172.21.15.50:0/33389301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa21c009dd0 con 0x7fa22c06cb00 2023-10-11T04:22:39.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa22a7fc640 1 -- 172.21.15.50:0/33389301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa21c00e230 con 0x7fa22c06cb00 2023-10-11T04:22:39.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa22a7fc640 1 -- 172.21.15.50:0/33389301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa21c00e4d0 con 0x7fa22c06cb00 2023-10-11T04:22:39.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa231e2d640 1 -- 172.21.15.50:0/33389301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 msgr2=0x7fa22c12fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:39.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa231e2d640 1 --2- 172.21.15.50:0/33389301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c12fde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:39.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa231e2d640 1 -- 172.21.15.50:0/33389301 shutdown_connections 2023-10-11T04:22:39.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa231e2d640 1 --2- 172.21.15.50:0/33389301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c12fde0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:39.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.164+0000 7fa231e2d640 1 -- 172.21.15.50:0/33389301 >> 172.21.15.50:0/33389301 conn(0x7fa22c0a3060 msgr2=0x7fa22c0a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.165+0000 7fa231e2d640 1 -- 172.21.15.50:0/33389301 shutdown_connections 2023-10-11T04:22:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.165+0000 7fa231e2d640 1 -- 172.21.15.50:0/33389301 wait complete. 2023-10-11T04:22:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.165+0000 7fa231e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.166+0000 7fa231e2d640 1 Processor -- start 2023-10-11T04:22:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.166+0000 7fa231e2d640 1 -- start start 2023-10-11T04:22:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.166+0000 7fa231e2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c11c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.166+0000 7fa231e2d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c11f5d0 con 0x7fa22c06cb00 2023-10-11T04:22:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa22b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c11c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa22b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c11c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33502/0 (socket says 172.21.15.50:33502) 2023-10-11T04:22:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa22b7fe640 1 -- 172.21.15.50:0/3831898150 learned_addr learned my addr 172.21.15.50:0/3831898150 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa22b7fe640 1 -- 172.21.15.50:0/3831898150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c11f850 con 0x7fa22c06cb00 2023-10-11T04:22:39.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa22b7fe640 1 --2- 172.21.15.50:0/3831898150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c11c460 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:39.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa213fff640 1 -- 172.21.15.50:0/3831898150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa21c014410 con 0x7fa22c06cb00 2023-10-11T04:22:39.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa213fff640 1 -- 172.21.15.50:0/3831898150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa21c014570 con 0x7fa22c06cb00 2023-10-11T04:22:39.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c120420 con 0x7fa22c06cb00 2023-10-11T04:22:39.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa213fff640 1 -- 172.21.15.50:0/3831898150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa21c014810 con 0x7fa22c06cb00 2023-10-11T04:22:39.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c11ee50 con 0x7fa22c06cb00 2023-10-11T04:22:39.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa213fff640 1 -- 172.21.15.50:0/3831898150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fa21c014cc0 con 0x7fa22c06cb00 2023-10-11T04:22:39.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.167+0000 7fa213fff640 1 -- 172.21.15.50:0/3831898150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (crc 0 0 0) 0x7fa21c019040 con 0x7fa22c06cb00 2023-10-11T04:22:39.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.168+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c061d90 con 0x7fa22c06cb00 2023-10-11T04:22:39.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.170+0000 7fa213fff640 1 -- 172.21.15.50:0/3831898150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7fa21c013400 con 0x7fa22c06cb00 2023-10-11T04:22:39.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:39.246+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa22c06c8e0 con 0x7fa22c06cb00 2023-10-11T04:22:39.247 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:22:39.246+0000 7ff92e3f1640 -1 WARNING: experimental feature 'crimson' is enabled 2023-10-11T04:22:39.247 INFO:tasks.ceph.mon.a.smithi050.stderr:Please be aware that this feature is experimental, untested, 2023-10-11T04:22:39.248 INFO:tasks.ceph.mon.a.smithi050.stderr:unsupported, and may result in data corruption, data loss, 2023-10-11T04:22:39.248 INFO:tasks.ceph.mon.a.smithi050.stderr:and/or irreparable damage to your cluster. Do not use 2023-10-11T04:22:39.248 INFO:tasks.ceph.mon.a.smithi050.stderr:feature with important data. 2023-10-11T04:22:39.248 INFO:tasks.ceph.mon.a.smithi050.stderr: 2023-10-11T04:22:39.590 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:39.589+0000 7fa52701df00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-11T04:22:39.640 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:39.639+0000 7fa52701df00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-11T04:22:40.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.041+0000 7fa213fff640 1 -- 172.21.15.50:0/3831898150 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) v1 ==== 99+0+0 (crc 0 0 0) 0x7fa21c013670 con 0x7fa22c06cb00 2023-10-11T04:22:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.042+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 msgr2=0x7fa22c11c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.042+0000 7fa231e2d640 1 --2- 172.21.15.50:0/3831898150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c11c460 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.042+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 shutdown_connections 2023-10-11T04:22:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.042+0000 7fa231e2d640 1 --2- 172.21.15.50:0/3831898150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c06cb00 0x7fa22c11c460 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.042+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 >> 172.21.15.50:0/3831898150 conn(0x7fa22c0a3060 msgr2=0x7fa22c0a1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.043+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 shutdown_connections 2023-10-11T04:22:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:40.043+0000 7fa231e2d640 1 -- 172.21.15.50:0/3831898150 wait complete. 2023-10-11T04:22:40.058 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-11T04:22:40.058 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:40.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-11T04:22:40.093 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:22:40.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-11T04:22:40.166 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:40.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-11T04:22:40.169 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.167+0000 7fa52701df00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-11T04:22:40.193 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-11T04:22:40.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-11T04:22:40.223 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.222+0000 7fa52701df00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-11T04:22:40.250 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 1e006f4f-a0aa-4faa-ad11-d61314eb5482 0 2023-10-11T04:22:40.271 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.270+0000 7fa52701df00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-11T04:22:40.328 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.327+0000 7fa52701df00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-11T04:22:40.373 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.372+0000 7fa52701df00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-11T04:22:40.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.370+0000 7f04d955e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d955e640 1 Processor -- start 2023-10-11T04:22:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d955e640 1 -- start start 2023-10-11T04:22:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d955e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04d4111d00 0x7f04d4112110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d955e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d41128d0 con 0x7f04d41166e0 2023-10-11T04:22:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d955e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d4117220 con 0x7f04d4111d00 2023-10-11T04:22:40.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04d4111d00 0x7f04d4112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:40.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04d4111d00 0x7f04d4112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.151:33084/0 (socket says 172.21.15.151:33084) 2023-10-11T04:22:40.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04d2ffd640 1 -- 172.21.15.151:0/2549777741 learned_addr learned my addr 172.21.15.151:0/2549777741 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-11T04:22:40.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.376+0000 7f04cbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04d41166e0 0x7f04d4116af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.151:45320/0 (socket says 172.21.15.151:45320) 2023-10-11T04:22:40.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.377+0000 7f04d2ffd640 1 -- 172.21.15.151:0/2549777741 >> v1:172.21.15.50:6789/0 conn(0x7f04d41166e0 legacy=0x7f04d4116af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.377+0000 7f04d2ffd640 1 -- 172.21.15.151:0/2549777741 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4117390 con 0x7f04d4111d00 2023-10-11T04:22:40.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.377+0000 7f04d2ffd640 1 --2- 172.21.15.151:0/2549777741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d4112110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a1818819fbc90b server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:40.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.377+0000 7f04d27fc640 1 -- 172.21.15.151:0/2549777741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f04c4009dd0 con 0x7f04d4111d00 2023-10-11T04:22:40.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.377+0000 7f04d27fc640 1 -- 172.21.15.151:0/2549777741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f04c400e230 con 0x7f04d4111d00 2023-10-11T04:22:40.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.377+0000 7f04d27fc640 1 -- 172.21.15.151:0/2549777741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f04c400e4d0 con 0x7f04d4111d00 2023-10-11T04:22:40.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 1 -- 172.21.15.151:0/2549777741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 msgr2=0x7f04d4112110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 1 --2- 172.21.15.151:0/2549777741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d4112110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 1 -- 172.21.15.151:0/2549777741 shutdown_connections 2023-10-11T04:22:40.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 1 --2- 172.21.15.151:0/2549777741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d4112110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 1 -- 172.21.15.151:0/2549777741 >> 172.21.15.151:0/2549777741 conn(0x7f04d406d820 msgr2=0x7f04d410fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:40.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 1 -- 172.21.15.151:0/2549777741 shutdown_connections 2023-10-11T04:22:40.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 1 -- 172.21.15.151:0/2549777741 wait complete. 2023-10-11T04:22:40.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.378+0000 7f04d955e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:40.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.379+0000 7f04d955e640 1 Processor -- start 2023-10-11T04:22:40.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.379+0000 7f04d955e640 1 -- start start 2023-10-11T04:22:40.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.379+0000 7f04d955e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d41ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:40.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.379+0000 7f04d955e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d41ac950 con 0x7f04d4111d00 2023-10-11T04:22:40.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.379+0000 7f04d2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d41ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:40.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.379+0000 7f04d2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d41ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.151:33088/0 (socket says 172.21.15.151:33088) 2023-10-11T04:22:40.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.379+0000 7f04d2ffd640 1 -- 172.21.15.151:0/487847966 learned_addr learned my addr 172.21.15.151:0/487847966 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-11T04:22:40.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04d2ffd640 1 -- 172.21.15.151:0/487847966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d41aca90 con 0x7f04d4111d00 2023-10-11T04:22:40.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04d2ffd640 1 --2- 172.21.15.151:0/487847966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d41ac380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:40.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04cb7fe640 1 -- 172.21.15.151:0/487847966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f04c4014540 con 0x7f04d4111d00 2023-10-11T04:22:40.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04cb7fe640 1 -- 172.21.15.151:0/487847966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f04c40146a0 con 0x7f04d4111d00 2023-10-11T04:22:40.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d41acc80 con 0x7f04d4111d00 2023-10-11T04:22:40.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04cb7fe640 1 -- 172.21.15.151:0/487847966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f04c4014940 con 0x7f04d4111d00 2023-10-11T04:22:40.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d41a6670 con 0x7f04d4111d00 2023-10-11T04:22:40.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04cb7fe640 1 -- 172.21.15.151:0/487847966 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f04c4013400 con 0x7f04d4111d00 2023-10-11T04:22:40.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.380+0000 7f04cb7fe640 1 -- 172.21.15.151:0/487847966 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 747+0+0 (crc 0 0 0) 0x7f04c4019040 con 0x7f04d4111d00 2023-10-11T04:22:40.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.381+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d41ace70 con 0x7f04d4111d00 2023-10-11T04:22:40.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.383+0000 7f04cb7fe640 1 -- 172.21.15.151:0/487847966 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f04c4013940 con 0x7f04d4111d00 2023-10-11T04:22:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.455+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e006f4f-a0aa-4faa-ad11-d61314eb5482", "id": 0} v 0) v1 -- 0x7f04d41166e0 con 0x7f04d4111d00 2023-10-11T04:22:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.456+0000 7f04cb7fe640 1 -- 172.21.15.151:0/487847966 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e006f4f-a0aa-4faa-ad11-d61314eb5482", "id": 0}]=0 v4) v1 ==== 112+0+2 (crc 0 0 0) 0x7f04c4013bb0 con 0x7f04d4111d00 2023-10-11T04:22:40.457 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-10-11T04:22:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.457+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 msgr2=0x7f04d41ac380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.457+0000 7f04d955e640 1 --2- 172.21.15.151:0/487847966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d41ac380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.457+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 shutdown_connections 2023-10-11T04:22:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.457+0000 7f04d955e640 1 --2- 172.21.15.151:0/487847966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d4111d00 0x7f04d41ac380 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.457+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 >> 172.21.15.151:0/487847966 conn(0x7f04d406d820 msgr2=0x7f04d4110330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.457+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 shutdown_connections 2023-10-11T04:22:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.457+0000 7f04d955e640 1 -- 172.21.15.151:0/487847966 wait complete. 2023-10-11T04:22:40.468 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 05bdb8c7-b470-4cfe-a670-93c628f07afa 1 2023-10-11T04:22:40.480 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.479+0000 7fa52701df00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-11T04:22:40.555 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.555+0000 7fa52701df00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-11T04:22:40.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.568+0000 7f0530a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:40.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.573+0000 7f0530a6d640 1 Processor -- start 2023-10-11T04:22:40.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.573+0000 7f0530a6d640 1 -- start start 2023-10-11T04:22:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f0530a6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f052c11a990 0x7f052c11cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f0530a6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c11d380 con 0x7f052c111d80 2023-10-11T04:22:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f0530a6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c11e520 con 0x7f052c11a990 2023-10-11T04:22:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f0529d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f052c11a990 0x7f052c11cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f052a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f052c111d80 0x7f052c112190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.151:45334/0 (socket says 172.21.15.151:45334) 2023-10-11T04:22:40.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f052a59c640 1 -- 172.21.15.151:0/643629439 learned_addr learned my addr 172.21.15.151:0/643629439 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-11T04:22:40.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f0529d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f052c11a990 0x7f052c11cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.151:33090/0 (socket says 172.21.15.151:33090) 2023-10-11T04:22:40.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f052959a640 1 -- 172.21.15.151:0/643629439 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875404480 0 0) 0x7f052c11d380 con 0x7f052c111d80 2023-10-11T04:22:40.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f052959a640 1 -- 172.21.15.151:0/643629439 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05140034f0 con 0x7f052c111d80 2023-10-11T04:22:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f0529d9b640 1 -- 172.21.15.151:0/643629439 >> v1:172.21.15.50:6789/0 conn(0x7f052c111d80 legacy=0x7f052c112190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.574+0000 7f0529d9b640 1 -- 172.21.15.151:0/643629439 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c11e660 con 0x7f052c11a990 2023-10-11T04:22:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.575+0000 7f0529d9b640 1 --2- 172.21.15.151:0/643629439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c11a990 0x7f052c11cdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2de23d0208d32e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.575+0000 7f052959a640 1 -- 172.21.15.151:0/643629439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0520009ce0 con 0x7f052c11a990 2023-10-11T04:22:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.575+0000 7f052959a640 1 -- 172.21.15.151:0/643629439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0520009e40 con 0x7f052c11a990 2023-10-11T04:22:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.575+0000 7f052959a640 1 -- 172.21.15.151:0/643629439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f052000e360 con 0x7f052c11a990 2023-10-11T04:22:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 1 -- 172.21.15.151:0/643629439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c11a990 msgr2=0x7f052c11cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 1 --2- 172.21.15.151:0/643629439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c11a990 0x7f052c11cdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 1 -- 172.21.15.151:0/643629439 shutdown_connections 2023-10-11T04:22:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 1 --2- 172.21.15.151:0/643629439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c11a990 0x7f052c11cdb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 1 -- 172.21.15.151:0/643629439 >> 172.21.15.151:0/643629439 conn(0x7f052c06d7b0 msgr2=0x7f052c10fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 1 -- 172.21.15.151:0/643629439 shutdown_connections 2023-10-11T04:22:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 1 -- 172.21.15.151:0/643629439 wait complete. 2023-10-11T04:22:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.576+0000 7f0530a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:40.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.577+0000 7f0530a6d640 1 Processor -- start 2023-10-11T04:22:40.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.577+0000 7f0530a6d640 1 -- start start 2023-10-11T04:22:40.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.577+0000 7f0530a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c111d80 0x7f052c1ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.577+0000 7f0530a6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c1ac720 con 0x7f052c111d80 2023-10-11T04:22:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.577+0000 7f052a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c111d80 0x7f052c1ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.577+0000 7f052a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c111d80 0x7f052c1ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.151:33104/0 (socket says 172.21.15.151:33104) 2023-10-11T04:22:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.577+0000 7f052a59c640 1 -- 172.21.15.151:0/4158754270 learned_addr learned my addr 172.21.15.151:0/4158754270 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-11T04:22:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f052a59c640 1 -- 172.21.15.151:0/4158754270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c1ac860 con 0x7f052c111d80 2023-10-11T04:22:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f052a59c640 1 --2- 172.21.15.151:0/4158754270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c111d80 0x7f052c1ac150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f051affd640 1 -- 172.21.15.151:0/4158754270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f051c0059d0 con 0x7f052c111d80 2023-10-11T04:22:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f051affd640 1 -- 172.21.15.151:0/4158754270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f051c005b30 con 0x7f052c111d80 2023-10-11T04:22:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f051affd640 1 -- 172.21.15.151:0/4158754270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f051c005dd0 con 0x7f052c111d80 2023-10-11T04:22:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c1acab0 con 0x7f052c111d80 2023-10-11T04:22:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c1a64c0 con 0x7f052c111d80 2023-10-11T04:22:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f051affd640 1 -- 172.21.15.151:0/4158754270 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f051c0073b0 con 0x7f052c111d80 2023-10-11T04:22:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.578+0000 7f051affd640 1 -- 172.21.15.151:0/4158754270 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 862+0+0 (crc 0 0 0) 0x7f051c00f690 con 0x7f052c111d80 2023-10-11T04:22:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.579+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c1acca0 con 0x7f052c111d80 2023-10-11T04:22:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.581+0000 7f051affd640 1 -- 172.21.15.151:0/4158754270 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f051c00c7c0 con 0x7f052c111d80 2023-10-11T04:22:40.604 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.604+0000 7fa52701df00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-11T04:22:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.653+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05bdb8c7-b470-4cfe-a670-93c628f07afa", "id": 1} v 0) v1 -- 0x7f052c11a990 con 0x7f052c111d80 2023-10-11T04:22:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.655+0000 7f051affd640 1 -- 172.21.15.151:0/4158754270 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05bdb8c7-b470-4cfe-a670-93c628f07afa", "id": 1}]=0 v5) v1 ==== 112+0+2 (crc 0 0 0) 0x7f051c00ca30 con 0x7f052c111d80 2023-10-11T04:22:40.656 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-11T04:22:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.656+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c111d80 msgr2=0x7f052c1ac150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.656+0000 7f0530a6d640 1 --2- 172.21.15.151:0/4158754270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c111d80 0x7f052c1ac150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.656+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 shutdown_connections 2023-10-11T04:22:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.656+0000 7f0530a6d640 1 --2- 172.21.15.151:0/4158754270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052c111d80 0x7f052c1ac150 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.656+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 >> 172.21.15.151:0/4158754270 conn(0x7f052c06d7b0 msgr2=0x7f052c11bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.656+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 shutdown_connections 2023-10-11T04:22:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.656+0000 7f0530a6d640 1 -- 172.21.15.151:0/4158754270 wait complete. 2023-10-11T04:22:40.658 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.657+0000 7fa52701df00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-11T04:22:40.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 90577fa5-daa9-45d6-aa35-d9ea6d143f5e 2 2023-10-11T04:22:40.707 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:40.706+0000 7fa52701df00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-11T04:22:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.806+0000 7f55fef1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:40.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.812+0000 7f55fef1e640 1 Processor -- start 2023-10-11T04:22:40.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.812+0000 7f55fef1e640 1 -- start start 2023-10-11T04:22:40.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.812+0000 7f55fef1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55f811a9b0 0x7f55f811cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.812+0000 7f55fef1e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f811d3a0 con 0x7f55f8111d00 2023-10-11T04:22:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.812+0000 7f55fef1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f811e540 con 0x7f55f811a9b0 2023-10-11T04:22:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55f811a9b0 0x7f55f811cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55fccba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f55f8111d00 0x7f55f8112110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.151:45348/0 (socket says 172.21.15.151:45348) 2023-10-11T04:22:40.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55fccba640 1 -- 172.21.15.151:0/180124425 learned_addr learned my addr 172.21.15.151:0/180124425 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-11T04:22:40.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f7fff640 1 -- 172.21.15.151:0/180124425 >> v1:172.21.15.50:6789/0 conn(0x7f55f8111d00 legacy=0x7f55f8112110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f77fe640 1 -- 172.21.15.151:0/180124425 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50892503 0 0) 0x7f55f811d3a0 con 0x7f55f8111d00 2023-10-11T04:22:40.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f7fff640 1 -- 172.21.15.151:0/180124425 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f811e680 con 0x7f55f811a9b0 2023-10-11T04:22:40.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f7fff640 1 --2- 172.21.15.151:0/180124425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f811a9b0 0x7f55f811cdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839bc96f431e59a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f77fe640 1 -- 172.21.15.151:0/180124425 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f55e4009ce0 con 0x7f55f811a9b0 2023-10-11T04:22:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f77fe640 1 -- 172.21.15.151:0/180124425 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f55e4009e40 con 0x7f55f811a9b0 2023-10-11T04:22:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.813+0000 7f55f77fe640 1 -- 172.21.15.151:0/180124425 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f55e400e360 con 0x7f55f811a9b0 2023-10-11T04:22:40.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 1 -- 172.21.15.151:0/180124425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f811a9b0 msgr2=0x7f55f811cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 1 --2- 172.21.15.151:0/180124425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f811a9b0 0x7f55f811cdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 1 -- 172.21.15.151:0/180124425 shutdown_connections 2023-10-11T04:22:40.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 1 --2- 172.21.15.151:0/180124425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f811a9b0 0x7f55f811cdd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 1 -- 172.21.15.151:0/180124425 >> 172.21.15.151:0/180124425 conn(0x7f55f806d820 msgr2=0x7f55f810fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:40.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 1 -- 172.21.15.151:0/180124425 shutdown_connections 2023-10-11T04:22:40.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 1 -- 172.21.15.151:0/180124425 wait complete. 2023-10-11T04:22:40.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.814+0000 7f55fef1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:40.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.815+0000 7f55fef1e640 1 Processor -- start 2023-10-11T04:22:40.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.815+0000 7f55fef1e640 1 -- start start 2023-10-11T04:22:40.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.815+0000 7f55fef1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f8111d00 0x7f55f81ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:40.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.815+0000 7f55fef1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81ac720 con 0x7f55f8111d00 2023-10-11T04:22:40.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55fccba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f8111d00 0x7f55f81ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:40.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55fccba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f8111d00 0x7f55f81ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.151:33122/0 (socket says 172.21.15.151:33122) 2023-10-11T04:22:40.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55fccba640 1 -- 172.21.15.151:0/1451934002 learned_addr learned my addr 172.21.15.151:0/1451934002 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-11T04:22:40.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55fccba640 1 -- 172.21.15.151:0/1451934002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f81ac860 con 0x7f55f8111d00 2023-10-11T04:22:40.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55fccba640 1 --2- 172.21.15.151:0/1451934002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f8111d00 0x7f55f81ac150 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:40.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55f57fa640 1 -- 172.21.15.151:0/1451934002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f55ec004bd0 con 0x7f55f8111d00 2023-10-11T04:22:40.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55f57fa640 1 -- 172.21.15.151:0/1451934002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f55ec004d30 con 0x7f55f8111d00 2023-10-11T04:22:40.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.816+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f81acab0 con 0x7f55f8111d00 2023-10-11T04:22:40.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.817+0000 7f55f57fa640 1 -- 172.21.15.151:0/1451934002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f55ec007120 con 0x7f55f8111d00 2023-10-11T04:22:40.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.817+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f81a64c0 con 0x7f55f8111d00 2023-10-11T04:22:40.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.817+0000 7f55f57fa640 1 -- 172.21.15.151:0/1451934002 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f55ec00c580 con 0x7f55f8111d00 2023-10-11T04:22:40.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.817+0000 7f55f57fa640 1 -- 172.21.15.151:0/1451934002 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 977+0+0 (crc 0 0 0) 0x7f55ec00cc70 con 0x7f55f8111d00 2023-10-11T04:22:40.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.817+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f81acca0 con 0x7f55f8111d00 2023-10-11T04:22:40.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.820+0000 7f55f57fa640 1 -- 172.21.15.151:0/1451934002 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f55ec00c830 con 0x7f55f8111d00 2023-10-11T04:22:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.891+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "90577fa5-daa9-45d6-aa35-d9ea6d143f5e", "id": 2} v 0) v1 -- 0x7f55f811a9b0 con 0x7f55f8111d00 2023-10-11T04:22:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.892+0000 7f55f57fa640 1 -- 172.21.15.151:0/1451934002 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90577fa5-daa9-45d6-aa35-d9ea6d143f5e", "id": 2}]=0 v6) v1 ==== 112+0+2 (crc 0 0 0) 0x7f55ec00c9d0 con 0x7f55f8111d00 2023-10-11T04:22:40.893 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-10-11T04:22:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.893+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f8111d00 msgr2=0x7f55f81ac150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.893+0000 7f55fef1e640 1 --2- 172.21.15.151:0/1451934002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f8111d00 0x7f55f81ac150 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.893+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 shutdown_connections 2023-10-11T04:22:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.893+0000 7f55fef1e640 1 --2- 172.21.15.151:0/1451934002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55f8111d00 0x7f55f81ac150 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.893+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 >> 172.21.15.151:0/1451934002 conn(0x7f55f806d820 msgr2=0x7f55f811bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.893+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 shutdown_connections 2023-10-11T04:22:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:40.893+0000 7f55fef1e640 1 -- 172.21.15.151:0/1451934002 wait complete. 2023-10-11T04:22:40.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b7cf8915-2f7f-4d4a-8b30-d1285eace09c 3 2023-10-11T04:22:41.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.004+0000 7f318b613640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:41.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.009+0000 7f318b613640 1 Processor -- start 2023-10-11T04:22:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f318b613640 1 -- start start 2023-10-11T04:22:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f318b613640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3184111d80 0x7f3184112190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f318b613640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3184112950 con 0x7f3184116750 2023-10-11T04:22:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f318b613640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3184117290 con 0x7f3184111d80 2023-10-11T04:22:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f31893af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3184111d80 0x7f3184112190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f31893af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3184111d80 0x7f3184112190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.151:33134/0 (socket says 172.21.15.151:33134) 2023-10-11T04:22:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f3188bae640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3184116750 0x7f3184116b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.151:45358/0 (socket says 172.21.15.151:45358) 2023-10-11T04:22:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f31893af640 1 -- 172.21.15.151:0/2588865740 learned_addr learned my addr 172.21.15.151:0/2588865740 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-11T04:22:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f31893af640 1 -- 172.21.15.151:0/2588865740 >> v1:172.21.15.50:6789/0 conn(0x7f3184116750 legacy=0x7f3184116b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.010+0000 7f31893af640 1 -- 172.21.15.151:0/2588865740 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184117400 con 0x7f3184111d80 2023-10-11T04:22:41.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.011+0000 7f31893af640 1 --2- 172.21.15.151:0/2588865740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f3184112190 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6546b74bf63e9019 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:41.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.011+0000 7f317bfff640 1 -- 172.21.15.151:0/2588865740 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3180009dd0 con 0x7f3184111d80 2023-10-11T04:22:41.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.011+0000 7f317bfff640 1 -- 172.21.15.151:0/2588865740 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f318000e230 con 0x7f3184111d80 2023-10-11T04:22:41.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.011+0000 7f317bfff640 1 -- 172.21.15.151:0/2588865740 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f318000e4d0 con 0x7f3184111d80 2023-10-11T04:22:41.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.011+0000 7f318b613640 1 -- 172.21.15.151:0/2588865740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 msgr2=0x7f3184112190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:41.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.011+0000 7f318b613640 1 --2- 172.21.15.151:0/2588865740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f3184112190 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 1 -- 172.21.15.151:0/2588865740 shutdown_connections 2023-10-11T04:22:41.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 1 --2- 172.21.15.151:0/2588865740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f3184112190 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 1 -- 172.21.15.151:0/2588865740 >> 172.21.15.151:0/2588865740 conn(0x7f318406d7b0 msgr2=0x7f318410fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 1 -- 172.21.15.151:0/2588865740 shutdown_connections 2023-10-11T04:22:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 1 -- 172.21.15.151:0/2588865740 wait complete. 2023-10-11T04:22:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 1 Processor -- start 2023-10-11T04:22:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.012+0000 7f318b613640 1 -- start start 2023-10-11T04:22:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f318b613640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f31841ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f318b613640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841ac9e0 con 0x7f3184111d80 2023-10-11T04:22:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f31893af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f31841ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f31893af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f31841ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.151:33150/0 (socket says 172.21.15.151:33150) 2023-10-11T04:22:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f31893af640 1 -- 172.21.15.151:0/2750335097 learned_addr learned my addr 172.21.15.151:0/2750335097 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-11T04:22:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f31893af640 1 -- 172.21.15.151:0/2750335097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31841acb20 con 0x7f3184111d80 2023-10-11T04:22:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f31893af640 1 --2- 172.21.15.151:0/2750335097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f31841ac410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f3179ffb640 1 -- 172.21.15.151:0/2750335097 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3180014540 con 0x7f3184111d80 2023-10-11T04:22:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f3179ffb640 1 -- 172.21.15.151:0/2750335097 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f31800146a0 con 0x7f3184111d80 2023-10-11T04:22:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31841acd10 con 0x7f3184111d80 2023-10-11T04:22:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.013+0000 7f3179ffb640 1 -- 172.21.15.151:0/2750335097 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3180014940 con 0x7f3184111d80 2023-10-11T04:22:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.014+0000 7f3179ffb640 1 -- 172.21.15.151:0/2750335097 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f3180013400 con 0x7f3184111d80 2023-10-11T04:22:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.014+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31841a6700 con 0x7f3184111d80 2023-10-11T04:22:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.014+0000 7f3179ffb640 1 -- 172.21.15.151:0/2750335097 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1092+0+0 (crc 0 0 0) 0x7f3180019040 con 0x7f3184111d80 2023-10-11T04:22:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.015+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31841acf00 con 0x7f3184111d80 2023-10-11T04:22:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.017+0000 7f3179ffb640 1 -- 172.21.15.151:0/2750335097 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f31800136b0 con 0x7f3184111d80 2023-10-11T04:22:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.088+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7cf8915-2f7f-4d4a-8b30-d1285eace09c", "id": 3} v 0) v1 -- 0x7f3184116750 con 0x7f3184111d80 2023-10-11T04:22:41.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.090+0000 7f3179ffb640 1 -- 172.21.15.151:0/2750335097 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7cf8915-2f7f-4d4a-8b30-d1285eace09c", "id": 3}]=0 v7) v1 ==== 112+0+2 (crc 0 0 0) 0x7f31800138f0 con 0x7f3184111d80 2023-10-11T04:22:41.091 INFO:teuthology.orchestra.run.smithi151.stdout:3 2023-10-11T04:22:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.090+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 msgr2=0x7f31841ac410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.090+0000 7f318b613640 1 --2- 172.21.15.151:0/2750335097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f31841ac410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.091+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 shutdown_connections 2023-10-11T04:22:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.091+0000 7f318b613640 1 --2- 172.21.15.151:0/2750335097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184111d80 0x7f31841ac410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.091+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 >> 172.21.15.151:0/2750335097 conn(0x7f318406d7b0 msgr2=0x7f3184110350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.091+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 shutdown_connections 2023-10-11T04:22:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-11T04:22:41.091+0000 7f318b613640 1 -- 172.21.15.151:0/2750335097 wait complete. 2023-10-11T04:22:41.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2023-10-11T04:22:41.113 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.113+0000 7fa52701df00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-11T04:22:41.145 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-11T04:22:41.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2023-10-11T04:22:41.187 INFO:tasks.ceph.osd.0:Started 2023-10-11T04:22:41.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2023-10-11T04:22:41.227 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-11T04:22:41.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2023-10-11T04:22:41.238 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.237+0000 7fa52701df00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-11T04:22:41.270 INFO:tasks.ceph.osd.1:Started 2023-10-11T04:22:41.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2023-10-11T04:22:41.303 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-11T04:22:41.303 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2023-10-11T04:22:41.345 INFO:tasks.ceph.osd.2:Started 2023-10-11T04:22:41.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2023-10-11T04:22:41.361 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.360+0000 7fa52701df00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-11T04:22:41.378 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-11T04:22:41.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2023-10-11T04:22:41.410 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.409+0000 7fa52701df00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-11T04:22:41.412 INFO:tasks.ceph.osd.3:Started 2023-10-11T04:22:41.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-11T04:22:41.524 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.523+0000 7fa52701df00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-11T04:22:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.536+0000 7f2d2082d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.541+0000 7f2d2082d640 1 Processor -- start 2023-10-11T04:22:41.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.541+0000 7f2d2082d640 1 -- start start 2023-10-11T04:22:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.542+0000 7f2d2082d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d1c136040 0x7f2d1c138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.542+0000 7f2d2082d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c06c280 con 0x7f2d1c06cb00 2023-10-11T04:22:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.542+0000 7f2d2082d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c06c6c0 con 0x7f2d1c136040 2023-10-11T04:22:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.542+0000 7f2d13fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d1c136040 0x7f2d1c138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.542+0000 7f2d1a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2d1c06cb00 0x7f2d1c12fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35104/0 (socket says 172.21.15.50:35104) 2023-10-11T04:22:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.542+0000 7f2d1a59c640 1 -- 172.21.15.50:0/581379616 learned_addr learned my addr 172.21.15.50:0/581379616 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.543+0000 7f2d13fff640 1 -- 172.21.15.50:0/581379616 >> v1:172.21.15.50:6789/0 conn(0x7f2d1c06cb00 legacy=0x7f2d1c12fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.543+0000 7f2d13fff640 1 -- 172.21.15.50:0/581379616 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c06d8b0 con 0x7f2d1c136040 2023-10-11T04:22:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.543+0000 7f2d13fff640 1 --2- 172.21.15.50:0/581379616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c136040 0x7f2d1c138460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8235b0df1f843f server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.543+0000 7f2d19d9b640 1 -- 172.21.15.50:0/581379616 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d04009ce0 con 0x7f2d1c136040 2023-10-11T04:22:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.543+0000 7f2d19d9b640 1 -- 172.21.15.50:0/581379616 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2d04009e40 con 0x7f2d1c136040 2023-10-11T04:22:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.543+0000 7f2d19d9b640 1 -- 172.21.15.50:0/581379616 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d0400e360 con 0x7f2d1c136040 2023-10-11T04:22:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.544+0000 7f2d2082d640 1 -- 172.21.15.50:0/581379616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c136040 msgr2=0x7f2d1c138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.544+0000 7f2d2082d640 1 --2- 172.21.15.50:0/581379616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c136040 0x7f2d1c138460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.544+0000 7f2d2082d640 1 -- 172.21.15.50:0/581379616 shutdown_connections 2023-10-11T04:22:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.544+0000 7f2d2082d640 1 --2- 172.21.15.50:0/581379616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c136040 0x7f2d1c138460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.544+0000 7f2d2082d640 1 -- 172.21.15.50:0/581379616 >> 172.21.15.50:0/581379616 conn(0x7f2d1c0a3060 msgr2=0x7f2d1c0a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.544+0000 7f2d2082d640 1 -- 172.21.15.50:0/581379616 shutdown_connections 2023-10-11T04:22:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.544+0000 7f2d2082d640 1 -- 172.21.15.50:0/581379616 wait complete. 2023-10-11T04:22:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.545+0000 7f2d2082d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.546+0000 7f2d2082d640 1 Processor -- start 2023-10-11T04:22:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.546+0000 7f2d2082d640 1 -- start start 2023-10-11T04:22:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.546+0000 7f2d2082d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c06cb00 0x7f2d1c06e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.546+0000 7f2d2082d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0711a0 con 0x7f2d1c06cb00 2023-10-11T04:22:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d1a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c06cb00 0x7f2d1c06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d1a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c06cb00 0x7f2d1c06e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33516/0 (socket says 172.21.15.50:33516) 2023-10-11T04:22:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d1a59c640 1 -- 172.21.15.50:0/3289242210 learned_addr learned my addr 172.21.15.50:0/3289242210 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d1a59c640 1 -- 172.21.15.50:0/3289242210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c071420 con 0x7f2d1c06cb00 2023-10-11T04:22:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d1a59c640 1 --2- 172.21.15.50:0/3289242210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c06cb00 0x7f2d1c06e810 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d12ffd640 1 -- 172.21.15.50:0/3289242210 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d0c0059d0 con 0x7f2d1c06cb00 2023-10-11T04:22:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d12ffd640 1 -- 172.21.15.50:0/3289242210 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2d0c005b30 con 0x7f2d1c06cb00 2023-10-11T04:22:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d12ffd640 1 -- 172.21.15.50:0/3289242210 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d0c005dd0 con 0x7f2d1c06cb00 2023-10-11T04:22:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.547+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c070470 con 0x7f2d1c06cb00 2023-10-11T04:22:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.548+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c12afb0 con 0x7f2d1c06cb00 2023-10-11T04:22:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.548+0000 7f2d12ffd640 1 -- 172.21.15.50:0/3289242210 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f2d0c0073b0 con 0x7f2d1c06cb00 2023-10-11T04:22:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.548+0000 7f2d12ffd640 1 -- 172.21.15.50:0/3289242210 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7f2d0c007660 con 0x7f2d1c06cb00 2023-10-11T04:22:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.548+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c061d90 con 0x7f2d1c06cb00 2023-10-11T04:22:41.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.551+0000 7f2d12ffd640 1 -- 172.21.15.50:0/3289242210 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f2d0c00c730 con 0x7f2d1c06cb00 2023-10-11T04:22:41.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.614+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d1c06c8e0 con 0x7f2d1c06cb00 2023-10-11T04:22:41.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.614+0000 7f2d12ffd640 1 -- 172.21.15.50:0/3289242210 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7f2d0c00c8d0 con 0x7f2d1c06cb00 2023-10-11T04:22:41.616 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:41.616 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"fsid":"56da8739-9c2f-410c-8b66-6ff166a3873a","created":"2023-10-11T04:22:38.958007+0000","modified":"2023-10-11T04:22:41.090025+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T04:22:41.090025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"1e006f4f-a0aa-4faa-ad11-d61314eb5482","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"05bdb8c7-b470-4cfe-a670-93c628f07afa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"90577fa5-daa9-45d6-aa35-d9ea6d143f5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7cf8915-2f7f-4d4a-8b30-d1285eace09c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T04:22:41.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.615+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c06cb00 msgr2=0x7f2d1c06e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:41.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.615+0000 7f2d2082d640 1 --2- 172.21.15.50:0/3289242210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c06cb00 0x7f2d1c06e810 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.615+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 shutdown_connections 2023-10-11T04:22:41.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.615+0000 7f2d2082d640 1 --2- 172.21.15.50:0/3289242210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c06cb00 0x7f2d1c06e810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:41.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.615+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 >> 172.21.15.50:0/3289242210 conn(0x7f2d1c0a3060 msgr2=0x7f2d1c12c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:41.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.615+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 shutdown_connections 2023-10-11T04:22:41.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:41.615+0000 7f2d2082d640 1 -- 172.21.15.50:0/3289242210 wait complete. 2023-10-11T04:22:41.629 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-11T04:22:41.629 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-11T04:22:41.642 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.641+0000 7fa52701df00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-11T04:22:41.807 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.806+0000 7fa52701df00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-11T04:22:41.854 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:41.854+0000 7fa52701df00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-11T04:22:42.003 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:42.003+0000 7fa52701df00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-11T04:22:42.033 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T04:22:42.135 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.129+0000 7f87f3e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:42.135 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.133+0000 7f87f3e2d640 1 Processor -- start 2023-10-11T04:22:42.136 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.134+0000 7f87f3e2d640 1 -- start start 2023-10-11T04:22:42.137 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.134+0000 7f87f3e2d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87ec12fcf0 0x7f87ec130100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:42.137 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.134+0000 7f87f3e2d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec06cef0 con 0x7f87ec09ce10 2023-10-11T04:22:42.137 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.134+0000 7f87f3e2d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec09e5b0 con 0x7f87ec12fcf0 2023-10-11T04:22:42.138 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f1bc9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87ec12fcf0 0x7f87ec130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:42.138 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f13c8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f87ec09ce10 0x7f87ec09d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35112/0 (socket says 172.21.15.50:35112) 2023-10-11T04:22:42.138 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f13c8640 1 -- 172.21.15.50:0/620324774 learned_addr learned my addr 172.21.15.50:0/620324774 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:42.138 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f1bc9640 1 -- 172.21.15.50:0/620324774 >> v1:172.21.15.50:6789/0 conn(0x7f87ec09ce10 legacy=0x7f87ec09d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:42.138 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f1bc9640 1 -- 172.21.15.50:0/620324774 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec12f8e0 con 0x7f87ec12fcf0 2023-10-11T04:22:42.139 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f1bc9640 1 --2- 172.21.15.50:0/620324774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec12fcf0 0x7f87ec130100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adbc3f3b8ceeaec server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:42.142 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f0bc7640 1 -- 172.21.15.50:0/620324774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f87dc009ce0 con 0x7f87ec12fcf0 2023-10-11T04:22:42.142 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f0bc7640 1 -- 172.21.15.50:0/620324774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f87dc009e40 con 0x7f87ec12fcf0 2023-10-11T04:22:42.142 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.135+0000 7f87f0bc7640 1 -- 172.21.15.50:0/620324774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f87dc00e360 con 0x7f87ec12fcf0 2023-10-11T04:22:42.142 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 1 -- 172.21.15.50:0/620324774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec12fcf0 msgr2=0x7f87ec130100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:42.143 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 1 --2- 172.21.15.50:0/620324774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec12fcf0 0x7f87ec130100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:42.143 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 1 -- 172.21.15.50:0/620324774 shutdown_connections 2023-10-11T04:22:42.143 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 1 --2- 172.21.15.50:0/620324774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec12fcf0 0x7f87ec130100 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:42.143 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 1 -- 172.21.15.50:0/620324774 >> 172.21.15.50:0/620324774 conn(0x7f87ec0a2290 msgr2=0x7f87ec09f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:42.143 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 1 -- 172.21.15.50:0/620324774 shutdown_connections 2023-10-11T04:22:42.144 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 1 -- 172.21.15.50:0/620324774 wait complete. 2023-10-11T04:22:42.144 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.136+0000 7f87f3e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:42.144 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.137+0000 7f87f3e2d640 1 Processor -- start 2023-10-11T04:22:42.144 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.137+0000 7f87f3e2d640 1 -- start start 2023-10-11T04:22:42.144 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.138+0000 7f87f3e2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec09ce10 0x7f87ec11c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:42.144 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.138+0000 7f87f3e2d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec11ec10 con 0x7f87ec09ce10 2023-10-11T04:22:42.145 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.138+0000 7f87f1bc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec09ce10 0x7f87ec11c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:42.145 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.138+0000 7f87f1bc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec09ce10 0x7f87ec11c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33526/0 (socket says 172.21.15.50:33526) 2023-10-11T04:22:42.145 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.138+0000 7f87f1bc9640 1 -- 172.21.15.50:0/456599105 learned_addr learned my addr 172.21.15.50:0/456599105 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:42.146 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87f1bc9640 1 -- 172.21.15.50:0/456599105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec11d230 con 0x7f87ec09ce10 2023-10-11T04:22:42.146 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87f1bc9640 1 --2- 172.21.15.50:0/456599105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec09ce10 0x7f87ec11c190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:42.146 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87e27fc640 1 -- 172.21.15.50:0/456599105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f87dc014620 con 0x7f87ec09ce10 2023-10-11T04:22:42.146 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87e27fc640 1 -- 172.21.15.50:0/456599105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f87dc014780 con 0x7f87ec09ce10 2023-10-11T04:22:42.146 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec12f3f0 con 0x7f87ec09ce10 2023-10-11T04:22:42.147 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87e27fc640 1 -- 172.21.15.50:0/456599105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f87dc014a20 con 0x7f87ec09ce10 2023-10-11T04:22:42.147 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec11f6d0 con 0x7f87ec09ce10 2023-10-11T04:22:42.147 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87e27fc640 1 -- 172.21.15.50:0/456599105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f87dc011380 con 0x7f87ec09ce10 2023-10-11T04:22:42.148 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.139+0000 7f87e27fc640 1 -- 172.21.15.50:0/456599105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7f87dc019040 con 0x7f87ec09ce10 2023-10-11T04:22:42.148 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.140+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec11fb80 con 0x7f87ec09ce10 2023-10-11T04:22:42.149 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.142+0000 7f87e27fc640 1 -- 172.21.15.50:0/456599105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f87dc0103b0 con 0x7f87ec09ce10 2023-10-11T04:22:42.205 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.204+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87ec061d90 con 0x7f87ec09ce10 2023-10-11T04:22:42.206 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.204+0000 7f87e27fc640 1 -- 172.21.15.50:0/456599105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7f87dc010600 con 0x7f87ec09ce10 2023-10-11T04:22:42.206 INFO:teuthology.misc.health.smithi050.stdout: 2023-10-11T04:22:42.206 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":7,"fsid":"56da8739-9c2f-410c-8b66-6ff166a3873a","created":"2023-10-11T04:22:38.958007+0000","modified":"2023-10-11T04:22:41.090025+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T04:22:41.090025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"1e006f4f-a0aa-4faa-ad11-d61314eb5482","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"05bdb8c7-b470-4cfe-a670-93c628f07afa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"90577fa5-daa9-45d6-aa35-d9ea6d143f5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7cf8915-2f7f-4d4a-8b30-d1285eace09c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T04:22:42.207 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.205+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec09ce10 msgr2=0x7f87ec11c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:42.208 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.205+0000 7f87f3e2d640 1 --2- 172.21.15.50:0/456599105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec09ce10 0x7f87ec11c190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:42.208 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.205+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 shutdown_connections 2023-10-11T04:22:42.208 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.205+0000 7f87f3e2d640 1 --2- 172.21.15.50:0/456599105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87ec09ce10 0x7f87ec11c190 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:42.208 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.205+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 >> 172.21.15.50:0/456599105 conn(0x7f87ec0a2290 msgr2=0x7f87ec1ba1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:42.208 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.205+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 shutdown_connections 2023-10-11T04:22:42.209 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:42.206+0000 7f87f3e2d640 1 -- 172.21.15.50:0/456599105 wait complete. 2023-10-11T04:22:42.216 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-11T04:22:42.865 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:42.864+0000 7fa52701df00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-11T04:22:43.148 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:43.147+0000 7fa52701df00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-11T04:22:43.202 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:43.201+0000 7fa52701df00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-11T04:22:43.309 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:43.308+0000 7fa52701df00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-11T04:22:44.336 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:22:44.335+0000 7fa4c725a640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-11T04:22:48.620 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T04:22:48.724 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.720+0000 7f8bc182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:48.725 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.725+0000 7f8bc182d640 1 Processor -- start 2023-10-11T04:22:48.725 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.725+0000 7f8bc182d640 1 -- start start 2023-10-11T04:22:48.732 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.725+0000 7f8bc182d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bbc12ff90 0x7f8bbc1303a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:48.732 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.725+0000 7f8bc182d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc12fab0 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.733 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.725+0000 7f8bc182d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc06e750 con 0x7f8bbc12ff90 2023-10-11T04:22:48.733 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.725+0000 7f8bbaffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bbc12ff90 0x7f8bbc1303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:48.733 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bba7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8bbc06cbe0 0x7f8bbc06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37502/0 (socket says 172.21.15.50:37502) 2023-10-11T04:22:48.733 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bba7fc640 1 -- 172.21.15.50:0/195792266 learned_addr learned my addr 172.21.15.50:0/195792266 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:48.733 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bbaffd640 1 -- 172.21.15.50:0/195792266 >> v1:172.21.15.50:6789/0 conn(0x7f8bbc06cbe0 legacy=0x7f8bbc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:48.733 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bbaffd640 1 -- 172.21.15.50:0/195792266 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc06de00 con 0x7f8bbc12ff90 2023-10-11T04:22:48.734 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bbaffd640 1 --2- 172.21.15.50:0/195792266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc12ff90 0x7f8bbc1303a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d91e670153d296 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:48.734 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bb9ffb640 1 -- 172.21.15.50:0/195792266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8bac009ce0 con 0x7f8bbc12ff90 2023-10-11T04:22:48.734 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bb9ffb640 1 -- 172.21.15.50:0/195792266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8bac009e40 con 0x7f8bbc12ff90 2023-10-11T04:22:48.734 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.726+0000 7f8bb9ffb640 1 -- 172.21.15.50:0/195792266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8bac00e360 con 0x7f8bbc12ff90 2023-10-11T04:22:48.734 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 1 -- 172.21.15.50:0/195792266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc12ff90 msgr2=0x7f8bbc1303a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:48.735 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 1 --2- 172.21.15.50:0/195792266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc12ff90 0x7f8bbc1303a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:48.735 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 1 -- 172.21.15.50:0/195792266 shutdown_connections 2023-10-11T04:22:48.735 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 1 --2- 172.21.15.50:0/195792266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc12ff90 0x7f8bbc1303a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:48.735 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 1 -- 172.21.15.50:0/195792266 >> 172.21.15.50:0/195792266 conn(0x7f8bbc09eac0 msgr2=0x7f8bbc09eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:48.736 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 1 -- 172.21.15.50:0/195792266 shutdown_connections 2023-10-11T04:22:48.736 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 1 -- 172.21.15.50:0/195792266 wait complete. 2023-10-11T04:22:48.736 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.727+0000 7f8bc182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:48.736 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.728+0000 7f8bc182d640 1 Processor -- start 2023-10-11T04:22:48.736 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.728+0000 7f8bc182d640 1 -- start start 2023-10-11T04:22:48.737 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.729+0000 7f8bc182d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc06cbe0 0x7f8bbc070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:48.737 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.729+0000 7f8bc182d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc12a110 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.737 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.729+0000 7f8bbaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc06cbe0 0x7f8bbc070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:48.737 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.729+0000 7f8bbaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc06cbe0 0x7f8bbc070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56704/0 (socket says 172.21.15.50:56704) 2023-10-11T04:22:48.737 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.729+0000 7f8bbaffd640 1 -- 172.21.15.50:0/931530631 learned_addr learned my addr 172.21.15.50:0/931530631 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:48.738 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.729+0000 7f8bbaffd640 1 -- 172.21.15.50:0/931530631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc118af0 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.738 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.730+0000 7f8bbaffd640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc06cbe0 0x7f8bbc070c90 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:48.738 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.730+0000 7f8ba3fff640 1 -- 172.21.15.50:0/931530631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8bac014410 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.738 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.730+0000 7f8ba3fff640 1 -- 172.21.15.50:0/931530631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8bac014570 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.738 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.730+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc118ee0 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.739 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.730+0000 7f8ba3fff640 1 -- 172.21.15.50:0/931530631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8bac014810 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.739 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.730+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc129e40 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.739 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.731+0000 7f8ba3fff640 1 -- 172.21.15.50:0/931530631 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 44799+0+0 (crc 0 0 0) 0x7f8bac0149c0 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.739 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.731+0000 7f8ba3fff640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f8ba80377b0 0x7f8ba8039cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:48.739 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.731+0000 7f8ba3fff640 1 -- 172.21.15.50:0/931530631 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f8bac019040 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.740 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.731+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc118c80 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.740 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.731+0000 7f8bba7fc640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f8ba80377b0 0x7f8ba8039cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:48.740 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.732+0000 7f8bba7fc640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f8ba80377b0 0x7f8ba8039cc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:48.741 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.736+0000 7f8ba3fff640 1 -- 172.21.15.50:0/931530631 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f8bac00fb00 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.913 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.913+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bbc061d90 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.913 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.913+0000 7f8ba3fff640 1 -- 172.21.15.50:0/931530631 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6896 (crc 0 0 0) 0x7f8bac00f710 con 0x7f8bbc06cbe0 2023-10-11T04:22:48.914 INFO:teuthology.misc.health.smithi050.stdout: 2023-10-11T04:22:48.914 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":12,"fsid":"56da8739-9c2f-410c-8b66-6ff166a3873a","created":"2023-10-11T04:22:38.958007+0000","modified":"2023-10-11T04:22:48.340542+0000","last_up_change":"2023-10-11T04:22:45.329985+0000","last_in_change":"2023-10-11T04:22:41.090025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-11T04:22:45.383307+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e006f4f-a0aa-4faa-ad11-d61314eb5482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6801","nonce":1516004873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1516004873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":1516004873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1516004873}]},"public_addr":"172.21.15.50:6801/1516004873","cluster_addr":"172.21.15.50:6800/1516004873","heartbeat_back_addr":"172.21.15.50:6805/1516004873","heartbeat_front_addr":"172.21.15.50:6804/1516004873","state":["exists","up"]},{"osd":1,"uuid":"05bdb8c7-b470-4cfe-a670-93c628f07afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":2018685117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2018685117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":2018685117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2018685117}]},"public_addr":"172.21.15.50:6803/2018685117","cluster_addr":"172.21.15.50:6802/2018685117","heartbeat_back_addr":"172.21.15.50:6807/2018685117","heartbeat_front_addr":"172.21.15.50:6806/2018685117","state":["exists","up"]},{"osd":2,"uuid":"90577fa5-daa9-45d6-aa35-d9ea6d143f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3538222359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":3538222359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":3538222359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3538222359}]},"public_addr":"172.21.15.151:6802/3538222359","cluster_addr":"172.21.15.151:6803/3538222359","heartbeat_back_addr":"172.21.15.151:6807/3538222359","heartbeat_front_addr":"172.21.15.151:6806/3538222359","state":["exists","up"]},{"osd":3,"uuid":"b7cf8915-2f7f-4d4a-8b30-d1285eace09c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":361867287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":361867287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":361867287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":361867287}]},"public_addr":"172.21.15.151:6805/361867287","cluster_addr":"172.21.15.151:6804/361867287","heartbeat_back_addr":"172.21.15.151:6809/361867287","heartbeat_front_addr":"172.21.15.151:6808/361867287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T04:22:48.916 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f8ba80377b0 msgr2=0x7f8ba8039cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:48.916 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f8ba80377b0 0x7f8ba8039cc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:48.916 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc06cbe0 msgr2=0x7f8bbc070c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:48.916 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc06cbe0 0x7f8bbc070c90 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:48.916 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 shutdown_connections 2023-10-11T04:22:48.917 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f8ba80377b0 0x7f8ba8039cc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:48.917 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 --2- 172.21.15.50:0/931530631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bbc06cbe0 0x7f8bbc070c90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:48.917 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 >> 172.21.15.50:0/931530631 conn(0x7f8bbc09eac0 msgr2=0x7f8bbc1b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:48.917 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 shutdown_connections 2023-10-11T04:22:48.917 INFO:teuthology.misc.health.smithi050.stderr:2023-10-11T04:22:48.915+0000 7f8bc182d640 1 -- 172.21.15.50:0/931530631 wait complete. 2023-10-11T04:22:48.925 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-11T04:22:48.926 INFO:tasks.ceph:Creating RBD pool 2023-10-11T04:22:48.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-11T04:22:49.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.030+0000 7f98eb66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:49.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.037+0000 7f98eb66d640 1 Processor -- start 2023-10-11T04:22:49.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.037+0000 7f98eb66d640 1 -- start start 2023-10-11T04:22:49.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.038+0000 7f98eb66d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98e4136040 0x7f98e4138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:49.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.038+0000 7f98eb66d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e406c250 con 0x7f98e406d080 2023-10-11T04:22:49.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.038+0000 7f98eb66d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e406cdf0 con 0x7f98e4136040 2023-10-11T04:22:49.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.038+0000 7f98e8c08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98e4136040 0x7f98e4138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:49.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.038+0000 7f98e9409640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f98e406d080 0x7f98e41332f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37512/0 (socket says 172.21.15.50:37512) 2023-10-11T04:22:49.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.038+0000 7f98e9409640 1 -- 172.21.15.50:0/4167724799 learned_addr learned my addr 172.21.15.50:0/4167724799 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:49.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.039+0000 7f98e8c08640 1 -- 172.21.15.50:0/4167724799 >> v1:172.21.15.50:6789/0 conn(0x7f98e406d080 legacy=0x7f98e41332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:49.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.039+0000 7f98e8c08640 1 -- 172.21.15.50:0/4167724799 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e406c6c0 con 0x7f98e4136040 2023-10-11T04:22:49.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.039+0000 7f98e3fff640 1 -- 172.21.15.50:0/4167724799 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143258693 0 0) 0x7f98e406c250 con 0x7f98e406d080 2023-10-11T04:22:49.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.039+0000 7f98e8c08640 1 --2- 172.21.15.50:0/4167724799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e4136040 0x7f98e4138460 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b750b0b647c3417b server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:49.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.039+0000 7f98e3fff640 1 -- 172.21.15.50:0/4167724799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f98d8009ce0 con 0x7f98e4136040 2023-10-11T04:22:49.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.039+0000 7f98e3fff640 1 -- 172.21.15.50:0/4167724799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f98d8009e40 con 0x7f98e4136040 2023-10-11T04:22:49.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.039+0000 7f98e3fff640 1 -- 172.21.15.50:0/4167724799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f98d800e360 con 0x7f98e4136040 2023-10-11T04:22:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 1 -- 172.21.15.50:0/4167724799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e4136040 msgr2=0x7f98e4138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:49.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 1 --2- 172.21.15.50:0/4167724799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e4136040 0x7f98e4138460 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 1 -- 172.21.15.50:0/4167724799 shutdown_connections 2023-10-11T04:22:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 1 --2- 172.21.15.50:0/4167724799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e4136040 0x7f98e4138460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 1 -- 172.21.15.50:0/4167724799 >> 172.21.15.50:0/4167724799 conn(0x7f98e40a2d60 msgr2=0x7f98e40a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 1 -- 172.21.15.50:0/4167724799 shutdown_connections 2023-10-11T04:22:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 1 -- 172.21.15.50:0/4167724799 wait complete. 2023-10-11T04:22:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.040+0000 7f98eb66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.041+0000 7f98eb66d640 1 Processor -- start 2023-10-11T04:22:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.041+0000 7f98eb66d640 1 -- start start 2023-10-11T04:22:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.041+0000 7f98eb66d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e406d080 0x7f98e406f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.041+0000 7f98eb66d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e412c320 con 0x7f98e406d080 2023-10-11T04:22:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e9409640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e406d080 0x7f98e406f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e9409640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e406d080 0x7f98e406f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56722/0 (socket says 172.21.15.50:56722) 2023-10-11T04:22:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e9409640 1 -- 172.21.15.50:0/2795613819 learned_addr learned my addr 172.21.15.50:0/2795613819 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e9409640 1 -- 172.21.15.50:0/2795613819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e411bc30 con 0x7f98e406d080 2023-10-11T04:22:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e9409640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e406d080 0x7f98e406f5f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e1ffb640 1 -- 172.21.15.50:0/2795613819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f98d4004e70 con 0x7f98e406d080 2023-10-11T04:22:49.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e1ffb640 1 -- 172.21.15.50:0/2795613819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f98d400c8e0 con 0x7f98e406d080 2023-10-11T04:22:49.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e4071250 con 0x7f98e406d080 2023-10-11T04:22:49.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98e1ffb640 1 -- 172.21.15.50:0/2795613819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f98d400cb80 con 0x7f98e406d080 2023-10-11T04:22:49.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.042+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e411cf20 con 0x7f98e406d080 2023-10-11T04:22:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.043+0000 7f98e1ffb640 1 -- 172.21.15.50:0/2795613819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 44799+0+0 (crc 0 0 0) 0x7f98d4007120 con 0x7f98e406d080 2023-10-11T04:22:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.043+0000 7f98e1ffb640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f98d00377b0 0x7f98d0039cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.043+0000 7f98e1ffb640 1 -- 172.21.15.50:0/2795613819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f98d4046e70 con 0x7f98e406d080 2023-10-11T04:22:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.043+0000 7f98e8c08640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f98d00377b0 0x7f98d0039cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.043+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e412c120 con 0x7f98e406d080 2023-10-11T04:22:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.044+0000 7f98e8c08640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f98d00377b0 0x7f98d0039cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:49.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.048+0000 7f98e1ffb640 1 -- 172.21.15.50:0/2795613819 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f98d400cd70 con 0x7f98e406d080 2023-10-11T04:22:49.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.224+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f98e4061d90 con 0x7f98e406d080 2023-10-11T04:22:49.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.943+0000 7f98e1ffb640 1 -- 172.21.15.50:0/2795613819 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (crc 0 0 0) 0x7f98d400a6d0 con 0x7f98e406d080 2023-10-11T04:22:49.943 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2023-10-11T04:22:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f98d00377b0 msgr2=0x7f98d0039cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:49.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f98d00377b0 0x7f98d0039cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:49.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e406d080 msgr2=0x7f98e406f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:49.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e406d080 0x7f98e406f5f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:49.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 shutdown_connections 2023-10-11T04:22:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f98d00377b0 0x7f98d0039cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 --2- 172.21.15.50:0/2795613819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e406d080 0x7f98e406f5f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 >> 172.21.15.50:0/2795613819 conn(0x7f98e40a2d60 msgr2=0x7f98e412c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 shutdown_connections 2023-10-11T04:22:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:49.946+0000 7f98eb66d640 1 -- 172.21.15.50:0/2795613819 wait complete. 2023-10-11T04:22:49.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-11T04:22:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.080+0000 7fa8f7b9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.089+0000 7fa8f7b9e640 1 Processor -- start 2023-10-11T04:22:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.089+0000 7fa8f7b9e640 1 -- start start 2023-10-11T04:22:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f7b9e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8f006db70 0x7fa8f012d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f7b9e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f012d630 con 0x7fa8f012dda0 2023-10-11T04:22:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f7b9e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f006eac0 con 0x7fa8f006db70 2023-10-11T04:22:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f593a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8f006db70 0x7fa8f012d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f5139640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa8f012dda0 0x7fa8f006bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37522/0 (socket says 172.21.15.50:37522) 2023-10-11T04:22:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f5139640 1 -- 172.21.15.50:0/3581058175 learned_addr learned my addr 172.21.15.50:0/3581058175 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f593a640 1 -- 172.21.15.50:0/3581058175 >> v1:172.21.15.50:6789/0 conn(0x7fa8f012dda0 legacy=0x7fa8f006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f593a640 1 -- 172.21.15.50:0/3581058175 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f006d470 con 0x7fa8f006db70 2023-10-11T04:22:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f4938640 1 -- 172.21.15.50:0/3581058175 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513124666 0 0) 0x7fa8f012d630 con 0x7fa8f012dda0 2023-10-11T04:22:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f593a640 1 --2- 172.21.15.50:0/3581058175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f012d860 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e280423c1afb93d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f4938640 1 -- 172.21.15.50:0/3581058175 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa8ec009ce0 con 0x7fa8f006db70 2023-10-11T04:22:50.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f4938640 1 -- 172.21.15.50:0/3581058175 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa8ec009e40 con 0x7fa8f006db70 2023-10-11T04:22:50.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.090+0000 7fa8f4938640 1 -- 172.21.15.50:0/3581058175 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa8ec00e360 con 0x7fa8f006db70 2023-10-11T04:22:50.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3581058175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 msgr2=0x7fa8f012d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:50.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 1 --2- 172.21.15.50:0/3581058175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f012d860 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:50.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3581058175 shutdown_connections 2023-10-11T04:22:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 1 --2- 172.21.15.50:0/3581058175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f012d860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3581058175 >> 172.21.15.50:0/3581058175 conn(0x7fa8f009fc60 msgr2=0x7fa8f00a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3581058175 shutdown_connections 2023-10-11T04:22:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3581058175 wait complete. 2023-10-11T04:22:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.091+0000 7fa8f7b9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:50.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.092+0000 7fa8f7b9e640 1 Processor -- start 2023-10-11T04:22:50.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.092+0000 7fa8f7b9e640 1 -- start start 2023-10-11T04:22:50.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.093+0000 7fa8f7b9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f0130520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:50.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.093+0000 7fa8f7b9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0099be0 con 0x7fa8f006db70 2023-10-11T04:22:50.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.093+0000 7fa8f593a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f0130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:50.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.093+0000 7fa8f593a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f0130520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56742/0 (socket says 172.21.15.50:56742) 2023-10-11T04:22:50.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.093+0000 7fa8f593a640 1 -- 172.21.15.50:0/3883453905 learned_addr learned my addr 172.21.15.50:0/3883453905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:50.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.093+0000 7fa8f593a640 1 -- 172.21.15.50:0/3883453905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0131890 con 0x7fa8f006db70 2023-10-11T04:22:50.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.093+0000 7fa8f593a640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f0130520 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:50.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.094+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa8ec014620 con 0x7fa8f006db70 2023-10-11T04:22:50.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.094+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa8ec014780 con 0x7fa8f006db70 2023-10-11T04:22:50.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.094+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f011cc80 con 0x7fa8f006db70 2023-10-11T04:22:50.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.094+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa8ec014a20 con 0x7fa8f006db70 2023-10-11T04:22:50.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.094+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f009a2c0 con 0x7fa8f006db70 2023-10-11T04:22:50.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.094+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 44799+0+0 (crc 0 0 0) 0x7fa8ec014bd0 con 0x7fa8f006db70 2023-10-11T04:22:50.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.095+0000 7fa8e67fc640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fa8d40377b0 0x7fa8d4039cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:50.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.095+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2661+0+0 (crc 0 0 0) 0x7fa8ec019040 con 0x7fa8f006db70 2023-10-11T04:22:50.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.095+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f0061d90 con 0x7fa8f006db70 2023-10-11T04:22:50.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.095+0000 7fa8f5139640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fa8d40377b0 0x7fa8d4039cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:50.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.096+0000 7fa8f5139640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fa8d40377b0 0x7fa8d4039cc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:50.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.100+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fa8ec010310 con 0x7fa8f006db70 2023-10-11T04:22:50.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.275+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa8f004e1b0 con 0x7fa8f006db70 2023-10-11T04:22:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.347+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fa8ec00e230 con 0x7fa8f006db70 2023-10-11T04:22:50.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.943+0000 7fa8e67fc640 1 -- 172.21.15.50:0/3883453905 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (crc 0 0 0) 0x7fa8ec041d50 con 0x7fa8f006db70 2023-10-11T04:22:50.944 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-11T04:22:50.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fa8d40377b0 msgr2=0x7fa8d4039cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:50.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fa8d40377b0 0x7fa8d4039cc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:50.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 msgr2=0x7fa8f0130520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:50.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f0130520 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:50.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 shutdown_connections 2023-10-11T04:22:50.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fa8d40377b0 0x7fa8d4039cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:50.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 --2- 172.21.15.50:0/3883453905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f006db70 0x7fa8f0130520 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:50.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 >> 172.21.15.50:0/3883453905 conn(0x7fa8f009fc60 msgr2=0x7fa8f01b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:50.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 shutdown_connections 2023-10-11T04:22:50.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:50.947+0000 7fa8f7b9e640 1 -- 172.21.15.50:0/3883453905 wait complete. 2023-10-11T04:22:50.962 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-11T04:22:50.963 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-11T04:22:50.963 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-11T04:22:50.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-11T04:22:50.964 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-11T04:22:51.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.082+0000 7fba4619e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:51.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba4619e640 1 Processor -- start 2023-10-11T04:22:51.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba4619e640 1 -- start start 2023-10-11T04:22:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba4619e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba40136040 0x7fba40138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba4619e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4006c280 con 0x7fba4006cb00 2023-10-11T04:22:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba4619e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4006c6c0 con 0x7fba40136040 2023-10-11T04:22:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba3effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba40136040 0x7fba40138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba3f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba4006cb00 0x7fba4012fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37528/0 (socket says 172.21.15.50:37528) 2023-10-11T04:22:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.086+0000 7fba3f7fe640 1 -- 172.21.15.50:0/3466245370 learned_addr learned my addr 172.21.15.50:0/3466245370 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:51.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3e7fc640 1 -- 172.21.15.50:0/3466245370 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501866912 0 0) 0x7fba4006c280 con 0x7fba4006cb00 2023-10-11T04:22:51.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3e7fc640 1 -- 172.21.15.50:0/3466245370 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba280034f0 con 0x7fba4006cb00 2023-10-11T04:22:51.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3effd640 1 -- 172.21.15.50:0/3466245370 >> v1:172.21.15.50:6789/0 conn(0x7fba4006cb00 legacy=0x7fba4012fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3effd640 1 -- 172.21.15.50:0/3466245370 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4006d8b0 con 0x7fba40136040 2023-10-11T04:22:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3effd640 1 --2- 172.21.15.50:0/3466245370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba40136040 0x7fba40138460 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2fa6ad92150e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3e7fc640 1 -- 172.21.15.50:0/3466245370 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba34009ce0 con 0x7fba40136040 2023-10-11T04:22:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3e7fc640 1 -- 172.21.15.50:0/3466245370 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fba34009e40 con 0x7fba40136040 2023-10-11T04:22:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.087+0000 7fba3e7fc640 1 -- 172.21.15.50:0/3466245370 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba3400e360 con 0x7fba40136040 2023-10-11T04:22:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 1 -- 172.21.15.50:0/3466245370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba40136040 msgr2=0x7fba40138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 1 --2- 172.21.15.50:0/3466245370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba40136040 0x7fba40138460 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 1 -- 172.21.15.50:0/3466245370 shutdown_connections 2023-10-11T04:22:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 1 --2- 172.21.15.50:0/3466245370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba40136040 0x7fba40138460 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 1 -- 172.21.15.50:0/3466245370 >> 172.21.15.50:0/3466245370 conn(0x7fba400a3060 msgr2=0x7fba400a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 1 -- 172.21.15.50:0/3466245370 shutdown_connections 2023-10-11T04:22:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 1 -- 172.21.15.50:0/3466245370 wait complete. 2023-10-11T04:22:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.088+0000 7fba4619e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.089+0000 7fba4619e640 1 Processor -- start 2023-10-11T04:22:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.089+0000 7fba4619e640 1 -- start start 2023-10-11T04:22:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba4619e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba4006cb00 0x7fba4006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba4619e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4006f900 con 0x7fba4006cb00 2023-10-11T04:22:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba3f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba4006cb00 0x7fba4006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba3f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba4006cb00 0x7fba4006fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56770/0 (socket says 172.21.15.50:56770) 2023-10-11T04:22:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba3f7fe640 1 -- 172.21.15.50:0/2779345531 learned_addr learned my addr 172.21.15.50:0/2779345531 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba3f7fe640 1 -- 172.21.15.50:0/2779345531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4011b540 con 0x7fba4006cb00 2023-10-11T04:22:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba3f7fe640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba4006cb00 0x7fba4006fda0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba27fff640 1 -- 172.21.15.50:0/2779345531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba300059d0 con 0x7fba4006cb00 2023-10-11T04:22:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba27fff640 1 -- 172.21.15.50:0/2779345531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fba30005b30 con 0x7fba4006cb00 2023-10-11T04:22:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4011cc90 con 0x7fba4006cb00 2023-10-11T04:22:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba27fff640 1 -- 172.21.15.50:0/2779345531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba30005dd0 con 0x7fba4006cb00 2023-10-11T04:22:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.090+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4011c9b0 con 0x7fba4006cb00 2023-10-11T04:22:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.091+0000 7fba27fff640 1 -- 172.21.15.50:0/2779345531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fba300070b0 con 0x7fba4006cb00 2023-10-11T04:22:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.091+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba400719f0 con 0x7fba4006cb00 2023-10-11T04:22:51.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.092+0000 7fba27fff640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fba2c0377f0 0x7fba2c039d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.092+0000 7fba27fff640 1 -- 172.21.15.50:0/2779345531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fba30046e20 con 0x7fba4006cb00 2023-10-11T04:22:51.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.092+0000 7fba3effd640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fba2c0377f0 0x7fba2c039d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.092+0000 7fba3effd640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fba2c0377f0 0x7fba2c039d00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.096+0000 7fba27fff640 1 -- 172.21.15.50:0/2779345531 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fba3000d750 con 0x7fba4006cb00 2023-10-11T04:22:51.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.319+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fba40061d90 con 0x7fba4006cb00 2023-10-11T04:22:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.321+0000 7fba27fff640 1 -- 172.21.15.50:0/2779345531 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86182 (crc 0 0 0) 0x7fba3000d570 con 0x7fba4006cb00 2023-10-11T04:22:51.322 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:51.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fba2c0377f0 msgr2=0x7fba2c039d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fba2c0377f0 0x7fba2c039d00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba4006cb00 msgr2=0x7fba4006fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba4006cb00 0x7fba4006fda0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 shutdown_connections 2023-10-11T04:22:51.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fba2c0377f0 0x7fba2c039d00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 --2- 172.21.15.50:0/2779345531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba4006cb00 0x7fba4006fda0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 >> 172.21.15.50:0/2779345531 conn(0x7fba400a3060 msgr2=0x7fba401bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:51.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 shutdown_connections 2023-10-11T04:22:51.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.323+0000 7fba4619e640 1 -- 172.21.15.50:0/2779345531 wait complete. 2023-10-11T04:22:51.333 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3619362033},{"type":"v1","addr":"172.21.15.151:6801","nonce":3619362033}]},"active_addr":"172.21.15.151:6801/3619362033","active_change":"2023-10-11T04:22:43.322845+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1123382033}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1160072913}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":4127776432}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1311253884}]}]} 2023-10-11T04:22:51.336 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-11T04:22:51.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-11T04:22:51.336 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-11T04:22:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.444+0000 7f6aafead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.448+0000 7f6aafead640 1 Processor -- start 2023-10-11T04:22:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.448+0000 7f6aafead640 1 -- start start 2023-10-11T04:22:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aafead640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6aa8098da0 0x7f6aa81364b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aafead640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa8067630 con 0x7f6aa8099f20 2023-10-11T04:22:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aafead640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa8073c60 con 0x7f6aa8098da0 2023-10-11T04:22:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aadc49640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6aa8099f20 0x7f6aa8098690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37530/0 (socket says 172.21.15.50:37530) 2023-10-11T04:22:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aadc49640 1 -- 172.21.15.50:0/3866172168 learned_addr learned my addr 172.21.15.50:0/3866172168 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aad448640 1 --2- 172.21.15.50:0/3866172168 >> v2:172.21.15.50:3300/0 conn(0x7f6aa8098da0 0x7f6aa81364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aacc47640 1 -- 172.21.15.50:0/3866172168 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908531861 0 0) 0x7f6aa8067630 con 0x7f6aa8099f20 2023-10-11T04:22:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aacc47640 1 -- 172.21.15.50:0/3866172168 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a900034f0 con 0x7f6aa8099f20 2023-10-11T04:22:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aad448640 1 -- 172.21.15.50:0/3866172168 >> v1:172.21.15.50:6789/0 conn(0x7f6aa8099f20 legacy=0x7f6aa8098690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aad448640 1 -- 172.21.15.50:0/3866172168 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa809a770 con 0x7f6aa8098da0 2023-10-11T04:22:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.449+0000 7f6aad448640 1 --2- 172.21.15.50:0/3866172168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa81364b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322e120a948d4d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aacc47640 1 -- 172.21.15.50:0/3866172168 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6a9c009ce0 con 0x7f6aa8098da0 2023-10-11T04:22:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aacc47640 1 -- 172.21.15.50:0/3866172168 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6a9c009e40 con 0x7f6aa8098da0 2023-10-11T04:22:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aacc47640 1 -- 172.21.15.50:0/3866172168 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6a9c00e360 con 0x7f6aa8098da0 2023-10-11T04:22:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aafead640 1 -- 172.21.15.50:0/3866172168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 msgr2=0x7f6aa81364b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aafead640 1 --2- 172.21.15.50:0/3866172168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa81364b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aafead640 1 -- 172.21.15.50:0/3866172168 shutdown_connections 2023-10-11T04:22:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aafead640 1 --2- 172.21.15.50:0/3866172168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa81364b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aafead640 1 -- 172.21.15.50:0/3866172168 >> 172.21.15.50:0/3866172168 conn(0x7f6aa809f190 msgr2=0x7f6aa809f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aafead640 1 -- 172.21.15.50:0/3866172168 shutdown_connections 2023-10-11T04:22:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.450+0000 7f6aafead640 1 -- 172.21.15.50:0/3866172168 wait complete. 2023-10-11T04:22:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.451+0000 7f6aafead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.452+0000 7f6aafead640 1 Processor -- start 2023-10-11T04:22:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.452+0000 7f6aafead640 1 -- start start 2023-10-11T04:22:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.452+0000 7f6aafead640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa812ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.452+0000 7f6aafead640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa81317f0 con 0x7f6aa8098da0 2023-10-11T04:22:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.452+0000 7f6aadc49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa812ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.452+0000 7f6aadc49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa812ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56790/0 (socket says 172.21.15.50:56790) 2023-10-11T04:22:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.452+0000 7f6aadc49640 1 -- 172.21.15.50:0/278052314 learned_addr learned my addr 172.21.15.50:0/278052314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.453+0000 7f6aadc49640 1 -- 172.21.15.50:0/278052314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa808a030 con 0x7f6aa8098da0 2023-10-11T04:22:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.453+0000 7f6aadc49640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa812ec30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.453+0000 7f6aa67fc640 1 -- 172.21.15.50:0/278052314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6aa00059d0 con 0x7f6aa8098da0 2023-10-11T04:22:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.453+0000 7f6aa67fc640 1 -- 172.21.15.50:0/278052314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6aa0005b30 con 0x7f6aa8098da0 2023-10-11T04:22:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.453+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa808aba0 con 0x7f6aa8098da0 2023-10-11T04:22:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.453+0000 7f6aa67fc640 1 -- 172.21.15.50:0/278052314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6aa0005dd0 con 0x7f6aa8098da0 2023-10-11T04:22:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.453+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa8131dc0 con 0x7f6aa8098da0 2023-10-11T04:22:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.454+0000 7f6aa67fc640 1 -- 172.21.15.50:0/278052314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f6aa00070b0 con 0x7f6aa8098da0 2023-10-11T04:22:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.454+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa8130790 con 0x7f6aa8098da0 2023-10-11T04:22:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.454+0000 7f6aa67fc640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f6a94037840 0x7f6a94039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.454+0000 7f6aa67fc640 1 -- 172.21.15.50:0/278052314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f6aa0046d10 con 0x7f6aa8098da0 2023-10-11T04:22:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.454+0000 7f6aad448640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f6a94037840 0x7f6a94039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.455+0000 7f6aad448640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f6a94037840 0x7f6a94039d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.459+0000 7f6aa67fc640 1 -- 172.21.15.50:0/278052314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f6aa000d750 con 0x7f6aa8098da0 2023-10-11T04:22:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.634+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6aa8061d90 con 0x7f6aa8098da0 2023-10-11T04:22:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.635+0000 7f6aa67fc640 1 -- 172.21.15.50:0/278052314 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8664 (crc 0 0 0) 0x7f6aa000d570 con 0x7f6aa8098da0 2023-10-11T04:22:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:51.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"fsid":"56da8739-9c2f-410c-8b66-6ff166a3873a","created":"2023-10-11T04:22:38.958007+0000","modified":"2023-10-11T04:22:50.943063+0000","last_up_change":"2023-10-11T04:22:45.329985+0000","last_in_change":"2023-10-11T04:22:41.090025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-11T04:22:45.383307+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-11T04:22:49.253915+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e006f4f-a0aa-4faa-ad11-d61314eb5482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6801","nonce":1516004873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1516004873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":1516004873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1516004873}]},"public_addr":"172.21.15.50:6801/1516004873","cluster_addr":"172.21.15.50:6800/1516004873","heartbeat_back_addr":"172.21.15.50:6805/1516004873","heartbeat_front_addr":"172.21.15.50:6804/1516004873","state":["exists","up"]},{"osd":1,"uuid":"05bdb8c7-b470-4cfe-a670-93c628f07afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":2018685117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2018685117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":2018685117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2018685117}]},"public_addr":"172.21.15.50:6803/2018685117","cluster_addr":"172.21.15.50:6802/2018685117","heartbeat_back_addr":"172.21.15.50:6807/2018685117","heartbeat_front_addr":"172.21.15.50:6806/2018685117","state":["exists","up"]},{"osd":2,"uuid":"90577fa5-daa9-45d6-aa35-d9ea6d143f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3538222359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":3538222359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":3538222359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3538222359}]},"public_addr":"172.21.15.151:6802/3538222359","cluster_addr":"172.21.15.151:6803/3538222359","heartbeat_back_addr":"172.21.15.151:6807/3538222359","heartbeat_front_addr":"172.21.15.151:6806/3538222359","state":["exists","up"]},{"osd":3,"uuid":"b7cf8915-2f7f-4d4a-8b30-d1285eace09c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":361867287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":361867287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":361867287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":361867287}]},"public_addr":"172.21.15.151:6805/361867287","cluster_addr":"172.21.15.151:6804/361867287","heartbeat_back_addr":"172.21.15.151:6809/361867287","heartbeat_front_addr":"172.21.15.151:6808/361867287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T04:22:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f6a94037840 msgr2=0x7f6a94039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f6a94037840 0x7f6a94039d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 msgr2=0x7f6aa812ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa812ec30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 shutdown_connections 2023-10-11T04:22:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f6a94037840 0x7f6a94039d50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 --2- 172.21.15.50:0/278052314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6aa8098da0 0x7f6aa812ec30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 >> 172.21.15.50:0/278052314 conn(0x7f6aa809f190 msgr2=0x7f6aa8127fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 shutdown_connections 2023-10-11T04:22:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.637+0000 7f6aafead640 1 -- 172.21.15.50:0/278052314 wait complete. 2023-10-11T04:22:51.647 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-11T04:22:51.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-11T04:22:51.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.755+0000 7f4e510de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.759+0000 7f4e510de640 1 Processor -- start 2023-10-11T04:22:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.759+0000 7f4e510de640 1 -- start start 2023-10-11T04:22:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.759+0000 7f4e510de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e4c06d800 0x7f4e4c12c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.759+0000 7f4e510de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c12c540 con 0x7f4e4c12ce40 2023-10-11T04:22:51.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.759+0000 7f4e510de640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c06e990 con 0x7f4e4c06d800 2023-10-11T04:22:51.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e4ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e4c06d800 0x7f4e4c12c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e43fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e4c12ce40 0x7f4e4c12fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37546/0 (socket says 172.21.15.50:37546) 2023-10-11T04:22:51.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e43fff640 1 -- 172.21.15.50:0/2643847571 learned_addr learned my addr 172.21.15.50:0/2643847571 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e4ad9d640 1 -- 172.21.15.50:0/2643847571 >> v1:172.21.15.50:6789/0 conn(0x7f4e4c12ce40 legacy=0x7f4e4c12fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e4ad9d640 1 -- 172.21.15.50:0/2643847571 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c06dd40 con 0x7f4e4c06d800 2023-10-11T04:22:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e4ad9d640 1 --2- 172.21.15.50:0/2643847571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c12c900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca01840dab067419 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e4a59c640 1 -- 172.21.15.50:0/2643847571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4e3c009ce0 con 0x7f4e4c06d800 2023-10-11T04:22:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e4a59c640 1 -- 172.21.15.50:0/2643847571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4e3c009e40 con 0x7f4e4c06d800 2023-10-11T04:22:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.760+0000 7f4e4a59c640 1 -- 172.21.15.50:0/2643847571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4e3c00e360 con 0x7f4e4c06d800 2023-10-11T04:22:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 1 -- 172.21.15.50:0/2643847571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 msgr2=0x7f4e4c12c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 1 --2- 172.21.15.50:0/2643847571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c12c900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 1 -- 172.21.15.50:0/2643847571 shutdown_connections 2023-10-11T04:22:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 1 --2- 172.21.15.50:0/2643847571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c12c900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 1 -- 172.21.15.50:0/2643847571 >> 172.21.15.50:0/2643847571 conn(0x7f4e4c09f840 msgr2=0x7f4e4c09fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 1 -- 172.21.15.50:0/2643847571 shutdown_connections 2023-10-11T04:22:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 1 -- 172.21.15.50:0/2643847571 wait complete. 2023-10-11T04:22:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.761+0000 7f4e510de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:51.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.762+0000 7f4e510de640 1 Processor -- start 2023-10-11T04:22:51.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.762+0000 7f4e510de640 1 -- start start 2023-10-11T04:22:51.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.763+0000 7f4e510de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c117000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.763+0000 7f4e510de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1197c0 con 0x7f4e4c06d800 2023-10-11T04:22:51.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.763+0000 7f4e4ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c117000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.763+0000 7f4e4ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c117000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56808/0 (socket says 172.21.15.50:56808) 2023-10-11T04:22:51.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.763+0000 7f4e4ad9d640 1 -- 172.21.15.50:0/925079543 learned_addr learned my addr 172.21.15.50:0/925079543 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:51.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.763+0000 7f4e4ad9d640 1 -- 172.21.15.50:0/925079543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c1180a0 con 0x7f4e4c06d800 2023-10-11T04:22:51.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.764+0000 7f4e4ad9d640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c117000 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.764+0000 7f4e437fe640 1 -- 172.21.15.50:0/925079543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4e3c014620 con 0x7f4e4c06d800 2023-10-11T04:22:51.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.764+0000 7f4e437fe640 1 -- 172.21.15.50:0/925079543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4e3c014780 con 0x7f4e4c06d800 2023-10-11T04:22:51.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.764+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c119a30 con 0x7f4e4c06d800 2023-10-11T04:22:51.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.764+0000 7f4e437fe640 1 -- 172.21.15.50:0/925079543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4e3c014a20 con 0x7f4e4c06d800 2023-10-11T04:22:51.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.764+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c119290 con 0x7f4e4c06d800 2023-10-11T04:22:51.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.764+0000 7f4e437fe640 1 -- 172.21.15.50:0/925079543 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f4e3c014b80 con 0x7f4e4c06d800 2023-10-11T04:22:51.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.765+0000 7f4e437fe640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4e2c037840 0x7f4e2c039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:51.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.765+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c061d90 con 0x7f4e4c06d800 2023-10-11T04:22:51.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.765+0000 7f4e437fe640 1 -- 172.21.15.50:0/925079543 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f4e3c019040 con 0x7f4e4c06d800 2023-10-11T04:22:51.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.765+0000 7f4e43fff640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4e2c037840 0x7f4e2c039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:51.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.766+0000 7f4e43fff640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4e2c037840 0x7f4e2c039d50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:51.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.769+0000 7f4e437fe640 1 -- 172.21.15.50:0/925079543 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f4e3c014e30 con 0x7f4e4c06d800 2023-10-11T04:22:51.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.946+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e4c119bc0 con 0x7f4e4c06d800 2023-10-11T04:22:51.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.947+0000 7f4e437fe640 1 -- 172.21.15.50:0/925079543 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8664 (crc 0 0 0) 0x7f4e3c00e230 con 0x7f4e4c06d800 2023-10-11T04:22:51.947 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:51.947 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"fsid":"56da8739-9c2f-410c-8b66-6ff166a3873a","created":"2023-10-11T04:22:38.958007+0000","modified":"2023-10-11T04:22:50.943063+0000","last_up_change":"2023-10-11T04:22:45.329985+0000","last_in_change":"2023-10-11T04:22:41.090025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-11T04:22:45.383307+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-11T04:22:49.253915+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e006f4f-a0aa-4faa-ad11-d61314eb5482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6801","nonce":1516004873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1516004873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":1516004873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1516004873}]},"public_addr":"172.21.15.50:6801/1516004873","cluster_addr":"172.21.15.50:6800/1516004873","heartbeat_back_addr":"172.21.15.50:6805/1516004873","heartbeat_front_addr":"172.21.15.50:6804/1516004873","state":["exists","up"]},{"osd":1,"uuid":"05bdb8c7-b470-4cfe-a670-93c628f07afa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":2018685117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2018685117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":2018685117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2018685117}]},"public_addr":"172.21.15.50:6803/2018685117","cluster_addr":"172.21.15.50:6802/2018685117","heartbeat_back_addr":"172.21.15.50:6807/2018685117","heartbeat_front_addr":"172.21.15.50:6806/2018685117","state":["exists","up"]},{"osd":2,"uuid":"90577fa5-daa9-45d6-aa35-d9ea6d143f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3538222359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":3538222359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":3538222359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3538222359}]},"public_addr":"172.21.15.151:6802/3538222359","cluster_addr":"172.21.15.151:6803/3538222359","heartbeat_back_addr":"172.21.15.151:6807/3538222359","heartbeat_front_addr":"172.21.15.151:6806/3538222359","state":["exists","up"]},{"osd":3,"uuid":"b7cf8915-2f7f-4d4a-8b30-d1285eace09c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":361867287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":361867287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":361867287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":361867287}]},"public_addr":"172.21.15.151:6805/361867287","cluster_addr":"172.21.15.151:6804/361867287","heartbeat_back_addr":"172.21.15.151:6809/361867287","heartbeat_front_addr":"172.21.15.151:6808/361867287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T04:22:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4e2c037840 msgr2=0x7f4e2c039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4e2c037840 0x7f4e2c039d50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 msgr2=0x7f4e4c117000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c117000 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 shutdown_connections 2023-10-11T04:22:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4e2c037840 0x7f4e2c039d50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 --2- 172.21.15.50:0/925079543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e4c06d800 0x7f4e4c117000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 >> 172.21.15.50:0/925079543 conn(0x7f4e4c09f840 msgr2=0x7f4e4c1b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:51.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 shutdown_connections 2023-10-11T04:22:51.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:51.949+0000 7f4e510de640 1 -- 172.21.15.50:0/925079543 wait complete. 2023-10-11T04:22:51.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-11T04:22:51.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-11T04:22:51.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-11T04:22:51.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-11T04:22:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.079+0000 7f294bb1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.079+0000 7ff3e399e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.079+0000 7efec186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.079+0000 7fba1775e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.084+0000 7ff3e399e640 1 Processor -- start 2023-10-11T04:22:52.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.084+0000 7f294bb1e640 1 Processor -- start 2023-10-11T04:22:52.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.084+0000 7efec186d640 1 Processor -- start 2023-10-11T04:22:52.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.084+0000 7fba1775e640 1 Processor -- start 2023-10-11T04:22:52.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.084+0000 7ff3e399e640 1 -- start start 2023-10-11T04:22:52.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.084+0000 7efec186d640 1 -- start start 2023-10-11T04:22:52.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.084+0000 7f294bb1e640 1 -- start start 2023-10-11T04:22:52.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7fba1775e640 1 -- start start 2023-10-11T04:22:52.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7ff3e399e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3dc1324f0 0x7ff3dc134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7efec186d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efebc12e030 0x7efebc06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7f294bb1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2944136040 0x7f2944138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7ff3e399e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc06e400 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7ff3e399e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc09a630 con 0x7ff3dc1324f0 2023-10-11T04:22:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7f294bb1e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294406c280 con 0x7f294406cb00 2023-10-11T04:22:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7f294bb1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294406c6c0 con 0x7f2944136040 2023-10-11T04:22:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7f29490b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2944136040 0x7f2944138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7f29498ba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f294406cb00 0x7f294412fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37558/0 (socket says 172.21.15.50:37558) 2023-10-11T04:22:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7f29490b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2944136040 0x7f2944138460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56830/0 (socket says 172.21.15.50:56830) 2023-10-11T04:22:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7f29490b9640 1 -- 172.21.15.50:0/1528593809 learned_addr learned my addr 172.21.15.50:0/1528593809 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7ff3e173a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff3dc12f5d0 0x7ff3dc12f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37548/0 (socket says 172.21.15.50:37548) 2023-10-11T04:22:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7ff3e173a640 1 -- 172.21.15.50:0/2602978439 learned_addr learned my addr 172.21.15.50:0/2602978439 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba1775e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba1012e160 0x7fba1009b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba1775e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1012e570 con 0x7fba1009a860 2023-10-11T04:22:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba154fa640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba1009a860 0x7fba1012da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37570/0 (socket says 172.21.15.50:37570) 2023-10-11T04:22:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba154fa640 1 -- 172.21.15.50:0/3660970579 learned_addr learned my addr 172.21.15.50:0/3660970579 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7ff3e0f39640 1 --2- 172.21.15.50:0/2602978439 >> v2:172.21.15.50:3300/0 conn(0x7ff3dc1324f0 0x7ff3dc134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7efec186d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc12d5a0 con 0x7efebc12dc20 2023-10-11T04:22:52.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.085+0000 7efec186d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc09c0c0 con 0x7efebc12e030 2023-10-11T04:22:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7efeba7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efebc12e030 0x7efebc06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7efeba7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efebc12e030 0x7efebc06c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56814/0 (socket says 172.21.15.50:56814) 2023-10-11T04:22:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7efeba7fc640 1 -- 172.21.15.50:0/3816241455 learned_addr learned my addr 172.21.15.50:0/3816241455 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba1775e640 1 -- 172.21.15.50:0/3660970579 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1009bcf0 con 0x7fba1012e160 2023-10-11T04:22:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7efeba7fc640 1 -- 172.21.15.50:0/3816241455 >> v1:172.21.15.50:6789/0 conn(0x7efebc12dc20 legacy=0x7efebc06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7efeba7fc640 1 -- 172.21.15.50:0/3816241455 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc12d7d0 con 0x7efebc12e030 2023-10-11T04:22:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7f29490b9640 1 -- 172.21.15.50:0/1528593809 >> v1:172.21.15.50:6789/0 conn(0x7f294406cb00 legacy=0x7f294412fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7f29490b9640 1 -- 172.21.15.50:0/1528593809 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294406d8b0 con 0x7f2944136040 2023-10-11T04:22:52.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7f29488b8640 1 -- 172.21.15.50:0/1528593809 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173032176 0 0) 0x7f294406c280 con 0x7f294406cb00 2023-10-11T04:22:52.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba14cf9640 1 --2- 172.21.15.50:0/3660970579 >> v2:172.21.15.50:3300/0 conn(0x7fba1012e160 0x7fba1009b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7efeba7fc640 1 --2- 172.21.15.50:0/3816241455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12e030 0x7efebc06c5f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86890b468464ab6c server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba03fff640 1 -- 172.21.15.50:0/3660970579 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563027150 0 0) 0x7fba1012e570 con 0x7fba1009a860 2023-10-11T04:22:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7fba03fff640 1 -- 172.21.15.50:0/3660970579 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc0034f0 con 0x7fba1009a860 2023-10-11T04:22:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7ff3d3fff640 1 -- 172.21.15.50:0/2602978439 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810391721 0 0) 0x7ff3dc06e400 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7ff3d3fff640 1 -- 172.21.15.50:0/2602978439 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c8003410 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7ff3e0f39640 1 -- 172.21.15.50:0/2602978439 >> v1:172.21.15.50:6789/0 conn(0x7ff3dc12f5d0 legacy=0x7ff3dc12f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7ff3e0f39640 1 -- 172.21.15.50:0/2602978439 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc06dcb0 con 0x7ff3dc1324f0 2023-10-11T04:22:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.086+0000 7f29490b9640 1 --2- 172.21.15.50:0/1528593809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2944136040 0x7f2944138460 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3f304093f59678 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7fba14cf9640 1 -- 172.21.15.50:0/3660970579 >> v1:172.21.15.50:6789/0 conn(0x7fba1009a860 legacy=0x7fba1012da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7fba14cf9640 1 -- 172.21.15.50:0/3660970579 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1012d740 con 0x7fba1012e160 2023-10-11T04:22:52.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7ff3e0f39640 1 --2- 172.21.15.50:0/2602978439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1324f0 0x7ff3dc134910 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee3e8bdcdfb44bb server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7fba14cf9640 1 --2- 172.21.15.50:0/3660970579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1012e160 0x7fba1009b5d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b419fe435f88b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7efeb9ffb640 1 -- 172.21.15.50:0/3816241455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efeb0012040 con 0x7efebc12e030 2023-10-11T04:22:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7f29488b8640 1 -- 172.21.15.50:0/1528593809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2934009dd0 con 0x7f2944136040 2023-10-11T04:22:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7efeb9ffb640 1 -- 172.21.15.50:0/3816241455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7efeb000d0b0 con 0x7efebc12e030 2023-10-11T04:22:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7efeb9ffb640 1 -- 172.21.15.50:0/3816241455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efeb000b660 con 0x7efebc12e030 2023-10-11T04:22:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7f29488b8640 1 -- 172.21.15.50:0/1528593809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f293400e230 con 0x7f2944136040 2023-10-11T04:22:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7f29488b8640 1 -- 172.21.15.50:0/1528593809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f293400e4d0 con 0x7f2944136040 2023-10-11T04:22:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7fba03fff640 1 -- 172.21.15.50:0/3660970579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba0400e040 con 0x7fba1012e160 2023-10-11T04:22:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7fba03fff640 1 -- 172.21.15.50:0/3660970579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fba04007670 con 0x7fba1012e160 2023-10-11T04:22:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7fba03fff640 1 -- 172.21.15.50:0/3660970579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba04007910 con 0x7fba1012e160 2023-10-11T04:22:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7ff3d3fff640 1 -- 172.21.15.50:0/2602978439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff3cc009ce0 con 0x7ff3dc1324f0 2023-10-11T04:22:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.087+0000 7ff3d3fff640 1 -- 172.21.15.50:0/2602978439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ff3cc009e40 con 0x7ff3dc1324f0 2023-10-11T04:22:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7f294bb1e640 1 -- 172.21.15.50:0/1528593809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2944136040 msgr2=0x7f2944138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7f294bb1e640 1 --2- 172.21.15.50:0/1528593809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2944136040 0x7f2944138460 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7ff3d3fff640 1 -- 172.21.15.50:0/2602978439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff3cc009ce0 con 0x7ff3dc1324f0 2023-10-11T04:22:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7f294bb1e640 1 -- 172.21.15.50:0/1528593809 shutdown_connections 2023-10-11T04:22:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7f294bb1e640 1 --2- 172.21.15.50:0/1528593809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2944136040 0x7f2944138460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7f294bb1e640 1 -- 172.21.15.50:0/1528593809 >> 172.21.15.50:0/1528593809 conn(0x7f29440a3060 msgr2=0x7f29440a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7fba1775e640 1 -- 172.21.15.50:0/3660970579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1012e160 msgr2=0x7fba1009b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7fba1775e640 1 --2- 172.21.15.50:0/3660970579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1012e160 0x7fba1009b5d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7efec186d640 1 -- 172.21.15.50:0/3816241455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12e030 msgr2=0x7efebc06c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7efec186d640 1 --2- 172.21.15.50:0/3816241455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12e030 0x7efebc06c5f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7fba1775e640 1 -- 172.21.15.50:0/3660970579 shutdown_connections 2023-10-11T04:22:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7fba1775e640 1 --2- 172.21.15.50:0/3660970579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1012e160 0x7fba1009b5d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7efec186d640 1 -- 172.21.15.50:0/3816241455 shutdown_connections 2023-10-11T04:22:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7f294bb1e640 1 -- 172.21.15.50:0/1528593809 shutdown_connections 2023-10-11T04:22:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7fba1775e640 1 -- 172.21.15.50:0/3660970579 >> 172.21.15.50:0/3660970579 conn(0x7fba1009fac0 msgr2=0x7fba1009fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7efec186d640 1 --2- 172.21.15.50:0/3816241455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12e030 0x7efebc06c5f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7efec186d640 1 -- 172.21.15.50:0/3816241455 >> 172.21.15.50:0/3816241455 conn(0x7efebc09ff80 msgr2=0x7efebc0a0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7f294bb1e640 1 -- 172.21.15.50:0/1528593809 wait complete. 2023-10-11T04:22:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7efec186d640 1 -- 172.21.15.50:0/3816241455 shutdown_connections 2023-10-11T04:22:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7efec186d640 1 -- 172.21.15.50:0/3816241455 wait complete. 2023-10-11T04:22:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.088+0000 7fba1775e640 1 -- 172.21.15.50:0/3660970579 shutdown_connections 2023-10-11T04:22:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 1 -- 172.21.15.50:0/2602978439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1324f0 msgr2=0x7ff3dc134910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 1 --2- 172.21.15.50:0/2602978439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1324f0 0x7ff3dc134910 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7f294bb1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 1 -- 172.21.15.50:0/2602978439 shutdown_connections 2023-10-11T04:22:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7fba1775e640 1 -- 172.21.15.50:0/3660970579 wait complete. 2023-10-11T04:22:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 1 --2- 172.21.15.50:0/2602978439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1324f0 0x7ff3dc134910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 1 -- 172.21.15.50:0/2602978439 >> 172.21.15.50:0/2602978439 conn(0x7ff3dc09f840 msgr2=0x7ff3dc09fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7fba1775e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 1 -- 172.21.15.50:0/2602978439 shutdown_connections 2023-10-11T04:22:52.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7efec186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 1 -- 172.21.15.50:0/2602978439 wait complete. 2023-10-11T04:22:52.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.089+0000 7ff3e399e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7f294bb1e640 1 Processor -- start 2023-10-11T04:22:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7f294bb1e640 1 -- start start 2023-10-11T04:22:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7efec186d640 1 Processor -- start 2023-10-11T04:22:52.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7fba1775e640 1 Processor -- start 2023-10-11T04:22:52.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7fba1775e640 1 -- start start 2023-10-11T04:22:52.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7efec186d640 1 -- start start 2023-10-11T04:22:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7ff3e399e640 1 Processor -- start 2023-10-11T04:22:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.090+0000 7ff3e399e640 1 -- start start 2023-10-11T04:22:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7fba1775e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1009a860 0x7fba1006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7fba1775e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1006f0c0 con 0x7fba1009a860 2023-10-11T04:22:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7fba154fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1009a860 0x7fba1006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7ff3e399e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc12f5d0 0x7ff3dc1cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7ff3e399e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc119b20 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7f294bb1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294406cb00 0x7f29441c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7fba154fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1009a860 0x7fba1006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56852/0 (socket says 172.21.15.50:56852) 2023-10-11T04:22:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7fba154fa640 1 -- 172.21.15.50:0/1633419021 learned_addr learned my addr 172.21.15.50:0/1633419021 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7f294bb1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294412d350 con 0x7f294406cb00 2023-10-11T04:22:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7ff3e173a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc12f5d0 0x7ff3dc1cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7f29498ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294406cb00 0x7f29441c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7ff3e173a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc12f5d0 0x7ff3dc1cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56864/0 (socket says 172.21.15.50:56864) 2023-10-11T04:22:52.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7ff3e173a640 1 -- 172.21.15.50:0/1622769864 learned_addr learned my addr 172.21.15.50:0/1622769864 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7f29498ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294406cb00 0x7f29441c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56870/0 (socket says 172.21.15.50:56870) 2023-10-11T04:22:52.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7f29498ba640 1 -- 172.21.15.50:0/3863694083 learned_addr learned my addr 172.21.15.50:0/3863694083 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7efec186d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12dc20 0x7efebc118c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7efec186d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc11b380 con 0x7efebc12dc20 2023-10-11T04:22:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7ff3e173a640 1 -- 172.21.15.50:0/1622769864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc119690 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.091+0000 7fba154fa640 1 -- 172.21.15.50:0/1633419021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1006ee90 con 0x7fba1009a860 2023-10-11T04:22:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7efebaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12dc20 0x7efebc118c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7ff3e173a640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc12f5d0 0x7ff3dc1cbc20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7efebaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12dc20 0x7efebc118c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56874/0 (socket says 172.21.15.50:56874) 2023-10-11T04:22:52.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7efebaffd640 1 -- 172.21.15.50:0/1959581905 learned_addr learned my addr 172.21.15.50:0/1959581905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7f29498ba640 1 -- 172.21.15.50:0/3863694083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294411bdb0 con 0x7f294406cb00 2023-10-11T04:22:52.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7fba154fa640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1009a860 0x7fba1006cff0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff3d80059d0 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7f29498ba640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294406cb00 0x7f29441c77b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ff3d8005b30 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff3d8005dd0 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc119d50 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2940004af0 con 0x7f294406cb00 2023-10-11T04:22:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7efebaffd640 1 -- 172.21.15.50:0/1959581905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc11c310 con 0x7efebc12dc20 2023-10-11T04:22:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7f294bb1e640 1 -- 172.21.15.50:0/3863694083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294411cc00 con 0x7f294406cb00 2023-10-11T04:22:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc11a3a0 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7f294bb1e640 1 -- 172.21.15.50:0/3863694083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294411b620 con 0x7f294406cb00 2023-10-11T04:22:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba0c004bd0 con 0x7fba1009a860 2023-10-11T04:22:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2940004c50 con 0x7f294406cb00 2023-10-11T04:22:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2940007120 con 0x7f294406cb00 2023-10-11T04:22:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1012d010 con 0x7fba1009a860 2023-10-11T04:22:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.092+0000 7efebaffd640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12dc20 0x7efebc118c90 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1006e420 con 0x7fba1009a860 2023-10-11T04:22:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fba0c004d30 con 0x7fba1009a860 2023-10-11T04:22:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efeac00c7b0 con 0x7efebc12dc20 2023-10-11T04:22:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7efeac00c910 con 0x7efebc12dc20 2023-10-11T04:22:52.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3dc0a05c0 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7f294bb1e640 1 -- 172.21.15.50:0/3863694083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f292c000f10 con 0x7f294406cb00 2023-10-11T04:22:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efeac00c7b0 con 0x7efebc12dc20 2023-10-11T04:22:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc11a8f0 con 0x7efebc12dc20 2023-10-11T04:22:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc11cde0 con 0x7efebc12dc20 2023-10-11T04:22:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f29400072d0 con 0x7f294406cb00 2023-10-11T04:22:52.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7ff3d80070b0 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7ff3d1ffb640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7ff3c0037840 0x7ff3c0039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7ff3d8046cf0 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7ff3d1ffb640 1 --2- 172.21.15.50:0/1622769864 >> v2:172.21.15.50:6801/1516004873 conn(0x7ff3c003c7e0 0x7ff3c003ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 --> v2:172.21.15.50:6801/1516004873 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3c003f300 con 0x7ff3c003c7e0 2023-10-11T04:22:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.093+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fba0c007120 con 0x7fba1009a860 2023-10-11T04:22:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7ff3d800d510 con 0x7ff3dc12f5d0 2023-10-11T04:22:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7f293a7fc640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2928037840 0x7f2928039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f2940046e90 con 0x7f294406cb00 2023-10-11T04:22:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.094+0000 7efea1ffb640 1 -- 172.21.15.50:0/1959581905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efebc06d640 con 0x7efebc12dc20 2023-10-11T04:22:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7f293a7fc640 1 --2- 172.21.15.50:0/3863694083 >> v2:172.21.15.50:6803/2018685117 conn(0x7f292803c7e0 0x7f292803ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 --> v2:172.21.15.50:6803/2018685117 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f292803f300 con 0x7f292803c7e0 2023-10-11T04:22:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9f0000f10 con 0x7fba1009a860 2023-10-11T04:22:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7f29400492b0 con 0x7f294406cb00 2023-10-11T04:22:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7f29490b9640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2928037840 0x7f2928039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7ff3e0f39640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7ff3c0037840 0x7ff3c0039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fba0c007320 con 0x7fba1009a860 2023-10-11T04:22:52.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7ff3e1f3b640 1 --2- 172.21.15.50:0/1622769864 >> v2:172.21.15.50:6801/1516004873 conn(0x7ff3c003c7e0 0x7ff3c003ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-11T04:22:52.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7efeac00cb20 con 0x7efebc12dc20 2023-10-11T04:22:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7fba01ffb640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fb9f4037830 0x7fb9f4039d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7ff3e0f39640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7ff3c0037840 0x7ff3c0039d50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7f29490b9640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2928037840 0x7f2928039d50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fba0c046e70 con 0x7fba1009a860 2023-10-11T04:22:52.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7efea3fff640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7efea8037870 0x7efea8039d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7fba01ffb640 1 --2- 172.21.15.50:0/1633419021 >> v2:172.21.15.151:6802/3538222359 conn(0x7fb9f403c7d0 0x7fb9f403ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 --> v2:172.21.15.151:6802/3538222359 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9f403f2f0 con 0x7fb9f403c7d0 2023-10-11T04:22:52.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fba0c007120 con 0x7fba1009a860 2023-10-11T04:22:52.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.095+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7efeac046c60 con 0x7efebc12dc20 2023-10-11T04:22:52.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7fba14cf9640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fb9f4037830 0x7fb9f4039d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7efea3fff640 1 --2- 172.21.15.50:0/1959581905 >> v2:172.21.15.151:6805/361867287 conn(0x7efea803c810 0x7efea803eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 --> v2:172.21.15.151:6805/361867287 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efea803f330 con 0x7efea803c810 2023-10-11T04:22:52.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7efeac00c7b0 con 0x7efebc12dc20 2023-10-11T04:22:52.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7efeba7fc640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7efea8037870 0x7efea8039d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7fba14cf9640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fb9f4037830 0x7fb9f4039d40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7efeba7fc640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7efea8037870 0x7efea8039d80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.096+0000 7efebb7fe640 1 --2- 172.21.15.50:0/1959581905 >> v2:172.21.15.151:6805/361867287 conn(0x7efea803c810 0x7efea803eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-11T04:22:52.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.097+0000 7ff3e1f3b640 1 --2- 172.21.15.50:0/1622769864 >> v2:172.21.15.50:6801/1516004873 conn(0x7ff3c003c7e0 0x7ff3c003ec70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.098+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== osd.0 v2:172.21.15.50:6801/1516004873 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7ff3c003f300 con 0x7ff3c003c7e0 2023-10-11T04:22:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.099+0000 7f294a0bb640 1 --2- 172.21.15.50:0/3863694083 >> v2:172.21.15.50:6803/2018685117 conn(0x7f292803c7e0 0x7f292803ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-11T04:22:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.099+0000 7efebb7fe640 1 --2- 172.21.15.50:0/1959581905 >> v2:172.21.15.151:6805/361867287 conn(0x7efea803c810 0x7efea803eca0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.100+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== osd.3 v2:172.21.15.151:6805/361867287 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7efea803f330 con 0x7efea803c810 2023-10-11T04:22:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.101+0000 7f294a0bb640 1 --2- 172.21.15.50:0/3863694083 >> v2:172.21.15.50:6803/2018685117 conn(0x7f292803c7e0 0x7f292803ec70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.101+0000 7fba15cfb640 1 --2- 172.21.15.50:0/1633419021 >> v2:172.21.15.151:6802/3538222359 conn(0x7fb9f403c7d0 0x7fb9f403ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-11T04:22:52.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.101+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== osd.1 v2:172.21.15.50:6803/2018685117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f292803f300 con 0x7f292803c7e0 2023-10-11T04:22:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.103+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 --> v2:172.21.15.50:6801/1516004873 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3dc06e050 con 0x7ff3c003c7e0 2023-10-11T04:22:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3d1ffb640 1 -- 172.21.15.50:0/1622769864 <== osd.0 v2:172.21.15.50:6801/1516004873 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff3d400a820 con 0x7ff3c003c7e0 2023-10-11T04:22:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7fba15cfb640 1 --2- 172.21.15.50:0/1633419021 >> v2:172.21.15.151:6802/3538222359 conn(0x7fb9f403c7d0 0x7fb9f403ec60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7efea1ffb640 1 -- 172.21.15.50:0/1959581905 --> v2:172.21.15.151:6805/361867287 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efebc06e0a0 con 0x7efea803c810 2023-10-11T04:22:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 >> v2:172.21.15.50:6801/1516004873 conn(0x7ff3c003c7e0 msgr2=0x7ff3c003ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 --2- 172.21.15.50:0/1622769864 >> v2:172.21.15.50:6801/1516004873 conn(0x7ff3c003c7e0 0x7ff3c003ec70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7ff3c0037840 msgr2=0x7ff3c0039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7ff3c0037840 0x7ff3c0039d50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc12f5d0 msgr2=0x7ff3dc1cbc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc12f5d0 0x7ff3dc1cbc20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 shutdown_connections 2023-10-11T04:22:52.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 --2- 172.21.15.50:0/1622769864 >> v2:172.21.15.50:6801/1516004873 conn(0x7ff3c003c7e0 0x7ff3c003ec70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7ff3c0037840 0x7ff3c0039d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 --2- 172.21.15.50:0/1622769864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc12f5d0 0x7ff3dc1cbc20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 >> 172.21.15.50:0/1622769864 conn(0x7ff3dc09f840 msgr2=0x7ff3dc06e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 shutdown_connections 2023-10-11T04:22:52.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.104+0000 7ff3e399e640 1 -- 172.21.15.50:0/1622769864 wait complete. 2023-10-11T04:22:52.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efea3fff640 1 -- 172.21.15.50:0/1959581905 <== osd.3 v2:172.21.15.151:6805/361867287 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efeb400a820 con 0x7efea803c810 2023-10-11T04:22:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 >> v2:172.21.15.151:6805/361867287 conn(0x7efea803c810 msgr2=0x7efea803eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 --2- 172.21.15.50:0/1959581905 >> v2:172.21.15.151:6805/361867287 conn(0x7efea803c810 0x7efea803eca0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7efea8037870 msgr2=0x7efea8039d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7efea8037870 0x7efea8039d80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12dc20 msgr2=0x7efebc118c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12dc20 0x7efebc118c90 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 shutdown_connections 2023-10-11T04:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7efea8037870 0x7efea8039d80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 --2- 172.21.15.50:0/1959581905 >> v2:172.21.15.151:6805/361867287 conn(0x7efea803c810 0x7efea803eca0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 --2- 172.21.15.50:0/1959581905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efebc12dc20 0x7efebc118c90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 >> 172.21.15.50:0/1959581905 conn(0x7efebc09ff80 msgr2=0x7efebc12c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 shutdown_connections 2023-10-11T04:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7efec186d640 1 -- 172.21.15.50:0/1959581905 wait complete. 2023-10-11T04:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.105+0000 7f294bb1e640 1 -- 172.21.15.50:0/3863694083 --> v2:172.21.15.50:6803/2018685117 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f292c002b20 con 0x7f292803c7e0 2023-10-11T04:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f293a7fc640 1 -- 172.21.15.50:0/3863694083 <== osd.1 v2:172.21.15.50:6803/2018685117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f292c002b20 con 0x7f292803c7e0 2023-10-11T04:22:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== osd.2 v2:172.21.15.151:6802/3538222359 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fb9f403f2f0 con 0x7fb9f403c7d0 2023-10-11T04:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 -- 172.21.15.50:0/3863694083 >> v2:172.21.15.50:6803/2018685117 conn(0x7f292803c7e0 msgr2=0x7f292803ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 --2- 172.21.15.50:0/3863694083 >> v2:172.21.15.50:6803/2018685117 conn(0x7f292803c7e0 0x7f292803ec70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 -- 172.21.15.50:0/3863694083 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2928037840 msgr2=0x7f2928039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2928037840 0x7f2928039d50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 -- 172.21.15.50:0/3863694083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294406cb00 msgr2=0x7f29441c77b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294406cb00 0x7f29441c77b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 -- 172.21.15.50:0/3863694083 shutdown_connections 2023-10-11T04:22:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 --2- 172.21.15.50:0/3863694083 >> v2:172.21.15.50:6803/2018685117 conn(0x7f292803c7e0 0x7f292803ec70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.107+0000 7f2927fff640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2928037840 0x7f2928039d50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.108+0000 7f2927fff640 1 --2- 172.21.15.50:0/3863694083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294406cb00 0x7f29441c77b0 crc :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.108+0000 7f2927fff640 1 -- 172.21.15.50:0/3863694083 >> 172.21.15.50:0/3863694083 conn(0x7f29440a3060 msgr2=0x7f294412e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.108+0000 7f2927fff640 1 -- 172.21.15.50:0/3863694083 shutdown_connections 2023-10-11T04:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.111+0000 7f2927fff640 1 -- 172.21.15.50:0/3863694083 wait complete. 2023-10-11T04:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.113+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 --> v2:172.21.15.151:6802/3538222359 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9f0002b20 con 0x7fb9f403c7d0 2023-10-11T04:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.114+0000 7fba01ffb640 1 -- 172.21.15.50:0/1633419021 <== osd.2 v2:172.21.15.151:6802/3538222359 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9f0002b20 con 0x7fb9f403c7d0 2023-10-11T04:22:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.114+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 >> v2:172.21.15.151:6802/3538222359 conn(0x7fb9f403c7d0 msgr2=0x7fb9f403ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.114+0000 7fba1775e640 1 --2- 172.21.15.50:0/1633419021 >> v2:172.21.15.151:6802/3538222359 conn(0x7fb9f403c7d0 0x7fb9f403ec60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fb9f4037830 msgr2=0x7fb9f4039d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fb9f4037830 0x7fb9f4039d40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1009a860 msgr2=0x7fba1006cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1009a860 0x7fba1006cff0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 shutdown_connections 2023-10-11T04:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 --2- 172.21.15.50:0/1633419021 >> v2:172.21.15.151:6802/3538222359 conn(0x7fb9f403c7d0 0x7fb9f403ec60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fb9f4037830 0x7fb9f4039d40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 --2- 172.21.15.50:0/1633419021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba1009a860 0x7fba1006cff0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 >> 172.21.15.50:0/1633419021 conn(0x7fba1009fac0 msgr2=0x7fba10135200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 shutdown_connections 2023-10-11T04:22:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.115+0000 7fba1775e640 1 -- 172.21.15.50:0/1633419021 wait complete. 2023-10-11T04:22:52.178 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:52.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-11T04:22:52.179 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:52.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-11T04:22:52.181 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:52.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-11T04:22:52.182 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:52.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-11T04:22:52.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.338+0000 7fd5ea82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.338+0000 7fcea466d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.338+0000 7f7bd186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.343+0000 7fcea466d640 1 Processor -- start 2023-10-11T04:22:52.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.343+0000 7fcea466d640 1 -- start start 2023-10-11T04:22:52.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.343+0000 7f7bd186d640 1 Processor -- start 2023-10-11T04:22:52.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.343+0000 7fd5ea82d640 1 Processor -- start 2023-10-11T04:22:52.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.343+0000 7f7bd186d640 1 -- start start 2023-10-11T04:22:52.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.338+0000 7f40dc39e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.343+0000 7fd5ea82d640 1 -- start start 2023-10-11T04:22:52.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7f7bd186d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7bcc12e160 0x7f7bcc09b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7f7bd186d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc12e570 con 0x7f7bcc09a860 2023-10-11T04:22:52.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7f7bd186d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc09bcf0 con 0x7f7bcc12e160 2023-10-11T04:22:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7fcea466d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce9c1324f0 0x7fce9c134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7f7bcaffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7bcc09a860 0x7f7bcc12da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37576/0 (socket says 172.21.15.50:37576) 2023-10-11T04:22:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7f7bcaffd640 1 -- 172.21.15.50:0/73334261 learned_addr learned my addr 172.21.15.50:0/73334261 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:52.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7fcea466d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c06e400 con 0x7fce9c12f5d0 2023-10-11T04:22:52.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7f7bca7fc640 1 --2- 172.21.15.50:0/73334261 >> v2:172.21.15.50:3300/0 conn(0x7f7bcc12e160 0x7f7bcc09b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7f40dc39e640 1 Processor -- start 2023-10-11T04:22:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7fcea466d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c09a630 con 0x7fce9c1324f0 2023-10-11T04:22:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.344+0000 7fcea1c08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce9c1324f0 0x7fce9c134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fcea1c08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce9c1324f0 0x7fce9c134910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56896/0 (socket says 172.21.15.50:56896) 2023-10-11T04:22:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fcea1c08640 1 -- 172.21.15.50:0/284397235 learned_addr learned my addr 172.21.15.50:0/284397235 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fd5ea82d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5e4136040 0x7fd5e4138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fd5ea82d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e406c280 con 0x7fd5e406cb00 2023-10-11T04:22:52.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fd5ea82d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e406c6c0 con 0x7fd5e4136040 2023-10-11T04:22:52.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fcea1c08640 1 -- 172.21.15.50:0/284397235 >> v1:172.21.15.50:6789/0 conn(0x7fce9c12f5d0 legacy=0x7fce9c12f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-11T04:22:52.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fcea1c08640 1 -- 172.21.15.50:0/284397235 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c06dcb0 con 0x7fce9c1324f0 2023-10-11T04:22:52.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7f7bca7fc640 1 -- 172.21.15.50:0/73334261 >> v1:172.21.15.50:6789/0 conn(0x7f7bcc09a860 legacy=0x7f7bcc12da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7f40dc39e640 1 -- start start 2023-10-11T04:22:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7f7bca7fc640 1 -- 172.21.15.50:0/73334261 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc12d740 con 0x7f7bcc12e160 2023-10-11T04:22:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fd5e3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd5e406cb00 0x7fd5e412fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37600/0 (socket says 172.21.15.50:37600) 2023-10-11T04:22:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fcea1c08640 1 --2- 172.21.15.50:0/284397235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c1324f0 0x7fce9c134910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217c94ebee383438 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fd5e3fff640 1 -- 172.21.15.50:0/1274298029 learned_addr learned my addr 172.21.15.50:0/1274298029 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7f7bca7fc640 1 --2- 172.21.15.50:0/73334261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc12e160 0x7f7bcc09b5d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e71b3343bd03b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fd5e37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5e4136040 0x7fd5e4138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.345+0000 7fcea1407640 1 -- 172.21.15.50:0/284397235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce8c00d450 con 0x7fce9c1324f0 2023-10-11T04:22:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fd5e37fe640 1 -- 172.21.15.50:0/1274298029 >> v1:172.21.15.50:6789/0 conn(0x7fd5e406cb00 legacy=0x7fd5e412fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fd5e37fe640 1 -- 172.21.15.50:0/1274298029 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e406d8b0 con 0x7fd5e4136040 2023-10-11T04:22:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fcea1407640 1 -- 172.21.15.50:0/284397235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fce8c00d5b0 con 0x7fce9c1324f0 2023-10-11T04:22:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fcea1407640 1 -- 172.21.15.50:0/284397235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce8c00d850 con 0x7fce9c1324f0 2023-10-11T04:22:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f7bc9ffb640 1 -- 172.21.15.50:0/73334261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7bc0009ce0 con 0x7f7bcc12e160 2023-10-11T04:22:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fd5e37fe640 1 --2- 172.21.15.50:0/1274298029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e4136040 0x7fd5e4138460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8d86c66ce14a4a server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f7bc9ffb640 1 -- 172.21.15.50:0/73334261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7bc0009e40 con 0x7f7bcc12e160 2023-10-11T04:22:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f7bc9ffb640 1 -- 172.21.15.50:0/73334261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7bc000e360 con 0x7f7bcc12e160 2023-10-11T04:22:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40dc39e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40d409a860 0x7f40d409b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40dc39e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d412e570 con 0x7f40d412da50 2023-10-11T04:22:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40dc39e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d409bcf0 con 0x7f40d409a860 2023-10-11T04:22:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40d9939640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f40d412da50 0x7f40d412de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37610/0 (socket says 172.21.15.50:37610) 2023-10-11T04:22:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40d9939640 1 -- 172.21.15.50:0/3588711689 learned_addr learned my addr 172.21.15.50:0/3588711689 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40da13a640 1 --2- 172.21.15.50:0/3588711689 >> v2:172.21.15.50:3300/0 conn(0x7f40d409a860 0x7f40d409b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fd5e2ffd640 1 -- 172.21.15.50:0/1274298029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd5cc009ce0 con 0x7fd5e4136040 2023-10-11T04:22:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40d9138640 1 -- 172.21.15.50:0/3588711689 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604150275 0 0) 0x7f40d412e570 con 0x7f40d412da50 2023-10-11T04:22:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7f40d9138640 1 -- 172.21.15.50:0/3588711689 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40c00034f0 con 0x7f40d412da50 2023-10-11T04:22:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fd5e2ffd640 1 -- 172.21.15.50:0/1274298029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd5cc009e40 con 0x7fd5e4136040 2023-10-11T04:22:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.346+0000 7fd5e2ffd640 1 -- 172.21.15.50:0/1274298029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd5cc00e360 con 0x7fd5e4136040 2023-10-11T04:22:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f40da13a640 1 -- 172.21.15.50:0/3588711689 >> v1:172.21.15.50:6789/0 conn(0x7f40d412da50 legacy=0x7f40d412de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f40d9138640 1 -- 172.21.15.50:0/3588711689 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 292150580 0 0) 0x7f40c00034f0 con 0x7f40d412da50 2023-10-11T04:22:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 1 -- 172.21.15.50:0/284397235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c1324f0 msgr2=0x7fce9c134910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 1 --2- 172.21.15.50:0/284397235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c1324f0 0x7fce9c134910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f40da13a640 1 -- 172.21.15.50:0/3588711689 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d412d740 con 0x7f40d409a860 2023-10-11T04:22:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 1 -- 172.21.15.50:0/284397235 shutdown_connections 2023-10-11T04:22:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 1 --2- 172.21.15.50:0/284397235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c1324f0 0x7fce9c134910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 1 -- 172.21.15.50:0/284397235 >> 172.21.15.50:0/284397235 conn(0x7fce9c09f840 msgr2=0x7fce9c09fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f40da13a640 1 --2- 172.21.15.50:0/3588711689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d409b5d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e103385fb0cae30c server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 1 -- 172.21.15.50:0/73334261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc12e160 msgr2=0x7f7bcc09b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 1 --2- 172.21.15.50:0/73334261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc12e160 0x7f7bcc09b5d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 1 -- 172.21.15.50:0/284397235 shutdown_connections 2023-10-11T04:22:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 1 -- 172.21.15.50:0/73334261 shutdown_connections 2023-10-11T04:22:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 1 --2- 172.21.15.50:0/73334261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc12e160 0x7f7bcc09b5d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 1 -- 172.21.15.50:0/73334261 >> 172.21.15.50:0/73334261 conn(0x7f7bcc09fac0 msgr2=0x7f7bcc09fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 1 -- 172.21.15.50:0/284397235 wait complete. 2023-10-11T04:22:52.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f40d9138640 1 -- 172.21.15.50:0/3588711689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f40cc00e040 con 0x7f40d409a860 2023-10-11T04:22:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 1 -- 172.21.15.50:0/73334261 shutdown_connections 2023-10-11T04:22:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f40d9138640 1 -- 172.21.15.50:0/3588711689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f40cc007540 con 0x7f40d409a860 2023-10-11T04:22:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f40d9138640 1 -- 172.21.15.50:0/3588711689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f40d00015a0 con 0x7f40d409a860 2023-10-11T04:22:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 1 -- 172.21.15.50:0/73334261 wait complete. 2023-10-11T04:22:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fcea466d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7f7bd186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fd5ea82d640 1 -- 172.21.15.50:0/1274298029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e4136040 msgr2=0x7fd5e4138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.347+0000 7fd5ea82d640 1 --2- 172.21.15.50:0/1274298029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e4136040 0x7fd5e4138460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7fd5ea82d640 1 -- 172.21.15.50:0/1274298029 shutdown_connections 2023-10-11T04:22:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7fd5ea82d640 1 --2- 172.21.15.50:0/1274298029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e4136040 0x7fd5e4138460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7fd5ea82d640 1 -- 172.21.15.50:0/1274298029 >> 172.21.15.50:0/1274298029 conn(0x7fd5e40a3060 msgr2=0x7fd5e40a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7fd5ea82d640 1 -- 172.21.15.50:0/1274298029 shutdown_connections 2023-10-11T04:22:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7fd5ea82d640 1 -- 172.21.15.50:0/1274298029 wait complete. 2023-10-11T04:22:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7fd5ea82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7f40dc39e640 1 -- 172.21.15.50:0/3588711689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 msgr2=0x7f40d409b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7f40dc39e640 1 --2- 172.21.15.50:0/3588711689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d409b5d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7f40dc39e640 1 -- 172.21.15.50:0/3588711689 shutdown_connections 2023-10-11T04:22:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7f40dc39e640 1 --2- 172.21.15.50:0/3588711689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d409b5d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7f40dc39e640 1 -- 172.21.15.50:0/3588711689 >> 172.21.15.50:0/3588711689 conn(0x7f40d409fac0 msgr2=0x7f40d409fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7f40dc39e640 1 -- 172.21.15.50:0/3588711689 shutdown_connections 2023-10-11T04:22:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.348+0000 7f40dc39e640 1 -- 172.21.15.50:0/3588711689 wait complete. 2023-10-11T04:22:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7f40dc39e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7f7bd186d640 1 Processor -- start 2023-10-11T04:22:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7fcea466d640 1 Processor -- start 2023-10-11T04:22:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7fd5ea82d640 1 Processor -- start 2023-10-11T04:22:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7f7bd186d640 1 -- start start 2023-10-11T04:22:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7fd5ea82d640 1 -- start start 2023-10-11T04:22:52.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7fcea466d640 1 -- start start 2023-10-11T04:22:52.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7f40dc39e640 1 Processor -- start 2023-10-11T04:22:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7f40dc39e640 1 -- start start 2023-10-11T04:22:52.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7fcea466d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c12f5d0 0x7fce9c11b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7fcea466d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c11d1f0 con 0x7fce9c12f5d0 2023-10-11T04:22:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.349+0000 7fcea2409640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c12f5d0 0x7fce9c11b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fcea2409640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c12f5d0 0x7fce9c11b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56924/0 (socket says 172.21.15.50:56924) 2023-10-11T04:22:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fcea2409640 1 -- 172.21.15.50:0/1777039204 learned_addr learned my addr 172.21.15.50:0/1777039204 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f7bd186d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc09a860 0x7f7bcc119270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fd5ea82d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e406cb00 0x7fd5e406fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fd5ea82d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e406f420 con 0x7fd5e406cb00 2023-10-11T04:22:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f40dc39e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d4119270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fd5e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e406cb00 0x7fd5e406fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fd5e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e406cb00 0x7fd5e406fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56944/0 (socket says 172.21.15.50:56944) 2023-10-11T04:22:52.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fd5e3fff640 1 -- 172.21.15.50:0/759133066 learned_addr learned my addr 172.21.15.50:0/759133066 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f40dc39e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d411b540 con 0x7f40d409a860 2023-10-11T04:22:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f7bd186d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc130c80 con 0x7f7bcc09a860 2023-10-11T04:22:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f7bcaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc09a860 0x7f7bcc119270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f7bcaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc09a860 0x7f7bcc119270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56928/0 (socket says 172.21.15.50:56928) 2023-10-11T04:22:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f7bcaffd640 1 -- 172.21.15.50:0/2957531085 learned_addr learned my addr 172.21.15.50:0/2957531085 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fcea2409640 1 -- 172.21.15.50:0/1777039204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c11e780 con 0x7fce9c12f5d0 2023-10-11T04:22:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f40da13a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d4119270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7f7bcaffd640 1 -- 172.21.15.50:0/2957531085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc11a560 con 0x7f7bcc09a860 2023-10-11T04:22:52.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.350+0000 7fd5e3fff640 1 -- 172.21.15.50:0/759133066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e406f9f0 con 0x7fd5e406cb00 2023-10-11T04:22:52.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f40da13a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d4119270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56948/0 (socket says 172.21.15.50:56948) 2023-10-11T04:22:52.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f40da13a640 1 -- 172.21.15.50:0/1546764488 learned_addr learned my addr 172.21.15.50:0/1546764488 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:52.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f7bcaffd640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc09a860 0x7f7bcc119270 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7fd5e3fff640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e406cb00 0x7fd5e406fe40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7fd5e0ff9640 1 -- 172.21.15.50:0/759133066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd5dc0070b0 con 0x7fd5e406cb00 2023-10-11T04:22:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7fd5e0ff9640 1 -- 172.21.15.50:0/759133066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd5dc007210 con 0x7fd5e406cb00 2023-10-11T04:22:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e4071080 con 0x7fd5e406cb00 2023-10-11T04:22:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7fcea2409640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c12f5d0 0x7fce9c11b200 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7fd5e0ff9640 1 -- 172.21.15.50:0/759133066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd5dc0074b0 con 0x7fd5e406cb00 2023-10-11T04:22:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f7bb3fff640 1 -- 172.21.15.50:0/2957531085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7bbc0059d0 con 0x7f7bcc09a860 2023-10-11T04:22:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f7bb3fff640 1 -- 172.21.15.50:0/2957531085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7bbc005b30 con 0x7f7bcc09a860 2023-10-11T04:22:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f7bb3fff640 1 -- 172.21.15.50:0/2957531085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7bbc005dd0 con 0x7f7bcc09a860 2023-10-11T04:22:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc1313e0 con 0x7f7bcc09a860 2023-10-11T04:22:52.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e411cd40 con 0x7fd5e406cb00 2023-10-11T04:22:52.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc11bfe0 con 0x7f7bcc09a860 2023-10-11T04:22:52.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.351+0000 7f40da13a640 1 -- 172.21.15.50:0/1546764488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4071b60 con 0x7f40d409a860 2023-10-11T04:22:52.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.352+0000 7f40da13a640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d4119270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.352+0000 7fce92ffd640 1 -- 172.21.15.50:0/1777039204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce9800b8b0 con 0x7fce9c12f5d0 2023-10-11T04:22:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.352+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e406f7f0 con 0x7fd5e406cb00 2023-10-11T04:22:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.352+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c11cda0 con 0x7fce9c12f5d0 2023-10-11T04:22:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.352+0000 7f40caffd640 1 -- 172.21.15.50:0/1546764488 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f40cc00e040 con 0x7f40d409a860 2023-10-11T04:22:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.352+0000 7fd5e0ff9640 1 -- 172.21.15.50:0/759133066 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fd5dc0076a0 con 0x7fd5e406cb00 2023-10-11T04:22:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7f40caffd640 1 -- 172.21.15.50:0/1546764488 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f40cc009410 con 0x7f40d409a860 2023-10-11T04:22:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d411b1a0 con 0x7f40d409a860 2023-10-11T04:22:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d411ab20 con 0x7f40d409a860 2023-10-11T04:22:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7fd5e0ff9640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fd5c4037840 0x7fd5c4039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7fd5e0ff9640 1 -- 172.21.15.50:0/759133066 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fd5dc0477e0 con 0x7fd5e406cb00 2023-10-11T04:22:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7fd5e37fe640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fd5c4037840 0x7fd5c4039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.354+0000 7f40caffd640 1 -- 172.21.15.50:0/1546764488 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f40cc0139c0 con 0x7f40d409a860 2023-10-11T04:22:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc061d90 con 0x7f7bcc09a860 2023-10-11T04:22:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7f7bb3fff640 1 -- 172.21.15.50:0/2957531085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f7bbc0070b0 con 0x7f7bcc09a860 2023-10-11T04:22:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7f7bb3fff640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7bb8037890 0x7f7bb8039da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7f7bb3fff640 1 -- 172.21.15.50:0/2957531085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f7bbc046c80 con 0x7f7bcc09a860 2023-10-11T04:22:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.353+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c11e3e0 con 0x7fce9c12f5d0 2023-10-11T04:22:52.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.352+0000 7fce92ffd640 1 -- 172.21.15.50:0/1777039204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fce9800ba10 con 0x7fce9c12f5d0 2023-10-11T04:22:52.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.354+0000 7fce92ffd640 1 -- 172.21.15.50:0/1777039204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce9800bcb0 con 0x7fce9c12f5d0 2023-10-11T04:22:52.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.354+0000 7f7bca7fc640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7bb8037890 0x7f7bb8039da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.354+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d411b390 con 0x7f40d409a860 2023-10-11T04:22:52.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.354+0000 7fd5e37fe640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fd5c4037840 0x7fd5c4039d50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.354+0000 7f7bca7fc640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7bb8037890 0x7f7bb8039da0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.354+0000 7fce92ffd640 1 -- 172.21.15.50:0/1777039204 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fce98011380 con 0x7fce9c12f5d0 2023-10-11T04:22:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.355+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c061d90 con 0x7fce9c12f5d0 2023-10-11T04:22:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.355+0000 7fce92ffd640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fce800377f0 0x7fce80039d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.355+0000 7fcea1c08640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fce800377f0 0x7fce80039d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.355+0000 7fcea1c08640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fce800377f0 0x7fce80039d00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.358+0000 7fd5e0ff9640 1 -- 172.21.15.50:0/759133066 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fd5dc00de80 con 0x7fd5e406cb00 2023-10-11T04:22:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.358+0000 7fce92ffd640 1 -- 172.21.15.50:0/1777039204 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fce9800db90 con 0x7fce9c12f5d0 2023-10-11T04:22:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.359+0000 7f40caffd640 1 -- 172.21.15.50:0/1546764488 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f40cc011040 con 0x7f40d409a860 2023-10-11T04:22:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.359+0000 7f40caffd640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f40b8037840 0x7f40b8039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.359+0000 7f40d9939640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f40b8037840 0x7f40b8039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.360+0000 7f40d9939640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f40b8037840 0x7f40b8039d50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.363+0000 7f40caffd640 1 -- 172.21.15.50:0/1546764488 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f40cc011d60 con 0x7f40d409a860 2023-10-11T04:22:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.363+0000 7f7bb3fff640 1 -- 172.21.15.50:0/2957531085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f7bbc00d510 con 0x7f7bcc09a860 2023-10-11T04:22:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.367+0000 7fce92ffd640 1 -- 172.21.15.50:0/1777039204 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fce9800be60 con 0x7fce9c12f5d0 2023-10-11T04:22:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.376+0000 7f40caffd640 1 -- 172.21.15.50:0/1546764488 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f40cc010b00 con 0x7f40d409a860 2023-10-11T04:22:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.537+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5e4061d90 con 0x7fd5e406cb00 2023-10-11T04:22:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.537+0000 7fd5e0ff9640 1 -- 172.21.15.50:0/759133066 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fd5dc00de80 con 0x7fd5e406cb00 2023-10-11T04:22:52.539 INFO:teuthology.orchestra.run.smithi050.stdout:38654705669 2023-10-11T04:22:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7bcc06b820 con 0x7f7bcc09a860 2023-10-11T04:22:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fd5c4037840 msgr2=0x7fd5c4039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fd5c4037840 0x7fd5c4039d50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e406cb00 msgr2=0x7fd5e406fe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e406cb00 0x7fd5e406fe40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 shutdown_connections 2023-10-11T04:22:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fd5c4037840 0x7fd5c4039d50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 --2- 172.21.15.50:0/759133066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5e406cb00 0x7fd5e406fe40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 >> 172.21.15.50:0/759133066 conn(0x7fd5e40a3060 msgr2=0x7fd5e41bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 shutdown_connections 2023-10-11T04:22:52.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7fd5ea82d640 1 -- 172.21.15.50:0/759133066 wait complete. 2023-10-11T04:22:52.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.540+0000 7f7bb3fff640 1 -- 172.21.15.50:0/2957531085 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f7bbc00d150 con 0x7f7bcc09a860 2023-10-11T04:22:52.544 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:52.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7bb8037890 msgr2=0x7f7bb8039da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7bb8037890 0x7f7bb8039da0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc09a860 msgr2=0x7f7bcc119270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc09a860 0x7f7bcc119270 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 shutdown_connections 2023-10-11T04:22:52.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7bb8037890 0x7f7bb8039da0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 --2- 172.21.15.50:0/2957531085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bcc09a860 0x7f7bcc119270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 >> 172.21.15.50:0/2957531085 conn(0x7f7bcc09fac0 msgr2=0x7f7bcc1353a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.542+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 shutdown_connections 2023-10-11T04:22:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.543+0000 7f7bd186d640 1 -- 172.21.15.50:0/2957531085 wait complete. 2023-10-11T04:22:52.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2023-10-11T04:22:52.555 DEBUG:teuthology.parallel:result is None 2023-10-11T04:22:52.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2023-10-11T04:22:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.555+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40d4061d90 con 0x7f40d409a860 2023-10-11T04:22:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.555+0000 7f40caffd640 1 -- 172.21.15.50:0/1546764488 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f40cc0106f0 con 0x7f40d409a860 2023-10-11T04:22:52.558 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f40b8037840 msgr2=0x7f40b8039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f40b8037840 0x7f40b8039d50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 msgr2=0x7f40d4119270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d4119270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fce9c04e1b0 con 0x7fce9c12f5d0 2023-10-11T04:22:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 shutdown_connections 2023-10-11T04:22:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f40b8037840 0x7f40b8039d50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 --2- 172.21.15.50:0/1546764488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40d409a860 0x7f40d4119270 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 >> 172.21.15.50:0/1546764488 conn(0x7f40d409fac0 msgr2=0x7f40d41351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 shutdown_connections 2023-10-11T04:22:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.557+0000 7f40dc39e640 1 -- 172.21.15.50:0/1546764488 wait complete. 2023-10-11T04:22:52.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.558+0000 7fce92ffd640 1 -- 172.21.15.50:0/1777039204 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fce9800e230 con 0x7fce9c12f5d0 2023-10-11T04:22:52.562 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:52.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fce800377f0 msgr2=0x7fce80039d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fce800377f0 0x7fce80039d00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c12f5d0 msgr2=0x7fce9c11b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c12f5d0 0x7fce9c11b200 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 shutdown_connections 2023-10-11T04:22:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fce800377f0 0x7fce80039d00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 --2- 172.21.15.50:0/1777039204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce9c12f5d0 0x7fce9c11b200 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 >> 172.21.15.50:0/1777039204 conn(0x7fce9c09f840 msgr2=0x7fce9c09b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:52.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 shutdown_connections 2023-10-11T04:22:52.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:52.560+0000 7fcea466d640 1 -- 172.21.15.50:0/1777039204 wait complete. 2023-10-11T04:22:52.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2023-10-11T04:22:52.570 DEBUG:teuthology.parallel:result is None 2023-10-11T04:22:52.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2023-10-11T04:22:52.572 DEBUG:teuthology.parallel:result is None 2023-10-11T04:22:53.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-11T04:22:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.677+0000 7fe428115640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:53.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.682+0000 7fe428115640 1 Processor -- start 2023-10-11T04:22:53.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.683+0000 7fe428115640 1 -- start start 2023-10-11T04:22:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.683+0000 7fe428115640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe42006cb00 0x7fe42012fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.683+0000 7fe428115640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42006c280 con 0x7fe420130320 2023-10-11T04:22:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.683+0000 7fe428115640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42006c6c0 con 0x7fe42006cb00 2023-10-11T04:22:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.683+0000 7fe425eb1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe42006cb00 0x7fe42012fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.683+0000 7fe4256b0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe420130320 0x7fe420132cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37612/0 (socket says 172.21.15.50:37612) 2023-10-11T04:22:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.683+0000 7fe4256b0640 1 -- 172.21.15.50:0/635330440 learned_addr learned my addr 172.21.15.50:0/635330440 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.684+0000 7fe425eb1640 1 -- 172.21.15.50:0/635330440 >> v1:172.21.15.50:6789/0 conn(0x7fe420130320 legacy=0x7fe420132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.684+0000 7fe425eb1640 1 -- 172.21.15.50:0/635330440 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42006d8b0 con 0x7fe42006cb00 2023-10-11T04:22:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.684+0000 7fe424eaf640 1 -- 172.21.15.50:0/635330440 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766243868 0 0) 0x7fe42006c280 con 0x7fe420130320 2023-10-11T04:22:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.684+0000 7fe425eb1640 1 --2- 172.21.15.50:0/635330440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012fde0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a47c554d2bb702 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.684+0000 7fe424eaf640 1 -- 172.21.15.50:0/635330440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe41c009ce0 con 0x7fe42006cb00 2023-10-11T04:22:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.684+0000 7fe424eaf640 1 -- 172.21.15.50:0/635330440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe41c009e40 con 0x7fe42006cb00 2023-10-11T04:22:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.684+0000 7fe424eaf640 1 -- 172.21.15.50:0/635330440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe41c00e360 con 0x7fe42006cb00 2023-10-11T04:22:53.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 1 -- 172.21.15.50:0/635330440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 msgr2=0x7fe42012fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:53.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 1 --2- 172.21.15.50:0/635330440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012fde0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 1 -- 172.21.15.50:0/635330440 shutdown_connections 2023-10-11T04:22:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 1 --2- 172.21.15.50:0/635330440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012fde0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 1 -- 172.21.15.50:0/635330440 >> 172.21.15.50:0/635330440 conn(0x7fe4200a3060 msgr2=0x7fe4200a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 1 -- 172.21.15.50:0/635330440 shutdown_connections 2023-10-11T04:22:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 1 -- 172.21.15.50:0/635330440 wait complete. 2023-10-11T04:22:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.685+0000 7fe428115640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.686+0000 7fe428115640 1 Processor -- start 2023-10-11T04:22:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.686+0000 7fe428115640 1 -- start start 2023-10-11T04:22:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe428115640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe428115640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42006f760 con 0x7fe42006cb00 2023-10-11T04:22:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe425eb1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe425eb1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56976/0 (socket says 172.21.15.50:56976) 2023-10-11T04:22:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe425eb1640 1 -- 172.21.15.50:0/2181981536 learned_addr learned my addr 172.21.15.50:0/2181981536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe425eb1640 1 -- 172.21.15.50:0/2181981536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420070f40 con 0x7fe42006cb00 2023-10-11T04:22:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe425eb1640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012c610 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe4167fc640 1 -- 172.21.15.50:0/2181981536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe41c014540 con 0x7fe42006cb00 2023-10-11T04:22:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe4167fc640 1 -- 172.21.15.50:0/2181981536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe41c0146a0 con 0x7fe42006cb00 2023-10-11T04:22:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.687+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42006f3c0 con 0x7fe42006cb00 2023-10-11T04:22:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.688+0000 7fe4167fc640 1 -- 172.21.15.50:0/2181981536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe41c014940 con 0x7fe42006cb00 2023-10-11T04:22:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.688+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42011c860 con 0x7fe42006cb00 2023-10-11T04:22:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.688+0000 7fe4167fc640 1 -- 172.21.15.50:0/2181981536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fe41c014af0 con 0x7fe42006cb00 2023-10-11T04:22:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.689+0000 7fe4167fc640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fe404037840 0x7fe404039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.689+0000 7fe4167fc640 1 -- 172.21.15.50:0/2181981536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fe41c019040 con 0x7fe42006cb00 2023-10-11T04:22:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.689+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe420061d90 con 0x7fe42006cb00 2023-10-11T04:22:53.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.689+0000 7fe4256b0640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fe404037840 0x7fe404039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:53.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.689+0000 7fe4256b0640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fe404037840 0x7fe404039d50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:53.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.693+0000 7fe4167fc640 1 -- 172.21.15.50:0/2181981536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fe41c014df0 con 0x7fe42006cb00 2023-10-11T04:22:53.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.869+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe42006f550 con 0x7fe42006cb00 2023-10-11T04:22:53.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.869+0000 7fe4167fc640 1 -- 172.21.15.50:0/2181981536 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fe41c00fa90 con 0x7fe42006cb00 2023-10-11T04:22:53.871 INFO:teuthology.orchestra.run.smithi050.stdout:38654705669 2023-10-11T04:22:53.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fe404037840 msgr2=0x7fe404039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:53.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fe404037840 0x7fe404039d50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:53.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 msgr2=0x7fe42012c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:53.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012c610 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:53.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 shutdown_connections 2023-10-11T04:22:53.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fe404037840 0x7fe404039d50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:53.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 --2- 172.21.15.50:0/2181981536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42006cb00 0x7fe42012c610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:53.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 >> 172.21.15.50:0/2181981536 conn(0x7fe4200a3060 msgr2=0x7fe42012df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:53.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 shutdown_connections 2023-10-11T04:22:53.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:53.871+0000 7fe428115640 1 -- 172.21.15.50:0/2181981536 wait complete. 2023-10-11T04:22:53.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2023-10-11T04:22:54.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-11T04:22:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.006+0000 7fc1e151e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.011+0000 7fc1e151e640 1 Processor -- start 2023-10-11T04:22:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.011+0000 7fc1e151e640 1 -- start start 2023-10-11T04:22:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1e151e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1dc12d010 0x7fc1dc134d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1e151e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1dc12c540 con 0x7fc1dc06d800 2023-10-11T04:22:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1e151e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1dc06e990 con 0x7fc1dc12d010 2023-10-11T04:22:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1da7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1dc12d010 0x7fc1dc134d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1daffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc1dc06d800 0x7fc1dc12c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37626/0 (socket says 172.21.15.50:37626) 2023-10-11T04:22:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1daffd640 1 -- 172.21.15.50:0/277944925 learned_addr learned my addr 172.21.15.50:0/277944925 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1da7fc640 1 -- 172.21.15.50:0/277944925 >> v1:172.21.15.50:6789/0 conn(0x7fc1dc06d800 legacy=0x7fc1dc12c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.012+0000 7fc1da7fc640 1 -- 172.21.15.50:0/277944925 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc12d420 con 0x7fc1dc12d010 2023-10-11T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1da7fc640 1 --2- 172.21.15.50:0/277944925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc12d010 0x7fc1dc134d80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d080a46699535f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1d9ffb640 1 -- 172.21.15.50:0/277944925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1d0009ce0 con 0x7fc1dc12d010 2023-10-11T04:22:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1d9ffb640 1 -- 172.21.15.50:0/277944925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc1d0009e40 con 0x7fc1dc12d010 2023-10-11T04:22:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1d9ffb640 1 -- 172.21.15.50:0/277944925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1d000e360 con 0x7fc1dc12d010 2023-10-11T04:22:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1e151e640 1 -- 172.21.15.50:0/277944925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc12d010 msgr2=0x7fc1dc134d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1e151e640 1 --2- 172.21.15.50:0/277944925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc12d010 0x7fc1dc134d80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1e151e640 1 -- 172.21.15.50:0/277944925 shutdown_connections 2023-10-11T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1e151e640 1 --2- 172.21.15.50:0/277944925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc12d010 0x7fc1dc134d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1e151e640 1 -- 172.21.15.50:0/277944925 >> 172.21.15.50:0/277944925 conn(0x7fc1dc09f840 msgr2=0x7fc1dc09fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1e151e640 1 -- 172.21.15.50:0/277944925 shutdown_connections 2023-10-11T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.013+0000 7fc1e151e640 1 -- 172.21.15.50:0/277944925 wait complete. 2023-10-11T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.014+0000 7fc1e151e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.015+0000 7fc1e151e640 1 Processor -- start 2023-10-11T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.015+0000 7fc1e151e640 1 -- start start 2023-10-11T04:22:55.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.015+0000 7fc1e151e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc06d800 0x7fc1dc11a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.015+0000 7fc1e151e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc129e00 con 0x7fc1dc06d800 2023-10-11T04:22:55.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.015+0000 7fc1daffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc06d800 0x7fc1dc11a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1daffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc06d800 0x7fc1dc11a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56984/0 (socket says 172.21.15.50:56984) 2023-10-11T04:22:55.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1daffd640 1 -- 172.21.15.50:0/61471375 learned_addr learned my addr 172.21.15.50:0/61471375 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:55.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1daffd640 1 -- 172.21.15.50:0/61471375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc11e610 con 0x7fc1dc06d800 2023-10-11T04:22:55.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1daffd640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc06d800 0x7fc1dc11a120 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1c37fe640 1 -- 172.21.15.50:0/61471375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1cc0059d0 con 0x7fc1dc06d800 2023-10-11T04:22:55.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1c37fe640 1 -- 172.21.15.50:0/61471375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc1cc005b30 con 0x7fc1dc06d800 2023-10-11T04:22:55.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1c37fe640 1 -- 172.21.15.50:0/61471375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1cc005dd0 con 0x7fc1dc06d800 2023-10-11T04:22:55.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc11e2e0 con 0x7fc1dc06d800 2023-10-11T04:22:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.016+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc11bd80 con 0x7fc1dc06d800 2023-10-11T04:22:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.017+0000 7fc1c37fe640 1 -- 172.21.15.50:0/61471375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fc1cc0070b0 con 0x7fc1dc06d800 2023-10-11T04:22:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.017+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1dc11d850 con 0x7fc1dc06d800 2023-10-11T04:22:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.017+0000 7fc1c37fe640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fc1c8037840 0x7fc1c8039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.017+0000 7fc1c37fe640 1 -- 172.21.15.50:0/61471375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fc1cc046c10 con 0x7fc1dc06d800 2023-10-11T04:22:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.018+0000 7fc1da7fc640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fc1c8037840 0x7fc1c8039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.018+0000 7fc1da7fc640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fc1c8037840 0x7fc1c8039d50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.022+0000 7fc1c37fe640 1 -- 172.21.15.50:0/61471375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fc1cc00d330 con 0x7fc1dc06d800 2023-10-11T04:22:55.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.197+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc1dc129b90 con 0x7fc1dc06d800 2023-10-11T04:22:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.197+0000 7fc1c37fe640 1 -- 172.21.15.50:0/61471375 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fc1cc00d150 con 0x7fc1dc06d800 2023-10-11T04:22:55.199 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-10-11T04:22:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fc1c8037840 msgr2=0x7fc1c8039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fc1c8037840 0x7fc1c8039d50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc06d800 msgr2=0x7fc1dc11a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc06d800 0x7fc1dc11a120 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 shutdown_connections 2023-10-11T04:22:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fc1c8037840 0x7fc1c8039d50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 --2- 172.21.15.50:0/61471375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1dc06d800 0x7fc1dc11a120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 >> 172.21.15.50:0/61471375 conn(0x7fc1dc09f840 msgr2=0x7fc1dc099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:55.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 shutdown_connections 2023-10-11T04:22:55.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.200+0000 7fc1e151e640 1 -- 172.21.15.50:0/61471375 wait complete. 2023-10-11T04:22:55.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2023-10-11T04:22:55.211 DEBUG:teuthology.parallel:result is None 2023-10-11T04:22:55.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-11T04:22:55.212 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-11T04:22:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.318+0000 7f4a25b9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.322+0000 7f4a25b9e640 1 Processor -- start 2023-10-11T04:22:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.322+0000 7f4a25b9e640 1 -- start start 2023-10-11T04:22:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.323+0000 7f4a25b9e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a2006cb00 0x7f4a2012fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.323+0000 7f4a25b9e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2006c280 con 0x7f4a20130320 2023-10-11T04:22:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.323+0000 7f4a25b9e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2006c6c0 con 0x7f4a2006cb00 2023-10-11T04:22:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.323+0000 7f4a1f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a2006cb00 0x7f4a2012fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.323+0000 7f4a1effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a20130320 0x7f4a20132cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37640/0 (socket says 172.21.15.50:37640) 2023-10-11T04:22:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.323+0000 7f4a1effd640 1 -- 172.21.15.50:0/2963935161 learned_addr learned my addr 172.21.15.50:0/2963935161 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a1f7fe640 1 -- 172.21.15.50:0/2963935161 >> v1:172.21.15.50:6789/0 conn(0x7f4a20130320 legacy=0x7f4a20132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a1f7fe640 1 -- 172.21.15.50:0/2963935161 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2006d8b0 con 0x7f4a2006cb00 2023-10-11T04:22:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a1f7fe640 1 --2- 172.21.15.50:0/2963935161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2012fde0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c6e90b34c3bc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a1e7fc640 1 -- 172.21.15.50:0/2963935161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a10009ce0 con 0x7f4a2006cb00 2023-10-11T04:22:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a1e7fc640 1 -- 172.21.15.50:0/2963935161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4a10009e40 con 0x7f4a2006cb00 2023-10-11T04:22:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a1e7fc640 1 -- 172.21.15.50:0/2963935161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a1000e360 con 0x7f4a2006cb00 2023-10-11T04:22:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2963935161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 msgr2=0x7f4a2012fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.324+0000 7f4a25b9e640 1 --2- 172.21.15.50:0/2963935161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2012fde0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.325+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2963935161 shutdown_connections 2023-10-11T04:22:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.325+0000 7f4a25b9e640 1 --2- 172.21.15.50:0/2963935161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2012fde0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.325+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2963935161 >> 172.21.15.50:0/2963935161 conn(0x7f4a200a3060 msgr2=0x7f4a200a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.325+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2963935161 shutdown_connections 2023-10-11T04:22:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.325+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2963935161 wait complete. 2023-10-11T04:22:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.325+0000 7f4a25b9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.326+0000 7f4a25b9e640 1 Processor -- start 2023-10-11T04:22:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.326+0000 7f4a25b9e640 1 -- start start 2023-10-11T04:22:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a25b9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2011c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a25b9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2011f5d0 con 0x7f4a2006cb00 2023-10-11T04:22:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2011c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2011c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57008/0 (socket says 172.21.15.50:57008) 2023-10-11T04:22:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a1f7fe640 1 -- 172.21.15.50:0/2058390678 learned_addr learned my addr 172.21.15.50:0/2058390678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a1f7fe640 1 -- 172.21.15.50:0/2058390678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2011f850 con 0x7f4a2006cb00 2023-10-11T04:22:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a1f7fe640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2011c460 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a07fff640 1 -- 172.21.15.50:0/2058390678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a10014620 con 0x7f4a2006cb00 2023-10-11T04:22:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a07fff640 1 -- 172.21.15.50:0/2058390678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4a10014780 con 0x7f4a2006cb00 2023-10-11T04:22:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a20120420 con 0x7f4a2006cb00 2023-10-11T04:22:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a07fff640 1 -- 172.21.15.50:0/2058390678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a10014a20 con 0x7f4a2006cb00 2023-10-11T04:22:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.327+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2011ee50 con 0x7f4a2006cb00 2023-10-11T04:22:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.328+0000 7f4a07fff640 1 -- 172.21.15.50:0/2058390678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f4a10014bd0 con 0x7f4a2006cb00 2023-10-11T04:22:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.329+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a20061d90 con 0x7f4a2006cb00 2023-10-11T04:22:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.329+0000 7f4a07fff640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4a0c037840 0x7f4a0c039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.329+0000 7f4a07fff640 1 -- 172.21.15.50:0/2058390678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f4a10019040 con 0x7f4a2006cb00 2023-10-11T04:22:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.329+0000 7f4a1effd640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4a0c037840 0x7f4a0c039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.329+0000 7f4a1effd640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4a0c037840 0x7f4a0c039d50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.333+0000 7f4a07fff640 1 -- 172.21.15.50:0/2058390678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f4a10018d90 con 0x7f4a2006cb00 2023-10-11T04:22:55.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.510+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 --> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a2012f750 con 0x7f4a0c037840 2023-10-11T04:22:55.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.512+0000 7f4a07fff640 1 -- 172.21.15.50:0/2058390678 <== mgr.4101 v2:172.21.15.151:6800/3619362033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30047 (crc 0 0 0) 0x7f4a14001250 con 0x7f4a0c037840 2023-10-11T04:22:55.514 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:55.514 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-11T04:22:55.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4a0c037840 msgr2=0x7f4a0c039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4a0c037840 0x7f4a0c039d50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 msgr2=0x7f4a2011c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2011c460 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 shutdown_connections 2023-10-11T04:22:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f4a0c037840 0x7f4a0c039d50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 --2- 172.21.15.50:0/2058390678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a2006cb00 0x7f4a2011c460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 >> 172.21.15.50:0/2058390678 conn(0x7f4a200a3060 msgr2=0x7f4a200a1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:55.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 shutdown_connections 2023-10-11T04:22:55.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.514+0000 7f4a25b9e640 1 -- 172.21.15.50:0/2058390678 wait complete. 2023-10-11T04:22:55.525 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-11T04:22:55.328027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109524,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320876,"statfs":{"total":429496729600,"available":429384577024,"internally_reserved":0,"allocated":1433600,"data_stored":1268060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.220557"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.004481+0000","last_change":"2023-10-11T04:22:51.006133+0000","last_active":"2023-10-11T04:22:51.004481+0000","last_peered":"2023-10-11T04:22:51.004481+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:51.001583+0000","last_became_peered":"2023-10-11T04:22:51.001583+0000","last_unstale":"2023-10-11T04:22:51.004481+0000","last_undegraded":"2023-10-11T04:22:51.004481+0000","last_fullsized":"2023-10-11T04:22:51.004481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.956433+0000","last_change":"2023-10-11T04:22:51.014923+0000","last_active":"2023-10-11T04:22:51.956433+0000","last_peered":"2023-10-11T04:22:51.956433+0000","last_clean":"2023-10-11T04:22:51.956433+0000","last_became_active":"2023-10-11T04:22:51.011840+0000","last_became_peered":"2023-10-11T04:22:51.011840+0000","last_unstale":"2023-10-11T04:22:51.956433+0000","last_undegraded":"2023-10-11T04:22:51.956433+0000","last_fullsized":"2023-10-11T04:22:51.956433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.990940+0000","last_change":"2023-10-11T04:22:50.994712+0000","last_active":"2023-10-11T04:22:50.990940+0000","last_peered":"2023-10-11T04:22:50.990940+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.988342+0000","last_became_peered":"2023-10-11T04:22:50.988342+0000","last_unstale":"2023-10-11T04:22:50.990940+0000","last_undegraded":"2023-10-11T04:22:50.990940+0000","last_fullsized":"2023-10-11T04:22:50.990940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.956217+0000","last_change":"2023-10-11T04:22:51.012443+0000","last_active":"2023-10-11T04:22:51.956217+0000","last_peered":"2023-10-11T04:22:51.956217+0000","last_clean":"2023-10-11T04:22:51.956217+0000","last_became_active":"2023-10-11T04:22:51.006610+0000","last_became_peered":"2023-10-11T04:22:51.006610+0000","last_unstale":"2023-10-11T04:22:51.956217+0000","last_undegraded":"2023-10-11T04:22:51.956217+0000","last_fullsized":"2023-10-11T04:22:51.956217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.998031+0000","last_change":"2023-10-11T04:22:50.998655+0000","last_active":"2023-10-11T04:22:50.998031+0000","last_peered":"2023-10-11T04:22:50.998031+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.994569+0000","last_became_peered":"2023-10-11T04:22:50.994569+0000","last_unstale":"2023-10-11T04:22:50.998031+0000","last_undegraded":"2023-10-11T04:22:50.998031+0000","last_fullsized":"2023-10-11T04:22:50.998031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.997275+0000","last_change":"2023-10-11T04:22:50.997801+0000","last_active":"2023-10-11T04:22:50.997275+0000","last_peered":"2023-10-11T04:22:50.997275+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.988294+0000","last_became_peered":"2023-10-11T04:22:50.988294+0000","last_unstale":"2023-10-11T04:22:50.997275+0000","last_undegraded":"2023-10-11T04:22:50.997275+0000","last_fullsized":"2023-10-11T04:22:50.997275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.999269+0000","last_change":"2023-10-11T04:22:50.999822+0000","last_active":"2023-10-11T04:22:50.999269+0000","last_peered":"2023-10-11T04:22:50.999269+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.996441+0000","last_became_peered":"2023-10-11T04:22:50.996441+0000","last_unstale":"2023-10-11T04:22:50.999269+0000","last_undegraded":"2023-10-11T04:22:50.999269+0000","last_fullsized":"2023-10-11T04:22:50.999269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.006937+0000","last_change":"2023-10-11T04:22:51.007333+0000","last_active":"2023-10-11T04:22:51.006937+0000","last_peered":"2023-10-11T04:22:51.006937+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:51.003428+0000","last_became_peered":"2023-10-11T04:22:51.003428+0000","last_unstale":"2023-10-11T04:22:51.006937+0000","last_undegraded":"2023-10-11T04:22:51.006937+0000","last_fullsized":"2023-10-11T04:22:51.006937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.952738+0000","last_change":"2023-10-11T04:22:47.379641+0000","last_active":"2023-10-11T04:22:50.952738+0000","last_peered":"2023-10-11T04:22:50.952738+0000","last_clean":"2023-10-11T04:22:50.952738+0000","last_became_active":"2023-10-11T04:22:47.375402+0000","last_became_peered":"2023-10-11T04:22:47.375402+0000","last_unstale":"2023-10-11T04:22:50.952738+0000","last_undegraded":"2023-10-11T04:22:50.952738+0000","last_fullsized":"2023-10-11T04:22:50.952738+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:46.330823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:46.330823+0000","last_clean_scrub_stamp":"2023-10-11T04:22:46.330823+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27720,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829880,"statfs":{"total":107374182400,"available":107345797120,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-10-11T04:22:55.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-11T04:22:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.633+0000 7f71ac02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.636+0000 7f71ac02d640 1 Processor -- start 2023-10-11T04:22:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.637+0000 7f71ac02d640 1 -- start start 2023-10-11T04:22:55.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.637+0000 7f71ac02d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71a412f5d0 0x7f71a412f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.637+0000 7f71ac02d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a406e400 con 0x7f71a406bee0 2023-10-11T04:22:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.637+0000 7f71ac02d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a409a630 con 0x7f71a412f5d0 2023-10-11T04:22:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a9dc9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f71a412f5d0 0x7f71a412f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a95c8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f71a406bee0 0x7f71a406c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37652/0 (socket says 172.21.15.50:37652) 2023-10-11T04:22:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a95c8640 1 -- 172.21.15.50:0/2533375555 learned_addr learned my addr 172.21.15.50:0/2533375555 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a9dc9640 1 -- 172.21.15.50:0/2533375555 >> v1:172.21.15.50:6789/0 conn(0x7f71a406bee0 legacy=0x7f71a406c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a9dc9640 1 -- 172.21.15.50:0/2533375555 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a406dcb0 con 0x7f71a412f5d0 2023-10-11T04:22:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a9dc9640 1 --2- 172.21.15.50:0/2533375555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a412f5d0 0x7f71a412f9e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afadf5b5cd07ea01 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a8dc7640 1 -- 172.21.15.50:0/2533375555 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f719c009ce0 con 0x7f71a412f5d0 2023-10-11T04:22:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a8dc7640 1 -- 172.21.15.50:0/2533375555 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f719c009e40 con 0x7f71a412f5d0 2023-10-11T04:22:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.638+0000 7f71a8dc7640 1 -- 172.21.15.50:0/2533375555 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f719c00e360 con 0x7f71a412f5d0 2023-10-11T04:22:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 1 -- 172.21.15.50:0/2533375555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a412f5d0 msgr2=0x7f71a412f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 1 --2- 172.21.15.50:0/2533375555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a412f5d0 0x7f71a412f9e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 1 -- 172.21.15.50:0/2533375555 shutdown_connections 2023-10-11T04:22:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 1 --2- 172.21.15.50:0/2533375555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a412f5d0 0x7f71a412f9e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 1 -- 172.21.15.50:0/2533375555 >> 172.21.15.50:0/2533375555 conn(0x7f71a409f840 msgr2=0x7f71a409fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 1 -- 172.21.15.50:0/2533375555 shutdown_connections 2023-10-11T04:22:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 1 -- 172.21.15.50:0/2533375555 wait complete. 2023-10-11T04:22:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.639+0000 7f71ac02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.640+0000 7f71ac02d640 1 Processor -- start 2023-10-11T04:22:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.640+0000 7f71ac02d640 1 -- start start 2023-10-11T04:22:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71ac02d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a406bee0 0x7f71a4119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71ac02d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a41371a0 con 0x7f71a406bee0 2023-10-11T04:22:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a9dc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a406bee0 0x7f71a4119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a9dc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a406bee0 0x7f71a4119b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57022/0 (socket says 172.21.15.50:57022) 2023-10-11T04:22:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a9dc9640 1 -- 172.21.15.50:0/2550263244 learned_addr learned my addr 172.21.15.50:0/2550263244 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a9dc9640 1 -- 172.21.15.50:0/2550263244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a41366d0 con 0x7f71a406bee0 2023-10-11T04:22:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a9dc9640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a406bee0 0x7f71a4119b30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a27fc640 1 -- 172.21.15.50:0/2550263244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f719c014620 con 0x7f71a406bee0 2023-10-11T04:22:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a27fc640 1 -- 172.21.15.50:0/2550263244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f719c014780 con 0x7f71a406bee0 2023-10-11T04:22:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a411cbd0 con 0x7f71a406bee0 2023-10-11T04:22:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71a27fc640 1 -- 172.21.15.50:0/2550263244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f719c014a20 con 0x7f71a406bee0 2023-10-11T04:22:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.641+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a411b490 con 0x7f71a406bee0 2023-10-11T04:22:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.642+0000 7f71a27fc640 1 -- 172.21.15.50:0/2550263244 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f719c014bd0 con 0x7f71a406bee0 2023-10-11T04:22:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.642+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a406e020 con 0x7f71a406bee0 2023-10-11T04:22:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.642+0000 7f71a27fc640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7190037840 0x7f7190039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.642+0000 7f71a27fc640 1 -- 172.21.15.50:0/2550263244 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f719c019040 con 0x7f71a406bee0 2023-10-11T04:22:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.643+0000 7f71a95c8640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7190037840 0x7f7190039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.643+0000 7f71a95c8640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7190037840 0x7f7190039d50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.647+0000 7f71a27fc640 1 -- 172.21.15.50:0/2550263244 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f719c018d90 con 0x7f71a406bee0 2023-10-11T04:22:55.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.822+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 --> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71a40a05c0 con 0x7f7190037840 2023-10-11T04:22:55.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.823+0000 7f71a27fc640 1 -- 172.21.15.50:0/2550263244 <== mgr.4101 v2:172.21.15.151:6800/3619362033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30047 (crc 0 0 0) 0x7f7198001250 con 0x7f7190037840 2023-10-11T04:22:55.825 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:55.825 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-11T04:22:55.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7190037840 msgr2=0x7f7190039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7190037840 0x7f7190039d50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a406bee0 msgr2=0x7f71a4119b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a406bee0 0x7f71a4119b30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 shutdown_connections 2023-10-11T04:22:55.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f7190037840 0x7f7190039d50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 --2- 172.21.15.50:0/2550263244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71a406bee0 0x7f71a4119b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 >> 172.21.15.50:0/2550263244 conn(0x7f71a409f840 msgr2=0x7f71a41357d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:55.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 shutdown_connections 2023-10-11T04:22:55.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.825+0000 7f71ac02d640 1 -- 172.21.15.50:0/2550263244 wait complete. 2023-10-11T04:22:55.838 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-11T04:22:55.328027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109524,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320876,"statfs":{"total":429496729600,"available":429384577024,"internally_reserved":0,"allocated":1433600,"data_stored":1268060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.220557"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.004481+0000","last_change":"2023-10-11T04:22:51.006133+0000","last_active":"2023-10-11T04:22:51.004481+0000","last_peered":"2023-10-11T04:22:51.004481+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:51.001583+0000","last_became_peered":"2023-10-11T04:22:51.001583+0000","last_unstale":"2023-10-11T04:22:51.004481+0000","last_undegraded":"2023-10-11T04:22:51.004481+0000","last_fullsized":"2023-10-11T04:22:51.004481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.956433+0000","last_change":"2023-10-11T04:22:51.014923+0000","last_active":"2023-10-11T04:22:51.956433+0000","last_peered":"2023-10-11T04:22:51.956433+0000","last_clean":"2023-10-11T04:22:51.956433+0000","last_became_active":"2023-10-11T04:22:51.011840+0000","last_became_peered":"2023-10-11T04:22:51.011840+0000","last_unstale":"2023-10-11T04:22:51.956433+0000","last_undegraded":"2023-10-11T04:22:51.956433+0000","last_fullsized":"2023-10-11T04:22:51.956433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.990940+0000","last_change":"2023-10-11T04:22:50.994712+0000","last_active":"2023-10-11T04:22:50.990940+0000","last_peered":"2023-10-11T04:22:50.990940+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.988342+0000","last_became_peered":"2023-10-11T04:22:50.988342+0000","last_unstale":"2023-10-11T04:22:50.990940+0000","last_undegraded":"2023-10-11T04:22:50.990940+0000","last_fullsized":"2023-10-11T04:22:50.990940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.956217+0000","last_change":"2023-10-11T04:22:51.012443+0000","last_active":"2023-10-11T04:22:51.956217+0000","last_peered":"2023-10-11T04:22:51.956217+0000","last_clean":"2023-10-11T04:22:51.956217+0000","last_became_active":"2023-10-11T04:22:51.006610+0000","last_became_peered":"2023-10-11T04:22:51.006610+0000","last_unstale":"2023-10-11T04:22:51.956217+0000","last_undegraded":"2023-10-11T04:22:51.956217+0000","last_fullsized":"2023-10-11T04:22:51.956217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.998031+0000","last_change":"2023-10-11T04:22:50.998655+0000","last_active":"2023-10-11T04:22:50.998031+0000","last_peered":"2023-10-11T04:22:50.998031+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.994569+0000","last_became_peered":"2023-10-11T04:22:50.994569+0000","last_unstale":"2023-10-11T04:22:50.998031+0000","last_undegraded":"2023-10-11T04:22:50.998031+0000","last_fullsized":"2023-10-11T04:22:50.998031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.997275+0000","last_change":"2023-10-11T04:22:50.997801+0000","last_active":"2023-10-11T04:22:50.997275+0000","last_peered":"2023-10-11T04:22:50.997275+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.988294+0000","last_became_peered":"2023-10-11T04:22:50.988294+0000","last_unstale":"2023-10-11T04:22:50.997275+0000","last_undegraded":"2023-10-11T04:22:50.997275+0000","last_fullsized":"2023-10-11T04:22:50.997275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.999269+0000","last_change":"2023-10-11T04:22:50.999822+0000","last_active":"2023-10-11T04:22:50.999269+0000","last_peered":"2023-10-11T04:22:50.999269+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:50.996441+0000","last_became_peered":"2023-10-11T04:22:50.996441+0000","last_unstale":"2023-10-11T04:22:50.999269+0000","last_undegraded":"2023-10-11T04:22:50.999269+0000","last_fullsized":"2023-10-11T04:22:50.999269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:51.006937+0000","last_change":"2023-10-11T04:22:51.007333+0000","last_active":"2023-10-11T04:22:51.006937+0000","last_peered":"2023-10-11T04:22:51.006937+0000","last_clean":"2023-10-11T04:22:49.942101+0000","last_became_active":"2023-10-11T04:22:51.003428+0000","last_became_peered":"2023-10-11T04:22:51.003428+0000","last_unstale":"2023-10-11T04:22:51.006937+0000","last_undegraded":"2023-10-11T04:22:51.006937+0000","last_fullsized":"2023-10-11T04:22:51.006937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:49.942101+0000","last_clean_scrub_stamp":"2023-10-11T04:22:49.942101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-11T04:22:50.952738+0000","last_change":"2023-10-11T04:22:47.379641+0000","last_active":"2023-10-11T04:22:50.952738+0000","last_peered":"2023-10-11T04:22:50.952738+0000","last_clean":"2023-10-11T04:22:50.952738+0000","last_became_active":"2023-10-11T04:22:47.375402+0000","last_became_peered":"2023-10-11T04:22:47.375402+0000","last_unstale":"2023-10-11T04:22:50.952738+0000","last_undegraded":"2023-10-11T04:22:50.952738+0000","last_fullsized":"2023-10-11T04:22:50.952738+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T04:22:46.330823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T04:22:46.330823+0000","last_clean_scrub_stamp":"2023-10-11T04:22:46.330823+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27720,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829880,"statfs":{"total":107374182400,"available":107345797120,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-10-11T04:22:55.839 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-11T04:22:55.839 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-11T04:22:55.840 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-11T04:22:55.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-11T04:22:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.946+0000 7f2b0815e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.949+0000 7f2b0815e640 1 Processor -- start 2023-10-11T04:22:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.949+0000 7f2b0815e640 1 -- start start 2023-10-11T04:22:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.950+0000 7f2b0815e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b00136040 0x7f2b00138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.950+0000 7f2b0815e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0006c280 con 0x7f2b0006cb00 2023-10-11T04:22:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.950+0000 7f2b0815e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0006c6c0 con 0x7f2b00136040 2023-10-11T04:22:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.950+0000 7f2b05efa640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2b0006cb00 0x7f2b0012fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37666/0 (socket says 172.21.15.50:37666) 2023-10-11T04:22:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.950+0000 7f2b05efa640 1 -- 172.21.15.50:0/1509415285 learned_addr learned my addr 172.21.15.50:0/1509415285 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-11T04:22:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.950+0000 7f2b056f9640 1 --2- 172.21.15.50:0/1509415285 >> v2:172.21.15.50:3300/0 conn(0x7f2b00136040 0x7f2b00138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b04ef8640 1 -- 172.21.15.50:0/1509415285 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168780895 0 0) 0x7f2b0006c280 con 0x7f2b0006cb00 2023-10-11T04:22:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b04ef8640 1 -- 172.21.15.50:0/1509415285 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec0034f0 con 0x7f2b0006cb00 2023-10-11T04:22:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b056f9640 1 -- 172.21.15.50:0/1509415285 >> v1:172.21.15.50:6789/0 conn(0x7f2b0006cb00 legacy=0x7f2b0012fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b056f9640 1 -- 172.21.15.50:0/1509415285 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0006d8b0 con 0x7f2b00136040 2023-10-11T04:22:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b056f9640 1 --2- 172.21.15.50:0/1509415285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b00136040 0x7f2b00138460 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7318509eb9ed08 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b04ef8640 1 -- 172.21.15.50:0/1509415285 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2af0009ce0 con 0x7f2b00136040 2023-10-11T04:22:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b04ef8640 1 -- 172.21.15.50:0/1509415285 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2af0009e40 con 0x7f2b00136040 2023-10-11T04:22:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.951+0000 7f2b04ef8640 1 -- 172.21.15.50:0/1509415285 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2af000e360 con 0x7f2b00136040 2023-10-11T04:22:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 1 -- 172.21.15.50:0/1509415285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b00136040 msgr2=0x7f2b00138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 1 --2- 172.21.15.50:0/1509415285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b00136040 0x7f2b00138460 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 1 -- 172.21.15.50:0/1509415285 shutdown_connections 2023-10-11T04:22:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 1 --2- 172.21.15.50:0/1509415285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b00136040 0x7f2b00138460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 1 -- 172.21.15.50:0/1509415285 >> 172.21.15.50:0/1509415285 conn(0x7f2b000a3060 msgr2=0x7f2b000a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 1 -- 172.21.15.50:0/1509415285 shutdown_connections 2023-10-11T04:22:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 1 -- 172.21.15.50:0/1509415285 wait complete. 2023-10-11T04:22:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.952+0000 7f2b0815e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:22:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.953+0000 7f2b0815e640 1 Processor -- start 2023-10-11T04:22:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.953+0000 7f2b0815e640 1 -- start start 2023-10-11T04:22:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.954+0000 7f2b0815e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0006cb00 0x7f2b0006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.954+0000 7f2b0815e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0006f900 con 0x7f2b0006cb00 2023-10-11T04:22:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.954+0000 7f2b05efa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0006cb00 0x7f2b0006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.954+0000 7f2b05efa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0006cb00 0x7f2b0006fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57036/0 (socket says 172.21.15.50:57036) 2023-10-11T04:22:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.954+0000 7f2b05efa640 1 -- 172.21.15.50:0/365197633 learned_addr learned my addr 172.21.15.50:0/365197633 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:22:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.954+0000 7f2b05efa640 1 -- 172.21.15.50:0/365197633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0011b540 con 0x7f2b0006cb00 2023-10-11T04:22:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.954+0000 7f2b05efa640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0006cb00 0x7f2b0006fda0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.956+0000 7f2af67fc640 1 -- 172.21.15.50:0/365197633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2afc0059d0 con 0x7f2b0006cb00 2023-10-11T04:22:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.956+0000 7f2af67fc640 1 -- 172.21.15.50:0/365197633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2afc005b30 con 0x7f2b0006cb00 2023-10-11T04:22:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.956+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0011cc90 con 0x7f2b0006cb00 2023-10-11T04:22:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.956+0000 7f2af67fc640 1 -- 172.21.15.50:0/365197633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2afc005dd0 con 0x7f2b0006cb00 2023-10-11T04:22:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.956+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0011c9b0 con 0x7f2b0006cb00 2023-10-11T04:22:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.957+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b000719f0 con 0x7f2b0006cb00 2023-10-11T04:22:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.959+0000 7f2af67fc640 1 -- 172.21.15.50:0/365197633 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f2afc0070b0 con 0x7f2b0006cb00 2023-10-11T04:22:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.959+0000 7f2af67fc640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2ae4037840 0x7f2ae4039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:22:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.959+0000 7f2af67fc640 1 -- 172.21.15.50:0/365197633 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f2afc046f50 con 0x7f2b0006cb00 2023-10-11T04:22:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.959+0000 7f2b056f9640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2ae4037840 0x7f2ae4039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:22:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.960+0000 7f2b056f9640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2ae4037840 0x7f2ae4039d50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:22:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:55.963+0000 7f2af67fc640 1 -- 172.21.15.50:0/365197633 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f2afc00a6c0 con 0x7f2b0006cb00 2023-10-11T04:22:56.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.176+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2b00061d90 con 0x7f2b0006cb00 2023-10-11T04:22:56.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.176+0000 7f2af67fc640 1 -- 172.21.15.50:0/365197633 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (crc 0 0 0) 0x7f2afc00a120 con 0x7f2b0006cb00 2023-10-11T04:22:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-11T04:22:56.178 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-11T04:22:56.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2ae4037840 msgr2=0x7f2ae4039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:56.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2ae4037840 0x7f2ae4039d50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:56.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0006cb00 msgr2=0x7f2b0006fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:22:56.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0006cb00 0x7f2b0006fda0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:56.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 shutdown_connections 2023-10-11T04:22:56.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7f2ae4037840 0x7f2ae4039d50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:56.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 --2- 172.21.15.50:0/365197633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0006cb00 0x7f2b0006fda0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:22:56.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 >> 172.21.15.50:0/365197633 conn(0x7f2b000a3060 msgr2=0x7f2b001bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:22:56.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 shutdown_connections 2023-10-11T04:22:56.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T04:22:56.178+0000 7f2b0815e640 1 -- 172.21.15.50:0/365197633 wait complete. 2023-10-11T04:22:56.189 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-11T04:22:56.190 INFO:teuthology.run_tasks:Running task workunit... 2023-10-11T04:22:56.202 INFO:tasks.workunit:Pulling workunits from ref 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 2023-10-11T04:22:56.203 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-11T04:22:56.203 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-11T04:22:56.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T04:22:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-11T04:22:56.219 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-11T04:22:56.273 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-11T04:22:56.274 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-11T04:22:56.329 INFO:tasks.workunit:timeout=3h 2023-10-11T04:22:56.329 INFO:tasks.workunit:cleanup=True 2023-10-11T04:22:56.330 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 2023-10-11T04:22:56.385 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-11T04:23:59.344 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 97% (11819/12065) Updating files: 98% (11824/12065) Updating files: 99% (11945/12065) Updating files: 100% (12065/12065) Updating files: 100% (12065/12065), done. 2023-10-11T04:23:59.721 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5'. 2023-10-11T04:23:59.721 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-11T04:23:59.721 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-11T04:23:59.721 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-11T04:23:59.722 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2023-10-11T04:23:59.722 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-11T04:23:59.722 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-11T04:23:59.722 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-11T04:23:59.722 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-11T04:23:59.723 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2023-10-11T04:23:59.723 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-11T04:23:59.723 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2023-10-11T04:23:59.723 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-11T04:23:59.723 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2023-10-11T04:23:59.724 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-11T04:23:59.724 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-11T04:23:59.724 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-11T04:23:59.724 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 9587ffdfc8c crimson/common/operation: drop cross-core supports in ExitBarrier 2023-10-11T04:23:59.725 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-11T04:23:59.793 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-11T04:23:59.796 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-11T04:23:59.796 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-11T04:24:00.605 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-11T04:24:00.677 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-11T04:24:00.720 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-11T04:24:00.722 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-11T04:24:00.722 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-11T04:24:00.762 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-11T04:24:00.766 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-11T04:24:00.766 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-11T04:24:00.821 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2023-10-11T04:24:00.823 INFO:tasks.workunit:Running workunit rados/test.sh... 2023-10-11T04:24:00.823 DEBUG:teuthology.orchestra.run.smithi050:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2023-10-11T04:24:00.882 INFO:tasks.workunit.client.0.smithi050.stderr:+ parallel=1 2023-10-11T04:24:00.882 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '' = --serial ']' 2023-10-11T04:24:00.883 INFO:tasks.workunit.client.0.smithi050.stderr:+ color= 2023-10-11T04:24:00.883 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -t 1 ']' 2023-10-11T04:24:00.883 INFO:tasks.workunit.client.0.smithi050.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2023-10-11T04:24:00.883 INFO:tasks.workunit.client.0.smithi050.stderr:+ declare -A pids 2023-10-11T04:24:00.883 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:00.884 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:00.884 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_aio 2023-10-11T04:24:00.884 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_aio' 2023-10-11T04:24:00.885 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_aio 2023-10-11T04:24:00.885 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:00.885 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_aio 2023-10-11T04:24:00.886 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83693 2023-10-11T04:24:00.886 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_aio on pid 83693' 2023-10-11T04:24:00.886 INFO:tasks.workunit.client.0.smithi050.stdout:test api_aio on pid 83693 2023-10-11T04:24:00.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83693 2023-10-11T04:24:00.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:00.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:00.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2023-10-11T04:24:00.890 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_aio_pp 2023-10-11T04:24:00.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_aio_pp' 2023-10-11T04:24:00.890 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_aio_pp 2023-10-11T04:24:00.890 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:00.891 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:00.891 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:00.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:00.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:00.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:00.892 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:00.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:00.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:00.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:00.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:00.893 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:00.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:00.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:00.894 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.894 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.895 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:00.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:00.896 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.896 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_aio_pp 2023-10-11T04:24:00.897 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83700 2023-10-11T04:24:00.897 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_aio_pp on pid 83700' 2023-10-11T04:24:00.897 INFO:tasks.workunit.client.0.smithi050.stdout:test api_aio_pp on pid 83700 2023-10-11T04:24:00.900 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83700 2023-10-11T04:24:00.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:00.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:00.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2023-10-11T04:24:00.901 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_io 2023-10-11T04:24:00.901 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_io' 2023-10-11T04:24:00.902 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_io 2023-10-11T04:24:00.902 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:00.902 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:00.902 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:00.902 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:00.903 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:00.903 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.903 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:00.903 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:00.903 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:00.904 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:00.904 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:00.904 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.904 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:00.904 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.907 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.907 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:00.907 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:00.907 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:00.907 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:00.908 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.908 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:00.908 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:00.908 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.908 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:00.908 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.909 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.909 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:00.909 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:00.909 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.909 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:00.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:00.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.911 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_io 2023-10-11T04:24:00.911 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83709 2023-10-11T04:24:00.911 INFO:tasks.workunit.client.0.smithi050.stdout:test api_io on pid 83709 2023-10-11T04:24:00.915 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_io on pid 83709' 2023-10-11T04:24:00.915 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83709 2023-10-11T04:24:00.915 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:00.915 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2023-10-11T04:24:00.916 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:00.916 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_io_pp 2023-10-11T04:24:00.916 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_io_pp' 2023-10-11T04:24:00.916 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_io_pp 2023-10-11T04:24:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.921 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:00.921 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:00.921 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.921 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:00.921 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:00.921 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.922 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:00.922 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.922 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:00.922 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:00.922 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:00.923 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:00.923 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.923 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:00.923 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.923 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.924 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:00.924 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:00.924 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.924 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:00.924 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:00.925 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:00.925 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.925 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.925 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.925 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:00.925 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.926 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.926 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:00.926 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_io_pp 2023-10-11T04:24:00.928 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83721 2023-10-11T04:24:00.928 INFO:tasks.workunit.client.0.smithi050.stdout:test api_io_pp on pid 83721 2023-10-11T04:24:00.935 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_io_pp on pid 83721' 2023-10-11T04:24:00.935 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83721 2023-10-11T04:24:00.935 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2023-10-11T04:24:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_asio 2023-10-11T04:24:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_asio' 2023-10-11T04:24:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:00.939 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.939 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:00.939 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:00.940 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.940 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:00.940 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.941 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:00.941 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_asio 2023-10-11T04:24:00.941 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:00.941 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.942 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:00.942 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.942 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:00.942 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:00.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:00.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:00.943 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:00.943 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:00.943 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:00.943 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:00.944 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:00.944 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.944 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:00.944 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:00.944 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:00.945 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.945 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:00.945 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:00.945 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.945 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:00.946 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:00.946 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.946 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:00.946 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:00.946 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:00.947 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.947 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.947 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:00.947 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:00.947 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.949 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.949 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:00.949 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.949 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:00.949 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:00.950 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.950 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:00.950 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.950 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:00.950 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.951 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:00.951 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:00.951 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.951 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:00.951 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.952 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:00.952 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.952 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.952 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.952 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:00.953 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.953 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:00.953 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.953 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:00.953 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:00.953 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:00.954 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:00.954 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:00.954 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_asio 2023-10-11T04:24:00.954 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:00.954 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83736 2023-10-11T04:24:00.955 INFO:tasks.workunit.client.0.smithi050.stdout:test api_asio on pid 83736 2023-10-11T04:24:00.961 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_asio on pid 83736' 2023-10-11T04:24:00.961 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83736 2023-10-11T04:24:00.961 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2023-10-11T04:24:00.961 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:00.962 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:00.962 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_list 2023-10-11T04:24:00.962 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_list' 2023-10-11T04:24:00.962 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_list 2023-10-11T04:24:00.963 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:00.963 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:00.963 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:00.963 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:00.963 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:00.963 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:00.964 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:00.964 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:00.964 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:00.964 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:00.965 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:00.965 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:00.965 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:00.965 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:00.965 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:00.965 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:00.966 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:00.966 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.966 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:00.966 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.966 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:00.967 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:00.967 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.967 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:00.967 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:00.967 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:00.968 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:00.968 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.968 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:00.968 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:00.968 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.969 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:00.969 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:00.969 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.969 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.969 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:00.969 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:00.970 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.970 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.970 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:00.970 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:00.970 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:00.971 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:00.971 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.971 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.971 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:00.972 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:00.972 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.972 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:00.972 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.972 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:00.973 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:00.973 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.973 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:00.973 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:00.973 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:00.974 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:00.974 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.974 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:00.974 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:00.975 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:00.975 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.975 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:00.976 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:00.976 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.976 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:00.977 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:00.977 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:00.977 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:00.978 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.978 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.978 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:00.978 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:00.979 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.979 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:00.979 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:00.980 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:00.980 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.980 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:00.980 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.981 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83693/exe 2023-10-11T04:24:00.981 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:00.981 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:00.981 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.982 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:00.982 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.982 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.982 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:00.983 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.983 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:00.983 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:00.983 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:00.983 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:00.984 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:00.984 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:00.984 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_list 2023-10-11T04:24:00.984 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83752 2023-10-11T04:24:00.984 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:00.985 INFO:tasks.workunit.client.0.smithi050.stdout:test api_list on pid 83752 2023-10-11T04:24:00.993 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_list on pid 83752' 2023-10-11T04:24:00.994 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83752 2023-10-11T04:24:00.994 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:00.994 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:00.995 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2023-10-11T04:24:00.995 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:00.995 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:00.996 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:00.996 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:00.996 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:00.997 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_lock 2023-10-11T04:24:00.997 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_lock' 2023-10-11T04:24:00.997 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:00.998 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_lock 2023-10-11T04:24:00.998 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:00.998 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:00.999 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:00.999 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:00.999 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.000 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.000 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.000 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.001 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.001 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.001 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.002 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.002 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.002 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_aio 2023-10-11T04:24:01.003 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.003 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.004 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.004 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.004 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.005 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.005 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_aio: /' 2023-10-11T04:24:01.005 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.005 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.005 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.006 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.006 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.006 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.006 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.006 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.007 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.007 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.007 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.007 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.007 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.008 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.008 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_aio.log 2023-10-11T04:24:01.008 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.008 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.008 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.009 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.009 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.009 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.009 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.009 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.009 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.010 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.010 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.010 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.010 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.010 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.011 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.011 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.011 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.011 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.011 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.012 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.012 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.012 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.012 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.013 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.013 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.013 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.013 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.014 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.014 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.014 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.014 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.015 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.015 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.015 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.015 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.015 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.016 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.016 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.016 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.016 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.016 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.017 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.017 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.017 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.017 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.017 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.018 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.018 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.018 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.018 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.018 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.018 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83700/exe 2023-10-11T04:24:01.019 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.019 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.019 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.019 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.019 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.020 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.020 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.020 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.020 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.020 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.021 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.021 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.021 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.021 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.021 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.021 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.022 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_lock 2023-10-11T04:24:01.022 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.022 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.023 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.023 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.023 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83770 2023-10-11T04:24:01.024 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_lock on pid 83770' 2023-10-11T04:24:01.025 INFO:tasks.workunit.client.0.smithi050.stdout:test api_lock on pid 83770 2023-10-11T04:24:01.032 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83770 2023-10-11T04:24:01.033 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.033 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.033 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2023-10-11T04:24:01.033 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_lock_pp 2023-10-11T04:24:01.033 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_lock_pp' 2023-10-11T04:24:01.034 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.034 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.034 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.034 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.034 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_lock_pp 2023-10-11T04:24:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.037 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.037 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.037 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.038 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.038 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.038 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.039 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.039 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.040 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.040 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.040 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.041 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.041 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.041 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.042 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.042 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_aio_pp 2023-10-11T04:24:01.042 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.043 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.043 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.043 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.043 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.044 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_aio_pp.log 2023-10-11T04:24:01.044 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.044 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.045 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.045 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.045 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.045 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.046 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.046 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.046 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.046 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.046 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.047 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.047 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.047 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.047 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.047 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.048 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.048 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.048 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.048 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.048 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.048 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.049 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.049 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.049 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.049 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.050 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.050 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.050 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.051 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.051 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_aio_pp: /' 2023-10-11T04:24:01.052 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.052 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.052 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.053 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.053 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.053 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.054 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.054 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.054 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.055 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.055 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.055 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.056 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.056 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.057 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.057 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.057 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.058 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.058 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_lock_pp 2023-10-11T04:24:01.058 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.059 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.059 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.059 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.060 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.060 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.061 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.061 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.061 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.062 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.062 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.062 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.063 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.063 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.063 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83786 2023-10-11T04:24:01.064 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.064 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.065 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_lock_pp on pid 83786' 2023-10-11T04:24:01.065 INFO:tasks.workunit.client.0.smithi050.stdout:test api_lock_pp on pid 83786 2023-10-11T04:24:01.084 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.084 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83786 2023-10-11T04:24:01.084 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.085 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.085 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.085 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.085 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.085 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.086 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.086 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.086 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.086 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.086 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.087 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2023-10-11T04:24:01.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.089 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.089 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.089 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.089 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_misc 2023-10-11T04:24:01.090 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_misc' 2023-10-11T04:24:01.090 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83709/exe 2023-10-11T04:24:01.090 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.090 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.090 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.090 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.091 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.091 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.091 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_misc 2023-10-11T04:24:01.091 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.091 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.092 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.092 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.092 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.092 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.092 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.093 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.093 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.093 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.093 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.093 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.093 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.094 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.094 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.094 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.094 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.094 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.095 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.095 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.095 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.095 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.095 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.096 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.096 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.096 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.096 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.096 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.096 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.097 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.097 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.097 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.097 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.098 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.098 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.098 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.098 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.098 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.099 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.099 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.099 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.099 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.099 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.100 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.100 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.100 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.100 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.100 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.100 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.101 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.101 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.101 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.101 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.101 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.102 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.102 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.102 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_io.log 2023-10-11T04:24:01.102 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.102 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.102 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.103 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.103 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.103 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.103 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.103 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.104 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.104 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.104 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.104 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.104 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.105 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.105 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.105 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.105 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.105 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.105 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.106 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.106 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.106 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.106 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.106 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.107 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.107 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.107 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.107 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.107 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.108 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.108 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.108 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.108 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.108 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.108 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.109 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.109 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.109 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.109 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.109 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.110 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.110 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.110 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.110 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.110 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.110 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.111 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.111 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.111 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_io 2023-10-11T04:24:01.111 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_io: /' 2023-10-11T04:24:01.112 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_misc 2023-10-11T04:24:01.112 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83721/exe 2023-10-11T04:24:01.112 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83811 2023-10-11T04:24:01.112 INFO:tasks.workunit.client.0.smithi050.stdout:test api_misc on pid 83811 2023-10-11T04:24:01.132 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_misc on pid 83811' 2023-10-11T04:24:01.133 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83811 2023-10-11T04:24:01.133 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.133 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2023-10-11T04:24:01.133 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.134 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_misc_pp 2023-10-11T04:24:01.134 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_misc_pp' 2023-10-11T04:24:01.134 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.134 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_misc_pp 2023-10-11T04:24:01.134 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.135 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.135 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.135 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.135 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.135 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.136 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.136 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.136 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.136 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.136 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.137 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.137 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.137 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.137 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.137 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.137 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.138 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.138 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.138 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.138 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.138 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.139 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.139 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.139 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.139 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.139 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.140 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.140 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.140 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.140 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.140 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.141 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.141 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.141 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.141 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.141 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.142 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.142 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.142 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.142 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.142 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_io_pp 2023-10-11T04:24:01.143 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.143 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.143 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.143 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.143 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.143 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.144 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.144 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.144 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.144 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.144 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.145 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.145 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.145 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.145 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.145 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.146 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.146 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.146 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.146 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.146 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.146 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.147 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.147 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.147 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.147 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.147 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.148 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.148 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.148 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.148 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.148 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_io_pp.log 2023-10-11T04:24:01.149 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.149 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.149 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.149 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.149 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.150 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.150 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_io_pp: /' 2023-10-11T04:24:01.150 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.150 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.150 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.150 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.151 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.151 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.151 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.151 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.151 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.152 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.152 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83736/exe 2023-10-11T04:24:01.152 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.152 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.152 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.153 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.153 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.153 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.153 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.153 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.154 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.154 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.154 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.154 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.154 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.154 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.155 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.155 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.155 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.155 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.155 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.156 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.156 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.156 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.156 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.156 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.157 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.157 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.157 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.157 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.157 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.157 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.158 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.158 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.158 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.158 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.158 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.159 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.159 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.159 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.159 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.159 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.160 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.160 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.160 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.160 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.160 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.160 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.161 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.161 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.161 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.161 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.161 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.162 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.162 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.162 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.162 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.162 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.163 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.163 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.163 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.163 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.163 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.164 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.164 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.164 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.164 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.164 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.164 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.165 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.165 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.165 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_asio: /' 2023-10-11T04:24:01.165 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_asio 2023-10-11T04:24:01.165 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.166 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.166 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.166 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.166 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.166 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.167 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.167 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.167 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.167 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_asio.log 2023-10-11T04:24:01.167 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.167 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.168 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.168 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.168 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.168 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.168 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.169 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.169 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.169 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.169 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.169 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.170 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.170 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.170 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.170 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.170 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.171 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.171 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.171 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.171 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.171 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.172 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.172 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.172 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.172 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.172 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.173 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.173 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.173 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.173 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.173 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.173 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.174 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.174 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83770/exe 2023-10-11T04:24:01.174 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.174 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.174 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.175 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.175 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.175 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.175 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.175 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.176 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.176 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.176 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.176 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.176 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.176 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.177 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.177 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.177 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.177 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.177 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.178 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.178 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.178 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.178 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.178 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.179 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.179 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.179 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.179 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.179 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.179 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.180 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.180 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.180 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_lock 2023-10-11T04:24:01.180 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.180 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.181 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.181 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.181 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.181 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.181 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.182 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.182 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.182 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.182 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.182 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.182 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.183 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.183 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.183 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.183 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.183 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.184 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.184 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.184 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.184 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.184 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.184 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.185 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.185 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.185 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.185 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.185 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83752/exe 2023-10-11T04:24:01.186 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.186 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.186 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.186 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.186 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.187 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.187 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_misc_pp 2023-10-11T04:24:01.187 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.187 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83856 2023-10-11T04:24:01.188 INFO:tasks.workunit.client.0.smithi050.stdout:test api_misc_pp on pid 83856 2023-10-11T04:24:01.196 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_misc_pp on pid 83856' 2023-10-11T04:24:01.196 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83856 2023-10-11T04:24:01.196 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.197 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.197 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.197 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.197 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.197 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.198 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.198 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.198 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.198 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.198 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.199 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.199 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.199 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.199 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.199 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.200 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.200 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.200 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.200 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.200 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.200 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.201 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.201 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_list: /' 2023-10-11T04:24:01.201 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.201 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.201 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.202 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.202 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.202 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.202 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.202 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.203 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.203 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.203 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_list 2023-10-11T04:24:01.203 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_tier_pp 2023-10-11T04:24:01.203 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_tier_pp' 2023-10-11T04:24:01.203 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_tier_pp 2023-10-11T04:24:01.204 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_list.log 2023-10-11T04:24:01.204 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_lock: /' 2023-10-11T04:24:01.204 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_lock.log 2023-10-11T04:24:01.204 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.204 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.205 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.205 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.205 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.205 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.205 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.206 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.206 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.206 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.206 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.206 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.206 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2023-10-11T04:24:01.207 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.207 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.207 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.207 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.207 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.208 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.208 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83786/exe 2023-10-11T04:24:01.208 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.208 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.208 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.209 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.209 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.209 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.209 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.209 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.209 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.210 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.210 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.210 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.210 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.210 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.211 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.211 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.211 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.211 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.211 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.212 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.212 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.212 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.212 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.212 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.213 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.213 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.213 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.213 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.213 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.214 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.214 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.214 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.214 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.214 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.214 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.215 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.215 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.215 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.215 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.215 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_lock_pp: /' 2023-10-11T04:24:01.216 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_lock_pp.log 2023-10-11T04:24:01.216 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_tier_pp 2023-10-11T04:24:01.216 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_lock_pp 2023-10-11T04:24:01.216 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83878 2023-10-11T04:24:01.217 INFO:tasks.workunit.client.0.smithi050.stdout:test api_tier_pp on pid 83878 2023-10-11T04:24:01.225 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_tier_pp on pid 83878' 2023-10-11T04:24:01.225 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83878 2023-10-11T04:24:01.225 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.226 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.226 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2023-10-11T04:24:01.226 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.226 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.226 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.227 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.227 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.227 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.227 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.227 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.228 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.228 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.228 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.228 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.228 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.229 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.229 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.229 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.229 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.229 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.230 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.230 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.230 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.230 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.230 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.231 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.231 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.231 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.231 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.231 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.231 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.232 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.232 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.232 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83811/exe 2023-10-11T04:24:01.232 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.232 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.233 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.233 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.233 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.233 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.233 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.233 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.234 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.234 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.234 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.234 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_misc: /' 2023-10-11T04:24:01.234 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_misc 2023-10-11T04:24:01.235 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.235 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.235 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.235 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.235 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.236 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.236 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.236 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.236 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.236 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.237 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.237 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.237 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.237 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.237 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.238 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_pool 2023-10-11T04:24:01.238 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.238 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.238 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.238 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.238 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_pool' 2023-10-11T04:24:01.239 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_misc.log 2023-10-11T04:24:01.239 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.239 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.239 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.239 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.240 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.240 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.240 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.240 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.240 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.241 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.241 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.241 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.241 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.241 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.242 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.242 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.242 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.242 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.242 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.243 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.243 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_pool 2023-10-11T04:24:01.243 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.243 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.243 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.243 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.244 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.244 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.244 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.244 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.244 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.245 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.245 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_pool 2023-10-11T04:24:01.245 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83952 2023-10-11T04:24:01.245 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_pool on pid 83952' 2023-10-11T04:24:01.245 INFO:tasks.workunit.client.0.smithi050.stdout:test api_pool on pid 83952 2023-10-11T04:24:01.254 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83952 2023-10-11T04:24:01.254 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.254 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.255 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2023-10-11T04:24:01.255 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.255 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.255 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.255 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.256 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.256 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.256 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.256 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.256 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.257 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.257 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.257 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.257 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.257 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.258 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.258 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.258 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.258 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.258 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.259 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.259 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.259 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.259 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.259 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.259 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.260 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.260 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.260 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.260 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.260 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.261 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.261 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.261 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.261 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.261 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.262 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.262 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.262 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.262 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.262 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.263 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.263 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.263 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.263 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.263 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.263 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.264 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.264 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.264 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.264 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.264 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.265 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.265 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.265 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.265 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.265 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.266 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.266 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.266 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.266 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.266 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.267 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.267 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.267 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.267 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.267 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.268 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.268 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.268 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.268 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.268 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.269 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.269 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.269 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.269 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.269 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.270 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.270 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.270 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.270 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.270 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.271 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.271 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.271 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.271 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.271 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.271 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.272 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.272 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.272 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.272 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_snapshots 2023-10-11T04:24:01.272 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83856/exe 2023-10-11T04:24:01.273 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_snapshots' 2023-10-11T04:24:01.273 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_snapshots 2023-10-11T04:24:01.273 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.273 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.273 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.274 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.274 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.274 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.274 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.274 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.275 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.275 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.275 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.275 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.275 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.275 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.276 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.276 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.276 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.276 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.276 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.277 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.277 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.277 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_misc_pp.log 2023-10-11T04:24:01.277 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_snapshots 2023-10-11T04:24:01.277 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_misc_pp 2023-10-11T04:24:01.277 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83981 2023-10-11T04:24:01.278 INFO:tasks.workunit.client.0.smithi050.stdout:test api_snapshots on pid 83981 2023-10-11T04:24:01.283 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_snapshots on pid 83981' 2023-10-11T04:24:01.283 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83981 2023-10-11T04:24:01.283 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.284 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.284 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_misc_pp: /' 2023-10-11T04:24:01.284 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2023-10-11T04:24:01.284 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.284 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_snapshots_pp 2023-10-11T04:24:01.285 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.285 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.285 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.285 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.285 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.286 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.286 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.286 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.286 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.286 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.287 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.287 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.287 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.287 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.287 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.288 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.288 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_snapshots_pp' 2023-10-11T04:24:01.288 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.288 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.288 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.289 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.289 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.289 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.289 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.289 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.289 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.290 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.290 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.290 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_snapshots_pp 2023-10-11T04:24:01.290 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.290 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.291 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.291 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.291 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.291 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.291 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.293 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.293 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.293 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.294 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.294 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.294 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.294 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.294 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.294 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.295 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.295 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.295 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.295 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.295 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.296 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.296 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.296 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.296 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.296 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.297 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.297 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_snapshots_pp 2023-10-11T04:24:01.297 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83991 2023-10-11T04:24:01.297 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_snapshots_pp on pid 83991' 2023-10-11T04:24:01.298 INFO:tasks.workunit.client.0.smithi050.stdout:test api_snapshots_pp on pid 83991 2023-10-11T04:24:01.301 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=83991 2023-10-11T04:24:01.301 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2023-10-11T04:24:01.302 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.302 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.302 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_stat 2023-10-11T04:24:01.302 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_stat' 2023-10-11T04:24:01.303 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_stat 2023-10-11T04:24:01.303 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.303 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.303 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.303 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.303 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.304 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.304 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.304 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.304 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.304 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.305 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.305 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.305 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.305 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.305 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.305 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.306 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.306 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.306 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.306 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.306 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.307 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.307 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.307 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.307 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.307 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.308 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.308 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.308 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.308 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.308 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.308 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.309 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.309 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.309 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.309 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_stat 2023-10-11T04:24:01.309 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.310 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.310 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.310 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84003 2023-10-11T04:24:01.310 INFO:tasks.workunit.client.0.smithi050.stdout:test api_stat on pid 84003 2023-10-11T04:24:01.318 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_stat on pid 84003' 2023-10-11T04:24:01.318 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84003 2023-10-11T04:24:01.318 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.319 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.319 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.319 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.319 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.320 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.320 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.320 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.320 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.320 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.320 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.321 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.321 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.321 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.321 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.321 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.322 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.322 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.322 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.322 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.322 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.323 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.323 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.323 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.323 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.323 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.324 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.324 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.324 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.324 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.324 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.325 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.325 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.325 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_stat_pp 2023-10-11T04:24:01.325 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.325 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.325 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.326 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.326 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.326 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.326 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.326 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.327 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.327 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.327 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.327 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_stat_pp' 2023-10-11T04:24:01.328 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.328 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.328 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.328 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.328 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.328 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.329 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.329 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.329 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.329 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.329 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.330 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_stat_pp 2023-10-11T04:24:01.330 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.330 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2023-10-11T04:24:01.330 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.330 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.331 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.331 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.331 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.331 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.331 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.331 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.332 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.332 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.332 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.332 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.332 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.333 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.333 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_stat_pp 2023-10-11T04:24:01.333 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.333 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.333 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84024 2023-10-11T04:24:01.334 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.334 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.334 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.334 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.334 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.334 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.335 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.335 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.335 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.335 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.335 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.336 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.336 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.336 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.336 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.336 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.337 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.337 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.337 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.337 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.337 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.337 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.338 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.338 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.338 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.338 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.338 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.339 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.339 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.339 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.339 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.339 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.339 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.340 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.340 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.340 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.340 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.340 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.341 INFO:tasks.workunit.client.0.smithi050.stdout:test api_stat_pp on pid 84024 2023-10-11T04:24:01.354 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_stat_pp on pid 84024' 2023-10-11T04:24:01.354 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84024 2023-10-11T04:24:01.354 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.354 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.355 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2023-10-11T04:24:01.355 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.355 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.355 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.355 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.355 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.358 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.358 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.358 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.358 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.358 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.359 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.359 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.359 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.359 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.359 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.359 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.360 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.360 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.360 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.360 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.360 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.361 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.361 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.361 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.361 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.361 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.362 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.362 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.362 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.362 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.362 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.363 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.363 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.363 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.363 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.363 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.363 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.364 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.364 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.364 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.364 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.364 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.365 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.365 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.365 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.365 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.365 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.365 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.366 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.366 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.366 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.366 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.366 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.367 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.367 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.367 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.367 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.367 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.368 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.368 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.368 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.368 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.368 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.369 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.369 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.369 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.369 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.369 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.370 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.370 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.370 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.370 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_watch_notify 2023-10-11T04:24:01.370 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_watch_notify' 2023-10-11T04:24:01.371 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.371 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.371 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.371 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.371 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83878/exe 2023-10-11T04:24:01.371 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.372 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.372 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.372 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.372 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.372 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.373 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.373 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.373 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.373 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.373 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.374 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.374 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.374 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.374 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.374 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.375 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.375 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.375 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.375 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.375 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.376 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.376 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.376 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.376 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.376 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.376 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.377 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.377 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.377 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.377 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.377 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.378 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.378 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.378 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.378 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.378 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.379 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.379 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.379 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.379 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_watch_notify 2023-10-11T04:24:01.379 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83981/exe 2023-10-11T04:24:01.379 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.380 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83952/exe 2023-10-11T04:24:01.380 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.380 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.380 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.380 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.381 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.381 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.381 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.382 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.382 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_tier_pp 2023-10-11T04:24:01.382 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.382 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.382 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.383 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.383 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.383 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.383 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.383 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.384 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.384 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.384 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.384 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.384 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.384 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.385 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.385 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.385 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.385 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.385 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.386 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.386 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.386 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.386 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.387 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.388 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.388 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.388 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.388 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.388 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.388 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.389 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.389 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.389 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.389 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.389 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.390 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.390 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_pool: /' 2023-10-11T04:24:01.390 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_pool.log 2023-10-11T04:24:01.390 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.964+0000 7fea3cb28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:01.391 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.976+0000 7fea3cb28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:01.391 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.976+0000 7fea3cb28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:01.391 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2023-10-11T04:24:01.391 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] Global test environment set-up. 2023-10-11T04:24:01.392 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] 12 tests from AsioRados 2023-10-11T04:24:01.392 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.977+0000 7fea3cb28640 1 Processor -- start 2023-10-11T04:24:01.392 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.977+0000 7fea3cb28640 1 -- start start 2023-10-11T04:24:01.392 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.978+0000 7fea3cb28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x55585073bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:24:01.392 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.978+0000 7fea3cb28640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555850634010 con 0x555850735bf0 2023-10-11T04:24:01.392 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.979+0000 7fea35b9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x55585073bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:24:01.393 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.980+0000 7fea35b9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x55585073bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47834/0 (socket says 172.21.15.50:47834) 2023-10-11T04:24:01.393 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.980+0000 7fea35b9a640 1 -- 172.21.15.50:0/1704517132 learned_addr learned my addr 172.21.15.50:0/1704517132 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:24:01.393 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.981+0000 7fea35b9a640 1 -- 172.21.15.50:0/1704517132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558505db630 con 0x555850735bf0 2023-10-11T04:24:01.393 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:00.982+0000 7fea35b9a640 1 --2- 172.21.15.50:0/1704517132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x55585073bf60 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de54471ae4c2d359 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:24:01.393 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.024+0000 7fea27fff640 1 -- 172.21.15.50:0/1704517132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fea300061e0 con 0x555850735bf0 2023-10-11T04:24:01.394 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.024+0000 7fea27fff640 1 -- 172.21.15.50:0/1704517132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fea30006340 con 0x555850735bf0 2023-10-11T04:24:01.394 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.024+0000 7fea27fff640 1 -- 172.21.15.50:0/1704517132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fea30004880 con 0x555850735bf0 2023-10-11T04:24:01.394 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.026+0000 7fea3cb28640 1 -- 172.21.15.50:0/1704517132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 msgr2=0x55585073bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:24:01.394 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.026+0000 7fea3cb28640 1 --2- 172.21.15.50:0/1704517132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x55585073bf60 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:01.394 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.027+0000 7fea3cb28640 1 -- 172.21.15.50:0/1704517132 shutdown_connections 2023-10-11T04:24:01.396 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.397 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.397 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.397 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.397 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.397 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.398 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.398 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.398 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.398 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.398 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.399 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.399 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.399 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.399 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.399 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.400 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.400 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.400 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.400 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.400 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_pool 2023-10-11T04:24:01.401 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_tier_pp.log 2023-10-11T04:24:01.401 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.027+0000 7fea3cb28640 1 --2- 172.21test api_watch_notify on pid 84113 2023-10-11T04:24:01.401 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_watch_notify 2023-10-11T04:24:01.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_tier_pp: /' 2023-10-11T04:24:01.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84113 2023-10-11T04:24:01.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_watch_notify on pid 84113' 2023-10-11T04:24:01.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84113 2023-10-11T04:24:01.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.403 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.403 INFO:tasks.workunit.client.0.smithi050.stdout:.15.50:0/1704517132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x55585073bf60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:01.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.027+0000 7fea3cb28640 1 -- 172.21.15.50:0/1704517132 >> 172.21.15.50:0/1704517132 conn(0x5558505aed80 msgr2=0x55585067d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:24:01.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.027+0000 7fea3cb28640 1 -- 172.21.15.50:0/1704517132 shutdown_connections 2023-10-11T04:24:01.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.027+0000 7fea3cb28640 1 -- 172.21.15.50:0/1704517132 wait complete. 2023-10-11T04:24:01.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.028+0000 7fea3cb28640 1 Processor -- start 2023-10-11T04:24:01.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.029+0000 7fea3cb28640 1 -- start start 2023-10-11T04:24:01.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.030+0000 7fea3cb28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x555850721760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:24:01.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.030+0000 7fea3cb28640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558505cf1e0 con 0x555850735bf0 2023-10-11T04:24:01.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.030+0000 7fea35b9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x555850721760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:24:01.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.030+0000 7fea35b9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x555850721760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47918/0 (socket says 172.21.15.50:47918) 2023-10-11T04:24:01.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.030+0000 7fea35b9a640 1 -- 172.21.15.50:0/811177921 learned_addr learned my addr 172.21.15.50:0/811177921 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-11T04:24:01.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.031+0000 7fea35b9a640 1 -- 172.21.15.50:0/811177921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558505ce7e0 con 0x555850735bf0 2023-10-11T04:24:01.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.031+0000 7fea35b9a640 1 --2- 172.21.15.50:0/811177921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x555850721760 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:24:01.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.031+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fea30001bd0 con 0x555850735bf0 2023-10-11T04:24:01.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.031+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558505ce240 con 0x555850735bf0 2023-10-11T04:24:01.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.031+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555850724bd0 con 0x555850735bf0 2023-10-11T04:24:01.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.032+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fea30001d30 con 0x555850735bf0 2023-10-11T04:24:01.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.034+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fea30001fd0 con 0x555850735bf0 2023-10-11T04:24:01.407 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.034+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fea30014410 con 0x555850735bf0 2023-10-11T04:24:01.426 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_snapshots 2023-10-11T04:24:01.426 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2023-10-11T04:24:01.426 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.427 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.427 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.427 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.427 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.427 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.428 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.428 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.428 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.428 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.428 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.429 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.429 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.429 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.429 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.429 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.431 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.431 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.431 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.431 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.431 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.432 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.432 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.433 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.433 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_snapshots.log 2023-10-11T04:24:01.433 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_snapshots: /' 2023-10-11T04:24:01.433 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.434 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.434 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.436 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.437 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.438 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.438 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.438 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.438 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.438 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.439 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.439 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.439 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.439 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.439 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.440 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.440 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.440 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.440 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.440 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.441 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.441 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.441 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.441 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.441 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.441 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.442 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.442 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.442 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.442 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.442 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.443 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.443 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.443 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.443 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.443 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.444 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.444 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.444 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.444 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.444 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.444 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.445 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.446 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.446 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.446 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.447 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.447 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.448 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/83991/exe 2023-10-11T04:24:01.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.449 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.450 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.450 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.452 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.452 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.452 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.455 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.455 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.455 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.455 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.455 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.456 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.456 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.456 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.456 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.456 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.457 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.457 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.457 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.457 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.457 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.457 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.458 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84003/exe 2023-10-11T04:24:01.458 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.458 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.458 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_snapshots_pp 2023-10-11T04:24:01.458 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.459 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.459 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.459 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.459 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.459 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2023-10-11T04:24:01.460 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_watch_notify_pp 2023-10-11T04:24:01.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.461 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.461 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.461 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.461 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_watch_notify_pp' 2023-10-11T04:24:01.461 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.462 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.462 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.462 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.462 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.462 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.465 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_watch_notify_pp 2023-10-11T04:24:01.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.466 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_snapshots_pp: /' 2023-10-11T04:24:01.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84024/exe 2023-10-11T04:24:01.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.468 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.468 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.468 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.468 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.468 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_stat 2023-10-11T04:24:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_stat_pp 2023-10-11T04:24:01.473 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_stat_pp: /' 2023-10-11T04:24:01.473 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_stat_pp.log 2023-10-11T04:24:01.473 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_stat.log 2023-10-11T04:24:01.473 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.473 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_stat: /' 2023-10-11T04:24:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_watch_notify_pp 2023-10-11T04:24:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84173 2023-10-11T04:24:01.476 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_watch_notify_pp on pid 84173' 2023-10-11T04:24:01.476 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.035+0000 7fea26ffd640 1 --2- 172.21.15.50:0/811177921 >> [v2:172test api_watch_notify_pp on pid 84173 2023-10-11T04:24:01.483 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84173 2023-10-11T04:24:01.484 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.484 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.484 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cmd 2023-10-11T04:24:01.484 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cmd' 2023-10-11T04:24:01.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cmd 2023-10-11T04:24:01.485 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2023-10-11T04:24:01.485 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.485 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.486 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.488 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.488 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.488 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.488 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.488 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.488 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.489 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.489 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.489 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.489 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.489 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.490 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.490 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.490 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.490 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.490 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.491 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.491 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.491 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.491 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.491 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.492 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.492 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.492 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.492 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.492 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.492 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.493 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.493 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.493 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.493 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.493 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.494 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.494 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.494 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.494 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.494 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.495 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.495 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.495 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.495 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.495 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.495 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.496 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.496 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.496 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.496 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.496 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.497 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.497 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.497 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.497 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.497 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.497 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.498 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.498 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.498 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.498 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.498 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.499 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.499 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.499 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.499 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.499 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.500 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.500 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cmd 2023-10-11T04:24:01.500 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84204 2023-10-11T04:24:01.500 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cmd on pid 84204' 2023-10-11T04:24:01.501 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cmd on pid 84204 2023-10-11T04:24:01.506 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84204 2023-10-11T04:24:01.506 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.507 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.507 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2023-10-11T04:24:01.507 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.507 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.507 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.509 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.509 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.509 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.510 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.510 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.510 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.510 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.510 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.511 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.511 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.511 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.511 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.511 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.511 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.512 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.512 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.512 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.512 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84113/exe 2023-10-11T04:24:01.512 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.513 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.513 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.513 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.513 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.513 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.514 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.514 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.514 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.514 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.514 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.514 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cmd_pp 2023-10-11T04:24:01.515 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cmd_pp' 2023-10-11T04:24:01.515 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cmd_pp 2023-10-11T04:24:01.515 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.515 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.515 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.516 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.516 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.516 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.516 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.516 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.517 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.517 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.517 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.517 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.517 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.517 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.518 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.518 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.518 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.518 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.518 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.519 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cmd_pp 2023-10-11T04:24:01.519 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84221 2023-10-11T04:24:01.519 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cmd_pp on pid 84221' 2023-10-11T04:24:01.519 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cmd_pp on pid 84221 2023-10-11T04:24:01.525 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84221 2023-10-11T04:24:01.525 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.525 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.525 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.526 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.526 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.526 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2023-10-11T04:24:01.526 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.526 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.527 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_service 2023-10-11T04:24:01.527 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_service' 2023-10-11T04:24:01.527 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_service 2023-10-11T04:24:01.527 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.527 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.527 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.528 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.528 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.528 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.528 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.528 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.529 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.529 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.529 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.529 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.529 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.530 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.530 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.533 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_watch_notify: /' 2023-10-11T04:24:01.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.534 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.534 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.534 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.534 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.534 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.536 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_watch_notify 2023-10-11T04:24:01.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.537 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.537 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.537 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.538 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.539 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.539 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.539 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_service 2023-10-11T04:24:01.539 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84235 2023-10-11T04:24:01.539 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_service on pid 84235' 2023-10-11T04:24:01.540 INFO:tasks.workunit.client.0.smithi050.stdout:test api_service on pid 84235 2023-10-11T04:24:01.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84235 2023-10-11T04:24:01.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.543 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.544 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.544 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.544 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.544 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.544 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.545 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_service_pp 2023-10-11T04:24:01.545 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_service_pp' 2023-10-11T04:24:01.545 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84173/exe 2023-10-11T04:24:01.545 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2023-10-11T04:24:01.545 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.546 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_service_pp 2023-10-11T04:24:01.546 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.546 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.546 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.546 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.547 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.547 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.547 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_watch_notify.log 2023-10-11T04:24:01.547 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.547 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.547 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.548 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.548 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.548 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.548 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.548 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.549 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.549 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.549 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.549 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_watch_notify_pp 2023-10-11T04:24:01.549 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.550 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_service_pp 2023-10-11T04:24:01.550 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.550 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.550 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84260 2023-10-11T04:24:01.551 INFO:tasks.workunit.client.0.smithi050.stdout:test api_service_pp on pid 84260 2023-10-11T04:24:01.556 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_service_pp on pid 84260' 2023-10-11T04:24:01.556 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84260 2023-10-11T04:24:01.556 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.556 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.557 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.558 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.559 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.560 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.560 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2023-10-11T04:24:01.560 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.560 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.561 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.561 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.561 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.561 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2023-10-11T04:24:01.561 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2023-10-11T04:24:01.561 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.562 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.562 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.562 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.562 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.562 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.563 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.563 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.563 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.563 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.563 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.564 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.564 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.564 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.564 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.564 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.564 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.565 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_c_write_operations 2023-10-11T04:24:01.565 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.565 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.565 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.565 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.566 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.566 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.566 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.566 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.566 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.567 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.567 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.567 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.567 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_c_write_operations' 2023-10-11T04:24:01.567 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_c_write_operations 2023-10-11T04:24:01.567 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.568 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.568 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.568 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.568 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.568 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.569 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.569 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.569 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.569 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.569 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.570 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.570 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.570 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.570 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.570 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.571 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.571 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.571 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.572 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.572 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.573 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.573 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.573 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.574 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.574 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.576 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.576 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.577 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.577 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_c_write_operations 2023-10-11T04:24:01.578 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84316 2023-10-11T04:24:01.578 INFO:tasks.workunit.client.0.smithi050.stdout:test api_c_write_operations on pid 84316 2023-10-11T04:24:01.584 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_c_write_operations on pid 84316' 2023-10-11T04:24:01.584 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84316 2023-10-11T04:24:01.584 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.585 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.585 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2023-10-11T04:24:01.585 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_c_read_operations 2023-10-11T04:24:01.585 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.585 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.586 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.586 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_c_read_operations' 2023-10-11T04:24:01.586 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.586 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.586 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.587 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.587 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.587 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.587 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.587 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.588 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.588 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.588 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.588 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.588 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.589 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.589 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.589 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.589 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.589 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.590 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.590 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.590 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.590 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.590 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.591 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.591 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.591 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.591 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.591 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.592 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.592 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.592 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.593 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.593 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_c_read_operations 2023-10-11T04:24:01.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.594 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.596 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.597 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.597 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.598 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.598 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.598 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_c_read_operations 2023-10-11T04:24:01.598 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.599 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.599 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84331 2023-10-11T04:24:01.599 INFO:tasks.workunit.client.0.smithi050.stdout:test api_c_read_operations on pid 84331 2023-10-11T04:24:01.606 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_c_read_operations on pid 84331' 2023-10-11T04:24:01.606 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84331 2023-10-11T04:24:01.606 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.607 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.607 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.607 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.607 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.607 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.608 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.608 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.608 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2023-10-11T04:24:01.608 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.608 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.609 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.609 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cls_remote_reads 2023-10-11T04:24:01.609 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.609 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.609 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.610 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.610 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.610 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.610 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.610 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.613 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cls_remote_reads' 2023-10-11T04:24:01.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.615 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.615 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.615 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.616 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.616 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.616 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cls_remote_reads 2023-10-11T04:24:01.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.617 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.617 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.617 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.618 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.618 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.618 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.618 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.618 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.619 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.619 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.619 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.619 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.619 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.620 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.620 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.620 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.620 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.621 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.621 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.621 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.621 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.622 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.622 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.622 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.622 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.622 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.623 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.623 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.623 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.623 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.623 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.624 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.624 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.624 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cls_remote_reads 2023-10-11T04:24:01.624 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.624 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.625 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.625 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.625 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.625 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84347 2023-10-11T04:24:01.625 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cls_remote_reads on pid 84347' 2023-10-11T04:24:01.626 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cls_remote_reads on pid 84347 2023-10-11T04:24:01.637 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84347 2023-10-11T04:24:01.638 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.639 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.639 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2023-10-11T04:24:01.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.639 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.639 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.640 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.640 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.640 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.642 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.642 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.642 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.642 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.642 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s list_parallel 2023-10-11T04:24:01.643 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.643 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' list_parallel' 2023-10-11T04:24:01.643 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.643 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.645 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.647 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.647 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.648 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.648 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo list_parallel 2023-10-11T04:24:01.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.651 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.652 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.652 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.652 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.653 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.653 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.653 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.653 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.653 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.654 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.655 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.655 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.655 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.656 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.656 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.656 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.656 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.656 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.657 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.657 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.657 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.657 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.657 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.658 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.658 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.658 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.658 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.658 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.659 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.659 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.659 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.659 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.659 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.660 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.660 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.660 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.660 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.660 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.661 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.661 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.661 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.661 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.661 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.661 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84221/exe 2023-10-11T04:24:01.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.665 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.665 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.665 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.665 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.665 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.666 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.666 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.666 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.666 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.666 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.667 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.667 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.667 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.667 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=list_parallel 2023-10-11T04:24:01.667 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.667 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.668 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.668 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.668 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.668 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.668 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.669 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.669 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.669 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.669 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.669 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84370 2023-10-11T04:24:01.669 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test list_parallel on pid 84370' 2023-10-11T04:24:01.670 INFO:tasks.workunit.client.0.smithi050.stdout:test list_parallel on pid 84370 2023-10-11T04:24:01.682 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84370 2023-10-11T04:24:01.683 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.683 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.683 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.683 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.684 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.684 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2023-10-11T04:24:01.684 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.684 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cmd_pp: /' 2023-10-11T04:24:01.684 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.685 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.685 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.685 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.685 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.685 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.686 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.686 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.686 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.686 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.686 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.687 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.687 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.687 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.687 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.687 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.688 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.688 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.688 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.688 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.688 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.688 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.689 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.689 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.689 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.689 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.689 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.690 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.690 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.690 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.690 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.690 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.691 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.691 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.691 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.691 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.691 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.692 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.692 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.692 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.692 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.692 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.693 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.693 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.693 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.693 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.693 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.694 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.694 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.694 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.694 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.694 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.694 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.695 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.695 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.695 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.695 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.695 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.696 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.696 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.696 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.696 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.696 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.698 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.699 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.699 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.699 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.699 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.699 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s open_pools_parallel 2023-10-11T04:24:01.700 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.701 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.706 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.706 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.707 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84235/exe 2023-10-11T04:24:01.707 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.707 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.707 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.707 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.707 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.708 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.708 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.708 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' open_pools_parallel' 2023-10-11T04:24:01.708 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.708 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.709 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo open_pools_parallel 2023-10-11T04:24:01.709 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.709 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.709 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.709 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.710 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.710 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.710 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.710 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.710 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.711 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.711 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.711 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.711 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.711 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.711 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.712 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.712 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.712 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.712 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.712 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.713 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.713 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.713 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.713 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.713 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.714 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.714 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.714 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.714 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.714 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.715 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.715 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.718 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.718 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84316/exe 2023-10-11T04:24:01.719 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.720 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.720 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.721 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_service 2023-10-11T04:24:01.721 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.721 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_service.log 2023-10-11T04:24:01.721 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=open_pools_parallel 2023-10-11T04:24:01.721 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84401 2023-10-11T04:24:01.722 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test open_pools_parallel on pid 84401' 2023-10-11T04:24:01.722 INFO:tasks.workunit.client.0.smithi050.stdout:test open_pools_parallel on pid 84401 2023-10-11T04:24:01.731 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84401 2023-10-11T04:24:01.732 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-11T04:24:01.732 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.732 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.732 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.732 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.733 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.733 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.733 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_service: /' 2023-10-11T04:24:01.734 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.734 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.734 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.734 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2023-10-11T04:24:01.734 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_c_write_operations: /' 2023-10-11T04:24:01.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.737 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.737 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.738 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.738 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.739 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.739 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.739 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_c_write_operations 2023-10-11T04:24:01.739 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.739 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.740 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.740 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.740 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s delete_pools_parallel 2023-10-11T04:24:01.740 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.740 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' delete_pools_parallel' 2023-10-11T04:24:01.741 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.741 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.741 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.741 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.741 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.742 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.742 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2023-10-11T04:24:01.742 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cmd_pp 2023-10-11T04:24:01.742 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84204/exe 2023-10-11T04:24:01.742 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.743 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.743 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.743 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.743 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.743 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.743 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.744 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.744 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.744 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.744 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.744 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.745 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.745 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.745 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.745 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.745 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.746 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.746 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.746 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.746 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.746 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.747 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.747 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.747 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.748 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-10-11T04:24:01.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.749 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.750 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.750 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.751 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.751 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.751 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.752 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.752 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.752 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.752 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.752 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.753 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84260/exe 2023-10-11T04:24:01.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.753 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.753 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.754 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo delete_pools_parallel 2023-10-11T04:24:01.754 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.754 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=delete_pools_parallel 2023-10-11T04:24:01.754 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84426 2023-10-11T04:24:01.754 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test delete_pools_parallel on pid 84426' 2023-10-11T04:24:01.755 INFO:tasks.workunit.client.0.smithi050.stdout:test delete_pools_parallel on pid 84426 2023-10-11T04:24:01.784 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84426 2023-10-11T04:24:01.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ ret=0 2023-10-11T04:24:01.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-10-11T04:24:01.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-10-11T04:24:01.785 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83878 2023-10-11T04:24:01.786 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 83878 2023-10-11T04:24:01.786 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2023-10-11T04:24:01.786 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.786 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.786 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.787 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.787 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.787 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.787 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cmd 2023-10-11T04:24:01.787 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cmd: /' 2023-10-11T04:24:01.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.788 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2023-10-11T04:24:01.789 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.789 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.789 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.789 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.789 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.790 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.790 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.790 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.790 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.790 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.791 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.791 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.791 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.791 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.791 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.792 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.792 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.792 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.792 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.792 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.792 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-10-11T04:24:01.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-10-11T04:24:01.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-10-11T04:24:01.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-10-11T04:24:01.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-10-11T04:24:01.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-10-11T04:24:01.797 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-10-11T04:24:01.797 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-10-11T04:24:01.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.798 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.798 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.801 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.801 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.801 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.801 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.801 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.802 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.802 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-11T04:24:01.802 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.802 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-11T04:24:01.802 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-11T04:24:01.803 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.803 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-11T04:24:01.803 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.803 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-11T04:24:01.803 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_service_pp 2023-10-11T04:24:01.804 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.804 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-11T04:24:01.804 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.804 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.804 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_service_pp.log 2023-10-11T04:24:01.804 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-11T04:24:01.805 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.805 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-11T04:24:01.805 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.805 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.805 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.806 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.806 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.806 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.806 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.807 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.807 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.807 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cmd.log 2023-10-11T04:24:01.807 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_service_pp: /' 2023-10-11T04:24:01.807 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.807 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.808 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.809 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.809 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.809 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.809 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.809 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.810 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.810 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.810 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.810 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.810 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.811 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.811 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.811 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.811 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.811 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.811 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.812 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.812 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.812 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.812 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.812 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.813 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.813 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.813 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.813 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.813 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.814 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.814 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.814 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.814 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.814 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.815 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.815 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.815 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.815 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.815 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.815 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.816 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.816 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.816 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.816 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.816 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.817 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.817 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.817 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.817 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.817 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.818 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.818 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.818 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.818 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.818 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.818 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.819 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.819 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.819 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.819 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.819 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.820 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.820 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.820 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.820 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.820 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.821 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.821 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.821 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.821 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.821 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.821 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.822 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.823 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.825 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.826 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84401/exe 2023-10-11T04:24:01.826 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.826 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-10-11T04:24:01.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-11T04:24:01.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-11T04:24:01.827 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-11T04:24:01.828 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.828 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-10-11T04:24:01.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84370/exe 2023-10-11T04:24:01.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-10-11T04:24:01.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-10-11T04:24:01.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-11T04:24:01.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-11T04:24:01.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-10-11T04:24:01.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-10-11T04:24:01.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-11T04:24:01.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-11T04:24:01.831 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.831 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.831 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.831 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.831 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.833 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.833 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.833 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.833 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.833 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.834 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.834 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.834 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.834 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.834 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.835 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.835 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.835 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.835 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.835 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.836 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.836 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.836 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.836 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.836 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.836 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.837 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.837 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.837 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_list_parallel.log 2023-10-11T04:24:01.837 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.837 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.838 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.838 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.838 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.838 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.838 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.839 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.839 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.839 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.839 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2023-10-11T04:24:01.839 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_list_parallel 2023-10-11T04:24:01.840 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_open_pools_parallel 2023-10-11T04:24:01.840 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ list_parallel: /' 2023-10-11T04:24:01.840 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ open_pools_parallel: /' 2023-10-11T04:24:01.840 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-11T04:24:01.840 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-11T04:24:01.840 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-11T04:24:01.841 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.841 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-11T04:24:01.841 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.841 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-11T04:24:01.841 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-11T04:24:01.842 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-11T04:24:01.842 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84331/exe 2023-10-11T04:24:01.842 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.842 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.842 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.843 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.843 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.843 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.843 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.843 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.844 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.844 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.844 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.844 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_c_read_operations: /' 2023-10-11T04:24:01.844 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84347/exe 2023-10-11T04:24:01.845 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2023-10-11T04:24:01.845 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_c_read_operations 2023-10-11T04:24:01.845 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.845 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.845 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.845 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.846 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.846 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.846 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.846 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.846 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.847 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.847 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.847 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cls_remote_reads 2023-10-11T04:24:01.847 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2023-10-11T04:24:01.847 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2023-10-11T04:24:01.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-11T04:24:01.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-11T04:24:01.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-11T04:24:01.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-11T04:24:01.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-11T04:24:01.849 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-11T04:24:01.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-11T04:24:01.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-10-11T04:24:01.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-11T04:24:01.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-10-11T04:24:01.851 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-10-11T04:24:01.851 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-10-11T04:24:01.851 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.851 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-11T04:24:01.851 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-11T04:24:01.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-11T04:24:01.852 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-11T04:24:01.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-11T04:24:01.852 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-10-11T04:24:01.853 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-10-11T04:24:01.853 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-11T04:24:01.853 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-11T04:24:01.853 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.853 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-10-11T04:24:01.853 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-10-11T04:24:01.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-10-11T04:24:01.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-11T04:24:01.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-10-11T04:24:01.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-11T04:24:01.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-10-11T04:24:01.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-11T04:24:01.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-10-11T04:24:01.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-11T04:24:01.856 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-10-11T04:24:01.856 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-10-11T04:24:01.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-11T04:24:01.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84426/exe 2023-10-11T04:24:01.856 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-10-11T04:24:01.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-10-11T04:24:01.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-10-11T04:24:01.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-10-11T04:24:01.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-10-11T04:24:01.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-10-11T04:24:01.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-10-11T04:24:01.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-11T04:24:01.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-10-11T04:24:01.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-11T04:24:01.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-10-11T04:24:01.858 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_delete_pools_parallel 2023-10-11T04:24:01.859 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2023-10-11T04:24:01.859 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ delete_pools_parallel: /' 2023-10-11T04:24:01.859 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2023-10-11T04:24:01.859 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2023-10-11T04:24:01.860 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2023-10-11T04:24:01.860 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2023-10-11T04:24:01.860 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-10-11T04:24:01.282+0000 7fdb150b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:01.860 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-10-11T04:24:01.282+0000 7fdb150b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:01.860 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-10-11T04:24:01.282+0000 7fdb150b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:01.861 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/cls_remote_reads.cc:13: Skipped 2023-10-11T04:24:01.861 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: Not supported by crimson yet. Skipped 2023-10-11T04:24:01.861 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather (13 ms) 2023-10-11T04:24:01.861 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (13 ms total) 2023-10-11T04:24:01.861 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-10-11T04:24:01.862 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2023-10-11T04:24:01.862 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (13 ms total) 2023-10-11T04:24:01.862 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ PASSED ] 0 tests. 2023-10-11T04:24:01.862 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ SKIPPED ] 1 test, listed below: 2023-10-11T04:24:01.862 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather 2023-10-11T04:24:03.862 INFO:tasks.workunit.client.0.smithi050.stdout:.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fea18036190 0x7fea180386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:24:03.862 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.035+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fea30046fc0 con 0x555850735bf0 2023-10-11T04:24:03.863 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.035+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea2800ee20 con 0x555850735bf0 2023-10-11T04:24:03.863 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.035+0000 7fea35399640 1 --2- 172.21.15.50:0/811177921 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fea18036190 0x7fea180386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-11T04:24:03.863 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.036+0000 7fea35399640 1 --2- 172.21.15.50:0/811177921 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fea18036190 0x7fea180386a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:24:03.863 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.076+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fea30010e70 con 0x555850735bf0 2023-10-11T04:24:03.863 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:01.076+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x55585063df90 con 0x555850735bf0 2023-10-11T04:24:03.863 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:02.132+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v17) v1 ==== 43+0+0 (crc 0 0 0) 0x7fea3000f6b0 con 0x555850735bf0 2023-10-11T04:24:03.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:02.132+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=16}) v3 -- 0x7fea1803aab0 con 0x555850735bf0 2023-10-11T04:24:03.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:02.133+0000 7fea26ffd640 1 -- 172.21.15.50:0/811177921 <== mon.0 v2:172.21.15.50:3300/0 8 ==== osd_map(16..17 src has 1..17) v4 ==== 10560+0+0 (crc 0 0 0) 0x7fea3000e230 con 0x555850735bf0 2023-10-11T04:24:03.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:02.134+0000 7fea3cb28640 1 --2- 172.21.15.50:0/811177921 >> v2:172.21.15.151:6805/361867287 conn(0x55585073d170 0x5558507221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T04:24:03.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:02.134+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:2 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d3590 con 0x55585073d170 2023-10-11T04:24:03.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:02.135+0000 7fea3639b640 1 --2- 172.21.15.50:0/811177921 >> v2:172.21.15.151:6805/361867287 conn(0x55585073d170 0x5558507221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-11T04:24:03.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:02.201+0000 7fea3639b640 1 --2- 172.21.15.50:0/811177921 >> v2:172.21.15.151:6805/361867287 conn(0x55585073d170 0x5558507221b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-11T04:24:03.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:03.861+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 1 ==== osd_op_reply(2 exist [writefull 0~5] v18'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:03.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2023-10-11T04:24:05.897 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:03.861+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:3 8.1 8:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507ce350 con 0x55585073d170 2023-10-11T04:24:05.897 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:03.861+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:4 8.1 8:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507cec40 con 0x55585073d170 2023-10-11T04:24:05.898 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.889+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:05.898 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.890+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v18'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:05.898 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (2028 ms) 2023-10-11T04:24:05.898 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2023-10-11T04:24:05.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.890+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:5 8.1 8:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507ceff0 con 0x55585073d170 2023-10-11T04:24:05.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.890+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:6 8.1 8:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d38f0 con 0x55585073d170 2023-10-11T04:24:05.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.893+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v18'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:05.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.894+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:05.899 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (4 ms) 2023-10-11T04:24:05.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2023-10-11T04:24:05.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.894+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:7 8.1 8:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507251d0 con 0x55585073d170 2023-10-11T04:24:05.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.894+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:8 8.1 8:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x555850814780 con 0x55585073d170 2023-10-11T04:24:05.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.897+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 6 ==== osd_op_reply(7 exist [read 0~5 out=5b] v18'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:05.900 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.897+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 7 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:05.901 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (3 ms) 2023-10-11T04:24:05.901 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2023-10-11T04:24:06.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:05.897+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867 api_tier_pp: [==========] Running 77 tests from 4 test suites. 2023-10-11T04:24:06.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] Global test environment set-up. 2023-10-11T04:24:06.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2023-10-11T04:24:06.162 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: seed 84059 2023-10-11T04:24:06.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-10-11T04:24:01.095+0000 7f480624c940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:06.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-10-11T04:24:01.095+0000 7f480624c940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:06.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-10-11T04:24:01.095+0000 7f480624c940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:06.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2023-10-11T04:24:06.163 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:287: Skipped 2023-10-11T04:24:06.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2023-10-11T04:24:06.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2023-10-11T04:24:06.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:2182: Skipped 2023-10-11T04:24:06.164 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.165 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2023-10-11T04:24:06.165 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2023-10-11T04:24:06.165 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:2561: Skipped 2023-10-11T04:24:06.165 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.165 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2023-10-11T04:24:06.166 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (0 ms total) 2023-10-11T04:24:06.166 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-10-11T04:24:06.166 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2023-10-11T04:24:06.166 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2023-10-11T04:24:06.166 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.167 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.167 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.167 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.167 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2023-10-11T04:24:06.167 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2023-10-11T04:24:06.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2023-10-11T04:24:06.168 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2023-10-11T04:24:06.169 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2023-10-11T04:24:06.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-10-11T04:24:06.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2023-10-11T04:24:06.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-10-11T04:24:06.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2023-10-11T04:24:06.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2023-10-11T04:24:06.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2023-10-11T04:24:06.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-10-11T04:24:06.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (1 ms) 2023-10-11T04:24:06.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2023-10-11T04:24:06.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2023-10-11T04:24:06.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2023-10-11T04:24:06.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2023-10-11T04:24:06.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2023-10-11T04:24:06.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2023-10-11T04:24:06.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2023-10-11T04:24:06.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2023-10-11T04:24:06.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-10-11T04:24:06.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2023-10-11T04:24:06.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2023-10-11T04:24:06.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2023-10-11T04:24:06.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2023-10-11T04:24:06.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2023-10-11T04:24:06.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2023-10-11T04:24:06.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2023-10-11T04:24:06.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-10-11T04:24:06.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2023-10-11T04:24:06.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-10-11T04:24:06.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2023-10-11T04:24:06.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2023-10-11T04:24:06.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2023-10-11T04:24:06.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2023-10-11T04:24:06.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2023-10-11T04:24:06.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2023-10-11T04:24:06.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2023-10-11T04:24:06.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-10-11T04:24:06.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2023-10-11T04:24:06.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2023-10-11T04:24:06.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2023-10-11T04:24:06.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2023-10-11T04:24:06.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2023-10-11T04:24:06.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2023-10-11T04:24:06.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2023-10-11T04:24:06.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-10-11T04:24:06.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2023-10-11T04:24:06.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2023-10-11T04:24:06.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2023-10-11T04:24:06.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2023-10-11T04:24:06.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2023-10-11T04:24:06.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-10-11T04:24:06.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2023-10-11T04:24:06.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-10-11T04:24:06.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2023-10-11T04:24:06.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-10-11T04:24:06.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2023-10-11T04:24:06.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-10-11T04:24:06.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2023-10-11T04:24:06.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-10-11T04:24:06.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2023-10-11T04:24:06.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-10-11T04:24:06.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2023-10-11T04:24:06.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-10-11T04:24:06.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2023-10-11T04:24:06.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2023-10-11T04:24:06.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2023-10-11T04:24:06.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-10-11T04:24:06.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2023-10-11T04:24:06.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-10-11T04:24:06.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2023-10-11T04:24:06.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2023-10-11T04:24:06.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2023-10-11T04:24:06.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-10-11T04:24:06.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2023-10-11T04:24:06.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-10-11T04:24:06.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2023-10-11T04:24:06.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-10-11T04:24:06.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2023-10-11T04:24:06.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-10-11T04:24:06.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2023-10-11T04:24:06.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2023-10-11T04:24:06.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2023-10-11T04:24:06.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-10-11T04:24:06.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:06.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:06.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2023-10-11T04:24:06.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-10-11T04:24:06.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:06.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:07.170 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2023-10-11T04:24:07.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-10-11T04:24:07.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:07.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.171 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:07.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2023-10-11T04:24:07.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-10-11T04:24:07.172 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:07.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.173 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:07.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2023-10-11T04:24:07.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-10-11T04:24:07.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-11T04:24:07.174 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-11T04:24:07.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2023-10-11T04:24:07.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2023-10-11T04:24:07.175 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-10-11T04:24:07.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2023-10-11T04:24:07.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:373: Skipped 2023-10-11T04:24:07.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2023-10-11T04:24:07.176 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-11T04:24:07.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-11T04:24:07.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2023-10-11T04:24:07.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2023-10-11T04:24:07.177 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-11T04:24:07.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-11T04:24:07.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.178 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2023-10-11T04:24:07.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2023-10-11T04:24:07.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-11T04:24:07.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-11T04:24:07.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.179 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2023-10-11T04:24:07.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2023-10-11T04:24:07.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-11T04:24:07.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-11T04:24:07.180 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2023-10-11T04:24:07.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/testcase_cxx.cc:381: Skipped 2023-10-11T04:24:07.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (0 ms total) 2023-10-11T04:24:07.181 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-10-11T04:24:07.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2023-10-11T04:24:07.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6267: Skipped 2023-10-11T04:24:07.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2023-10-11T04:24:07.182 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2023-10-11T04:24:07.183 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2023-10-11T04:24:07.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.184 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2023-10-11T04:24:07.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2023-10-11T04:24:07.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.185 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2023-10-11T04:24:07.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-10-11T04:24:07.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.186 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2023-10-11T04:24:07.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2023-10-11T04:24:07.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.187 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2023-10-11T04:24:07.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2023-10-11T04:24:07.188 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2023-10-11T04:24:07.189 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2023-10-11T04:24:07.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.190 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2023-10-11T04:24:07.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2023-10-11T04:24:07.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.191 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2023-10-11T04:24:07.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2023-10-11T04:24:07.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.192 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2023-10-11T04:24:07.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2023-10-11T04:24:07.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.193 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2023-10-11T04:24:07.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2023-10-11T04:24:07.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.194 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2023-10-11T04:24:07.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-10-11T04:24:07.195 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2023-10-11T04:24:07.196 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-10-11T04:24:07.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2023-10-11T04:24:07.197 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2023-10-11T04:24:07.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.198 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2023-10-11T04:24:07.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2023-10-11T04:24:07.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.199 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2023-10-11T04:24:07.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-10-11T04:24:07.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2023-10-11T04:24:07.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2023-10-11T04:24:07.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2023-10-11T04:24:07.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2023-10-11T04:24:07.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2023-10-11T04:24:07.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-10-11T04:24:07.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2023-10-11T04:24:07.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2023-10-11T04:24:07.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2023-10-11T04:24:07.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-10-11T04:24:07.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.206 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2023-10-11T04:24:07.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-10-11T04:24:07.207 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-11T04:24:07.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-11T04:24:07.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2023-10-11T04:24:07.208 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/tier_cxx.cc:6272: Skipped 2023-10-11T04:24:07.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-11T04:24:07.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2023-10-11T04:24:07.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-10-11T04:24:07.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] Global test environment tear-down 2023-10-11T04:24:07.209 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (6073 ms total) 2023-10-11T04:24:07.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ PASSED ] 0 tests. 2023-10-11T04:24:07.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] 77 tests, listed below: 2023-10-11T04:24:07.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty 2023-10-11T04:24:07.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2023-10-11T04:24:07.210 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone 2023-10-11T04:24:07.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2023-10-11T04:24:07.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote 2023-10-11T04:24:07.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2023-10-11T04:24:07.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-10-11T04:24:07.211 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-10-11T04:24:07.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2023-10-11T04:24:07.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-10-11T04:24:07.212 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict 2023-10-11T04:24:07.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2023-10-11T04:24:07.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2023-10-11T04:24:07.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2023-10-11T04:24:07.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-10-11T04:24:07.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2023-10-11T04:24:07.213 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush 2023-10-11T04:24:07.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2023-10-11T04:24:07.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-10-11T04:24:07.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-10-11T04:24:07.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2023-10-11T04:24:07.214 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2023-10-11T04:24:07.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2023-10-11T04:24:07.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-10-11T04:24:07.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2023-10-11T04:24:07.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2023-10-11T04:24:07.215 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2023-10-11T04:24:07.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-10-11T04:24:07.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2023-10-11T04:24:07.216 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2023-10-11T04:24:07.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-10-11T04:24:07.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-10-11T04:24:07.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-10-11T04:24:07.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-10-11T04:24:07.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-10-11T04:24:07.217 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-10-11T04:24:07.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-10-11T04:24:07.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2023-10-11T04:24:07.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-10-11T04:24:07.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-10-11T04:24:07.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2023-10-11T04:24:07.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-10-11T04:24:07.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-10-11T04:24:07.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-10-11T04:24:07.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-10-11T04:24:07.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2023-10-11T04:24:07.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-10-11T04:24:07.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-10-11T04:24:07.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-10-11T04:24:07.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-10-11T04:24:07.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-10-11T04:24:07.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty 2023-10-11T04:24:07.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2023-10-11T04:24:07.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2023-10-11T04:24:07.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone 2023-10-11T04:24:07.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2023-10-11T04:24:07.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2023-10-11T04:24:07.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2023-10-11T04:24:07.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-10-11T04:24:07.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2023-10-11T04:24:07.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2023-10-11T04:24:07.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2023-10-11T04:24:07.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2023-10-11T04:24:07.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2023-10-11T04:24:07.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2023-10-11T04:24:07.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2023-10-11T04:24:07.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-10-11T04:24:07.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-10-11T04:24:07.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2023-10-11T04:24:07.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2023-10-11T04:24:07.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-10-11T04:24:07.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2023-10-11T04:24:07.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2023-10-11T04:24:07.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-10-11T04:24:07.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2023-10-11T04:24:07.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-10-11T04:24:07.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-10-11T04:24:07.226 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-10-11T04:24:07.227 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83736 2023-10-11T04:24:07.227 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 83736 2023-10-11T04:24:07.973 INFO:tasks.workunit.client.0.smithi050.stdout:287 -- osd_op(unknown.0.0:9 8.1 8:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d4c60 con 0x55585073d170 2023-10-11T04:24:07.973 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:06.118+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 8 ==== osd_op_reply(9 exist [write 0~5] v20'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:07.974 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (221 ms) 2023-10-11T04:24:07.974 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2023-10-11T04:24:07.974 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:06.118+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:10 8.1 8:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d5110 con 0x55585073d170 2023-10-11T04:24:07.974 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.068+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 9 ==== osd_op_reply(10 exist [write 0~5] v20'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:07.974 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (950 ms) 2023-10-11T04:24:07.975 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2023-10-11T04:24:07.975 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.068+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:11 8.1 8:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507f76d0 con 0x55585073d170 2023-10-11T04:24:07.975 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.964+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 10 ==== osd_op_reply(11 exist [write 0~5] v21'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:07.975 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (896 ms) 2023-10-11T04:24:07.975 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2023-10-11T04:24:07.976 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.964+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:12 8.1 8:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d3c50 con 0x55585073d170 2023-10-11T04:24:07.976 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.964+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:13 8.1 8:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d45a0 con 0x55585073d170 2023-10-11T04:24:07.976 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.967+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 11 ==== osd_op_reply(12 exist [read 0~5 out=5b] v21'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:07.976 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.968+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 12 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:07.976 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (4 ms) 2023-10-11T04:24:07.977 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2023-10-11T04:24:07.977 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.968+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:14 8.1 8:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d4100 con 0x55585073d170 2023-10-11T04:24:07.977 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.968+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:15 8.1 8:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507f7b10 con 0x55585073d170 2023-10-11T04:24:08.906 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.973+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v21'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:08.906 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.973+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:08.906 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (6 ms) 2023-10-11T04:24:08.907 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2023-10-11T04:24:08.907 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.974+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:16 8.1 8:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d4100 con 0x55585073d170 2023-10-11T04:24:08.907 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.974+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:17 8.1 8:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507f7690 con 0x55585073d170 2023-10-11T04:24:08.907 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.979+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v21'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:08.907 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.980+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:08.908 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2023-10-11T04:24:08.908 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2023-10-11T04:24:08.908 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:07.980+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:18 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d45b0 con 0x55585073d170 2023-10-11T04:24:08.908 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.634+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 17 ==== osd_op_reply(18 exist [writefull 0~5] v22'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:08.908 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (655 ms) 2023-10-11T04:24:08.908 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2023-10-11T04:24:08.909 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.635+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:19 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d45b0 con 0x55585073d170 2023-10-11T04:24:08.909 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.778+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 18 ==== osd_op_reply(19 exist [writefull 0~5] v23'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:08.909 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (143 ms) 2023-10-11T04:24:08.909 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2023-10-11T04:24:08.909 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.778+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 --> v2:172.21.15.151:6805/361867287 -- osd_op(unknown.0.0:20 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5558507d4100 con 0x55585073d170 2023-10-11T04:24:08.910 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.905+0000 7fea3639b640 1 -- 172.21.15.50:0/811177921 <== osd.3 v2:172.21.15.151:6805/361867287 19 ==== osd_op_reply(20 exist [writefull 0~5] v23'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea2c00c430 con 0x55585073d170 2023-10-11T04:24:08.910 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (128 ms) 2023-10-11T04:24:08.910 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 >> v2:172.21.15.151:6805/361867287 conn(0x55585073d170 msgr2=0x5558507221b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:24:08.911 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 --2- 172.21.15.50:0/811177921 >> v2:172.21.15.151:6805/361867287 conn(0x55585073d170 0x5558507221b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:08.911 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fea18036190 msgr2=0x7fea180386a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:24:08.911 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 --2- 172.21.15.50:0/811177921 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fea18036190 0x7fea180386a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:08.911 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 msgr2=0x555850721760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-11T04:24:08.911 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 --2- 172.21.15.50:0/811177921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x555850721760 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:08.912 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 shutdown_connections 2023-10-11T04:24:08.912 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 --2- 172.21.15.50:0/811177921 >> [v2:172.21.15.151:6800/3619362033,v1:172.21.15.151:6801/3619362033] conn(0x7fea18036190 0x7fea180386a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:08.912 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 --2- 172.21.15.50:0/811177921 >> v2:172.21.15.151:6805/361867287 conn(0x55585073d170 0x5558507221b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:08.912 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 --2- 172.21.15.50:0/811177921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555850735bf0 0x555850721760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T04:24:08.912 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 >> 172.21.15.50:0/811177921 conn(0x5558505aed80 msgr2=0x55585067d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-11T04:24:08.913 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 shutdown_connections 2023-10-11T04:24:08.913 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.906+0000 7fea3cb28640 1 -- 172.21.15.50:0/811177921 wait complete. 2023-10-11T04:24:08.913 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] 12 tests from AsioRados (5044 ms total) 2023-10-11T04:24:08.913 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-10-11T04:24:08.913 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] Global test environment tear-down 2023-10-11T04:24:08.914 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (7928 ms total) 2023-10-11T04:24:08.914 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ PASSED ] 12 tests. 2023-10-11T04:24:08.914 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-10-11T04:24:08.915 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=83981 2023-10-11T04:24:08.915 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 83981 2023-10-11T04:24:09.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-11T04:24:15.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2023-10-11T04:24:20.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~11s 2023-10-11T04:24:26.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~17s 2023-10-11T04:24:28.718 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2023-10-11T04:24:28.718 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] Global test environment set-up. 2023-10-11T04:24:28.719 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] 4 tests from LibRadosService 2023-10-11T04:24:28.719 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2023-10-11T04:24:28.719 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:01.212+0000 7f049cc2e7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:28.719 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:01.212+0000 7f049cc2e7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:28.719 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:01.213+0000 7f049cc2e7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:28.720 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5181 ms) 2023-10-11T04:24:28.720 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2023-10-11T04:24:28.720 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.RegisterLate (35 ms) 2023-10-11T04:24:28.720 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2023-10-11T04:24:28.720 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2023-10-11T04:24:28.721 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:24:28.721 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2023-10-11T04:24:28.721 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 9 pool(s) do not have an application enabled 2023-10-11T04:24:28.721 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.721 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2023-10-11T04:24:28.722 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 1 daemons, quorum a (age 87s) 2023-10-11T04:24:28.722 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: x(active, since 83s) 2023-10-11T04:24:28.722 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 4 osds: 4 up (since 81s), 4 in (since 85s) 2023-10-11T04:24:28.722 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 2 daemons active (1 hosts) 2023-10-11T04:24:28.723 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.723 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2023-10-11T04:24:28.723 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 28 pools, 841 pgs 2023-10-11T04:24:28.723 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 2 objects, 577 KiB 2023-10-11T04:24:28.723 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-10-11T04:24:28.724 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 98.930% pgs unknown 2023-10-11T04:24:28.724 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 832 unknown 2023-10-11T04:24:28.724 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 9 active+clean 2023-10-11T04:24:28.724 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.724 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.724 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2023-10-11T04:24:28.725 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 56da8739-9c2f-410c-8b66-6ff166a3873a 2023-10-11T04:24:28.725 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2023-10-11T04:24:28.725 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 8 pool(s) do not have an application enabled 2023-10-11T04:24:28.725 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.725 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2023-10-11T04:24:28.726 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 1 daemons, quorum a (age 89s) 2023-10-11T04:24:28.726 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: x(active, since 85s) 2023-10-11T04:24:28.726 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 4 osds: 4 up (since 83s), 4 in (since 87s) 2023-10-11T04:24:28.726 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2023-10-11T04:24:28.726 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-10-11T04:24:28.727 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.727 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2023-10-11T04:24:28.727 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 27 pools, 809 pgs 2023-10-11T04:24:28.727 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 9 objects, 577 KiB 2023-10-11T04:24:28.727 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-10-11T04:24:28.728 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 66.625% pgs unknown 2023-10-11T04:24:28.728 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 12.855% pgs not active 2023-10-11T04:24:28.728 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 539 unknown 2023-10-11T04:24:28.728 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 166 active+clean 2023-10-11T04:24:28.728 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 87 creating+peering 2023-10-11T04:24:28.728 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 17 creating+activating 2023-10-11T04:24:28.729 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.729 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2023-10-11T04:24:28.729 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1.7 KiB/s rd, 1.7 KiB/s wr, 1 op/s rd, 1 op/s wr 2023-10-11T04:24:28.729 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.729 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.730 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2248 ms) 2023-10-11T04:24:28.730 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.Status 2023-10-11T04:24:28.730 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.Status (20040 ms) 2023-10-11T04:24:28.730 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] 4 tests from LibRadosService (27504 ms total) 2023-10-11T04:24:28.730 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-10-11T04:24:28.730 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] Global test environment tear-down 2023-10-11T04:24:28.733 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27504 ms total) 2023-10-11T04:24:28.733 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ PASSED ] 4 tests. 2023-10-11T04:24:31.308 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: Running main() from gmock_main.cc 2023-10-11T04:24:31.308 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2023-10-11T04:24:31.308 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] Global test environment set-up. 2023-10-11T04:24:31.308 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] 9 tests from LibRadosPools 2023-10-11T04:24:31.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2023-10-11T04:24:31.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolList (3093 ms) 2023-10-11T04:24:31.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2023-10-11T04:24:31.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3020 ms) 2023-10-11T04:24:31.309 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2023-10-11T04:24:31.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3023 ms) 2023-10-11T04:24:31.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2023-10-11T04:24:31.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3015 ms) 2023-10-11T04:24:31.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2023-10-11T04:24:31.310 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3020 ms) 2023-10-11T04:24:31.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2023-10-11T04:24:31.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5023 ms) 2023-10-11T04:24:31.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2023-10-11T04:24:31.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5030 ms) 2023-10-11T04:24:31.311 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2023-10-11T04:24:31.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5026 ms) 2023-10-11T04:24:31.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2023-10-11T04:24:31.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6684-g9587ffdf/rpm/el9/BUILD/ceph-18.0.0-6684-g9587ffdf/src/test/librados/pool.cc:139: Skipped 2023-10-11T04:24:31.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: Not supported by crimson yet. Skipped 2023-10-11T04:24:31.312 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2023-10-11T04:24:31.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] 9 tests from LibRadosPools (30250 ms total) 2023-10-11T04:24:31.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: 2023-10-11T04:24:31.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] Global test environment tear-down 2023-10-11T04:24:31.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (30250 ms total) 2023-10-11T04:24:31.313 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ PASSED ] 8 tests. 2023-10-11T04:24:31.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ SKIPPED ] 1 test, listed below: 2023-10-11T04:24:31.314 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier 2023-10-11T04:24:31.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~22s 2023-10-11T04:24:36.648 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2023-10-11T04:24:36.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] Global test environment set-up. 2023-10-11T04:24:36.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2023-10-11T04:24:36.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2023-10-11T04:24:36.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-10-11T04:24:01.232+0000 7f9c363487c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:36.649 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-10-11T04:24:01.233+0000 7f9c363487c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:36.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-10-11T04:24:01.233+0000 7f9c363487c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:24:36.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5160 ms) 2023-10-11T04:24:36.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2023-10-11T04:24:36.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (93 ms) 2023-10-11T04:24:36.650 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2023-10-11T04:24:36.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20043 ms) 2023-10-11T04:24:36.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2023-10-11T04:24:36.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: attempt 0 of 20 2023-10-11T04:24:36.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: failed to deregister: 2023-10-11T04:24:36.651 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: { 2023-10-11T04:24:36.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "epoch": 7, 2023-10-11T04:24:36.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "modified": "2023-10-11T04:24:29.351354+0000", 2023-10-11T04:24:36.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "services": { 2023-10-11T04:24:36.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "laundry": { 2023-10-11T04:24:36.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "daemons": { 2023-10-11T04:24:36.652 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "summary": "", 2023-10-11T04:24:36.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "close-test-pid84431": { 2023-10-11T04:24:36.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "start_epoch": 6, 2023-10-11T04:24:36.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "start_stamp": "2023-10-11T04:24:26.564974+0000", 2023-10-11T04:24:36.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "gid": 4383, 2023-10-11T04:24:36.653 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "addr": "172.21.15.50:0/3424473880", 2023-10-11T04:24:36.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "metadata": { 2023-10-11T04:24:36.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "arch": "x86_64", 2023-10-11T04:24:36.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "ceph_release": "reef", 2023-10-11T04:24:36.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "ceph_version": "ceph version 18.0.0-6684-g9587ffdf (9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5) reef (dev)", 2023-10-11T04:24:36.654 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "ceph_version_short": "18.0.0-6684-g9587ffdf", 2023-10-11T04:24:36.655 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2023-10-11T04:24:36.655 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "distro": "centos", 2023-10-11T04:24:36.655 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2023-10-11T04:24:36.655 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "distro_version": "9", 2023-10-11T04:24:36.655 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "foo": "bar", 2023-10-11T04:24:36.655 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "hostname": "smithi050", 2023-10-11T04:24:36.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Oct 5 02:38:42 UTC 2023", 2023-10-11T04:24:36.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "kernel_version": "5.14.0-373.el9.x86_64", 2023-10-11T04:24:36.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "mem_swap_kb": "0", 2023-10-11T04:24:36.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "mem_total_kb": "32482644", 2023-10-11T04:24:36.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "os": "Linux", 2023-10-11T04:24:36.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "this": "that" 2023-10-11T04:24:36.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: }, 2023-10-11T04:24:36.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: "task_status": {} 2023-10-11T04:24:36.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: } 2023-10-11T04:24:36.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: } 2023-10-11T04:24:36.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: } 2023-10-11T04:24:36.658 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: } 2023-10-11T04:24:36.658 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: } 2023-10-11T04:24:36.658 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-10-11T04:24:36.658 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: attempt 1 of 20 2023-10-11T04:24:36.658 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10118 ms) 2023-10-11T04:24:36.659 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35414 ms total) 2023-10-11T04:24:36.659 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-10-11T04:24:36.659 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] Global test environment tear-down 2023-10-11T04:24:36.660 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35414 ms total) 2023-10-11T04:24:36.660 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ PASSED ] 4 tests. 2023-10-11T04:24:37.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~28s 2023-10-11T04:24:42.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-11T04:24:42.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~33s 2023-10-11T04:24:42.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-11T04:24:48.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2023-10-11T04:24:48.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~38s 2023-10-11T04:24:48.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2023-10-11T04:24:53.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~11s 2023-10-11T04:24:53.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~44s 2023-10-11T04:24:53.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~11s 2023-10-11T04:24:58.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~16s 2023-10-11T04:24:58.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~49s 2023-10-11T04:24:58.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~16s 2023-10-11T04:25:03.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~21s 2023-10-11T04:25:03.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~54s 2023-10-11T04:25:03.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~21s 2023-10-11T04:25:05.025 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:24:01.016+0000 7ffa1d282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:25:05.026 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:24:01.017+0000 7ffa1d282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:25:05.026 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2023-10-11T04:25:05.026 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] Global test environment set-up. 2023-10-11T04:25:05.026 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2023-10-11T04:25:05.026 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2023-10-11T04:25:05.027 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2023-10-11T04:25:05.027 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:24:01.017+0000 7ffa1d282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T04:25:05.027 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-10-11T04:25:05.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:25:05.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2023-10-11T04:25:05.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2023-10-11T04:25:05.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: unable to get monitor info from DNS SRV with service name: 2023-10-11T04:24:01.320+0000 7ffa1d282640 -1 failed for service _ceph-mon._tcp 2023-10-11T04:25:05.028 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: ceph-mon 2023-10-11T04:25:05.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:24:01.320+0000 7ffa1d282640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2023-10-11T04:25:05.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (303 ms) 2023-10-11T04:25:05.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2023-10-11T04:25:05.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2007 ms) 2023-10-11T04:25:05.029 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2310 ms total) 2023-10-11T04:25:05.030 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:25:05.030 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2023-10-11T04:25:05.030 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2023-10-11T04:25:05.031 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x7ffa00017ad0 2023-10-11T04:25:05.031 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x7ffa00005de0 2023-10-11T04:25:05.031 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 2 aios 2023-10-11T04:25:05.031 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x7ffa00017ad0 2023-10-11T04:25:05.031 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x7ffa00005de0 2023-10-11T04:25:05.032 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: done. 2023-10-11T04:25:05.032 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (5857 ms) 2023-10-11T04:25:05.032 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (5857 ms total) 2023-10-11T04:25:05.032 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:25:05.032 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2023-10-11T04:25:05.033 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2023-10-11T04:25:05.033 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2023-10-11T04:25:05.033 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2023-10-11T04:25:05.033 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.Exec (709 ms) 2023-10-11T04:25:05.034 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2023-10-11T04:25:05.034 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (23446 ms) 2023-10-11T04:25:05.034 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2023-10-11T04:25:05.034 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (3047 ms) 2023-10-11T04:25:05.034 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2023-10-11T04:25:05.035 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4590 ms) 2023-10-11T04:25:05.035 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2023-10-11T04:25:05.035 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2023-10-11T04:25:05.035 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2023-10-11T04:25:05.035 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2023-10-11T04:25:05.036 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2023-10-11T04:25:05.036 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (21698 ms) 2023-10-11T04:25:05.036 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 8 tests from LibRadosMisc (53490 ms total) 2023-10-11T04:25:05.036 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-10-11T04:25:05.036 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] Global test environment tear-down 2023-10-11T04:25:05.037 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (63995 ms total) 2023-10-11T04:25:05.037 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ PASSED ] 12 tests. 2023-10-11T04:25:09.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~27s 2023-10-11T04:25:09.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-10-11T04:25:09.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~27s 2023-10-11T04:25:14.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~32s 2023-10-11T04:25:14.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2023-10-11T04:25:14.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~32s 2023-10-11T04:25:19.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~37s 2023-10-11T04:25:19.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2023-10-11T04:25:19.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~37s 2023-10-11T04:25:25.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~42s 2023-10-11T04:25:25.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2023-10-11T04:25:25.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~42s 2023-10-11T04:25:30.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~48s 2023-10-11T04:25:30.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~81s 2023-10-11T04:25:30.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~48s 2023-10-11T04:25:35.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2023-10-11T04:25:35.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~86s 2023-10-11T04:25:35.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~53s 2023-10-11T04:25:38.981 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:25:38.979+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:25:41.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2023-10-11T04:25:41.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~91s 2023-10-11T04:25:41.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~58s 2023-10-11T04:25:43.983 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:25:43.981+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:25:46.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2023-10-11T04:25:46.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~97s 2023-10-11T04:25:46.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~64s 2023-10-11T04:25:48.984 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:25:48.982+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:25:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~69s 2023-10-11T04:25:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~102s 2023-10-11T04:25:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~69s 2023-10-11T04:25:53.985 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:25:53.983+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:25:57.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~74s 2023-10-11T04:25:57.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~107s 2023-10-11T04:25:57.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~74s 2023-10-11T04:25:58.986 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:25:58.984+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:02.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2023-10-11T04:26:02.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~113s 2023-10-11T04:26:02.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2023-10-11T04:26:03.987 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:03.987+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:07.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-10-11T04:26:07.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~118s 2023-10-11T04:26:07.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-10-11T04:26:08.989 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:08.989+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:12.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2023-10-11T04:26:12.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2023-10-11T04:26:12.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~90s 2023-10-11T04:26:13.990 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:13.989+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:18.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2023-10-11T04:26:18.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2023-10-11T04:26:18.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2023-10-11T04:26:18.991 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:18.990+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:23.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~101s 2023-10-11T04:26:23.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~134s 2023-10-11T04:26:23.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~101s 2023-10-11T04:26:23.993 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:23.991+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:28.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2023-10-11T04:26:28.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~139s 2023-10-11T04:26:28.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~106s 2023-10-11T04:26:28.994 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:28.993+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:33.995 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:33.994+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:34.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2023-10-11T04:26:34.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~144s 2023-10-11T04:26:34.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~111s 2023-10-11T04:26:38.996 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:38.995+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:39.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2023-10-11T04:26:39.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~150s 2023-10-11T04:26:39.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~117s 2023-10-11T04:26:43.997 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:43.997+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:44.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2023-10-11T04:26:44.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2023-10-11T04:26:44.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~122s 2023-10-11T04:26:48.999 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:48.999+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:50.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~127s 2023-10-11T04:26:50.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2023-10-11T04:26:50.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~127s 2023-10-11T04:26:54.001 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:53.999+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:26:55.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~133s 2023-10-11T04:26:55.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~166s 2023-10-11T04:26:55.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~133s 2023-10-11T04:26:59.002 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:26:59.000+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:00.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~138s 2023-10-11T04:27:00.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~171s 2023-10-11T04:27:00.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~138s 2023-10-11T04:27:04.003 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:04.002+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:05.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~143s 2023-10-11T04:27:05.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~176s 2023-10-11T04:27:05.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~143s 2023-10-11T04:27:09.005 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:09.004+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:11.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~149s 2023-10-11T04:27:11.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~182s 2023-10-11T04:27:11.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~149s 2023-10-11T04:27:14.006 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:14.005+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:16.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~154s 2023-10-11T04:27:16.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~187s 2023-10-11T04:27:16.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~154s 2023-10-11T04:27:19.007 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:19.006+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:21.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~159s 2023-10-11T04:27:21.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~192s 2023-10-11T04:27:21.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~159s 2023-10-11T04:27:24.008 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:24.008+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:27.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~164s 2023-10-11T04:27:27.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~197s 2023-10-11T04:27:27.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~164s 2023-10-11T04:27:29.010 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:29.008+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:32.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2023-10-11T04:27:32.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~203s 2023-10-11T04:27:32.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2023-10-11T04:27:34.011 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:34.010+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:37.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2023-10-11T04:27:37.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~208s 2023-10-11T04:27:37.800 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2023-10-11T04:27:39.012 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:39.011+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:43.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2023-10-11T04:27:43.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~213s 2023-10-11T04:27:43.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~180s 2023-10-11T04:27:44.013 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:44.012+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:48.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~186s 2023-10-11T04:27:48.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~219s 2023-10-11T04:27:48.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~186s 2023-10-11T04:27:49.015 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:49.013+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:53.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~191s 2023-10-11T04:27:53.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~224s 2023-10-11T04:27:53.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~191s 2023-10-11T04:27:54.018 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:54.015+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:27:59.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~196s 2023-10-11T04:27:59.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~229s 2023-10-11T04:27:59.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~196s 2023-10-11T04:27:59.018 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:27:59.016+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:04.018 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:04.018+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:04.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~202s 2023-10-11T04:28:04.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~235s 2023-10-11T04:28:04.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~202s 2023-10-11T04:28:09.020 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:09.018+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:09.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~207s 2023-10-11T04:28:09.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2023-10-11T04:28:09.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~207s 2023-10-11T04:28:14.021 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:14.020+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:14.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~212s 2023-10-11T04:28:14.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2023-10-11T04:28:14.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~212s 2023-10-11T04:28:19.022 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:19.021+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:20.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~218s 2023-10-11T04:28:20.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~251s 2023-10-11T04:28:20.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~218s 2023-10-11T04:28:24.023 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:24.022+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:25.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~223s 2023-10-11T04:28:25.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~256s 2023-10-11T04:28:25.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~223s 2023-10-11T04:28:29.025 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:29.023+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:30.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~228s 2023-10-11T04:28:30.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~261s 2023-10-11T04:28:30.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~228s 2023-10-11T04:28:34.026 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:34.025+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:36.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~233s 2023-10-11T04:28:36.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~266s 2023-10-11T04:28:36.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~233s 2023-10-11T04:28:39.027 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:39.026+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:41.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~239s 2023-10-11T04:28:41.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~272s 2023-10-11T04:28:41.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~239s 2023-10-11T04:28:44.029 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:44.028+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:46.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~244s 2023-10-11T04:28:46.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~277s 2023-10-11T04:28:46.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~244s 2023-10-11T04:28:49.030 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:49.029+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:52.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~249s 2023-10-11T04:28:52.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~282s 2023-10-11T04:28:52.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~249s 2023-10-11T04:28:54.031 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:54.030+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:28:57.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2023-10-11T04:28:57.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~288s 2023-10-11T04:28:57.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2023-10-11T04:28:59.032 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:28:59.031+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:29:02.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2023-10-11T04:29:02.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~293s 2023-10-11T04:29:02.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2023-10-11T04:29:04.033 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:29:04.032+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:29:08.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2023-10-11T04:29:08.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~298s 2023-10-11T04:29:08.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2023-10-11T04:29:09.035 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:29:09.034+0000 7ff930bf6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.50:6801/1516004873 for 29sec e58 v58) 2023-10-11T04:29:13.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~271s 2023-10-11T04:29:13.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~304s 2023-10-11T04:29:13.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~271s 2023-10-11T04:29:13.332 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-11T04:29:13.634 INFO:tasks.ceph.osd.1:Sent signal 15 2023-10-11T04:29:13.635 INFO:tasks.ceph.mon.a:Sent signal 15 2023-10-11T04:29:13.636 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-10-11T04:29:13.636 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:29:13.635+0000 7ff933bfc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 81611) UID: 0 2023-10-11T04:29:13.636 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-11T04:29:13.635+0000 7ff933bfc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-11T04:29:13.638 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:29:13.637+0000 7fa5213f7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 81146) UID: 0 2023-10-11T04:29:13.638 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-11T04:29:13.637+0000 7fa5213f7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-11T05:04:34.829 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: Running main() from gmock_main.cc 2023-10-11T05:04:34.830 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2023-10-11T05:04:34.830 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] Global test environment set-up. 2023-10-11T05:04:34.830 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2023-10-11T05:04:34.830 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2023-10-11T05:04:34.830 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify_test_cb 2023-10-11T05:04:34.831 INFO:tasks.workunit.client.0.smithi050.stderr:bash: line 1: 84212 Alarm clock ceph_test_rados_api_watch_notify 2>&1 2023-10-11T05:04:34.831 INFO:tasks.workunit.client.0.smithi050.stderr: 84213 Done | tee ceph_test_rados_api_watch_notify.log 2023-10-11T05:04:34.831 INFO:tasks.workunit.client.0.smithi050.stderr: 84214 Done | sed "s/^/ api_watch_notify: /" 2023-10-11T05:04:41.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Running main() from gmock_main.cc 2023-10-11T05:04:41.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2023-10-11T05:04:41.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] Global test environment set-up. 2023-10-11T05:04:41.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 26 tests from LibRadosAio 2023-10-11T05:04:41.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2023-10-11T05:04:41.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2220 ms) 2023-10-11T05:04:41.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2023-10-11T05:04:41.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (36833 ms) 2023-10-11T05:04:41.986 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2023-10-11T05:04:41.986 INFO:tasks.workunit.client.0.smithi050.stderr:bash: line 1: 83760 Alarm clock ceph_test_rados_api_aio 2>&1 2023-10-11T05:04:41.986 INFO:tasks.workunit.client.0.smithi050.stderr: 83761 Done | tee ceph_test_rados_api_aio.log 2023-10-11T05:04:41.987 INFO:tasks.workunit.client.0.smithi050.stderr: 83762 Done | sed "s/^/ api_aio: /" 2023-10-11T07:24:00.880 INFO:tasks.workunit.client.0.smithi050.stderr:++ cleanup 2023-10-11T07:24:00.901 INFO:tasks.workunit.client.0.smithi050.stderr:++ pkill -P 83688 2023-10-11T07:24:00.907 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-11T07:24:00.958 INFO:tasks.workunit.client.0.smithi050.stderr:++ true 2023-10-11T07:24:00.958 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2023-10-11T07:24:00.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-11T07:24:01.249 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi050 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-10-11T07:24:01.369 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2f23e419565c435fab3e9fb7140c240f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi050 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-10-11T07:24:01.372 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-11T07:24:01.381 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-11T07:24:01.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-11T07:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.503+0000 7f532e39e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-11T07:24:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.506+0000 7f532e39e640 1 Processor -- start 2023-10-11T07:24:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.507+0000 7f532e39e640 1 -- start start 2023-10-11T07:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.507+0000 7f532e39e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5328134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.507+0000 7f532e39e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f532812f5d0 2023-10-11T07:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.507+0000 7f532e39e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f53281324f0 2023-10-11T07:24:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.507+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5328134910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.507+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f532812f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.507+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5328134910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:01.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.708+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f532812f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:01.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.708+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5328134910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:01.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:01.708+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5328134910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:02.109+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f532812f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:02.109+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5328134910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:02.109+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5328134910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:02.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:02.910+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f532812f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:02.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:02.910+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5328134910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:02.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:02.910+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5328134910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:04.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5328134910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:04.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5328134910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:04.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f532812f9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:04.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5314007820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:04.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f532812f5d0 2023-10-11T07:24:04.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f53281324f0 2023-10-11T07:24:04.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5314007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:04.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5314007820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:04.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.508+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f5314009e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:04.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.709+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5314007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:04.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.709+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f5314009e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:04.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:04.709+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5314007820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:05.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:05.110+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5314007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:05.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:05.110+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f5314009e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:05.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:05.110+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5314007820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:05.911+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5314007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:05.911+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f5314009e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:05.911+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5314007820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 msgr2=0x7f5314007820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53281324f0 0x7f5314007820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f5314009e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f532812f5d0 2023-10-11T07:24:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400b640 2023-10-11T07:24:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.509+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.710+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.710+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:07.710+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:08.111+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:08.111+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:08.111+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:08.912+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:08.912+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:08.912+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f532812f5d0 2023-10-11T07:24:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400b640 2023-10-11T07:24:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.509+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.710+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.710+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:10.710+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:11.111+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:11.111+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:11.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:11.111+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:11.912+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:11.912+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:11.912+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 msgr2=0x7f531400ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400b640 0x7f531400ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f532812f5d0 legacy=0x7f531400a540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 0x7f5314007800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400bab0 2023-10-11T07:24:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400c1e0 2023-10-11T07:24:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.509+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 msgr2=0x7f5314007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.510+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 0x7f5314007800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:13.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.710+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:13.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.711+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 msgr2=0x7f5314007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:13.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:13.711+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 0x7f5314007800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:14.111+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:14.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:14.112+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 msgr2=0x7f5314007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:14.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:14.112+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 0x7f5314007800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:14.912+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:14.913+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 msgr2=0x7f5314007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:14.913+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 0x7f5314007800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:16.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 msgr2=0x7f5314007800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400c1e0 0x7f5314007800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f531400a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400bab0 2023-10-11T07:24:16.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314009e20 2023-10-11T07:24:16.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:16.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:16.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.510+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f531400a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.711+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.711+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:16.711+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f531400a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:17.112+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:17.112+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:17.112+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f531400a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:17.912+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:17.912+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f531400a540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:17.912+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f531400a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:19.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f531400a540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:19.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f531400a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:19.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:19.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400bab0 2023-10-11T07:24:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314009e20 2023-10-11T07:24:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:19.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.509+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.710+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.710+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:19.710+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:20.111+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:20.111+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:20.111+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:20.912+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:20.912+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:20.912+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.509+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.509+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400bab0 legacy=0x7f531400acf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.509+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.509+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400a230 2023-10-11T07:24:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.509+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314009e20 2023-10-11T07:24:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.510+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400a230 legacy=0x7f531400f7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.510+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.510+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.711+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.711+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400a230 legacy=0x7f531400f7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:22.711+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:23.112+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400a230 legacy=0x7f531400f7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:23.112+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:23.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:23.112+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:23.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:23.913+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:23.913+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400a230 legacy=0x7f531400f7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:23.913+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f53140077a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f53140077a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400a230 legacy=0x7f531400f7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400acf0 2023-10-11T07:24:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314009e20 2023-10-11T07:24:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.510+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.711+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.711+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:25.711+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:26.112+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:26.112+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:26.112+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:26.913+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:26.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:26.913+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:26.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:26.913+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400acf0 2023-10-11T07:24:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314009e20 2023-10-11T07:24:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.510+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.711+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.711+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:28.711+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:29.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:29.112+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:29.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:29.112+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:29.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:29.112+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:29.913+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:29.913+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:29.913+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 msgr2=0x7f5314007780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:31.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314009e20 0x7f5314007780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:31.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:31.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 0x7f5314010310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400acf0 2023-10-11T07:24:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400def0 2023-10-11T07:24:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 msgr2=0x7f5314010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.511+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 0x7f5314010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.712+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 msgr2=0x7f5314010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.712+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:31.712+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 0x7f5314010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:32.113+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:32.113+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 msgr2=0x7f5314010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:32.113+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 0x7f5314010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:32.914+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:32.914+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 msgr2=0x7f5314010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:32.914+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 0x7f5314010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:34.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 msgr2=0x7f5314010310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:34.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400def0 0x7f5314010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:34.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:34.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 0x7f5314010850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:34.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400acf0 2023-10-11T07:24:34.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314005770 2023-10-11T07:24:34.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 msgr2=0x7f5314010850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:34.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:34.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.511+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 0x7f5314010850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.712+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 msgr2=0x7f5314010850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.712+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:34.712+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 0x7f5314010850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:35.113+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 msgr2=0x7f5314010850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:35.113+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:35.113+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 0x7f5314010850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:35.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:35.914+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 msgr2=0x7f5314010850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:35.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:35.914+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:35.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:35.914+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 0x7f5314010850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:37.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 msgr2=0x7f5314010850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314005770 0x7f5314010850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f531400e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400acf0 2023-10-11T07:24:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400e300 2023-10-11T07:24:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f531400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.511+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f531400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:37.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.712+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f531400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:37.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.712+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:37.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:37.712+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f531400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:38.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:38.113+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:38.113+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f531400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:38.113+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f531400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:38.914+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:38.914+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f531400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:38.914+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f531400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f531400e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:40.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f531400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:40.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 0x7f5314011070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400acf0 2023-10-11T07:24:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400ec50 2023-10-11T07:24:40.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 msgr2=0x7f5314011070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:40.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:40.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.511+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 0x7f5314011070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.712+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.712+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 msgr2=0x7f5314011070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:40.712+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 0x7f5314011070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:41.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:41.113+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:41.113+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 msgr2=0x7f5314011070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:41.113+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 0x7f5314011070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:41.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:41.914+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 msgr2=0x7f5314011070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:41.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:41.914+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:41.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:41.914+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 0x7f5314011070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:43.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 msgr2=0x7f5314011070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:43.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ec50 0x7f5314011070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:43.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:43.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 0x7f53140115b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:43.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400acf0 2023-10-11T07:24:43.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400d7e0 2023-10-11T07:24:43.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:43.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 msgr2=0x7f53140115b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:43.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.512+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 0x7f53140115b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:43.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.713+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 msgr2=0x7f53140115b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.713+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:43.713+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 0x7f53140115b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:44.114+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 msgr2=0x7f53140115b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:44.114+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:44.114+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 0x7f53140115b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:44.915+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:44.915+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 msgr2=0x7f53140115b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:44.915+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 0x7f53140115b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:46.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 msgr2=0x7f53140115b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d7e0 0x7f53140115b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400acf0 2023-10-11T07:24:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400ea10 2023-10-11T07:24:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:46.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.512+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:46.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.713+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.713+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:46.713+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:47.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:47.114+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:47.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:47.114+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:47.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:47.114+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:47.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:47.915+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:47.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:47.915+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:47.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:47.915+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400acf0 legacy=0x7f531400e300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400d7e0 2023-10-11T07:24:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400ea10 2023-10-11T07:24:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f5314011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.513+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.714+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.714+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f5314011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:49.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:49.714+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:50.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:50.115+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f5314011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:50.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:50.115+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:50.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:50.115+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:50.916+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f5314011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:50.916+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:50.916+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 msgr2=0x7f5314010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400ea10 0x7f5314010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f5314011370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400d7e0 2023-10-11T07:24:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400e300 2023-10-11T07:24:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.513+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:52.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.714+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:52.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.714+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:52.714+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:53.115+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:53.115+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:53.115+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:53.916+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:53.916+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:53.916+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:55.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:55.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d7e0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400c7d0 2023-10-11T07:24:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400e300 2023-10-11T07:24:55.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:55.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:55.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.514+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.715+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.715+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:55.715+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:56.116+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:56.116+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:56.116+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:56.916+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:56.916+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:56.916+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:24:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:24:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:24:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:24:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400c7d0 2023-10-11T07:24:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400e300 2023-10-11T07:24:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.513+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:24:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.714+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:58.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.714+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:58.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:58.714+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:24:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:59.115+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:59.115+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:59.115+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:24:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:59.916+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:24:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:59.916+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:24:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:24:59.916+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400c7d0 legacy=0x7f53140092f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400cbe0 2023-10-11T07:25:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400e300 2023-10-11T07:25:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.513+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.714+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:01.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.714+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:01.714+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:02.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:02.115+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:02.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:02.115+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:02.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:02.115+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:02.916+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:02.916+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:02.916+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:04.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 msgr2=0x7f5314008d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:04.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400e300 0x7f5314008d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:04.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:04.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:04.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f5314008d90 2023-10-11T07:25:04.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f53140092d0 2023-10-11T07:25:04.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:04.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f5314005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:04.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.514+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:04.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.715+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f5314005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:04.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.715+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:04.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:04.715+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:05.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:05.116+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f5314005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:05.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:05.116+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:05.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:05.116+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:05.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:05.917+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f5314005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:05.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:05.917+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:05.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:05.917+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f5314005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f5314008d90 2023-10-11T07:25:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f53140092d0 2023-10-11T07:25:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.514+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.715+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.715+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:07.715+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:08.116+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:08.116+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:08.116+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:08.917+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:08.917+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:08.917+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400d2f0 2023-10-11T07:25:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f53140092d0 2023-10-11T07:25:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314012e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.514+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.715+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.715+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:10.715+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314012e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:11.116+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:11.116+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314012e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:11.116+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:11.917+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:11.917+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314012e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:11.917+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:13.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:13.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314012e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:13.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:13.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400cbe0 2023-10-11T07:25:13.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f53140092d0 2023-10-11T07:25:13.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:13.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:13.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.515+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.716+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.716+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:13.716+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:14.117+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:14.117+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:14.117+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:14.918+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:14.918+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:14.918+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140092d0 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314008490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400cbe0 2023-10-11T07:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400cff0 2023-10-11T07:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314008490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.515+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314008490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:16.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.716+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314008490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:16.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.716+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:16.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:16.716+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314008490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:17.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:17.117+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314008490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:17.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:17.117+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:17.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:17.117+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314008490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:17.918+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314008490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:17.918+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:17.918+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314008490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314008490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314008490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400cbe0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314007d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:19.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f53140089d0 2023-10-11T07:25:19.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400cff0 2023-10-11T07:25:19.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:19.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:19.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.515+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.716+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.716+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:19.716+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:20.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:20.117+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:20.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:20.117+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:20.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:20.117+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:20.918+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:20.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:20.918+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:20.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:20.918+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cff0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f53140089d0 2023-10-11T07:25:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400cbe0 2023-10-11T07:25:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.516+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140082c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.717+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.717+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:22.717+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140082c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:23.118+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:23.118+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:23.118+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140082c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:23.919+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:23.919+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:23.919+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140082c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:25.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:25.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140082c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:25.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f53140089d0 2023-10-11T07:25:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400cbe0 2023-10-11T07:25:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.515+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.717+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.717+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:25.717+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:26.118+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:26.118+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:26.118+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:26.919+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:26.919+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:26.919+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f53140092d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f53140092d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f53140089d0 2023-10-11T07:25:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314008de0 2023-10-11T07:25:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.517+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.718+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.718+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:28.718+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:29.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:29.119+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:29.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:29.119+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:29.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:29.119+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:29.920+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:29.920+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:29.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:29.920+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:31.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:31.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140089d0 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f531400d2f0 2023-10-11T07:25:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314008de0 2023-10-11T07:25:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.517+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:31.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.718+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.718+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:31.718+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:32.119+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:32.119+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:32.119+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:32.920+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:32.920+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:32.920+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:34.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:34.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:34.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:34.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 0x7f53140088a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:34.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f531400d2f0 2023-10-11T07:25:34.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314008490 2023-10-11T07:25:34.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:34.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.517+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 msgr2=0x7f53140088a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:34.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.518+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 0x7f53140088a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.719+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.719+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 msgr2=0x7f53140088a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:34.719+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 0x7f53140088a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:35.119+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:35.119+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 msgr2=0x7f53140088a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:35.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:35.119+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 0x7f53140088a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:35.920+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:35.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:35.920+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 msgr2=0x7f53140088a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:35.920+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 0x7f53140088a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:37.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 msgr2=0x7f53140088a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:37.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008490 0x7f53140088a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:37.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f531400d2f0 legacy=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:37.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:37.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f53140092d0 2023-10-11T07:25:37.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314008de0 2023-10-11T07:25:37.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:37.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:37.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.517+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:37.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.718+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:37.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.718+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:37.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:37.718+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:38.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:38.119+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:38.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:38.119+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:38.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:38.119+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:38.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:38.920+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:38.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:38.920+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:38.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:38.920+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:40.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:40.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:40.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:40.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:40.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f5314007d80 2023-10-11T07:25:40.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400d120 2023-10-11T07:25:40.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314007d80 legacy=0x7f5314008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:40.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:40.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.517+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.718+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:40.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.718+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314007d80 legacy=0x7f5314008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:40.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:40.718+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:41.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:41.119+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314007d80 legacy=0x7f5314008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:41.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:41.119+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:41.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:41.119+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:41.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:41.920+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314007d80 legacy=0x7f5314008190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:41.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:41.920+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:41.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:41.920+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:43.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:43.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314007d80 legacy=0x7f5314008190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:43.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f53140092d0 2023-10-11T07:25:43.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400d120 2023-10-11T07:25:43.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:43.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:43.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.517+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.718+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.718+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:43.718+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:44.119+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:44.119+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:44.119+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:44.920+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:44.920+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:44.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:44.920+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:46.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 msgr2=0x7f53140096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:46.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400d120 0x7f53140096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140092d0 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f5314007d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f53140082c0 2023-10-11T07:25:46.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f531400cbe0 2023-10-11T07:25:46.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140082c0 legacy=0x7f53140086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:46.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:46.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.518+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.719+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.719+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140082c0 legacy=0x7f53140086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:46.719+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:47.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:47.120+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140082c0 legacy=0x7f53140086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:47.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:47.120+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:47.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:47.120+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:47.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:47.921+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140082c0 legacy=0x7f53140086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:47.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:47.921+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:47.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:47.921+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 msgr2=0x7f5314007d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f531400cbe0 0x7f5314007d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f53140082c0 legacy=0x7f53140086d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f5314009270 2023-10-11T07:25:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314008de0 2023-10-11T07:25:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.518+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:49.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.719+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.719+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:49.719+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:50.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:50.120+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:50.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:50.120+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:50.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:50.120+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:50.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:50.921+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:50.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:50.921+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:50.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:50.921+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f531400cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f531400cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314015e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f5314009270 2023-10-11T07:25:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314008de0 2023-10-11T07:25:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.518+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.719+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.719+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:52.719+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:53.120+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:53.120+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:53.120+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:53.921+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:53.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:53.921+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:53.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:53.921+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 msgr2=0x7f5314009680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314008de0 0x7f5314009680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:55.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 0x7f5314013250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:55.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806e400 con 0x7f5314009270 2023-10-11T07:25:55.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f5314010e30 2023-10-11T07:25:55.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:55.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 msgr2=0x7f5314013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:55.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.519+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 0x7f5314013250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.720+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 msgr2=0x7f5314013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.720+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:55.720+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 0x7f5314013250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:56.121+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 msgr2=0x7f5314013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:56.121+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:56.121+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 0x7f5314013250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:56.922+0000 7f5327fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 msgr2=0x7f5314013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:56.922+0000 7f53277fe640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314009680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:56.922+0000 7f5327fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 0x7f5314013250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:25:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f5325ffb640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 msgr2=0x7f5314013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5314010e30 0x7f5314013250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-11T07:25:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f5325ffb640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314009270 legacy=0x7f5314009680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-11T07:25:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f5325ffb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 0x7f5314016bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-11T07:25:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f5325ffb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806dcb0 con 0x7f5314008d90 2023-10-11T07:25:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f5325ffb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532809a630 con 0x7f53140147a0 2023-10-11T07:25:58.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:58.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 msgr2=0x7f5314016bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:58.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.519+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 0x7f5314016bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-11T07:25:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.720+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 msgr2=0x7f5314016bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.720+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:58.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:58.720+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 0x7f5314016bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-11T07:25:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:59.121+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 msgr2=0x7f5314016bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:59.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:59.121+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:59.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:59.121+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 0x7f5314016bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-11T07:25:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:59.922+0000 7f5327fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f5314008d90 legacy=0x7f531400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-10-11T07:25:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:59.922+0000 7f53277fe640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 msgr2=0x7f5314016bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-10-11T07:25:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-11T07:25:59.922+0000 7f53277fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53140147a0 0x7f5314016bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-11T07:26:01.431 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-11T07:26:01.432 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-11T07:26:01.496 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-11T07:26:01.497 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-11T07:26:01.497 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-11T07:26:01.498 INFO:teuthology.orchestra.run:waiting for 300 2023-10-11T07:26:01.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:01.500 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log' 2023-10-11T07:26:01.513 INFO:tasks.ceph.osd.0:Stopped 2023-10-11T07:26:01.514 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-11T07:26:01.514 INFO:teuthology.orchestra.run:waiting for 300 2023-10-11T07:26:01.587 INFO:tasks.ceph.osd.1:Stopped 2023-10-11T07:26:01.587 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-11T07:26:01.588 INFO:teuthology.orchestra.run:waiting for 300 2023-10-11T07:26:01.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:01.589 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi151 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log' 2023-10-11T07:26:01.600 INFO:tasks.ceph.osd.2:Stopped 2023-10-11T07:26:01.600 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-11T07:26:01.601 INFO:teuthology.orchestra.run:waiting for 300 2023-10-11T07:26:01.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:01.602 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi151 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log' 2023-10-11T07:26:01.612 INFO:tasks.ceph.osd.3:Stopped 2023-10-11T07:26:01.613 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-11T07:26:01.613 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-11T07:26:01.613 INFO:teuthology.orchestra.run:waiting for 300 2023-10-11T07:26:01.614 INFO:tasks.ceph.mgr.x:Stopped 2023-10-11T07:26:01.615 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-11T07:26:01.615 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-11T07:26:01.616 INFO:teuthology.orchestra.run:waiting for 300 2023-10-11T07:26:01.616 INFO:tasks.ceph.mon.a:Stopped 2023-10-11T07:26:01.617 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-11T07:26:01.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-11T07:26:01.656 INFO:teuthology.orchestra.run.smithi050.stdout:2023-10-11T04:24:33.311824+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-11T07:26:01.657 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-11T07:26:01.658 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-11T07:26:01.658 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-11T07:26:01.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-11T07:26:01.803 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-11T07:26:01.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-11T07:26:01.869 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-11T07:26:01.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-11T07:26:01.994 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-11T07:26:02.040 INFO:tasks.ceph:Archiving mon data... 2023-10-11T07:26:02.042 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/data/mon.a.tgz 2023-10-11T07:26:02.043 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-11T07:26:02.059 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.hg8o3ug1LL 2023-10-11T07:26:02.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hg8o3ug1LL 2023-10-11T07:26:02.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.hg8o3ug1LL 2023-10-11T07:26:02.377 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.hg8o3ug1LL is 727KB 2023-10-11T07:26:02.491 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.hg8o3ug1LL 2023-10-11T07:26:02.507 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-11T07:26:02.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-11T07:26:02.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-11T07:26:02.581 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-11T07:26:02.581 DEBUG:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-11T07:26:02.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-11T07:26:02.649 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-11T07:26:02.655 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-11T07:26:02.660 INFO:tasks.ceph:Archiving crash dumps... 2023-10-11T07:26:02.662 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/remote/smithi050/crash 2023-10-11T07:26:02.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-11T07:26:02.724 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/remote/smithi151/crash 2023-10-11T07:26:02.725 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-11T07:26:02.818 INFO:tasks.ceph:Compressing logs... 2023-10-11T07:26:02.818 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-11T07:26:02.821 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-11T07:26:02.857 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81266.log 2023-10-11T07:26:02.858 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81306.log 2023-10-11T07:26:02.858 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81346.log 2023-10-11T07:26:02.859 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.81266.log: /var/log/ceph/ceph-client.admin.81306.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-11T07:26:02.859 INFO:teuthology.orchestra.run.smithi151.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.81266.log.gz 2023-10-11T07:26:02.859 INFO:teuthology.orchestra.run.smithi151.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.81306.log.gz 2023-10-11T07:26:02.859 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.81346.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-11T07:26:02.860 INFO:teuthology.orchestra.run.smithi151.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.81346.log.gz 2023-10-11T07:26:02.860 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81226.log 2023-10-11T07:26:02.860 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-11T07:26:02.861 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.81226.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.81226.log.gz 2023-10-11T07:26:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84252.log 2023-10-11T07:26:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83344.log 2023-10-11T07:26:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82924.log 2023-10-11T07:26:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83344.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-11T07:26:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82924.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.83344.log.gz 2023-10-11T07:26:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84500.log 2023-10-11T07:26:02.866 INFO:teuthology.orchestra.run.smithi050.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.82924.log.gz 2023-10-11T07:26:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83024.log 2023-10-11T07:26:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83821.log 2023-10-11T07:26:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84397.log 2023-10-11T07:26:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83386.log 2023-10-11T07:26:02.867 INFO:teuthology.orchestra.run.smithi050.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.83024.log.gz 2023-10-11T07:26:02.868 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84494.log 2023-10-11T07:26:02.868 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81692.log 2023-10-11T07:26:02.868 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.84494.log: -5 --verbose 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83386.log.gz 2023-10-11T07:26:02.868 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.84144.log 2023-10-11T07:26:02.869 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84506.log 2023-10-11T07:26:02.869 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84144.log: /var/log/ceph/ceph-client.admin.81692.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.81692.log.gz 2023-10-11T07:26:02.869 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83193.log 2023-10-11T07:26:02.869 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84506.log: 68.0% -- replaced with /var/log/ceph/ceph-client.admin.84506.log.gz 2023-10-11T07:26:02.870 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84493.log 2023-10-11T07:26:02.870 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83193.log: 91.5% 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83193.log.gz 2023-10-11T07:26:02.870 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84397.log.gz 2023-10-11T07:26:02.871 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83192.log 2023-10-11T07:26:02.871 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82756.log 2023-10-11T07:26:02.871 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84493.log: /var/log/ceph/ceph-client.admin.83192.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83192.log.gz 2023-10-11T07:26:02.871 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83026.log 2023-10-11T07:26:02.872 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82756.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.82756.log.gz 2023-10-11T07:26:02.872 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83835.log 2023-10-11T07:26:02.872 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83026.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83026.log.gz 2023-10-11T07:26:02.873 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84373.log 2023-10-11T07:26:02.873 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83835.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.83835.log.gz 2023-10-11T07:26:02.873 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81613.log 2023-10-11T07:26:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84373.log: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.84500.log.gz 2023-10-11T07:26:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-11T07:26:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81613.log: 86.4% 96.7% -- replaced with /var/log/ceph/ceph-client.admin.84494.log.gz 2023-10-11T07:26:02.877 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81613.log.gz 2023-10-11T07:26:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83781.log 2023-10-11T07:26:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84694.log 2023-10-11T07:26:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83781.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-11T07:26:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82798.log 2023-10-11T07:26:02.885 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.2.log: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-11T07:26:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147434.log 2023-10-11T07:26:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82798.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.82798.log.gz 2023-10-11T07:26:02.893 INFO:teuthology.orchestra.run.smithi050.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.84252.log.gz 2023-10-11T07:26:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-11T07:26:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147434.log: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.147434.log.gz 2023-10-11T07:26:02.896 INFO:teuthology.orchestra.run.smithi050.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.83821.log.gz 2023-10-11T07:26:02.897 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84499.log 2023-10-11T07:26:02.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84075.log 2023-10-11T07:26:02.898 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84499.log: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.84144.log.gz 2023-10-11T07:26:02.898 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83302.log 2023-10-11T07:26:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84075.log: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.84694.log.gz 2023-10-11T07:26:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81848.log 92.0% -- replaced with /var/log/ceph/ceph-client.admin.84075.log.gz 2023-10-11T07:26:02.903 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T07:26:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83191.log 2023-10-11T07:26:02.904 INFO:teuthology.orchestra.run.smithi050.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83302.log.gz/var/log/ceph/ceph-client.admin.81848.log: 2023-10-11T07:26:02.904 INFO:teuthology.orchestra.run.smithi050.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.84493.log.gz 2023-10-11T07:26:02.904 INFO:teuthology.orchestra.run.smithi050.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.81848.log.gz 2023-10-11T07:26:02.905 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83802.log 2023-10-11T07:26:02.905 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83191.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79293.log 2023-10-11T07:26:02.905 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84693.log 2023-10-11T07:26:02.905 INFO:teuthology.orchestra.run.smithi050.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83191.log.gz 2023-10-11T07:26:02.906 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.tmp-client.admin.79293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82882.log 2023-10-11T07:26:02.906 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84693.log: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79293.log.gz 2023-10-11T07:26:02.906 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83023.log 2023-10-11T07:26:02.910 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82882.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.82882.log.gz 2023-10-11T07:26:02.910 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84431.log 2023-10-11T07:26:02.910 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83023.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.83023.log.gz 2023-10-11T07:26:02.910 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83977.log 2023-10-11T07:26:02.911 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84431.log: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.84373.log.gz 2023-10-11T07:26:02.911 INFO:teuthology.orchestra.run.smithi050.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.84431.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83760.log 2023-10-11T07:26:02.911 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T07:26:02.912 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84059.log 2023-10-11T07:26:02.913 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83760.log: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.83781.log.gz 2023-10-11T07:26:02.913 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82700.log 2023-10-11T07:26:02.916 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84059.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84059.log.gz 2023-10-11T07:26:02.917 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84404.log 2023-10-11T07:26:02.917 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82700.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.83760.log.gz 2023-10-11T07:26:02.917 INFO:teuthology.orchestra.run.smithi050.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.82700.log.gz 2023-10-11T07:26:02.917 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83874.log 2023-10-11T07:26:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83470.log 2023-10-11T07:26:02.928 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83874.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84499.log.gz 2023-10-11T07:26:02.929 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83194.log 2023-10-11T07:26:02.929 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83470.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83470.log.gz 2023-10-11T07:26:02.931 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-11T07:26:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83194.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83194.log.gz 2023-10-11T07:26:02.932 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83893.log 2023-10-11T07:26:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82840.log 2023-10-11T07:26:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83893.log: 95.8% 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84693.log.gz 2023-10-11T07:26:02.947 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83802.log.gz 2023-10-11T07:26:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84420.log 2023-10-11T07:26:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82840.log: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.83977.log.gz 85.9% -- replaced with /var/log/ceph/ceph-client.admin.82840.log.gz 2023-10-11T07:26:02.950 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T07:26:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84420.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84404.log.gz 2023-10-11T07:26:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-11T07:26:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84149.log 2023-10-11T07:26:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84489.log 2023-10-11T07:26:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84149.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-11T07:26:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83428.log 2023-10-11T07:26:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84489.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.83874.log.gz 2023-10-11T07:26:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83025.log 2023-10-11T07:26:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83428.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83428.log.gz 2023-10-11T07:26:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83858.log 2023-10-11T07:26:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83025.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.83025.log.gz 2023-10-11T07:26:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84161.log 2023-10-11T07:26:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84062.log 2023-10-11T07:26:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84161.log: 95.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83848.log 2023-10-11T07:26:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84062.log: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.84149.log.gz 2023-10-11T07:26:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81876.log 2023-10-11T07:26:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83848.log: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.84489.log.gz 2023-10-11T07:26:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84212.log 2023-10-11T07:26:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81876.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.81876.log.gz 2023-10-11T07:26:03.002 INFO:teuthology.orchestra.run.smithi151.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-11T07:26:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84212.log: -- replaced with /var/log/ceph/ceph-client.admin.84420.log.gz 2023-10-11T07:26:03.005 INFO:teuthology.orchestra.run.smithi050.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.84212.log.gz 2023-10-11T07:26:03.011 INFO:teuthology.orchestra.run.smithi050.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.83858.log.gz 2023-10-11T07:26:03.026 INFO:teuthology.orchestra.run.smithi050.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.84062.log.gz 2023-10-11T07:26:03.032 INFO:teuthology.orchestra.run.smithi050.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.83848.log.gz 2023-10-11T07:26:03.035 INFO:teuthology.orchestra.run.smithi050.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.84161.log.gz 2023-10-11T07:26:03.393 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.83893.log.gz 2023-10-11T07:26:03.655 INFO:teuthology.orchestra.run.smithi151.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-11T07:26:03.657 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-10-11T07:26:03.657 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m0.819s 2023-10-11T07:26:03.657 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m0.941s 2023-10-11T07:26:03.658 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.075s 2023-10-11T07:26:03.726 INFO:teuthology.orchestra.run.smithi050.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-11T07:26:03.975 INFO:teuthology.orchestra.run.smithi050.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-11T07:26:04.139 INFO:teuthology.orchestra.run.smithi050.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-11T07:26:04.141 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-11T07:26:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m1.308s 2023-10-11T07:26:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m4.329s 2023-10-11T07:26:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.219s 2023-10-11T07:26:04.143 INFO:tasks.ceph:Archiving logs... 2023-10-11T07:26:04.144 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/remote/smithi050/log 2023-10-11T07:26:04.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-11T07:26:04.877 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/remote/smithi151/log 2023-10-11T07:26:04.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-11T07:26:05.092 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-11T07:26:05.102 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-11T07:26:05.114 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-11T07:26:05.119 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-11T07:26:05.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-11T07:26:05.123 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-11T07:26:05.206 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-11T07:26:05.216 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-11T07:26:05.217 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-11T07:26:05.220 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-11T07:26:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-10-11T07:26:05.235 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-10-11T07:26:05.237 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-11T07:26:05.237 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-11T07:26:05.238 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 -1872us[-1872us] +/- 99ms 2023-10-11T07:26:05.238 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 9 377 31 -278us[ -218us] +/- 67ms 2023-10-11T07:26:05.238 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 93 +1641us[+1706us] +/- 68ms 2023-10-11T07:26:05.239 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T07:26:05.240 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-11T07:26:05.241 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-11T07:26:05.241 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 48 -1808us[-1838us] +/- 98ms 2023-10-11T07:26:05.241 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv02.front.sepia.ceph.com 3 9 377 44 -247us[ -277us] +/- 67ms 2023-10-11T07:26:05.242 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 103 +1709us[+1680us] +/- 68ms 2023-10-11T07:26:05.242 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T07:26:05.243 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-11T07:26:05.252 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-11T07:26:05.253 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-11T07:26:05.261 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-11T07:26:05.383 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-11T07:26:05.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-11T07:26:05.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:05.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-11T07:26:05.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:05.548 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-11T07:26:05.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-11T07:26:05.566 INFO:teuthology.task.internal:Duration was 11560.571669 seconds 2023-10-11T07:26:05.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-11T07:26:05.576 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-11T07:26:05.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-11T07:26:05.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-11T07:26:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-11T07:26:05.632 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-11T07:26:05.952 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-11T07:26:05.952 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-10-11T07:26:05.953 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-11T07:26:05.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-10-11T07:26:05.974 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-11T07:26:05.999 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-11T07:26:06.000 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-11T07:26:06.016 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-11T07:26:06.068 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-11T07:26:06.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-11T07:26:06.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-11T07:26:06.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-11T07:26:06.214 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-11T07:26:06.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-11T07:26:06.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-11T07:26:06.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-11T07:26:06.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-11T07:26:06.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-11T07:26:06.317 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-10-11T07:26:06.340 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-10-11T07:26:06.377 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-11T07:26:06.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:06.415 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-11T07:26:06.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:06.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-11T07:26:06.441 INFO:teuthology.task.internal:Transferring archived files... 2023-10-11T07:26:06.442 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/remote/smithi050 2023-10-11T07:26:06.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-11T07:26:06.496 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047/remote/smithi151 2023-10-11T07:26:06.497 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-11T07:26:06.536 INFO:teuthology.task.internal:Removing archive directory... 2023-10-11T07:26:06.537 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-11T07:26:06.540 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-11T07:26:06.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-11T07:26:06.597 INFO:teuthology.task.internal:Not uploading archives. 2023-10-11T07:26:06.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-11T07:26:06.607 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-11T07:26:06.608 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-11T07:26:06.611 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-11T07:26:06.623 INFO:teuthology.orchestra.run.smithi050.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 11 07:26 /home/ubuntu/cephtest 2023-10-11T07:26:06.624 INFO:teuthology.orchestra.run.smithi050.stdout: 531668 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 11 04:22 /home/ubuntu/cephtest/mnt.0 2023-10-11T07:26:06.624 INFO:teuthology.orchestra.run.smithi050.stdout: 531669 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0 2023-10-11T07:26:06.625 INFO:teuthology.orchestra.run.smithi050.stdout: 543560 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T07:26:06.625 INFO:teuthology.orchestra.run.smithi050.stdout: 543994 60 -rw-r--r-- 1 ubuntu ubuntu 59016 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_tier_pp.log 2023-10-11T07:26:06.625 INFO:teuthology.orchestra.run.smithi050.stdout: 544992 4 -rw-r--r-- 1 ubuntu ubuntu 302 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat_pp.log 2023-10-11T07:26:06.626 INFO:teuthology.orchestra.run.smithi050.stdout: 543623 4 -rw-r--r-- 1 ubuntu ubuntu 386 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock.log 2023-10-11T07:26:06.626 INFO:teuthology.orchestra.run.smithi050.stdout: 545580 4 -rw-r--r-- 1 ubuntu ubuntu 460 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_read_operations.log 2023-10-11T07:26:06.626 INFO:teuthology.orchestra.run.smithi050.stdout: 545578 0 -rw-r--r-- 1 ubuntu ubuntu 0 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_list_parallel.log 2023-10-11T07:26:06.627 INFO:teuthology.orchestra.run.smithi050.stdout: 543745 4 -rw-r--r-- 1 ubuntu ubuntu 848 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc_pp.log 2023-10-11T07:26:06.627 INFO:teuthology.orchestra.run.smithi050.stdout: 543571 4 -rw-r--r-- 1 ubuntu ubuntu 364 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio.log 2023-10-11T07:26:06.627 INFO:teuthology.orchestra.run.smithi050.stdout: 543626 4 -rw-r--r-- 1 ubuntu ubuntu 2500 Oct 11 04:25 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc.log 2023-10-11T07:26:06.627 INFO:teuthology.orchestra.run.smithi050.stdout: 545581 4 -rw-r--r-- 1 ubuntu ubuntu 1174 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cls_remote_reads.log 2023-10-11T07:26:06.628 INFO:teuthology.orchestra.run.smithi050.stdout: 545575 4 -rw-r--r-- 1 ubuntu ubuntu 362 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd_pp.log 2023-10-11T07:26:06.628 INFO:teuthology.orchestra.run.smithi050.stdout: 545577 4 -rw-r--r-- 1 ubuntu ubuntu 351 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd.log 2023-10-11T07:26:06.628 INFO:teuthology.orchestra.run.smithi050.stdout: 545571 4 -rw-r--r-- 1 ubuntu ubuntu 242 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify.log 2023-10-11T07:26:06.628 INFO:teuthology.orchestra.run.smithi050.stdout: 544868 4 -rw-r--r-- 1 ubuntu ubuntu 491 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots.log 2023-10-11T07:26:06.629 INFO:teuthology.orchestra.run.smithi050.stdout: 543621 24 -rw-r--r-- 1 ubuntu ubuntu 24303 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_asio.log 2023-10-11T07:26:06.629 INFO:teuthology.orchestra.run.smithi050.stdout: 545535 4 -rw-r--r-- 1 ubuntu ubuntu 347 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat.log 2023-10-11T07:26:06.629 INFO:teuthology.orchestra.run.smithi050.stdout: 545582 0 -rw-r--r-- 1 ubuntu ubuntu 0 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_delete_pools_parallel.log 2023-10-11T07:26:06.630 INFO:teuthology.orchestra.run.smithi050.stdout: 545576 4 -rw-r--r-- 1 ubuntu ubuntu 2629 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service_pp.log 2023-10-11T07:26:06.630 INFO:teuthology.orchestra.run.smithi050.stdout: 545574 4 -rw-r--r-- 1 ubuntu ubuntu 612 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_write_operations.log 2023-10-11T07:26:06.631 INFO:teuthology.orchestra.run.smithi050.stdout: 545573 4 -rw-r--r-- 1 ubuntu ubuntu 2378 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service.log 2023-10-11T07:26:06.631 INFO:teuthology.orchestra.run.smithi050.stdout: 543585 4 -rw-r--r-- 1 ubuntu ubuntu 283 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio_pp.log 2023-10-11T07:26:06.631 INFO:teuthology.orchestra.run.smithi050.stdout: 543619 4 -rw-r--r-- 1 ubuntu ubuntu 922 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io_pp.log 2023-10-11T07:26:06.632 INFO:teuthology.orchestra.run.smithi050.stdout: 545579 0 -rw-r--r-- 1 ubuntu ubuntu 0 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_open_pools_parallel.log 2023-10-11T07:26:06.633 INFO:teuthology.orchestra.run.smithi050.stdout: 545572 4 -rw-r--r-- 1 ubuntu ubuntu 2607 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify_pp.log 2023-10-11T07:26:06.634 INFO:teuthology.orchestra.run.smithi050.stdout: 543624 4 -rw-r--r-- 1 ubuntu ubuntu 225 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock_pp.log 2023-10-11T07:26:06.634 INFO:teuthology.orchestra.run.smithi050.stdout: 543765 4 -rw-r--r-- 1 ubuntu ubuntu 1611 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_pool.log 2023-10-11T07:26:06.634 INFO:teuthology.orchestra.run.smithi050.stdout: 543622 4 -rw-r--r-- 1 ubuntu ubuntu 547 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_list.log 2023-10-11T07:26:06.635 INFO:teuthology.orchestra.run.smithi050.stdout: 544934 4 -rw-r--r-- 1 ubuntu ubuntu 641 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots_pp.log 2023-10-11T07:26:06.635 INFO:teuthology.orchestra.run.smithi050.stdout: 543601 4 -rw-r--r-- 1 ubuntu ubuntu 952 Oct 11 04:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io.log 2023-10-11T07:26:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-11T07:26:06.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T07:26:06.638 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-11T07:26:06.654 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-11T07:26:06.666 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-11T07:26:06.678 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-11T07:26:06.678 INFO:teuthology.nuke:Checking targets against current locks 2023-10-11T07:26:06.683 INFO:teuthology.orchestra.run.smithi151.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 11 07:26 /home/ubuntu/cephtest 2023-10-11T07:26:06.706 DEBUG:teuthology.nuke:shortname: smithi050 2023-10-11T07:26:06.707 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-11T07:26:06.730 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-11T07:26:06.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-11T07:26:06.735 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 04:04:25.077623', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHH5ZT9sWcQ8M4I8bkHT3BMU232ofSnO8QLN7IgAcS2FY9NQNErb1d4QN2P0rhrFLcjfsVPAOeFyTCYAIbJImXw='} 2023-10-11T07:26:06.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-10-11_02:17:04-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7421047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 04:04:25.076117', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/b3CFSmLCP42k6y/5pgjPhbw7SHls1sk0jQCh9vjQNd3Pw15xxVZSYGGV7GAKD7Oyj35Z1gvanyBWDdqpo3PE='} 2023-10-11T07:26:06.788 INFO:teuthology.orchestra.console.smithi050:Power off 2023-10-11T07:26:06.789 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-11T07:26:06.815 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-10-11T07:26:06.816 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T07:26:06.833 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-11T07:26:06.834 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-11T07:26:06.843 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-11T07:26:06.856 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-11T07:26:06.857 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T07:26:06.879 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-11T07:26:10.845 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T07:26:10.881 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T07:26:10.955 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-11T07:26:10.992 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-11T07:26:14.958 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T07:26:14.993 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T07:26:15.068 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-10-11T07:26:15.104 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-11T07:26:15.169 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-10-11T07:26:19.106 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T07:26:19.215 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-11T07:26:19.316 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-11T07:26:19.422 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 11560.571669101715 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi050 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9587ffdfc8c52bcf06abbe89d2f527c434a3e9f5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh''' flavor: crimson owner: scheduled_yingxin@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2f23e419565c435fab3e9fb7140c240f status: fail success: false 2023-10-11T07:26:19.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-11T07:26:19.496 INFO:teuthology.run:FAIL