2023-10-31T23:06:08.280 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-31T23:06:08.281 DEBUG:teuthology.run:Teuthology command: teuthology --name matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi --archive /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519 --owner scheduled_matan@teuthology --verbose --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/orig.config.yaml 2023-10-31T23:06:08.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T23:06:08.396 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519 branch: wip-matanb-crimson-do_osd_ops_execute-part3 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: null first_in_suite: false job_id: '7442519' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-do_osd_ops_execute-part3 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson seastar smp: 3 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: a9edd23b5a8ddacab225824948b06b370baf276b owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6029 sha1: d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: a9edd23b5a8ddacab225824948b06b370baf276b targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk4jIz0Iy/U3c8+afCQ9hOCWAOAG/mDAXaEyzVYEMXV72ZflTOEbDTPDMEy+UwRxojIvv6ph7LNAyg4kVYEMMA= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpHKTlIFzQP0Aod3adCh8dUG6w/cE6VCroP+6taVVpGtgJxna+5b9584yxJhS90ia8cGkl5+V+oF/umwREmzT4= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-10-31_22:58:07 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.770726 2023-10-31T23:06:08.397 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa; will attempt to use it 2023-10-31T23:06:08.398 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks 2023-10-31T23:06:08.398 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-31T23:06:08.400 INFO:teuthology.task.internal:Checking packages... 2023-10-31T23:06:08.424 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2' 2023-10-31T23:06:08.424 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-31T23:06:08.425 INFO:teuthology.packaging:ref: None 2023-10-31T23:06:08.425 INFO:teuthology.packaging:tag: None 2023-10-31T23:06:08.425 INFO:teuthology.packaging:branch: wip-matanb-crimson-do_osd_ops_execute-part3 2023-10-31T23:06:08.426 INFO:teuthology.packaging:sha1: d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 2023-10-31T23:06:08.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-do_osd_ops_execute-part3 2023-10-31T23:06:08.583 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6795.gd1dcabba 2023-10-31T23:06:08.583 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-31T23:06:08.590 INFO:teuthology.task.internal:no buildpackages task found 2023-10-31T23:06:08.590 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-31T23:06:08.597 INFO:teuthology.task.internal:Saving configuration 2023-10-31T23:06:08.608 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-31T23:06:08.614 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-31T23:06:08.640 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 23:00:54.701644', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk4jIz0Iy/U3c8+afCQ9hOCWAOAG/mDAXaEyzVYEMXV72ZflTOEbDTPDMEy+UwRxojIvv6ph7LNAyg4kVYEMMA='} 2023-10-31T23:06:08.663 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 23:00:54.699617', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpHKTlIFzQP0Aod3adCh8dUG6w/cE6VCroP+6taVVpGtgJxna+5b9584yxJhS90ia8cGkl5+V+oF/umwREmzT4='} 2023-10-31T23:06:08.663 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-31T23:06:08.670 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2023-10-31T23:06:08.670 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-10-31T23:06:08.671 INFO:teuthology.run_tasks:Running task console_log... 2023-10-31T23:06:08.743 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f13b2388940>, signals=[15]) 2023-10-31T23:06:08.744 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-31T23:06:08.750 INFO:teuthology.task.internal:Opening connections... 2023-10-31T23:06:08.751 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-10-31T23:06:08.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:06:08.854 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2023-10-31T23:06:08.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:06:08.943 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-31T23:06:08.950 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-31T23:06:08.970 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-31T23:06:08.971 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-31T23:06:09.028 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-10-31T23:06:09.028 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2023-10-31T23:06:09.029 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-10-31T23:06:09.029 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-10-31T23:06:09.029 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2023-10-31T23:06:09.029 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2023-10-31T23:06:09.029 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-31T23:06:09.030 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-31T23:06:09.030 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2023-10-31T23:06:09.030 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-31T23:06:09.030 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-10-31T23:06:09.030 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T23:06:09.031 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-31T23:06:09.031 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T23:06:09.032 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-31T23:06:09.051 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-10-31T23:06:09.067 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-10-31T23:06:09.068 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-10-31T23:06:09.128 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-10-31T23:06:09.128 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2023-10-31T23:06:09.129 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-10-31T23:06:09.129 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-10-31T23:06:09.129 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2023-10-31T23:06:09.129 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2023-10-31T23:06:09.130 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-31T23:06:09.130 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-10-31T23:06:09.130 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2023-10-31T23:06:09.130 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-31T23:06:09.130 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-10-31T23:06:09.131 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T23:06:09.131 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-31T23:06:09.131 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T23:06:09.131 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-10-31T23:06:09.150 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-31T23:06:09.159 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-31T23:06:09.165 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-31T23:06:09.165 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-10-31T23:06:09.168 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2023-10-31T23:06:09.187 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-31T23:06:09.193 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-31T23:06:09.194 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-10-31T23:06:09.225 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2023-10-31T23:06:09.255 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-31T23:06:09.313 INFO:teuthology.run_tasks:Running task kernel... 2023-10-31T23:06:09.327 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-31T23:06:09.328 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-31T23:06:09.328 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-31T23:06:09.329 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-31T23:06:09.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-31T23:06:09.344 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-10-31T23:06:09.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-31T23:06:09.346 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-31T23:06:09.403 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-361.el9.x86_64 2023-10-31T23:06:09.403 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-361.el9.x86_64 2023-10-31T23:06:09.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2023-10-31T23:06:09.405 INFO:teuthology.orchestra.run.smithi008.stdout:5.14.0-361.el9.x86_64 2023-10-31T23:06:09.405 INFO:teuthology.task.kernel:Running kernel on smithi008: 5.14.0-361.el9.x86_64 2023-10-31T23:06:09.405 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2023-10-31T23:06:11.527 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-10-31T23:06:11.538 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-10-31T23:06:12.944 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2023-10-31T23:06:12.955 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2023-10-31T23:06:13.818 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-10-31T23:06:15.661 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 23 MB/s | 18 MB 00:00 2023-10-31T23:06:15.904 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 7.9 MB 00:02 2023-10-31T23:06:17.688 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 26 MB/s | 18 MB 00:00 2023-10-31T23:06:19.812 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 5.8 MB 00:00 2023-10-31T23:06:21.112 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 15 kB 00:00 2023-10-31T23:06:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 5.8 MB 00:01 2023-10-31T23:06:22.814 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-10-31T23:06:23.798 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 15 kB 00:00 2023-10-31T23:06:27.239 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2023-10-31T23:06:28.427 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 19 MB 00:04 2023-10-31T23:06:29.237 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-31T23:06:29.237 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-31T23:06:29.342 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:06:29.349 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:06:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2023-10-31T23:06:29.349 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:06:29.349 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:06:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-10-31T23:06:29.350 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:06:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-10-31T23:06:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-10-31T23:06:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-10-31T23:06:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:06:29.351 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:06:29.351 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:06:29.351 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2023-10-31T23:06:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:06:29.352 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 95 M 2023-10-31T23:06:29.352 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 120 M 2023-10-31T23:06:29.352 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:06:30.740 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 4.2 MB/s | 5.3 MB 00:01 2023-10-31T23:06:32.732 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 6.1 MB/s | 20 MB 00:03 2023-10-31T23:06:33.141 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2023-10-31T23:06:35.273 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-31T23:06:35.273 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-31T23:06:35.363 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:06:35.370 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:06:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-31T23:06:35.371 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:06:35.371 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:06:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-10-31T23:06:35.371 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:06:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-10-31T23:06:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-10-31T23:06:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-10-31T23:06:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:06:35.372 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:06:35.373 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:06:35.373 INFO:teuthology.orchestra.run.smithi008.stdout:Install 4 Packages 2023-10-31T23:06:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:06:35.374 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 95 M 2023-10-31T23:06:35.374 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 120 M 2023-10-31T23:06:35.374 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:06:35.956 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 6.1 MB/s | 32 MB 00:05 2023-10-31T23:06:36.656 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 5.2 MB/s | 38 MB 00:07 2023-10-31T23:06:36.657 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:06:36.658 INFO:teuthology.orchestra.run.smithi071.stdout:Total 13 MB/s | 95 MB 00:07 2023-10-31T23:06:37.498 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:06:37.843 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:06:37.843 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:06:39.059 INFO:teuthology.orchestra.run.smithi008.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 1.5 MB/s | 5.3 MB 00:03 2023-10-31T23:06:39.135 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:06:39.136 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:06:42.035 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:06:42.645 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-10-31T23:06:42.767 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-10-31T23:06:45.539 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-10-31T23:06:45.730 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-10-31T23:06:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-10-31T23:06:50.680 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:06:55.066 INFO:teuthology.orchestra.run.smithi008.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 1.0 MB/s | 20 MB 00:19 2023-10-31T23:06:55.337 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:07:16.123 INFO:teuthology.orchestra.run.smithi008.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 886 kB/s | 32 MB 00:37 2023-10-31T23:07:17.590 INFO:teuthology.orchestra.run.smithi008.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 912 kB/s | 38 MB 00:42 2023-10-31T23:07:17.590 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:07:17.590 INFO:teuthology.orchestra.run.smithi008.stdout:Total 2.2 MB/s | 95 MB 00:42 2023-10-31T23:07:18.465 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:07:18.925 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:07:18.926 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:07:20.287 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:07:20.287 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:07:23.057 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:07:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-10-31T23:07:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-10-31T23:07:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:07:24.134 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:07:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:07:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-10-31T23:07:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-10-31T23:07:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-10-31T23:07:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:07:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:07:25.012 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:07:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-378.el9.x86_64 2023-10-31T23:07:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-10-31T23:07:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-10-31T23:07:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-10-31T23:07:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:07:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:07:25.502 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2023-10-31T23:07:25.674 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-378.el9.x86_64 2023-10-31T23:07:25.675 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-10-31T23:07:25.675 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-10-31T23:07:25.675 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-31T23:07:25.676 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-31T23:07:25.676 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-10-31T23:07:25.676 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2023-10-31T23:07:25.676 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2023-10-31T23:07:25.794 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-378.el9.x86_64 2023-10-31T23:07:25.795 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-10-31T23:07:25.795 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2023-10-31T23:07:25.829 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2023-10-31T23:07:25.829 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2023-10-31T23:07:25.829 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2023-10-31T23:07:25.829 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 68.el9 2023-10-31T23:07:25.830 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2023-10-31T23:07:25.830 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-31T23:07:25.830 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2023-10-31T23:07:25.830 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8264254 2023-10-31T23:07:25.830 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2023-10-31T23:07:25.831 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-31T23:07:25.831 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-31T23:07:25.831 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-31T23:07:25.831 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-31T23:07:25.831 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2023-10-31T23:07:25.832 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2023-10-31T23:07:25.832 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-31T23:07:25.832 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2023-10-31T23:07:25.832 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2023-10-31T23:07:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:07:25.832 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-31T23:07:25.833 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-31T23:07:25.833 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-31T23:07:25.833 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2023-10-31T23:07:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:07:25.833 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2023-10-31T23:07:25.834 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-31T23:07:25.835 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 5.14.0-378.el9.x86_64 2023-10-31T23:07:25.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-31T23:07:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2023-10-31T23:07:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-10-31T23:07:26.938 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-10-31T23:07:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-31T23:07:27.862 INFO:teuthology.orchestra.run.smithi071.stderr:done 2023-10-31T23:07:27.865 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2023-10-31T23:07:27.880 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.gc0juyq4f6 2023-10-31T23:07:27.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gc0juyq4f6 2023-10-31T23:07:27.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.gc0juyq4f6 2023-10-31T23:07:28.086 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.gc0juyq4f6 is 6KB 2023-10-31T23:07:28.134 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.gc0juyq4f6 2023-10-31T23:07:28.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2023-10-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi071.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi071.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-31T23:07:28.222 INFO:teuthology.orchestra.run.smithi071.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-31T23:07:28.223 INFO:teuthology.orchestra.run.smithi071.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-10-31T23:07:28.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-10-31T23:07:28.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2023-10-31T23:07:31.882 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-10-31T23:07:32.004 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:07:36.976 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:07:58.392 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-10-31T23:07:58.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-31T23:07:58.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:08:07.563 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:08:07.606 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:08:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:08:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-10-31T23:08:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-10-31T23:08:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-10-31T23:08:08.425 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-10-31T23:08:08.425 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:08:08.426 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:08:08.426 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-5.14.0-378.el9.x86_64 2023-10-31T23:08:08.426 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-10-31T23:08:08.426 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-10-31T23:08:08.427 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-10-31T23:08:08.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:08:08.427 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:08:08.957 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-10-31T23:08:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-5.14.0-378.el9.x86_64 2023-10-31T23:08:09.098 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-10-31T23:08:09.098 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-10-31T23:08:09.098 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-31T23:08:09.098 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-31T23:08:09.099 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-31T23:08:09.099 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=None, version=distro) 2023-10-31T23:08:09.099 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-10-31T23:08:09.219 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-5.14.0-378.el9.x86_64 2023-10-31T23:08:09.220 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-10-31T23:08:09.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-10-31T23:08:09.258 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-10-31T23:08:09.258 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-10-31T23:08:09.258 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.06 2023-10-31T23:08:09.258 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 68.el9 2023-10-31T23:08:09.259 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-10-31T23:08:09.259 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-31T23:08:09.259 INFO:teuthology.orchestra.run.smithi008.stdout:Group : Unspecified 2023-10-31T23:08:09.259 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 8264254 2023-10-31T23:08:09.259 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-10-31T23:08:09.260 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-31T23:08:09.260 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-31T23:08:09.260 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-31T23:08:09.260 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-31T23:08:09.260 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : builder@centos.org 2023-10-31T23:08:09.260 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2023-10-31T23:08:09.261 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-31T23:08:09.261 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-10-31T23:08:09.261 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-10-31T23:08:09.261 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:08:09.261 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-31T23:08:09.262 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-31T23:08:09.262 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-31T23:08:09.262 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-10-31T23:08:09.262 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:08:09.262 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-10-31T23:08:09.263 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-31T23:08:09.263 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 5.14.0-378.el9.x86_64 2023-10-31T23:08:09.264 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-31T23:08:09.864 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-10-31T23:08:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-31T23:08:11.303 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-10-31T23:08:11.308 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-31T23:08:11.324 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.CvWeIeL5BO 2023-10-31T23:08:11.325 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CvWeIeL5BO 2023-10-31T23:08:11.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.CvWeIeL5BO 2023-10-31T23:08:11.542 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.CvWeIeL5BO is 6KB 2023-10-31T23:08:11.590 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.CvWeIeL5BO 2023-10-31T23:08:11.605 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-10-31T23:08:11.673 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-31T23:08:11.673 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-31T23:08:11.674 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-31T23:08:11.674 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-10-31T23:08:11.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-10-31T23:08:11.838 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-10-31T23:08:33.018 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-31T23:08:41.846 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-31T23:08:41.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-31T23:08:41.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:08:42.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-31T23:08:42.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:09:00.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-31T23:09:00.411 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-31T23:09:09.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-31T23:09:09.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:09:12.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-31T23:09:12.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:09:12.819 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-10-31T23:09:13.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-31T23:09:13.273 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-378.el9.x86_64"... 2023-10-31T23:09:13.273 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-10-31T23:09:13.287 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-378.el9.x86_64 2023-10-31T23:09:13.287 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-10-31T23:09:13.287 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-31T23:09:13.288 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-31T23:09:14.289 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-10-31T23:09:14.289 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-31T23:09:14.358 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2023-10-31T23:09:14.393 DEBUG:teuthology.parallel:result is None 2023-10-31T23:10:09.421 DEBUG:teuthology.orchestra.remote:timed out 2023-10-31T23:10:21.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-31T23:10:21.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:10:21.711 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-31T23:10:22.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-31T23:10:22.088 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-10-31T23:10:22.088 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-31T23:10:22.103 INFO:teuthology.orchestra.run.smithi008.stdout:5.14.0-378.el9.x86_64 2023-10-31T23:10:22.104 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-10-31T23:10:22.104 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-31T23:10:22.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-31T23:10:23.106 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-31T23:10:23.106 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-31T23:10:23.196 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-10-31T23:10:23.241 DEBUG:teuthology.parallel:result is None 2023-10-31T23:10:23.241 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-31T23:10:23.250 INFO:teuthology.task.internal:Creating test directory... 2023-10-31T23:10:23.251 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-31T23:10:23.253 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-31T23:10:23.272 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-31T23:10:23.280 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-31T23:10:23.291 INFO:teuthology.task.internal:Creating archive directory... 2023-10-31T23:10:23.292 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-31T23:10:23.312 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-31T23:10:23.342 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-31T23:10:23.351 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-31T23:10:23.351 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-31T23:10:23.380 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-31T23:10:23.421 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-31T23:10:23.423 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-31T23:10:23.438 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-31T23:10:23.438 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-31T23:10:23.440 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-31T23:10:23.449 INFO:teuthology.task.internal:Configuring sudo... 2023-10-31T23:10:23.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-31T23:10:23.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-31T23:10:23.513 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-31T23:10:23.524 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-31T23:10:23.524 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-31T23:10:23.556 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-31T23:10:23.571 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-31T23:10:23.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-31T23:10:23.712 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-31T23:10:23.755 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-31T23:10:23.801 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:10:23.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-31T23:10:23.872 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-31T23:10:23.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-31T23:10:23.967 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-31T23:10:24.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-31T23:10:24.093 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:10:24.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-31T23:10:24.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-10-31T23:10:24.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2023-10-31T23:10:24.213 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-31T23:10:24.250 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-31T23:10:24.672 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-31T23:10:24.681 INFO:teuthology.task.internal:Starting timer... 2023-10-31T23:10:24.681 INFO:teuthology.run_tasks:Running task pcp... 2023-10-31T23:10:24.706 INFO:teuthology.run_tasks:Running task selinux... 2023-10-31T23:10:24.717 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-10-31T23:10:24.774 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-10-31T23:10:24.776 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2023-10-31T23:10:24.826 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2023-10-31T23:10:24.828 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-31T23:10:24.828 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-10-31T23:10:24.859 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-10-31T23:10:24.860 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2023-10-31T23:10:24.903 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2023-10-31T23:10:24.903 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive'} 2023-10-31T23:10:24.904 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-31T23:10:24.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-31T23:10:24.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-31T23:10:24.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-31T23:10:24.970 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-31T23:10:24.971 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-10-31T23:10:25.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2023-10-31T23:10:25.055 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-31T23:10:25.065 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-31T23:10:25.071 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-31T23:10:25.225 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-31T23:10:25.241 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-31T23:10:25.242 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-31T23:15:56.100 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com')] 2023-10-31T23:15:56.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-31T23:15:56.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:15:56.204 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-31T23:15:56.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-31T23:15:56.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-31T23:15:56.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T23:15:56.361 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-10-31T23:15:56.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-31T23:15:56.430 INFO:teuthology.run_tasks:Running task clock... 2023-10-31T23:15:56.443 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-31T23:15:56.444 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-31T23:15:56.444 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-31T23:15:56.447 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-31T23:15:56.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-31T23:15:56.484 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-31T23:15:56.500 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-31T23:15:56.505 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-31T23:15:56.516 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-31T23:15:56.543 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-10-31T23:15:56.546 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2023-10-31T23:15:56.560 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2023-10-31T23:15:56.561 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-10-31T23:15:56.576 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-31T23:15:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-31T23:15:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-31T23:15:56.601 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-31T23:15:56.634 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2023-10-31T23:15:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-31T23:15:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-10-31T23:15:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.640 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.648 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2023-10-31T23:15:56.652 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-31T23:15:56.652 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-31T23:15:56.653 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.653 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.653 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.653 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-31T23:15:56.654 INFO:teuthology.run_tasks:Running task install... 2023-10-31T23:15:56.662 DEBUG:teuthology.task.install:project ceph 2023-10-31T23:15:56.662 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2'}} 2023-10-31T23:15:56.663 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2'} 2023-10-31T23:15:56.663 INFO:teuthology.task.install:Using flavor: crimson 2023-10-31T23:15:56.669 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-31T23:15:56.669 INFO:teuthology.task.install:extra packages: [] 2023-10-31T23:15:56.670 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2', 'tag': None, 'wait_for_package': False} 2023-10-31T23:15:56.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 2023-10-31T23:15:56.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2', 'tag': None, 'wait_for_package': False} 2023-10-31T23:15:56.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 2023-10-31T23:15:56.836 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/ 2023-10-31T23:15:56.837 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6795.gd1dcabba 2023-10-31T23:15:56.841 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/ 2023-10-31T23:15:56.841 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6795.gd1dcabba 2023-10-31T23:15:56.948 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-31T23:15:56.949 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:15:56.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-31T23:15:56.953 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-do_osd_ops_execute-part3/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-31T23:15:56.953 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:15:56.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-31T23:15:56.981 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-31T23:15:56.981 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-31T23:15:56.983 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-31T23:15:56.983 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-31T23:15:57.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-31T23:15:57.053 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-31T23:15:57.129 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-31T23:15:57.140 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-31T23:15:57.170 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-10-31T23:15:57.172 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-31T23:15:57.195 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2023-10-31T23:15:57.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2023-10-31T23:15:57.420 INFO:teuthology.orchestra.run.smithi008.stdout:72 files removed 2023-10-31T23:15:57.434 INFO:teuthology.orchestra.run.smithi071.stdout:72 files removed 2023-10-31T23:15:57.446 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw 2023-10-31T23:15:57.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2023-10-31T23:15:58.132 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 232 kB/s | 81 kB 00:00 2023-10-31T23:15:58.161 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 211 kB/s | 81 kB 00:00 2023-10-31T23:15:58.487 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 34 kB/s | 9.5 kB 00:00 2023-10-31T23:15:58.490 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 31 kB/s | 9.5 kB 00:00 2023-10-31T23:15:58.796 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2023-10-31T23:15:58.849 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2023-10-31T23:15:59.148 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS-9 - AppStream 20 MB/s | 6.3 MB 00:00 2023-10-31T23:15:59.244 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-10-31T23:16:00.440 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS-9 - BaseOS 8.0 MB/s | 2.0 MB 00:00 2023-10-31T23:16:00.602 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-10-31T23:16:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-10-31T23:16:02.635 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 7.9 MB 00:01 2023-10-31T23:16:03.165 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 25 MB/s | 18 MB 00:00 2023-10-31T23:16:06.094 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 18 MB 00:02 2023-10-31T23:16:07.200 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 5.8 MB 00:00 2023-10-31T23:16:08.867 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2023-10-31T23:16:09.810 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 23 MB/s | 19 MB 00:00 2023-10-31T23:16:10.021 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-10-31T23:16:11.638 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2023-10-31T23:16:12.850 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-10-31T23:16:14.393 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2023-10-31T23:16:16.797 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:16:16.806 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:16:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:16:16.806 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:16:16.807 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:16:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 8.4 M 2023-10-31T23:16:16.807 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2023-10-31T23:16:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 3.1 M 2023-10-31T23:16:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 3.0 M 2023-10-31T23:16:16.808 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:16:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options 2023-10-31T23:16:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-31T23:16:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 6.6 M 2023-10-31T23:16:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 17 M 2023-10-31T23:16:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 24 k 2023-10-31T23:16:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-31T23:16:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-31T23:16:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-31T23:16:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-31T23:16:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 727 k 2023-10-31T23:16:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-31T23:16:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-31T23:16:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-31T23:16:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 469 k 2023-10-31T23:16:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-31T23:16:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 4.5 M 2023-10-31T23:16:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-31T23:16:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-31T23:16:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-31T23:16:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse 2023-10-31T23:16:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 45 k 2023-10-31T23:16:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 127 k 2023-10-31T23:16:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 162 k 2023-10-31T23:16:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-31T23:16:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 321 k 2023-10-31T23:16:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 298 k 2023-10-31T23:16:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 99 k 2023-10-31T23:16:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-31T23:16:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-31T23:16:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:16.814 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:16:16.814 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:16:16.814 INFO:teuthology.orchestra.run.smithi071.stdout:Install 28 Packages 2023-10-31T23:16:16.814 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2023-10-31T23:16:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:16.815 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 54 M 2023-10-31T23:16:16.815 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:16:17.598 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-10-31T23:16:18.527 INFO:teuthology.orchestra.run.smithi071.stdout:(1/30): ceph-base-18.0.0-6795.gd1dcabba.el9.x86 5.0 MB/s | 6.6 MB 00:01 2023-10-31T23:16:18.627 INFO:teuthology.orchestra.run.smithi071.stdout:(2/30): ceph-radosgw-18.0.0-6795.gd1dcabba.el9. 5.9 MB/s | 8.4 MB 00:01 2023-10-31T23:16:18.653 INFO:teuthology.orchestra.run.smithi071.stdout:(3/30): ceph-selinux-18.0.0-6795.gd1dcabba.el9. 192 kB/s | 24 kB 00:00 2023-10-31T23:16:19.053 INFO:teuthology.orchestra.run.smithi071.stdout:(4/30): ceph-common-18.0.0-6795.gd1dcabba.el9.x 9.3 MB/s | 17 MB 00:01 2023-10-31T23:16:19.078 INFO:teuthology.orchestra.run.smithi071.stdout:(5/30): libradosstriper1-18.0.0-6795.gd1dcabba. 1.1 MB/s | 469 kB 00:00 2023-10-31T23:16:19.103 INFO:teuthology.orchestra.run.smithi071.stdout:(6/30): libcephfs2-18.0.0-6795.gd1dcabba.el9.x8 1.5 MB/s | 727 kB 00:00 2023-10-31T23:16:19.862 INFO:teuthology.orchestra.run.smithi071.stdout:(7/30): python3-ceph-argparse-18.0.0-6795.gd1dc 58 kB/s | 45 kB 00:00 2023-10-31T23:16:19.929 INFO:teuthology.orchestra.run.smithi071.stdout:(8/30): librgw2-18.0.0-6795.gd1dcabba.el9.x86_6 5.1 MB/s | 4.5 MB 00:00 2023-10-31T23:16:19.971 INFO:teuthology.orchestra.run.smithi071.stdout:(9/30): python3-ceph-common-18.0.0-6795.gd1dcab 146 kB/s | 127 kB 00:00 2023-10-31T23:16:19.996 INFO:teuthology.orchestra.run.smithi071.stdout:(10/30): python3-cephfs-18.0.0-6795.gd1dcabba.e 1.2 MB/s | 162 kB 00:00 2023-10-31T23:16:20.021 INFO:teuthology.orchestra.run.smithi071.stdout:(11/30): python3-rados-18.0.0-6795.gd1dcabba.el 3.4 MB/s | 321 kB 00:00 2023-10-31T23:16:20.080 INFO:teuthology.orchestra.run.smithi071.stdout:(12/30): python3-rbd-18.0.0-6795.gd1dcabba.el9. 2.7 MB/s | 298 kB 00:00 2023-10-31T23:16:20.089 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:16:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:16:20.092 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:16:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:16:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:16:20.093 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 8.4 M 2023-10-31T23:16:20.093 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-31T23:16:20.093 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 3.1 M 2023-10-31T23:16:20.094 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 3.0 M 2023-10-31T23:16:20.094 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:16:20.094 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options 2023-10-31T23:16:20.094 INFO:teuthology.orchestra.run.smithi008.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-31T23:16:20.094 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 6.6 M 2023-10-31T23:16:20.095 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 17 M 2023-10-31T23:16:20.095 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 24 k 2023-10-31T23:16:20.095 INFO:teuthology.orchestra.run.smithi008.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-31T23:16:20.095 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-31T23:16:20.095 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-31T23:16:20.096 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-31T23:16:20.096 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 727 k 2023-10-31T23:16:20.096 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-31T23:16:20.096 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-31T23:16:20.096 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-31T23:16:20.097 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 469 k 2023-10-31T23:16:20.097 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-31T23:16:20.097 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 4.5 M 2023-10-31T23:16:20.097 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-31T23:16:20.097 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-31T23:16:20.098 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-31T23:16:20.098 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse 2023-10-31T23:16:20.098 INFO:teuthology.orchestra.run.smithi008.stdout: x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 45 k 2023-10-31T23:16:20.098 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 127 k 2023-10-31T23:16:20.098 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 162 k 2023-10-31T23:16:20.099 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-31T23:16:20.099 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 321 k 2023-10-31T23:16:20.099 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 298 k 2023-10-31T23:16:20.099 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 99 k 2023-10-31T23:16:20.099 INFO:teuthology.orchestra.run.smithi008.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-31T23:16:20.099 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-31T23:16:20.100 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:16:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:16:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:Install 28 Packages 2023-10-31T23:16:20.100 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 2 Packages 2023-10-31T23:16:20.101 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 54 M 2023-10-31T23:16:20.101 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:16:20.105 INFO:teuthology.orchestra.run.smithi071.stdout:(13/30): python3-rgw-18.0.0-6795.gd1dcabba.el9. 914 kB/s | 99 kB 00:00 2023-10-31T23:16:20.155 INFO:teuthology.orchestra.run.smithi071.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 791 kB/s | 106 kB 00:00 2023-10-31T23:16:20.189 INFO:teuthology.orchestra.run.smithi071.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2023-10-31T23:16:20.226 INFO:teuthology.orchestra.run.smithi071.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 5.4 MB/s | 661 kB 00:00 2023-10-31T23:16:20.268 INFO:teuthology.orchestra.run.smithi071.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 282 kB 00:00 2023-10-31T23:16:20.284 INFO:teuthology.orchestra.run.smithi071.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 435 kB/s | 41 kB 00:00 2023-10-31T23:16:20.393 INFO:teuthology.orchestra.run.smithi071.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 887 kB/s | 111 kB 00:00 2023-10-31T23:16:20.418 INFO:teuthology.orchestra.run.smithi071.stdout:(20/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2023-10-31T23:16:20.452 INFO:teuthology.orchestra.run.smithi071.stdout:(21/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.8 MB/s | 309 kB 00:00 2023-10-31T23:16:20.494 INFO:teuthology.orchestra.run.smithi071.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2023-10-31T23:16:20.520 INFO:teuthology.orchestra.run.smithi071.stdout:(23/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 242 kB/s | 24 kB 00:00 2023-10-31T23:16:20.545 INFO:teuthology.orchestra.run.smithi071.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-10-31T23:16:20.604 INFO:teuthology.orchestra.run.smithi071.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-10-31T23:16:20.646 INFO:teuthology.orchestra.run.smithi071.stdout:(26/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 6.5 MB/s | 837 kB 00:00 2023-10-31T23:16:20.704 INFO:teuthology.orchestra.run.smithi071.stdout:(27/30): libarrow-9.0.0-9.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2023-10-31T23:16:20.771 INFO:teuthology.orchestra.run.smithi071.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2023-10-31T23:16:21.225 INFO:teuthology.orchestra.run.smithi008.stdout:(1/30): ceph-base-18.0.0-6795.gd1dcabba.el9.x86 6.9 MB/s | 6.6 MB 00:00 2023-10-31T23:16:21.283 INFO:teuthology.orchestra.run.smithi008.stdout:(2/30): ceph-selinux-18.0.0-6795.gd1dcabba.el9. 413 kB/s | 24 kB 00:00 2023-10-31T23:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout:(29/30): librbd1-18.0.0-6795.gd1dcabba.el9.x86_ 5.2 MB/s | 3.0 MB 00:00 2023-10-31T23:16:21.355 INFO:teuthology.orchestra.run.smithi071.stdout:(30/30): librados2-18.0.0-6795.gd1dcabba.el9.x8 4.4 MB/s | 3.1 MB 00:00 2023-10-31T23:16:21.358 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:16:21.359 INFO:teuthology.orchestra.run.smithi071.stdout:Total 12 MB/s | 54 MB 00:04 2023-10-31T23:16:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:16:21.383 INFO:teuthology.orchestra.run.smithi008.stdout:(3/30): libcephfs2-18.0.0-6795.gd1dcabba.el9.x8 7.1 MB/s | 727 kB 00:00 2023-10-31T23:16:21.407 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:16:21.407 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:16:21.459 INFO:teuthology.orchestra.run.smithi008.stdout:(4/30): libradosstriper1-18.0.0-6795.gd1dcabba. 6.1 MB/s | 469 kB 00:00 2023-10-31T23:16:21.869 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:16:21.869 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:16:21.909 INFO:teuthology.orchestra.run.smithi008.stdout:(5/30): librgw2-18.0.0-6795.gd1dcabba.el9.x86_6 10 MB/s | 4.5 MB 00:00 2023-10-31T23:16:21.959 INFO:teuthology.orchestra.run.smithi008.stdout:(6/30): python3-ceph-argparse-18.0.0-6795.gd1dc 905 kB/s | 45 kB 00:00 2023-10-31T23:16:22.135 INFO:teuthology.orchestra.run.smithi008.stdout:(7/30): ceph-common-18.0.0-6795.gd1dcabba.el9.x 9.3 MB/s | 17 MB 00:01 2023-10-31T23:16:22.152 INFO:teuthology.orchestra.run.smithi008.stdout:(8/30): python3-ceph-common-18.0.0-6795.gd1dcab 660 kB/s | 127 kB 00:00 2023-10-31T23:16:22.185 INFO:teuthology.orchestra.run.smithi008.stdout:(9/30): python3-cephfs-18.0.0-6795.gd1dcabba.el 3.2 MB/s | 162 kB 00:00 2023-10-31T23:16:22.210 INFO:teuthology.orchestra.run.smithi008.stdout:(10/30): python3-rados-18.0.0-6795.gd1dcabba.el 5.4 MB/s | 321 kB 00:00 2023-10-31T23:16:22.236 INFO:teuthology.orchestra.run.smithi008.stdout:(11/30): python3-rbd-18.0.0-6795.gd1dcabba.el9. 5.8 MB/s | 298 kB 00:00 2023-10-31T23:16:22.261 INFO:teuthology.orchestra.run.smithi008.stdout:(12/30): python3-rgw-18.0.0-6795.gd1dcabba.el9. 1.9 MB/s | 99 kB 00:00 2023-10-31T23:16:22.370 INFO:teuthology.orchestra.run.smithi008.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 793 kB/s | 106 kB 00:00 2023-10-31T23:16:22.403 INFO:teuthology.orchestra.run.smithi008.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2023-10-31T23:16:22.445 INFO:teuthology.orchestra.run.smithi008.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-10-31T23:16:22.470 INFO:teuthology.orchestra.run.smithi008.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-10-31T23:16:22.495 INFO:teuthology.orchestra.run.smithi008.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 826 kB/s | 41 kB 00:00 2023-10-31T23:16:22.596 INFO:teuthology.orchestra.run.smithi008.stdout:(18/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2023-10-31T23:16:22.621 INFO:teuthology.orchestra.run.smithi008.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 883 kB/s | 111 kB 00:00 2023-10-31T23:16:22.763 INFO:teuthology.orchestra.run.smithi008.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.8 MB/s | 309 kB 00:00 2023-10-31T23:16:22.830 INFO:teuthology.orchestra.run.smithi008.stdout:(21/30): libarrow-9.0.0-9.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2023-10-31T23:16:22.855 INFO:teuthology.orchestra.run.smithi008.stdout:(22/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 265 kB/s | 24 kB 00:00 2023-10-31T23:16:22.881 INFO:teuthology.orchestra.run.smithi008.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2023-10-31T23:16:22.906 INFO:teuthology.orchestra.run.smithi008.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-10-31T23:16:23.095 INFO:teuthology.orchestra.run.smithi008.stdout:(25/30): ceph-radosgw-18.0.0-6795.gd1dcabba.el9 3.0 MB/s | 8.4 MB 00:02 2023-10-31T23:16:23.123 INFO:teuthology.orchestra.run.smithi008.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 884 kB/s | 192 kB 00:00 2023-10-31T23:16:23.157 INFO:teuthology.orchestra.run.smithi008.stdout:(27/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.0 MB/s | 837 kB 00:00 2023-10-31T23:16:23.270 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:16:23.308 INFO:teuthology.orchestra.run.smithi008.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 7.4 MB/s | 1.6 MB 00:00 2023-10-31T23:16:23.416 INFO:teuthology.orchestra.run.smithi008.stdout:(29/30): librados2-18.0.0-6795.gd1dcabba.el9.x8 11 MB/s | 3.1 MB 00:00 2023-10-31T23:16:23.500 INFO:teuthology.orchestra.run.smithi008.stdout:(30/30): librbd1-18.0.0-6795.gd1dcabba.el9.x86_ 8.9 MB/s | 3.0 MB 00:00 2023-10-31T23:16:23.503 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:16:23.503 INFO:teuthology.orchestra.run.smithi008.stdout:Total 16 MB/s | 54 MB 00:03 2023-10-31T23:16:23.515 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:16:23.555 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:16:23.555 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:16:23.684 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-10-31T23:16:23.724 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/32 2023-10-31T23:16:23.814 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/32 2023-10-31T23:16:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 3/32 2023-10-31T23:16:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/32 2023-10-31T23:16:23.996 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/32 2023-10-31T23:16:24.034 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/32 2023-10-31T23:16:24.063 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/32 2023-10-31T23:16:24.066 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:16:24.066 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:16:24.100 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/32 2023-10-31T23:16:24.144 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:18.0.0-6795.gd1dcabba.el9. 8/32 2023-10-31T23:16:24.212 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 9/32 2023-10-31T23:16:24.236 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_6 10/32 2023-10-31T23:16:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_6 10/32 2023-10-31T23:16:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/32 2023-10-31T23:16:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-10-31T23:16:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-10-31T23:16:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-10-31T23:16:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-10-31T23:16:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-10-31T23:16:24.631 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-10-31T23:16:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-31T23:16:24.980 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-10-31T23:16:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 20/32 2023-10-31T23:16:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 20/32 2023-10-31T23:16:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 21/32 2023-10-31T23:16:25.177 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-10-31T23:16:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:16:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-10-31T23:16:25.630 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 24/32 2023-10-31T23:16:25.700 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 24/32 2023-10-31T23:16:25.768 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 25/32 2023-10-31T23:16:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:18.0.0-6795.gd1dcabba.el9.x8 26/32 2023-10-31T23:16:25.911 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-10-31T23:16:25.960 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/32 2023-10-31T23:16:26.056 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/32 2023-10-31T23:16:26.143 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 3/32 2023-10-31T23:16:26.178 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/32 2023-10-31T23:16:26.241 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/32 2023-10-31T23:16:26.287 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/32 2023-10-31T23:16:26.316 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/32 2023-10-31T23:16:26.354 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/32 2023-10-31T23:16:26.399 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:18.0.0-6795.gd1dcabba.el9. 8/32 2023-10-31T23:16:26.482 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 9/32 2023-10-31T23:16:26.515 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_6 10/32 2023-10-31T23:16:26.705 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_6 10/32 2023-10-31T23:16:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/32 2023-10-31T23:16:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-10-31T23:16:26.899 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-10-31T23:16:26.940 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-10-31T23:16:26.972 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-10-31T23:16:26.990 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-10-31T23:16:27.026 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-10-31T23:16:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-31T23:16:27.387 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-10-31T23:16:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 20/32 2023-10-31T23:16:27.505 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 20/32 2023-10-31T23:16:27.535 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 21/32 2023-10-31T23:16:27.571 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-10-31T23:16:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 27/32 2023-10-31T23:16:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 27/32 2023-10-31T23:16:28.027 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-10-31T23:16:28.050 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 24/32 2023-10-31T23:16:28.104 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 24/32 2023-10-31T23:16:28.183 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 25/32 2023-10-31T23:16:28.227 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:18.0.0-6795.gd1dcabba.el9.x8 26/32 2023-10-31T23:16:28.713 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 27/32 2023-10-31T23:16:28.757 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 28/32 2023-10-31T23:16:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 28/32 2023-10-31T23:16:28.842 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-31T23:16:28.842 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-31T23:16:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/32 2023-10-31T23:16:30.333 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 27/32 2023-10-31T23:16:30.369 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 27/32 2023-10-31T23:16:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 27/32 2023-10-31T23:16:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 28/32 2023-10-31T23:16:31.313 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 28/32 2023-10-31T23:16:31.314 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-31T23:16:31.314 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-31T23:16:31.314 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:31.349 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/32 2023-10-31T23:16:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/32 2023-10-31T23:16:38.399 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2023-10-31T23:16:38.399 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2023-10-31T23:16:38.399 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2023-10-31T23:16:38.399 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2023-10-31T23:16:38.399 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2023-10-31T23:16:38.400 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2023-10-31T23:16:38.400 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2023-10-31T23:16:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:39.235 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/32 2023-10-31T23:16:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/32 2023-10-31T23:16:39.259 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:16:39.260 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-31T23:16:39.260 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-31T23:16:39.260 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-31T23:16:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-31T23:16:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-31T23:16:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-31T23:16:40.498 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-31T23:16:40.499 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/32 2023-10-31T23:16:40.499 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/32 2023-10-31T23:16:40.499 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 3/32 2023-10-31T23:16:40.499 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/32 2023-10-31T23:16:40.499 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 5/32 2023-10-31T23:16:40.499 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_6 6/32 2023-10-31T23:16:40.500 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 7/32 2023-10-31T23:16:40.500 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6795.gd1dcabba.el9. 8/32 2023-10-31T23:16:40.500 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:18.0.0-6795.gd1dcabba.el9.x8 9/32 2023-10-31T23:16:40.500 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 10/32 2023-10-31T23:16:40.500 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 11/32 2023-10-31T23:16:40.500 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 12/32 2023-10-31T23:16:40.501 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 13/32 2023-10-31T23:16:40.501 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-10-31T23:16:40.501 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-10-31T23:16:40.501 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-10-31T23:16:40.501 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-10-31T23:16:40.502 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-31T23:16:40.502 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-10-31T23:16:40.502 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-10-31T23:16:40.502 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-10-31T23:16:40.502 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-10-31T23:16:40.503 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-10-31T23:16:40.503 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-10-31T23:16:40.503 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-10-31T23:16:40.503 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-10-31T23:16:40.503 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-10-31T23:16:40.503 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-10-31T23:16:40.504 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/32 2023-10-31T23:16:40.504 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-10-31T23:16:40.504 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 31/32 2023-10-31T23:16:41.626 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-10-31T23:16:41.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:41.626 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2023-10-31T23:16:41.627 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.627 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.627 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:16:41.627 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-31T23:16:41.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.628 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.628 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.628 INFO:teuthology.orchestra.run.smithi071.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-31T23:16:41.628 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-31T23:16:41.628 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-31T23:16:41.629 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-31T23:16:41.629 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.629 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-31T23:16:41.629 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-31T23:16:41.629 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-31T23:16:41.630 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.630 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-31T23:16:41.630 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.630 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-31T23:16:41.630 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-31T23:16:41.631 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-31T23:16:41.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-31T23:16:41.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:41.632 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-3.el9.x86_64 2023-10-31T23:16:41.632 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-31T23:16:41.632 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:41.633 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:16:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/32 2023-10-31T23:16:41.633 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-31T23:16:41.633 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-31T23:16:41.634 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-31T23:16:41.634 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-31T23:16:41.634 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-31T23:16:41.634 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /root 2023-10-31T23:16:41.634 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-31T23:16:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:41.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2023-10-31T23:16:42.498 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/32 2023-10-31T23:16:42.517 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:28 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:16:42.524 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/32 2023-10-31T23:16:42.524 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:16:42.524 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-31T23:16:42.524 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-31T23:16:42.525 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-31T23:16:42.525 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:42.526 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-31T23:16:42.617 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-31T23:16:42.617 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-31T23:16:42.665 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:16:42.666 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:16:42.666 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:16:42.667 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:16:42.667 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:16:42.667 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 117 M 2023-10-31T23:16:42.667 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:16:42.667 INFO:teuthology.orchestra.run.smithi071.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-10-31T23:16:42.668 INFO:teuthology.orchestra.run.smithi071.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-31T23:16:42.668 INFO:teuthology.orchestra.run.smithi071.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-10-31T23:16:42.668 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 161 k 2023-10-31T23:16:42.668 INFO:teuthology.orchestra.run.smithi071.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-10-31T23:16:42.669 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-31T23:16:42.669 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-31T23:16:42.669 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-31T23:16:42.669 INFO:teuthology.orchestra.run.smithi071.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-10-31T23:16:42.669 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:42.670 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:16:42.670 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:16:42.670 INFO:teuthology.orchestra.run.smithi071.stdout:Install 10 Packages 2023-10-31T23:16:42.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:16:42.671 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 120 M 2023-10-31T23:16:42.671 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 1.1 G 2023-10-31T23:16:42.671 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:16:43.315 INFO:teuthology.orchestra.run.smithi071.stdout:(1/10): libasan-11.4.1-2.3.el9.x86_64.rpm 2.6 MB/s | 418 kB 00:00 2023-10-31T23:16:43.348 INFO:teuthology.orchestra.run.smithi071.stdout:(2/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-10-31T23:16:43.381 INFO:teuthology.orchestra.run.smithi071.stdout:(3/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.3 MB/s | 217 kB 00:00 2023-10-31T23:16:43.423 INFO:teuthology.orchestra.run.smithi071.stdout:(4/10): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-10-31T23:16:43.457 INFO:teuthology.orchestra.run.smithi071.stdout:(5/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-10-31T23:16:43.557 INFO:teuthology.orchestra.run.smithi071.stdout:(6/10): libcephsqlite-18.0.0-6795.gd1dcabba.el9 399 kB/s | 161 kB 00:00 2023-10-31T23:16:43.820 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-31T23:16:43.821 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/32 2023-10-31T23:16:43.821 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/32 2023-10-31T23:16:43.821 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 3/32 2023-10-31T23:16:43.821 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/32 2023-10-31T23:16:43.822 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 5/32 2023-10-31T23:16:43.822 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_6 6/32 2023-10-31T23:16:43.822 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 7/32 2023-10-31T23:16:43.822 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6795.gd1dcabba.el9. 8/32 2023-10-31T23:16:43.822 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:18.0.0-6795.gd1dcabba.el9.x8 9/32 2023-10-31T23:16:43.823 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 10/32 2023-10-31T23:16:43.823 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 11/32 2023-10-31T23:16:43.823 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 12/32 2023-10-31T23:16:43.823 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 13/32 2023-10-31T23:16:43.823 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-10-31T23:16:43.823 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-10-31T23:16:43.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-10-31T23:16:43.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-10-31T23:16:43.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-31T23:16:43.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-10-31T23:16:43.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-10-31T23:16:43.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-10-31T23:16:43.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-10-31T23:16:43.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-10-31T23:16:43.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-10-31T23:16:43.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-10-31T23:16:43.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-10-31T23:16:43.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-10-31T23:16:43.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-10-31T23:16:43.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/32 2023-10-31T23:16:43.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-10-31T23:16:43.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 31/32 2023-10-31T23:16:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:(7/10): cryptopp-8.6.0-1.el9.x86_64.rpm 3.3 MB/s | 1.3 MB 00:00 2023-10-31T23:16:44.016 INFO:teuthology.orchestra.run.smithi071.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2023-10-31T23:16:44.275 INFO:teuthology.orchestra.run.smithi071.stdout:(9/10): jq-1.6-15.el9.x86_64.rpm 228 kB/s | 187 kB 00:00 2023-10-31T23:16:44.714 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-10-31T23:16:44.714 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-31T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-31T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-31T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-31T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-31T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-31T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-31T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-31T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-31T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-31T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-31T23:16:44.719 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-31T23:16:44.719 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-31T23:16:44.719 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.719 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.719 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.720 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-31T23:16:44.720 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.720 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.720 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:16:44.720 INFO:teuthology.orchestra.run.smithi008.stdout: re2-1:20211101-3.el9.x86_64 2023-10-31T23:16:44.720 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-31T23:16:44.721 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:44.721 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:16:45.061 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-test 2023-10-31T23:16:45.627 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:28 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:16:45.777 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:16:45.778 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:16:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:16:45.779 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:16:45.779 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:16:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 117 M 2023-10-31T23:16:45.779 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:16:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-10-31T23:16:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-31T23:16:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-10-31T23:16:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 161 k 2023-10-31T23:16:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-10-31T23:16:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-31T23:16:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-31T23:16:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-31T23:16:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-10-31T23:16:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:45.781 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:16:45.782 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:16:45.782 INFO:teuthology.orchestra.run.smithi008.stdout:Install 10 Packages 2023-10-31T23:16:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:16:45.783 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 120 M 2023-10-31T23:16:45.783 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 1.1 G 2023-10-31T23:16:45.783 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:16:46.178 INFO:teuthology.orchestra.run.smithi008.stdout:(1/10): libasan-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 418 kB 00:00 2023-10-31T23:16:46.211 INFO:teuthology.orchestra.run.smithi008.stdout:(2/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-10-31T23:16:46.253 INFO:teuthology.orchestra.run.smithi008.stdout:(3/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-10-31T23:16:46.304 INFO:teuthology.orchestra.run.smithi008.stdout:(4/10): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 300 kB 00:00 2023-10-31T23:16:46.337 INFO:teuthology.orchestra.run.smithi008.stdout:(5/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2023-10-31T23:16:46.471 INFO:teuthology.orchestra.run.smithi008.stdout:(6/10): jq-1.6-15.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-10-31T23:16:46.663 INFO:teuthology.orchestra.run.smithi008.stdout:(7/10): libcephsqlite-18.0.0-6795.gd1dcabba.el9 247 kB/s | 161 kB 00:00 2023-10-31T23:16:47.296 INFO:teuthology.orchestra.run.smithi008.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 192 kB/s | 122 kB 00:00 2023-10-31T23:16:47.430 INFO:teuthology.orchestra.run.smithi008.stdout:(9/10): cryptopp-8.6.0-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:00 2023-10-31T23:16:51.632 INFO:teuthology.orchestra.run.smithi071.stdout:(10/10): ceph-test-18.0.0-6795.gd1dcabba.el9.x8 14 MB/s | 117 MB 00:08 2023-10-31T23:16:51.636 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:16:51.636 INFO:teuthology.orchestra.run.smithi071.stdout:Total 13 MB/s | 120 MB 00:08 2023-10-31T23:16:51.649 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:16:51.672 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:16:51.672 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:16:52.488 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:16:52.489 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:16:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:16:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-10-31T23:16:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-10-31T23:16:53.762 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-10-31T23:16:53.800 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-10-31T23:16:53.838 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-31T23:16:53.872 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : jq-1.6-15.el9.x86_64 6/10 2023-10-31T23:16:53.907 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-10-31T23:16:53.951 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-10-31T23:16:53.978 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 9/10 2023-10-31T23:16:55.022 INFO:teuthology.orchestra.run.smithi008.stdout:(10/10): ceph-test-18.0.0-6795.gd1dcabba.el9.x8 13 MB/s | 117 MB 00:09 2023-10-31T23:16:55.026 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:16:55.026 INFO:teuthology.orchestra.run.smithi008.stdout:Total 13 MB/s | 120 MB 00:09 2023-10-31T23:16:55.040 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:16:55.065 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:16:55.065 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:16:55.929 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:16:55.930 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:16:57.069 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:16:57.156 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-10-31T23:16:57.197 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-10-31T23:16:57.240 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-10-31T23:16:57.274 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-10-31T23:16:57.315 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-31T23:16:57.345 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-15.el9.x86_64 6/10 2023-10-31T23:16:57.380 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-10-31T23:16:57.416 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-10-31T23:16:57.443 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 9/10 2023-10-31T23:17:10.255 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 9/10 2023-10-31T23:17:10.324 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 10/10 2023-10-31T23:17:14.621 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 9/10 2023-10-31T23:17:14.701 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 10/10 2023-10-31T23:17:18.452 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 10/10 2023-10-31T23:17:18.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/10 2023-10-31T23:17:18.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/10 2023-10-31T23:17:18.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 3/10 2023-10-31T23:17:18.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 4/10 2023-10-31T23:17:18.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-31T23:17:18.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 6/10 2023-10-31T23:17:18.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 7/10 2023-10-31T23:17:18.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : jq-1.6-15.el9.x86_64 8/10 2023-10-31T23:17:18.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-10-31T23:17:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-10-31T23:17:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:18.893 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:17:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:17:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-10-31T23:17:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: jq-1.6-15.el9.x86_64 2023-10-31T23:17:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-10-31T23:17:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:17:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-10-31T23:17:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-31T23:17:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-31T23:17:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-31T23:17:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-10-31T23:17:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:18.896 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:17:19.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2023-10-31T23:17:19.766 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:05 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:17:19.908 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:17:19.910 INFO:teuthology.orchestra.run.smithi071.stdout:========================================================================================= 2023-10-31T23:17:19.910 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:17:19.910 INFO:teuthology.orchestra.run.smithi071.stdout:========================================================================================= 2023-10-31T23:17:19.911 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:17:19.911 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 6.5 k 2023-10-31T23:17:19.911 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:17:19.911 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 2.0 M 2023-10-31T23:17:19.911 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 1.5 M 2023-10-31T23:17:19.912 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 243 k 2023-10-31T23:17:19.912 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 8.8 M 2023-10-31T23:17:19.912 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 117 M 2023-10-31T23:17:19.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-31T23:17:19.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-31T23:17:19.912 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-31T23:17:19.913 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-31T23:17:19.913 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-31T23:17:19.913 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-31T23:17:19.913 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-31T23:17:19.913 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-31T23:17:19.914 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-31T23:17:19.914 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-31T23:17:19.914 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-31T23:17:19.914 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-31T23:17:19.914 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-31T23:17:19.914 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-31T23:17:19.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-31T23:17:19.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-31T23:17:19.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-31T23:17:19.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-31T23:17:19.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-31T23:17:19.916 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-31T23:17:19.916 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-31T23:17:19.916 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-31T23:17:19.916 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-31T23:17:19.916 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-10-31T23:17:19.917 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-31T23:17:19.917 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-31T23:17:19.917 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-31T23:17:19.917 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:19.917 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:17:19.917 INFO:teuthology.orchestra.run.smithi071.stdout:========================================================================================= 2023-10-31T23:17:19.918 INFO:teuthology.orchestra.run.smithi071.stdout:Install 33 Packages 2023-10-31T23:17:19.918 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:19.918 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 133 M 2023-10-31T23:17:19.919 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 1.4 G 2023-10-31T23:17:19.919 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:17:20.448 INFO:teuthology.orchestra.run.smithi071.stdout:(1/33): ceph-18.0.0-6795.gd1dcabba.el9.x86_64.r 36 kB/s | 6.5 kB 00:00 2023-10-31T23:17:20.715 INFO:teuthology.orchestra.run.smithi071.stdout:(2/33): ceph-mds-18.0.0-6795.gd1dcabba.el9.x86_ 4.4 MB/s | 2.0 MB 00:00 2023-10-31T23:17:20.757 INFO:teuthology.orchestra.run.smithi071.stdout:(3/33): ceph-mgr-18.0.0-6795.gd1dcabba.el9.x86_ 3.0 MB/s | 1.5 MB 00:00 2023-10-31T23:17:20.857 INFO:teuthology.orchestra.run.smithi071.stdout:(4/33): ceph-mgr-modules-core-18.0.0-6795.gd1dc 2.4 MB/s | 243 kB 00:00 2023-10-31T23:17:20.957 INFO:teuthology.orchestra.run.smithi071.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2023-10-31T23:17:20.991 INFO:teuthology.orchestra.run.smithi071.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 949 kB/s | 32 kB 00:00 2023-10-31T23:17:21.024 INFO:teuthology.orchestra.run.smithi071.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-31T23:17:21.066 INFO:teuthology.orchestra.run.smithi071.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-10-31T23:17:21.100 INFO:teuthology.orchestra.run.smithi071.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-10-31T23:17:21.134 INFO:teuthology.orchestra.run.smithi071.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-10-31T23:17:21.167 INFO:teuthology.orchestra.run.smithi071.stdout:(11/33): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-10-31T23:17:21.201 INFO:teuthology.orchestra.run.smithi071.stdout:(12/33): python3-urllib3-1.26.5-4.el9.noarch.rp 5.4 MB/s | 187 kB 00:00 2023-10-31T23:17:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:(13/33): ceph-mon-18.0.0-6795.gd1dcabba.el9.x86 8.5 MB/s | 8.8 MB 00:01 2023-10-31T23:17:21.568 INFO:teuthology.orchestra.run.smithi071.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 614 kB/s | 51 kB 00:00 2023-10-31T23:17:21.702 INFO:teuthology.orchestra.run.smithi071.stdout:(15/33): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2023-10-31T23:17:21.869 INFO:teuthology.orchestra.run.smithi071.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 145 kB/s | 43 kB 00:00 2023-10-31T23:17:22.069 INFO:teuthology.orchestra.run.smithi071.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 470 kB/s | 172 kB 00:00 2023-10-31T23:17:22.094 INFO:teuthology.orchestra.run.smithi071.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2023-10-31T23:17:22.144 INFO:teuthology.orchestra.run.smithi071.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2023-10-31T23:17:22.170 INFO:teuthology.orchestra.run.smithi071.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2023-10-31T23:17:22.220 INFO:teuthology.orchestra.run.smithi071.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2023-10-31T23:17:22.245 INFO:teuthology.orchestra.run.smithi071.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2023-10-31T23:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2023-10-31T23:17:22.321 INFO:teuthology.orchestra.run.smithi071.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2023-10-31T23:17:22.388 INFO:teuthology.orchestra.run.smithi071.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 859 kB/s | 79 kB 00:00 2023-10-31T23:17:22.421 INFO:teuthology.orchestra.run.smithi071.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-10-31T23:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 219 kB/s | 16 kB 00:00 2023-10-31T23:17:22.497 INFO:teuthology.orchestra.run.smithi071.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2023-10-31T23:17:22.539 INFO:teuthology.orchestra.run.smithi071.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2023-10-31T23:17:22.589 INFO:teuthology.orchestra.run.smithi071.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-10-31T23:17:22.665 INFO:teuthology.orchestra.run.smithi071.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 266 kB/s | 20 kB 00:00 2023-10-31T23:17:22.698 INFO:teuthology.orchestra.run.smithi071.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.6 MB/s | 427 kB 00:00 2023-10-31T23:17:23.060 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 10/10 2023-10-31T23:17:23.061 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/10 2023-10-31T23:17:23.061 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/10 2023-10-31T23:17:23.061 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 3/10 2023-10-31T23:17:23.061 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 4/10 2023-10-31T23:17:23.061 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-10-31T23:17:23.062 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 6/10 2023-10-31T23:17:23.062 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 7/10 2023-10-31T23:17:23.062 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-15.el9.x86_64 8/10 2023-10-31T23:17:23.062 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-10-31T23:17:23.557 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-10-31T23:17:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:23.558 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:17:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:17:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-10-31T23:17:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-15.el9.x86_64 2023-10-31T23:17:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-10-31T23:17:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:17:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-10-31T23:17:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-31T23:17:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-31T23:17:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-31T23:17:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-10-31T23:17:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:23.560 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:17:23.883 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph 2023-10-31T23:17:24.457 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:07 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:17:24.610 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:17:24.612 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================= 2023-10-31T23:17:24.613 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:17:24.613 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================= 2023-10-31T23:17:24.613 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:17:24.613 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 6.5 k 2023-10-31T23:17:24.613 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:17:24.614 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 2.0 M 2023-10-31T23:17:24.614 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 1.5 M 2023-10-31T23:17:24.614 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 243 k 2023-10-31T23:17:24.614 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 8.8 M 2023-10-31T23:17:24.615 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 117 M 2023-10-31T23:17:24.615 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-31T23:17:24.615 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-31T23:17:24.615 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-31T23:17:24.615 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-31T23:17:24.616 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-31T23:17:24.616 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-31T23:17:24.616 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-31T23:17:24.616 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-31T23:17:24.616 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-31T23:17:24.617 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-31T23:17:24.617 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-31T23:17:24.617 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-31T23:17:24.617 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-31T23:17:24.617 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-31T23:17:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-31T23:17:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-31T23:17:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-31T23:17:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-31T23:17:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-31T23:17:24.619 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-31T23:17:24.619 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-31T23:17:24.619 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-31T23:17:24.619 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-31T23:17:24.619 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-10-31T23:17:24.620 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-31T23:17:24.620 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-31T23:17:24.620 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-31T23:17:24.620 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:24.621 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:17:24.621 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================= 2023-10-31T23:17:24.621 INFO:teuthology.orchestra.run.smithi008.stdout:Install 33 Packages 2023-10-31T23:17:24.622 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:24.622 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 133 M 2023-10-31T23:17:24.623 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 1.4 G 2023-10-31T23:17:24.623 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:17:25.128 INFO:teuthology.orchestra.run.smithi008.stdout:(1/33): ceph-18.0.0-6795.gd1dcabba.el9.x86_64.r 36 kB/s | 6.5 kB 00:00 2023-10-31T23:17:25.711 INFO:teuthology.orchestra.run.smithi008.stdout:(2/33): ceph-mgr-18.0.0-6795.gd1dcabba.el9.x86_ 1.9 MB/s | 1.5 MB 00:00 2023-10-31T23:17:25.862 INFO:teuthology.orchestra.run.smithi008.stdout:(3/33): ceph-mds-18.0.0-6795.gd1dcabba.el9.x86_ 2.2 MB/s | 2.0 MB 00:00 2023-10-31T23:17:25.929 INFO:teuthology.orchestra.run.smithi008.stdout:(4/33): ceph-mgr-modules-core-18.0.0-6795.gd1dc 3.6 MB/s | 243 kB 00:00 2023-10-31T23:17:26.029 INFO:teuthology.orchestra.run.smithi008.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2023-10-31T23:17:26.062 INFO:teuthology.orchestra.run.smithi008.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 954 kB/s | 32 kB 00:00 2023-10-31T23:17:26.096 INFO:teuthology.orchestra.run.smithi008.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-31T23:17:26.138 INFO:teuthology.orchestra.run.smithi008.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2023-10-31T23:17:26.171 INFO:teuthology.orchestra.run.smithi008.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-10-31T23:17:26.205 INFO:teuthology.orchestra.run.smithi008.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-10-31T23:17:26.238 INFO:teuthology.orchestra.run.smithi008.stdout:(11/33): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-10-31T23:17:26.272 INFO:teuthology.orchestra.run.smithi008.stdout:(12/33): python3-urllib3-1.26.5-4.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2023-10-31T23:17:26.339 INFO:teuthology.orchestra.run.smithi071.stdout:(33/33): ceph-osd-18.0.0-6795.gd1dcabba.el9.x86 21 MB/s | 117 MB 00:05 2023-10-31T23:17:26.346 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:17:26.346 INFO:teuthology.orchestra.run.smithi071.stdout:Total 21 MB/s | 133 MB 00:06 2023-10-31T23:17:26.380 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:17:26.419 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:17:26.419 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:17:26.522 INFO:teuthology.orchestra.run.smithi008.stdout:(13/33): ceph-mon-18.0.0-6795.gd1dcabba.el9.x86 6.3 MB/s | 8.8 MB 00:01 2023-10-31T23:17:26.873 INFO:teuthology.orchestra.run.smithi008.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 146 kB/s | 51 kB 00:00 2023-10-31T23:17:27.032 INFO:teuthology.orchestra.run.smithi008.stdout:(15/33): python3-cryptography-36.0.1-4.el9.x86_ 1.6 MB/s | 1.2 MB 00:00 2023-10-31T23:17:27.057 INFO:teuthology.orchestra.run.smithi008.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 237 kB/s | 43 kB 00:00 2023-10-31T23:17:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2023-10-31T23:17:27.157 INFO:teuthology.orchestra.run.smithi008.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2023-10-31T23:17:27.199 INFO:teuthology.orchestra.run.smithi008.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 424 kB/s | 18 kB 00:00 2023-10-31T23:17:27.241 INFO:teuthology.orchestra.run.smithi008.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 555 kB/s | 23 kB 00:00 2023-10-31T23:17:27.275 INFO:teuthology.orchestra.run.smithi008.stdout:(21/33): python3-jaraco-functools-3.5.0-2.el9.n 585 kB/s | 19 kB 00:00 2023-10-31T23:17:27.308 INFO:teuthology.orchestra.run.smithi008.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2023-10-31T23:17:27.334 INFO:teuthology.orchestra.run.smithi008.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2023-10-31T23:17:27.351 INFO:teuthology.orchestra.run.smithi008.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2023-10-31T23:17:27.376 INFO:teuthology.orchestra.run.smithi008.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2023-10-31T23:17:27.395 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:17:27.395 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:17:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 493 kB/s | 16 kB 00:00 2023-10-31T23:17:27.445 INFO:teuthology.orchestra.run.smithi008.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.8 MB/s | 272 kB 00:00 2023-10-31T23:17:27.470 INFO:teuthology.orchestra.run.smithi008.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2023-10-31T23:17:27.496 INFO:teuthology.orchestra.run.smithi008.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2023-10-31T23:17:27.562 INFO:teuthology.orchestra.run.smithi008.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-10-31T23:17:27.604 INFO:teuthology.orchestra.run.smithi008.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 480 kB/s | 20 kB 00:00 2023-10-31T23:17:27.638 INFO:teuthology.orchestra.run.smithi008.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2023-10-31T23:17:29.252 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:17:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-10-31T23:17:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-10-31T23:17:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-10-31T23:17:29.497 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-10-31T23:17:29.584 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-10-31T23:17:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-10-31T23:17:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-10-31T23:17:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-10-31T23:17:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-10-31T23:17:29.857 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-10-31T23:17:29.906 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-10-31T23:17:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-31T23:17:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-10-31T23:17:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-10-31T23:17:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-10-31T23:17:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-10-31T23:17:30.315 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-10-31T23:17:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-10-31T23:17:30.425 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-10-31T23:17:30.467 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-10-31T23:17:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-10-31T23:17:30.534 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-10-31T23:17:30.623 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-10-31T23:17:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-10-31T23:17:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-10-31T23:17:30.881 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-10-31T23:17:31.009 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-31T23:17:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6795.gd1dcabba.el9. 28/33 2023-10-31T23:17:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/33 2023-10-31T23:17:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/33 2023-10-31T23:17:31.228 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:31.228 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-31T23:17:31.228 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-31T23:17:31.229 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-31T23:17:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:31.380 INFO:teuthology.orchestra.run.smithi008.stdout:(33/33): ceph-osd-18.0.0-6795.gd1dcabba.el9.x86 21 MB/s | 117 MB 00:05 2023-10-31T23:17:31.386 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:17:31.387 INFO:teuthology.orchestra.run.smithi008.stdout:Total 20 MB/s | 133 MB 00:06 2023-10-31T23:17:31.420 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:17:31.465 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:17:31.465 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:17:32.480 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:17:32.481 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:17:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:17:34.574 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-10-31T23:17:34.606 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-10-31T23:17:34.640 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-10-31T23:17:34.737 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-10-31T23:17:34.820 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-10-31T23:17:34.868 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-10-31T23:17:34.904 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-10-31T23:17:34.977 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-10-31T23:17:35.028 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-10-31T23:17:35.066 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-10-31T23:17:35.124 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-10-31T23:17:35.188 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-31T23:17:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-10-31T23:17:35.444 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-10-31T23:17:35.493 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-10-31T23:17:35.526 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-10-31T23:17:35.564 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-10-31T23:17:35.644 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-10-31T23:17:35.682 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-10-31T23:17:35.715 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-10-31T23:17:35.758 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-10-31T23:17:35.792 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-10-31T23:17:35.885 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-10-31T23:17:35.933 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-10-31T23:17:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-10-31T23:17:36.165 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-10-31T23:17:36.297 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-31T23:17:36.462 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6795.gd1dcabba.el9. 28/33 2023-10-31T23:17:36.494 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/33 2023-10-31T23:17:36.520 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 29/33 2023-10-31T23:17:36.521 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:36.521 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-31T23:17:36.521 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-31T23:17:36.521 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-31T23:17:36.521 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/33 2023-10-31T23:17:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/33 2023-10-31T23:17:49.436 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:49.436 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-31T23:17:49.436 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-31T23:17:49.436 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-31T23:17:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 31/33 2023-10-31T23:17:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 31/33 2023-10-31T23:17:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-31T23:17:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-31T23:17:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-31T23:17:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:50.535 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 32/33 2023-10-31T23:17:50.558 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 32/33 2023-10-31T23:17:50.558 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:50.559 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-31T23:17:50.559 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-31T23:17:50.559 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-31T23:17:50.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:17:50.623 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 33/33 2023-10-31T23:17:55.868 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/33 2023-10-31T23:17:55.896 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 30/33 2023-10-31T23:17:55.896 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-31T23:17:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-31T23:17:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-31T23:17:55.897 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:56.827 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 31/33 2023-10-31T23:17:56.851 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 31/33 2023-10-31T23:17:56.851 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:56.852 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-31T23:17:56.852 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-31T23:17:56.852 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-31T23:17:56.852 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:57.061 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 32/33 2023-10-31T23:17:57.085 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 32/33 2023-10-31T23:17:57.085 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:17:57.085 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-31T23:17:57.086 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-31T23:17:57.086 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-31T23:17:57.086 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:17:57.144 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 33/33 2023-10-31T23:18:00.596 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 33/33 2023-10-31T23:18:00.596 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/33 2023-10-31T23:18:00.596 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/33 2023-10-31T23:18:00.596 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 3/33 2023-10-31T23:18:00.597 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/33 2023-10-31T23:18:00.597 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 5/33 2023-10-31T23:18:00.597 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6795.gd1dcabba.el9. 6/33 2023-10-31T23:18:00.597 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-10-31T23:18:00.597 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-10-31T23:18:00.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-10-31T23:18:00.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-10-31T23:18:00.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-10-31T23:18:00.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-31T23:18:00.598 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-10-31T23:18:00.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-10-31T23:18:00.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-10-31T23:18:00.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-10-31T23:18:00.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-10-31T23:18:00.599 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-10-31T23:18:00.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-10-31T23:18:00.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-10-31T23:18:00.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-10-31T23:18:00.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-10-31T23:18:00.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-10-31T23:18:00.601 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-10-31T23:18:00.601 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-10-31T23:18:00.601 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-10-31T23:18:00.601 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-31T23:18:00.601 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-10-31T23:18:00.602 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-10-31T23:18:00.602 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-10-31T23:18:00.603 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-10-31T23:18:00.603 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-10-31T23:18:01.608 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-10-31T23:18:01.610 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:01.610 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:01.610 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:01.611 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:01.611 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:01.611 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:01.611 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:01.611 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-31T23:18:01.612 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-31T23:18:01.612 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-31T23:18:01.612 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-31T23:18:01.613 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-31T23:18:01.613 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-31T23:18:01.613 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-31T23:18:01.613 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-31T23:18:01.614 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-31T23:18:01.614 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-31T23:18:01.614 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-31T23:18:01.614 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-31T23:18:01.615 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-31T23:18:01.615 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-31T23:18:01.615 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-31T23:18:01.616 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2023-10-31T23:18:01.616 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-31T23:18:01.616 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-31T23:18:01.617 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-31T23:18:01.617 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-31T23:18:01.617 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-31T23:18:01.618 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-31T23:18:01.618 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-31T23:18:01.618 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-10-31T23:18:01.619 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-31T23:18:01.619 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-31T23:18:01.619 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-31T23:18:01.619 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:01.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-base 2023-10-31T23:18:02.455 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:48 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:02.548 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:02.597 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:02.598 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:02.598 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:02.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install cephadm 2023-10-31T23:18:03.212 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:49 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:03.353 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:03.354 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:03.354 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:18:03.354 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:03.355 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:03.355 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 270 k 2023-10-31T23:18:03.355 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:03.355 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:03.355 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:03.356 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:03.356 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:03.356 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 270 k 2023-10-31T23:18:03.356 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 265 k 2023-10-31T23:18:03.357 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm-18.0.0-6795.gd1dcabba.el9.noarch.rpm 1.0 MB/s | 270 kB 00:00 2023-10-31T23:18:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.0 MB/s | 270 kB 00:00 2023-10-31T23:18:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:03.613 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:03.613 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:03.616 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:03.617 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:03.688 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:04.078 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:04.171 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:04.600 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:04.932 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:04.933 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:05.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-immutable-object-cache 2023-10-31T23:18:05.709 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:51 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:05.850 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:05.853 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:05.853 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2023-10-31T23:18:05.853 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:05.854 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:05.854 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 144 k 2023-10-31T23:18:05.854 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:05.854 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:05.854 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:05.855 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:05.855 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:05.855 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 144 k 2023-10-31T23:18:05.855 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 437 k 2023-10-31T23:18:05.855 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:06.104 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-immutable-object-cache-18.0.0-6795.gd1dcab 573 kB/s | 144 kB 00:00 2023-10-31T23:18:06.105 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:06.105 INFO:teuthology.orchestra.run.smithi071.stdout:Total 570 kB/s | 144 kB 00:00 2023-10-31T23:18:06.105 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:06.112 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:06.112 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:06.164 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:06.165 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:06.311 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba. 1/1 2023-10-31T23:18:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba. 1/1 2023-10-31T23:18:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:18:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-31T23:18:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:07.351 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba. 1/1 2023-10-31T23:18:07.351 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:07.352 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:07.352 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:07.352 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:07.352 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:07.499 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 33/33 2023-10-31T23:18:07.499 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/33 2023-10-31T23:18:07.499 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/33 2023-10-31T23:18:07.499 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 3/33 2023-10-31T23:18:07.500 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 4/33 2023-10-31T23:18:07.500 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 5/33 2023-10-31T23:18:07.500 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6795.gd1dcabba.el9. 6/33 2023-10-31T23:18:07.500 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-10-31T23:18:07.500 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-10-31T23:18:07.501 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-10-31T23:18:07.501 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-10-31T23:18:07.501 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-10-31T23:18:07.501 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-31T23:18:07.501 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-10-31T23:18:07.502 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-10-31T23:18:07.502 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-10-31T23:18:07.502 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-10-31T23:18:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-10-31T23:18:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-10-31T23:18:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-10-31T23:18:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-10-31T23:18:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-10-31T23:18:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-10-31T23:18:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-10-31T23:18:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-10-31T23:18:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-10-31T23:18:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-10-31T23:18:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-31T23:18:07.505 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-10-31T23:18:07.506 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-10-31T23:18:07.506 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-10-31T23:18:07.506 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-10-31T23:18:07.507 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-10-31T23:18:07.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr 2023-10-31T23:18:08.206 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:54 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:08.301 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-10-31T23:18:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:08.347 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-31T23:18:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-31T23:18:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-31T23:18:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-31T23:18:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-31T23:18:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-31T23:18:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-31T23:18:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-31T23:18:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-31T23:18:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-31T23:18:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-31T23:18:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-31T23:18:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-31T23:18:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-31T23:18:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-31T23:18:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply-3.11-14.el9.noarch 2023-10-31T23:18:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-31T23:18:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-31T23:18:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-31T23:18:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-31T23:18:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-31T23:18:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-31T23:18:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-31T23:18:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-10-31T23:18:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-31T23:18:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-31T23:18:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-31T23:18:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:08.356 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:08.357 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:08.358 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:08.358 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:08.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-dashboard 2023-10-31T23:18:08.616 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-base 2023-10-31T23:18:08.957 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:54 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:09.097 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:09.098 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:09.098 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:18:09.099 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:09.099 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:09.099 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 1.8 M 2023-10-31T23:18:09.099 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:18:09.099 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 23 k 2023-10-31T23:18:09.100 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 15 k 2023-10-31T23:18:09.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-31T23:18:09.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-31T23:18:09.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-31T23:18:09.100 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2023-10-31T23:18:09.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-31T23:18:09.101 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:09.101 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:09.101 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:09.101 INFO:teuthology.orchestra.run.smithi071.stdout:Install 7 Packages 2023-10-31T23:18:09.102 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:09.102 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.1 M 2023-10-31T23:18:09.102 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 8.6 M 2023-10-31T23:18:09.103 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:09.183 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:52 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:09.278 INFO:teuthology.orchestra.run.smithi008.stdout:Package ceph-base-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:09.330 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:09.331 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:09.331 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:09.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install cephadm 2023-10-31T23:18:09.481 INFO:teuthology.orchestra.run.smithi071.stdout:(1/7): ceph-grafana-dashboards-18.0.0-6795.gd1d 119 kB/s | 23 kB 00:00 2023-10-31T23:18:09.523 INFO:teuthology.orchestra.run.smithi071.stdout:(2/7): ceph-prometheus-alerts-18.0.0-6795.gd1dc 64 kB/s | 15 kB 00:00 2023-10-31T23:18:09.607 INFO:teuthology.orchestra.run.smithi071.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 72 kB/s | 9.0 kB 00:00 2023-10-31T23:18:09.674 INFO:teuthology.orchestra.run.smithi071.stdout:(4/7): ceph-mgr-dashboard-18.0.0-6795.gd1dcabba 4.6 MB/s | 1.8 MB 00:00 2023-10-31T23:18:09.749 INFO:teuthology.orchestra.run.smithi071.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 216 kB/s | 31 kB 00:00 2023-10-31T23:18:09.766 INFO:teuthology.orchestra.run.smithi071.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 169 kB/s | 41 kB 00:00 2023-10-31T23:18:09.968 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:52 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:09.983 INFO:teuthology.orchestra.run.smithi071.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 611 kB/s | 188 kB 00:00 2023-10-31T23:18:09.984 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:09.985 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.3 MB/s | 2.1 MB 00:00 2023-10-31T23:18:09.985 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:09.993 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:09.993 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:10.060 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:10.061 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:10.114 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:10.115 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:10.115 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:18:10.115 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:10.115 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:10.116 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 270 k 2023-10-31T23:18:10.116 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:10.116 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:10.116 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:10.116 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:18:10.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:10.117 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 270 k 2023-10-31T23:18:10.117 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 265 k 2023-10-31T23:18:10.117 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:10.368 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm-18.0.0-6795.gd1dcabba.el9.noarch.rpm 1.0 MB/s | 270 kB 00:00 2023-10-31T23:18:10.369 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:10.369 INFO:teuthology.orchestra.run.smithi008.stdout:Total 1.0 MB/s | 270 kB 00:00 2023-10-31T23:18:10.369 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:10.375 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:10.375 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:10.378 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:10.378 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-10-31T23:18:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-10-31T23:18:10.451 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:10.489 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-10-31T23:18:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-10-31T23:18:10.550 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6795.gd1dcabba.el9.n 5/7 2023-10-31T23:18:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6795.gd1dcabba.el9. 6/7 2023-10-31T23:18:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarc 7/7 2023-10-31T23:18:10.950 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:11.025 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarc 7/7 2023-10-31T23:18:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6795.gd1dcabba.el9. 1/7 2023-10-31T23:18:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarc 2/7 2023-10-31T23:18:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6795.gd1dcabba.el9.n 3/7 2023-10-31T23:18:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-10-31T23:18:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-10-31T23:18:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-10-31T23:18:11.387 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:11.690 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-10-31T23:18:11.691 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:11.691 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:11.691 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:11.691 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:11.691 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:11.692 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-31T23:18:11.692 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-31T23:18:11.692 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-31T23:18:11.692 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-31T23:18:11.692 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:11.693 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:11.723 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:11.724 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:11.724 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:11.724 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:11.724 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:11.725 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:11.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-31T23:18:11.931 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-immutable-object-cache 2023-10-31T23:18:12.445 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:58 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:12.509 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:55 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:12.596 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:12.597 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================================ 2023-10-31T23:18:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:18:12.598 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================================ 2023-10-31T23:18:12.598 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 7.4 M 2023-10-31T23:18:12.598 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:18:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-31T23:18:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-31T23:18:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-31T23:18:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-31T23:18:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-31T23:18:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-31T23:18:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-31T23:18:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-31T23:18:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-31T23:18:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-31T23:18:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-31T23:18:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:12.603 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:12.604 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================================ 2023-10-31T23:18:12.604 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2023-10-31T23:18:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:12.605 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 37 M 2023-10-31T23:18:12.605 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 209 M 2023-10-31T23:18:12.605 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:12.658 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:12.659 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-31T23:18:12.660 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:12.660 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 144 k 2023-10-31T23:18:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:12.661 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:12.661 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:12.661 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:18:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:12.661 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 144 k 2023-10-31T23:18:12.662 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 437 k 2023-10-31T23:18:12.662 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:12.739 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 228 kB/s | 32 kB 00:00 2023-10-31T23:18:12.773 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 525 kB/s | 17 kB 00:00 2023-10-31T23:18:12.839 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-10-31T23:18:12.865 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 381 kB/s | 34 kB 00:00 2023-10-31T23:18:12.919 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.7 MB/s | 205 kB 00:00 2023-10-31T23:18:12.933 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-immutable-object-cache-18.0.0-6795.gd1dcab 529 kB/s | 144 kB 00:00 2023-10-31T23:18:12.933 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:12.934 INFO:teuthology.orchestra.run.smithi008.stdout:Total 525 kB/s | 144 kB 00:00 2023-10-31T23:18:12.934 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:12.942 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:12.942 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:12.998 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:12.999 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:13.007 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 28 MB/s | 4.7 MB 00:00 2023-10-31T23:18:13.082 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-10-31T23:18:13.108 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-10-31T23:18:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:13.175 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-10-31T23:18:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba. 1/1 2023-10-31T23:18:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba. 1/1 2023-10-31T23:18:13.234 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:18:13.235 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-31T23:18:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:13.342 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2023-10-31T23:18:13.375 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 986 kB/s | 195 kB 00:00 2023-10-31T23:18:13.467 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): ceph-mgr-diskprediction-local-18.0.0-6 8.5 MB/s | 7.4 MB 00:00 2023-10-31T23:18:13.469 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:13.470 INFO:teuthology.orchestra.run.smithi071.stdout:Total 43 MB/s | 37 MB 00:00 2023-10-31T23:18:13.470 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:13.493 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:13.493 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:13.929 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:13.929 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba. 1/1 2023-10-31T23:18:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:14.240 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:14.241 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:14.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr 2023-10-31T23:18:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-10-31T23:18:14.763 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-10-31T23:18:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-10-31T23:18:14.891 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-10-31T23:18:15.066 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:58 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-31T23:18:15.107 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-31T23:18:15.169 INFO:teuthology.orchestra.run.smithi008.stdout:Package ceph-mgr-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-10-31T23:18:15.222 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:15.223 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:15.223 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:15.289 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-dashboard 2023-10-31T23:18:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-10-31T23:18:15.858 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:58 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:15.961 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-10-31T23:18:16.004 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:16.004 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:16.005 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:18:16.005 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:16.005 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:16.005 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 1.8 M 2023-10-31T23:18:16.005 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:18:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 23 k 2023-10-31T23:18:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 15 k 2023-10-31T23:18:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-31T23:18:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-31T23:18:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-31T23:18:16.007 INFO:teuthology.orchestra.run.smithi008.stdout:Installing weak dependencies: 2023-10-31T23:18:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-31T23:18:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:16.007 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:16.008 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:16.008 INFO:teuthology.orchestra.run.smithi008.stdout:Install 7 Packages 2023-10-31T23:18:16.008 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:16.009 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 2.1 M 2023-10-31T23:18:16.009 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 8.6 M 2023-10-31T23:18:16.009 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:16.586 INFO:teuthology.orchestra.run.smithi008.stdout:(1/7): ceph-prometheus-alerts-18.0.0-6795.gd1dc 71 kB/s | 15 kB 00:00 2023-10-31T23:18:16.612 INFO:teuthology.orchestra.run.smithi008.stdout:(2/7): ceph-grafana-dashboards-18.0.0-6795.gd1d 97 kB/s | 23 kB 00:00 2023-10-31T23:18:16.695 INFO:teuthology.orchestra.run.smithi008.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 83 kB/s | 9.0 kB 00:00 2023-10-31T23:18:16.762 INFO:teuthology.orchestra.run.smithi008.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 273 kB/s | 41 kB 00:00 2023-10-31T23:18:16.804 INFO:teuthology.orchestra.run.smithi008.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 283 kB/s | 31 kB 00:00 2023-10-31T23:18:16.871 INFO:teuthology.orchestra.run.smithi008.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2023-10-31T23:18:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-10-31T23:18:17.988 INFO:teuthology.orchestra.run.smithi008.stdout:(7/7): ceph-mgr-dashboard-18.0.0-6795.gd1dcabba 1.1 MB/s | 1.8 MB 00:01 2023-10-31T23:18:17.990 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:17.990 INFO:teuthology.orchestra.run.smithi008.stdout:Total 1.0 MB/s | 2.1 MB 00:01 2023-10-31T23:18:17.991 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:18.001 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:18.001 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:18.075 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:18.079 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:18.234 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-10-31T23:18:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dca 12/12 2023-10-31T23:18:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-10-31T23:18:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-10-31T23:18:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-10-31T23:18:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-10-31T23:18:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6795.gd1dcabba.el9.n 5/7 2023-10-31T23:18:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6795.gd1dcabba.el9. 6/7 2023-10-31T23:18:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarc 7/7 2023-10-31T23:18:19.424 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarc 7/7 2023-10-31T23:18:19.425 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6795.gd1dcabba.el9. 1/7 2023-10-31T23:18:19.425 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarc 2/7 2023-10-31T23:18:19.425 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6795.gd1dcabba.el9.n 3/7 2023-10-31T23:18:19.425 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-10-31T23:18:19.426 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-10-31T23:18:19.426 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-10-31T23:18:19.752 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-10-31T23:18:19.753 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:19.753 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:19.753 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:19.753 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:19.753 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:19.754 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-31T23:18:19.754 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-31T23:18:19.754 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-31T23:18:19.754 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-31T23:18:19.754 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:19.755 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:19.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-31T23:18:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:03 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:20.696 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:20.697 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-31T23:18:20.697 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:18:20.697 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-31T23:18:20.697 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:20.698 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 7.4 M 2023-10-31T23:18:20.698 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:18:20.698 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-31T23:18:20.698 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-31T23:18:20.698 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-31T23:18:20.699 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-31T23:18:20.699 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-31T23:18:20.699 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-31T23:18:20.699 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-31T23:18:20.699 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-31T23:18:20.700 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-31T23:18:20.700 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-31T23:18:20.700 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-31T23:18:20.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:20.700 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:20.700 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-31T23:18:20.701 INFO:teuthology.orchestra.run.smithi008.stdout:Install 12 Packages 2023-10-31T23:18:20.701 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:20.701 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 37 M 2023-10-31T23:18:20.702 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 209 M 2023-10-31T23:18:20.702 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:20.703 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dca 12/12 2023-10-31T23:18:20.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dca 1/12 2023-10-31T23:18:20.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-10-31T23:18:20.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-10-31T23:18:20.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-10-31T23:18:20.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-31T23:18:20.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-31T23:18:20.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-10-31T23:18:20.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-10-31T23:18:20.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-10-31T23:18:20.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-10-31T23:18:20.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-10-31T23:18:20.828 INFO:teuthology.orchestra.run.smithi008.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 247 kB/s | 32 kB 00:00 2023-10-31T23:18:20.861 INFO:teuthology.orchestra.run.smithi008.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 534 kB/s | 17 kB 00:00 2023-10-31T23:18:20.895 INFO:teuthology.orchestra.run.smithi008.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-10-31T23:18:20.954 INFO:teuthology.orchestra.run.smithi008.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-10-31T23:18:21.012 INFO:teuthology.orchestra.run.smithi008.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.5 MB/s | 205 kB 00:00 2023-10-31T23:18:21.071 INFO:teuthology.orchestra.run.smithi008.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 27 MB/s | 4.7 MB 00:00 2023-10-31T23:18:21.146 INFO:teuthology.orchestra.run.smithi008.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-10-31T23:18:21.171 INFO:teuthology.orchestra.run.smithi008.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-10-31T23:18:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-10-31T23:18:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:21.208 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-31T23:18:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-31T23:18:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-31T23:18:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-31T23:18:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-31T23:18:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-31T23:18:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-31T23:18:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-31T23:18:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-31T23:18:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-31T23:18:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-31T23:18:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:21.211 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:21.238 INFO:teuthology.orchestra.run.smithi008.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-10-31T23:18:21.414 INFO:teuthology.orchestra.run.smithi008.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2023-10-31T23:18:21.441 INFO:teuthology.orchestra.run.smithi008.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 987 kB/s | 195 kB 00:00 2023-10-31T23:18:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:(12/12): ceph-mgr-diskprediction-local-18.0.0-6 8.5 MB/s | 7.4 MB 00:00 2023-10-31T23:18:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:Total 42 MB/s | 37 MB 00:00 2023-10-31T23:18:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:21.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-rook 2023-10-31T23:18:22.067 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:22.068 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:22.244 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:08 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:22.385 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:22.386 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================== 2023-10-31T23:18:22.386 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:18:22.387 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================== 2023-10-31T23:18:22.387 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:22.387 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 48 k 2023-10-31T23:18:22.387 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:18:22.387 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-31T23:18:22.388 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-31T23:18:22.388 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-10-31T23:18:22.388 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-31T23:18:22.388 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-31T23:18:22.388 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-31T23:18:22.389 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-31T23:18:22.389 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-31T23:18:22.389 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-31T23:18:22.389 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-31T23:18:22.389 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-31T23:18:22.389 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-31T23:18:22.390 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:22.390 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:22.390 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================== 2023-10-31T23:18:22.390 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2023-10-31T23:18:22.390 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:22.391 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.0 M 2023-10-31T23:18:22.391 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 26 M 2023-10-31T23:18:22.391 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:22.662 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 208 kB/s | 24 kB 00:00 2023-10-31T23:18:22.679 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 135 kB/s | 18 kB 00:00 2023-10-31T23:18:22.721 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 3.0 MB/s | 174 kB 00:00 2023-10-31T23:18:22.746 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-10-31T23:18:22.771 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-10-31T23:18:22.788 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2023-10-31T23:18:22.792 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:22.805 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): ceph-mgr-rook-18.0.0-6795.gd1dcabba.el9 183 kB/s | 48 kB 00:00 2023-10-31T23:18:22.871 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-10-31T23:18:22.902 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-10-31T23:18:22.973 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 160 kB/s | 32 kB 00:00 2023-10-31T23:18:22.989 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 75 kB/s | 15 kB 00:00 2023-10-31T23:18:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-10-31T23:18:23.039 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-10-31T23:18:23.073 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2023-10-31T23:18:23.107 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): python3-google-auth-2.23.3-1.el9.noarc 655 kB/s | 197 kB 00:00 2023-10-31T23:18:23.157 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2023-10-31T23:18:23.190 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.7 MB/s | 1.0 MB 00:00 2023-10-31T23:18:23.194 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:23.195 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.5 MB/s | 2.0 MB 00:00 2023-10-31T23:18:23.195 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:23.207 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:23.207 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:23.219 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-31T23:18:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-31T23:18:23.303 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:23.303 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:23.336 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-10-31T23:18:23.818 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:23.985 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-10-31T23:18:24.033 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-10-31T23:18:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-10-31T23:18:24.113 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-10-31T23:18:24.142 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-10-31T23:18:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-10-31T23:18:24.183 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-10-31T23:18:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-10-31T23:18:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-10-31T23:18:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-10-31T23:18:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-10-31T23:18:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-10-31T23:18:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-10-31T23:18:25.278 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-10-31T23:18:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 13/13 2023-10-31T23:18:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-10-31T23:18:26.116 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 13/13 2023-10-31T23:18:26.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 1/13 2023-10-31T23:18:26.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-10-31T23:18:26.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-10-31T23:18:26.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-10-31T23:18:26.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-10-31T23:18:26.118 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-10-31T23:18:26.118 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-10-31T23:18:26.118 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-10-31T23:18:26.118 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-10-31T23:18:26.118 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-10-31T23:18:26.119 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-10-31T23:18:26.119 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-10-31T23:18:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-10-31T23:18:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:26.497 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-31T23:18:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-31T23:18:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-10-31T23:18:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-31T23:18:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-31T23:18:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-31T23:18:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-31T23:18:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-31T23:18:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-31T23:18:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-31T23:18:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-31T23:18:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-31T23:18:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:26.502 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:26.542 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-10-31T23:18:26.579 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dca 12/12 2023-10-31T23:18:26.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-cephadm 2023-10-31T23:18:27.316 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:13 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:27.458 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:27.459 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================== 2023-10-31T23:18:27.459 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:18:27.459 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================== 2023-10-31T23:18:27.460 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:27.460 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 132 k 2023-10-31T23:18:27.460 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:18:27.460 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-31T23:18:27.460 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-31T23:18:27.460 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-31T23:18:27.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-31T23:18:27.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-31T23:18:27.461 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:27.461 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:27.461 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================== 2023-10-31T23:18:27.462 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2023-10-31T23:18:27.462 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:27.463 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 6.8 M 2023-10-31T23:18:27.463 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 33 M 2023-10-31T23:18:27.463 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:27.786 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-10-31T23:18:27.894 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-10-31T23:18:27.970 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): ceph-mgr-cephadm-18.0.0-6795.gd1dcabba.e 393 kB/s | 132 kB 00:00 2023-10-31T23:18:27.995 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 575 kB/s | 58 kB 00:00 2023-10-31T23:18:28.020 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 2.3 MB/s | 548 kB 00:00 2023-10-31T23:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 436 kB/s | 51 kB 00:00 2023-10-31T23:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:Total 11 MB/s | 6.8 MB 00:00 2023-10-31T23:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:28.098 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:28.099 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:28.189 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:28.190 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:28.485 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:28.667 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-10-31T23:18:28.721 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-10-31T23:18:29.141 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dca 12/12 2023-10-31T23:18:29.142 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dca 1/12 2023-10-31T23:18:29.142 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-10-31T23:18:29.142 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-10-31T23:18:29.142 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-10-31T23:18:29.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-31T23:18:29.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-31T23:18:29.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-10-31T23:18:29.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-10-31T23:18:29.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-10-31T23:18:29.144 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-10-31T23:18:29.144 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-10-31T23:18:29.241 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-10-31T23:18:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-10-31T23:18:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-10-31T23:18:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 6/6 2023-10-31T23:18:29.590 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-10-31T23:18:29.590 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:29.591 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:29.591 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:29.591 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-31T23:18:29.591 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-31T23:18:29.591 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-31T23:18:29.591 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-31T23:18:29.592 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-31T23:18:29.592 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-31T23:18:29.592 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-31T23:18:29.592 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-31T23:18:29.592 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-31T23:18:29.593 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-31T23:18:29.593 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-31T23:18:29.593 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:29.593 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:29.976 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-rook 2023-10-31T23:18:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 6/6 2023-10-31T23:18:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/6 2023-10-31T23:18:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-10-31T23:18:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-10-31T23:18:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-10-31T23:18:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-10-31T23:18:30.551 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:13 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:30.587 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-10-31T23:18:30.588 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:30.588 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:30.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:30.588 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-31T23:18:30.588 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-31T23:18:30.589 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-31T23:18:30.589 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-31T23:18:30.589 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-31T23:18:30.589 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:30.589 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:30.708 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:30.709 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================== 2023-10-31T23:18:30.710 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:18:30.710 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================== 2023-10-31T23:18:30.710 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:30.710 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 48 k 2023-10-31T23:18:30.711 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:18:30.711 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-31T23:18:30.711 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-31T23:18:30.711 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-10-31T23:18:30.711 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-31T23:18:30.712 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-31T23:18:30.712 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-31T23:18:30.712 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-31T23:18:30.712 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-31T23:18:30.712 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-31T23:18:30.713 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-31T23:18:30.713 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-31T23:18:30.713 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-31T23:18:30.713 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:30.713 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:30.713 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================== 2023-10-31T23:18:30.714 INFO:teuthology.orchestra.run.smithi008.stdout:Install 13 Packages 2023-10-31T23:18:30.714 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:30.715 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 2.0 M 2023-10-31T23:18:30.715 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 26 M 2023-10-31T23:18:30.715 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:30.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2023-10-31T23:18:31.180 INFO:teuthology.orchestra.run.smithi008.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 201 kB/s | 24 kB 00:00 2023-10-31T23:18:31.205 INFO:teuthology.orchestra.run.smithi008.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 123 kB/s | 18 kB 00:00 2023-10-31T23:18:31.247 INFO:teuthology.orchestra.run.smithi008.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-10-31T23:18:31.272 INFO:teuthology.orchestra.run.smithi008.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-10-31T23:18:31.297 INFO:teuthology.orchestra.run.smithi008.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-10-31T23:18:31.323 INFO:teuthology.orchestra.run.smithi008.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2023-10-31T23:18:31.348 INFO:teuthology.orchestra.run.smithi008.stdout:(7/13): ceph-mgr-rook-18.0.0-6795.gd1dcabba.el9 164 kB/s | 48 kB 00:00 2023-10-31T23:18:31.406 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:17 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:31.550 INFO:teuthology.orchestra.run.smithi008.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 127 kB/s | 32 kB 00:00 2023-10-31T23:18:31.557 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:31.558 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:31.558 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:18:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:31.559 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 832 k 2023-10-31T23:18:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-31T23:18:31.559 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-31T23:18:31.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:Install 2 Packages 2023-10-31T23:18:31.560 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:31.561 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 910 k 2023-10-31T23:18:31.561 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 3.0 M 2023-10-31T23:18:31.561 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:31.575 INFO:teuthology.orchestra.run.smithi008.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 59 kB/s | 15 kB 00:00 2023-10-31T23:18:31.659 INFO:teuthology.orchestra.run.smithi008.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 709 kB/s | 59 kB 00:00 2023-10-31T23:18:31.664 INFO:teuthology.orchestra.run.smithi071.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 756 kB/s | 79 kB 00:00 2023-10-31T23:18:31.701 INFO:teuthology.orchestra.run.smithi008.stdout:(11/13): python3-google-auth-2.23.3-1.el9.noarc 558 kB/s | 197 kB 00:00 2023-10-31T23:18:31.743 INFO:teuthology.orchestra.run.smithi008.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2023-10-31T23:18:31.931 INFO:teuthology.orchestra.run.smithi071.stdout:(2/2): ceph-fuse-18.0.0-6795.gd1dcabba.el9.x86_ 2.2 MB/s | 832 kB 00:00 2023-10-31T23:18:31.932 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.4 MB/s | 910 kB 00:00 2023-10-31T23:18:31.933 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:31.954 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:31.954 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:32.031 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:32.032 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:32.110 INFO:teuthology.orchestra.run.smithi008.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2023-10-31T23:18:32.114 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:32.115 INFO:teuthology.orchestra.run.smithi008.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2023-10-31T23:18:32.115 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:32.129 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:32.130 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:32.213 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:32.238 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:32.239 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:32.367 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-10-31T23:18:32.439 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/2 2023-10-31T23:18:32.771 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-10-31T23:18:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-10-31T23:18:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-10-31T23:18:33.079 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-10-31T23:18:33.121 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-10-31T23:18:33.138 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/2 2023-10-31T23:18:33.139 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/2 2023-10-31T23:18:33.217 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-10-31T23:18:33.335 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-10-31T23:18:33.389 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-10-31T23:18:33.458 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-10-31T23:18:33.458 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:33.459 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-10-31T23:18:33.459 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:33.459 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:33.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-volume 2023-10-31T23:18:34.155 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-10-31T23:18:34.202 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-10-31T23:18:34.236 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-10-31T23:18:34.267 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:20 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:34.282 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-10-31T23:18:34.306 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 13/13 2023-10-31T23:18:34.411 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:34.412 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:34.412 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-31T23:18:34.412 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:34.413 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:34.413 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 262 k 2023-10-31T23:18:34.413 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:34.413 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:34.413 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:34.414 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 262 k 2023-10-31T23:18:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 1.2 M 2023-10-31T23:18:34.414 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:34.652 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-volume-18.0.0-6795.gd1dcabba.el9.noarch.rp 1.1 MB/s | 262 kB 00:00 2023-10-31T23:18:34.653 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:34.653 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.1 MB/s | 262 kB 00:00 2023-10-31T23:18:34.653 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:34.661 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:34.661 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:34.694 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:34.694 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:34.909 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:34.979 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:34.994 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:34.994 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:18:34.994 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-31T23:18:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:35.130 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 13/13 2023-10-31T23:18:35.133 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 1/13 2023-10-31T23:18:35.133 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-10-31T23:18:35.134 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-10-31T23:18:35.134 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-10-31T23:18:35.134 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-10-31T23:18:35.134 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-10-31T23:18:35.135 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-10-31T23:18:35.135 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-10-31T23:18:35.135 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-10-31T23:18:35.135 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-10-31T23:18:35.135 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-10-31T23:18:35.135 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-10-31T23:18:35.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-10-31T23:18:35.515 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:35.516 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:35.516 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:35.516 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-31T23:18:35.516 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-31T23:18:35.516 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-10-31T23:18:35.517 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-31T23:18:35.517 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-31T23:18:35.517 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-31T23:18:35.517 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-31T23:18:35.518 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-31T23:18:35.518 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-31T23:18:35.518 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-31T23:18:35.518 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-31T23:18:35.518 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-31T23:18:35.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:35.519 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:35.768 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-cephadm 2023-10-31T23:18:36.017 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:36.017 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:36.017 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:36.017 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:36.018 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:36.018 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:36.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados-devel 2023-10-31T23:18:36.348 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:19 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:36.497 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:36.498 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================== 2023-10-31T23:18:36.498 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:18:36.498 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================== 2023-10-31T23:18:36.499 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:36.499 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 132 k 2023-10-31T23:18:36.499 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:18:36.499 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-31T23:18:36.499 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-31T23:18:36.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-31T23:18:36.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-31T23:18:36.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-31T23:18:36.500 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:36.500 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:36.501 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================== 2023-10-31T23:18:36.501 INFO:teuthology.orchestra.run.smithi008.stdout:Install 6 Packages 2023-10-31T23:18:36.501 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:36.501 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 6.8 M 2023-10-31T23:18:36.502 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 33 M 2023-10-31T23:18:36.502 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:36.804 INFO:teuthology.orchestra.run.smithi008.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-10-31T23:18:36.884 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:22 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:36.904 INFO:teuthology.orchestra.run.smithi008.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-10-31T23:18:36.979 INFO:teuthology.orchestra.run.smithi008.stdout:(3/6): ceph-mgr-cephadm-18.0.0-6795.gd1dcabba.e 411 kB/s | 132 kB 00:00 2023-10-31T23:18:37.025 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:37.026 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:37.026 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2023-10-31T23:18:37.026 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:37.026 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:37.027 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 127 k 2023-10-31T23:18:37.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:37.027 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:37.027 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:37.027 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:37.028 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:37.028 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 127 k 2023-10-31T23:18:37.028 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 456 k 2023-10-31T23:18:37.028 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:37.255 INFO:teuthology.orchestra.run.smithi008.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 177 kB/s | 58 kB 00:00 2023-10-31T23:18:37.273 INFO:teuthology.orchestra.run.smithi071.stdout:librados-devel-18.0.0-6795.gd1dcabba.el9.x86_64 514 kB/s | 127 kB 00:00 2023-10-31T23:18:37.273 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:37.274 INFO:teuthology.orchestra.run.smithi071.stdout:Total 511 kB/s | 127 kB 00:00 2023-10-31T23:18:37.274 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:37.279 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:37.279 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:37.288 INFO:teuthology.orchestra.run.smithi008.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 180 kB/s | 51 kB 00:00 2023-10-31T23:18:37.335 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:37.335 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:37.346 INFO:teuthology.orchestra.run.smithi008.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2023-10-31T23:18:37.350 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:37.351 INFO:teuthology.orchestra.run.smithi008.stdout:Total 8.0 MB/s | 6.8 MB 00:00 2023-10-31T23:18:37.351 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:37.361 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:37.361 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:37.471 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:37.472 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:37.487 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:37.774 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:37.951 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-10-31T23:18:38.016 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-10-31T23:18:38.048 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:38.361 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:38.361 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:38.579 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-10-31T23:18:38.643 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs2 2023-10-31T23:18:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-10-31T23:18:38.738 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-10-31T23:18:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 6/6 2023-10-31T23:18:39.197 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:25 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:39.291 INFO:teuthology.orchestra.run.smithi071.stdout:Package libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:39.340 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:39.341 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:39.341 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:39.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs-devel 2023-10-31T23:18:39.583 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 6/6 2023-10-31T23:18:39.584 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 1/6 2023-10-31T23:18:39.584 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-10-31T23:18:39.584 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-10-31T23:18:39.584 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-10-31T23:18:39.585 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-10-31T23:18:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-10-31T23:18:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:39.908 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-31T23:18:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-31T23:18:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-31T23:18:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-31T23:18:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-31T23:18:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:39.909 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:39.954 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:25 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:40.095 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:40.096 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2023-10-31T23:18:40.096 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:40.096 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 31 k 2023-10-31T23:18:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:40.097 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:40.097 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:40.097 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:40.098 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 31 k 2023-10-31T23:18:40.098 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 139 k 2023-10-31T23:18:40.098 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:40.156 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-fuse 2023-10-31T23:18:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:libcephfs-devel-18.0.0-6795.gd1dcabba.el9.x86_6 158 kB/s | 31 kB 00:00 2023-10-31T23:18:40.295 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:40.295 INFO:teuthology.orchestra.run.smithi071.stdout:Total 157 kB/s | 31 kB 00:00 2023-10-31T23:18:40.295 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:40.298 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:40.298 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:40.329 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:40.329 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:40.412 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:40.516 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:40.728 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:23 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:40.876 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:40.876 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:40.876 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:18:40.877 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:40.877 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:40.877 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 832 k 2023-10-31T23:18:40.877 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-31T23:18:40.877 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-31T23:18:40.878 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:40.878 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:40.878 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:40.878 INFO:teuthology.orchestra.run.smithi008.stdout:Install 2 Packages 2023-10-31T23:18:40.878 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:40.879 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 910 k 2023-10-31T23:18:40.879 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 3.0 M 2023-10-31T23:18:40.880 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:40.928 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:40.990 INFO:teuthology.orchestra.run.smithi008.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 699 kB/s | 79 kB 00:00 2023-10-31T23:18:41.191 INFO:teuthology.orchestra.run.smithi008.stdout:(2/2): ceph-fuse-18.0.0-6795.gd1dcabba.el9.x86_ 2.6 MB/s | 832 kB 00:00 2023-10-31T23:18:41.191 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:41.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:41.192 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:41.192 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:41.192 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:41.192 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:41.193 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:41.193 INFO:teuthology.orchestra.run.smithi008.stdout:Total 2.8 MB/s | 910 kB 00:00 2023-10-31T23:18:41.193 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:41.213 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:41.214 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:41.292 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:41.293 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:41.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2023-10-31T23:18:41.478 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-10-31T23:18:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/2 2023-10-31T23:18:41.942 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:27 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:42.033 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:42.083 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:42.084 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:42.085 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:42.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2023-10-31T23:18:42.407 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2/2 2023-10-31T23:18:42.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/2 2023-10-31T23:18:42.715 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-10-31T23:18:42.715 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:42.716 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:42.716 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-10-31T23:18:42.716 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:42.716 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:42.718 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:28 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:42.808 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:42.857 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:42.858 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:42.858 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:42.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rados 2023-10-31T23:18:43.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-volume 2023-10-31T23:18:43.471 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:29 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:43.561 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:43.587 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:26 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:43.612 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:43.613 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:43.613 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:43.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rgw 2023-10-31T23:18:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:43.735 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-31T23:18:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:43.736 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:18.0.0-6795.gd1dcabba.el9 ceph-noarch 262 k 2023-10-31T23:18:43.736 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:18:43.737 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 262 k 2023-10-31T23:18:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 1.2 M 2023-10-31T23:18:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:44.224 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:30 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:44.245 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-volume-18.0.0-6795.gd1dcabba.el9.noarch.rp 515 kB/s | 262 kB 00:00 2023-10-31T23:18:44.246 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:44.246 INFO:teuthology.orchestra.run.smithi008.stdout:Total 513 kB/s | 262 kB 00:00 2023-10-31T23:18:44.246 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:44.255 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:44.255 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:44.289 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:44.290 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:44.314 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:44.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-cephfs 2023-10-31T23:18:44.516 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:44.598 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:44.614 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:44.614 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:18:44.615 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-31T23:18:44.615 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:44.980 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:30 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:45.070 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:45.121 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:45.121 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:45.122 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:45.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rbd 2023-10-31T23:18:45.703 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 1/1 2023-10-31T23:18:45.703 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:45.703 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:45.704 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:18.0.0-6795.gd1dcabba.el9.noarch 2023-10-31T23:18:45.704 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:45.704 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:45.734 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:31 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:45.824 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:45.873 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:45.874 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-31T23:18:45.874 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:45.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2023-10-31T23:18:46.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librados-devel 2023-10-31T23:18:46.495 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:32 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:46.596 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:29 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:46.637 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:46.638 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:46.638 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2023-10-31T23:18:46.638 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:46.639 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:46.639 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 87 k 2023-10-31T23:18:46.639 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:46.639 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:46.639 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:46.640 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:46.640 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:46.640 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 87 k 2023-10-31T23:18:46.640 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 252 k 2023-10-31T23:18:46.640 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:46.744 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:46.745 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:46.745 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-31T23:18:46.745 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:46.745 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:46.746 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 127 k 2023-10-31T23:18:46.746 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:46.746 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:46.746 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:46.746 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:18:46.747 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:46.747 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 127 k 2023-10-31T23:18:46.747 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 456 k 2023-10-31T23:18:46.747 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:47.038 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-fuse-18.0.0-6795.gd1dcabba.el9.x86_64.rpm 217 kB/s | 87 kB 00:00 2023-10-31T23:18:47.039 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:47.039 INFO:teuthology.orchestra.run.smithi071.stdout:Total 216 kB/s | 87 kB 00:00 2023-10-31T23:18:47.039 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:47.046 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:47.046 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:47.100 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:47.101 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:47.226 INFO:teuthology.orchestra.run.smithi008.stdout:librados-devel-18.0.0-6795.gd1dcabba.el9.x86_64 264 kB/s | 127 kB 00:00 2023-10-31T23:18:47.227 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:47.227 INFO:teuthology.orchestra.run.smithi008.stdout:Total 263 kB/s | 127 kB 00:00 2023-10-31T23:18:47.227 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:47.233 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:47.233 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:47.293 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:47.294 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:47.441 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:47.536 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:47.770 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:48.013 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:48.072 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:48.073 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:48.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2023-10-31T23:18:48.349 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:48.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:48.350 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:48.350 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:48.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:48.350 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:48.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install libcephfs2 2023-10-31T23:18:48.883 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:34 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:49.036 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:49.037 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2023-10-31T23:18:49.037 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:49.038 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 3.0 M 2023-10-31T23:18:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:49.038 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:49.038 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:49.039 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:49.039 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.0 M 2023-10-31T23:18:49.039 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 13 M 2023-10-31T23:18:49.039 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:49.230 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:32 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:49.324 INFO:teuthology.orchestra.run.smithi008.stdout:Package libcephfs2-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:49.376 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:49.377 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:49.377 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:49.452 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install libcephfs-devel 2023-10-31T23:18:50.025 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:33 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:50.172 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:50.173 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:50.173 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-31T23:18:50.173 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:50.174 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:50.174 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 31 k 2023-10-31T23:18:50.174 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:50.174 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:50.174 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:50.175 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:18:50.175 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:50.175 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 31 k 2023-10-31T23:18:50.175 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 139 k 2023-10-31T23:18:50.175 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-mirror-18.0.0-6795.gd1dcabba.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2023-10-31T23:18:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.3 MB/s | 3.0 MB 00:01 2023-10-31T23:18:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:50.343 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:50.343 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:50.363 INFO:teuthology.orchestra.run.smithi008.stdout:libcephfs-devel-18.0.0-6795.gd1dcabba.el9.x86_6 164 kB/s | 31 kB 00:00 2023-10-31T23:18:50.364 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:50.364 INFO:teuthology.orchestra.run.smithi008.stdout:Total 163 kB/s | 31 kB 00:00 2023-10-31T23:18:50.365 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:50.368 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:50.368 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:50.391 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:50.392 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:50.422 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:50.423 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:50.486 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:50.597 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:50.851 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:50.925 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:50.949 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:50.950 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:18:50.950 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-31T23:18:50.950 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-31T23:18:50.950 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-31T23:18:50.950 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:50.994 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:51.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:51.260 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:51.260 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:51.260 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:51.260 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:51.260 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:51.461 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librados2 2023-10-31T23:18:52.029 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:35 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:52.097 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:52.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:52.097 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:52.097 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:52.098 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:52.098 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:52.125 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:52.177 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:52.178 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:52.178 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:52.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librbd1 2023-10-31T23:18:52.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2023-10-31T23:18:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:35 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:52.913 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:02:38 ago on Tue 31 Oct 2023 11:16:14 PM UTC. 2023-10-31T23:18:52.919 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:52.972 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:52.973 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:52.973 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:53.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rados 2023-10-31T23:18:53.055 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-31T23:18:53.056 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2023-10-31T23:18:53.057 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:53.057 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-31T23:18:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 168 k 2023-10-31T23:18:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:53.059 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-31T23:18:53.059 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-10-31T23:18:53.059 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2023-10-31T23:18:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:53.059 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 168 k 2023-10-31T23:18:53.059 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 532 k 2023-10-31T23:18:53.060 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-31T23:18:53.327 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-nbd-18.0.0-6795.gd1dcabba.el9.x86_64.rpm 624 kB/s | 168 kB 00:00 2023-10-31T23:18:53.328 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:53.328 INFO:teuthology.orchestra.run.smithi071.stdout:Total 621 kB/s | 168 kB 00:00 2023-10-31T23:18:53.328 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-31T23:18:53.335 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-31T23:18:53.336 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-31T23:18:53.391 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-31T23:18:53.392 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-31T23:18:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-31T23:18:53.629 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:36 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:53.722 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rados-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:53.774 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:53.775 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:53.775 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:53.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rgw 2023-10-31T23:18:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:54.428 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:37 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:54.430 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:54.430 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:54.431 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-31T23:18:54.431 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:54.431 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:18:54.431 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-31T23:18:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rgw-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:54.654 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-cephfs 2023-10-31T23:18:54.682 DEBUG:teuthology.parallel:result is None 2023-10-31T23:18:55.226 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:38 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:55.320 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-cephfs-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:55.373 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:55.374 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:55.374 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:55.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rbd 2023-10-31T23:18:56.025 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:39 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:56.131 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 is already installed. 2023-10-31T23:18:56.186 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:56.187 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-31T23:18:56.187 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:56.256 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-fuse 2023-10-31T23:18:56.830 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:39 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:56.981 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:56.982 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:56.982 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-31T23:18:56.983 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:56.983 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:56.983 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 87 k 2023-10-31T23:18:56.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:56.983 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:56.984 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:56.984 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:18:56.984 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:56.984 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 87 k 2023-10-31T23:18:56.984 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 252 k 2023-10-31T23:18:56.984 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:57.184 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-fuse-18.0.0-6795.gd1dcabba.el9.x86_64.rpm 432 kB/s | 87 kB 00:00 2023-10-31T23:18:57.185 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:57.185 INFO:teuthology.orchestra.run.smithi008.stdout:Total 428 kB/s | 87 kB 00:00 2023-10-31T23:18:57.185 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:57.192 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:57.193 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:57.251 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:57.251 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:18:57.409 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:18:57.509 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:57.912 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:58.236 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:18:58.236 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:58.237 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:18:58.237 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:18:58.237 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:58.237 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:18:58.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-mirror 2023-10-31T23:18:59.081 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:42 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:18:59.227 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:18:59.228 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:59.228 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-31T23:18:59.228 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:59.228 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:18:59.229 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 3.0 M 2023-10-31T23:18:59.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:59.229 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:18:59.229 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:18:59.229 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:18:59.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:18:59.230 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 3.0 M 2023-10-31T23:18:59.230 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 13 M 2023-10-31T23:18:59.230 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:18:59.621 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-mirror-18.0.0-6795.gd1dcabba.el9.x86_64.rpm 7.7 MB/s | 3.0 MB 00:00 2023-10-31T23:18:59.622 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:18:59.622 INFO:teuthology.orchestra.run.smithi008.stdout:Total 7.6 MB/s | 3.0 MB 00:00 2023-10-31T23:18:59.622 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:18:59.631 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:18:59.632 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:18:59.713 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:18:59.713 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:19:00.162 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:19:00.230 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:19:00.255 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:19:00.256 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-31T23:19:00.256 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-31T23:19:00.256 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-31T23:19:00.256 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-31T23:19:00.256 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:01.459 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:19:01.460 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:01.460 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:19:01.460 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:19:01.461 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:01.461 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:19:01.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-nbd 2023-10-31T23:19:02.300 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:45 ago on Tue 31 Oct 2023 11:16:17 PM UTC. 2023-10-31T23:19:02.447 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-31T23:19:02.448 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:19:02.448 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-31T23:19:02.449 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:19:02.449 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-31T23:19:02.449 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:18.0.0-6795.gd1dcabba.el9 ceph 168 k 2023-10-31T23:19:02.449 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:02.449 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-31T23:19:02.449 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-31T23:19:02.450 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-31T23:19:02.450 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:02.450 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 168 k 2023-10-31T23:19:02.450 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 532 k 2023-10-31T23:19:02.450 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-31T23:19:02.675 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-nbd-18.0.0-6795.gd1dcabba.el9.x86_64.rpm 745 kB/s | 168 kB 00:00 2023-10-31T23:19:02.676 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-31T23:19:02.676 INFO:teuthology.orchestra.run.smithi008.stdout:Total 740 kB/s | 168 kB 00:00 2023-10-31T23:19:02.676 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-31T23:19:02.684 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-31T23:19:02.685 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-31T23:19:02.743 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-31T23:19:02.743 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-31T23:19:02.911 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-31T23:19:03.018 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:19:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:19:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 1/1 2023-10-31T23:19:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:03.802 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-31T23:19:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:18.0.0-6795.gd1dcabba.el9.x86_64 2023-10-31T23:19:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:03.803 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-31T23:19:04.077 DEBUG:teuthology.parallel:result is None 2023-10-31T23:19:04.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 2023-10-31T23:19:04.225 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-31T23:19:04.246 INFO:teuthology.orchestra.run.smithi008.stdout:18.0.0-6795.gd1dcabba.el9 2023-10-31T23:19:04.247 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6795.gd1dcabba.el9 2023-10-31T23:19:04.247 INFO:teuthology.task.install:The correct ceph version 18.0.0-6795.gd1dcabba is installed. 2023-10-31T23:19:04.248 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2 2023-10-31T23:19:04.401 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-31T23:19:04.426 INFO:teuthology.orchestra.run.smithi071.stdout:18.0.0-6795.gd1dcabba.el9 2023-10-31T23:19:04.426 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6795.gd1dcabba.el9 2023-10-31T23:19:04.427 INFO:teuthology.task.install:The correct ceph version 18.0.0-6795.gd1dcabba is installed. 2023-10-31T23:19:04.427 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-31T23:19:04.428 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:04.428 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-31T23:19:04.460 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:04.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-31T23:19:04.497 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-31T23:19:04.497 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:04.498 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-10-31T23:19:04.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-31T23:19:04.601 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:04.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2023-10-31T23:19:04.631 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-31T23:19:04.699 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-31T23:19:04.700 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:04.700 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-31T23:19:04.748 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-31T23:19:04.818 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:04.819 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-31T23:19:04.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-31T23:19:04.912 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-31T23:19:04.912 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:04.912 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-10-31T23:19:04.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-31T23:19:05.013 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:05.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2023-10-31T23:19:05.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-31T23:19:05.109 INFO:teuthology.run_tasks:Running task ceph... 2023-10-31T23:19:05.176 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-31T23:19:05.176 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2023-10-31T23:19:05.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2023-10-31T23:19:05.206 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-31T23:19:05.206 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-31T23:19:05.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-31T23:19:05.276 INFO:tasks.ceph:Creating extra log directories... 2023-10-31T23:19:05.276 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-31T23:19:05.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-31T23:19:05.355 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-31T23:19:05.355 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-31T23:19:05.355 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519', 'branch': 'wip-matanb-crimson-do_osd_ops_execute-part3', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7442519', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-do_osd_ops_execute-part3'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'a9edd23b5a8ddacab225824948b06b370baf276b'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6029, 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'a9edd23b5a8ddacab225824948b06b370baf276b', 'targets': {'smithi008.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk4jIz0Iy/U3c8+afCQ9hOCWAOAG/mDAXaEyzVYEMXV72ZflTOEbDTPDMEy+UwRxojIvv6ph7LNAyg4kVYEMMA=', 'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpHKTlIFzQP0Aod3adCh8dUG6w/cE6VCroP+6taVVpGtgJxna+5b9584yxJhS90ia8cGkl5+V+oF/umwREmzT4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'd1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-10-31_22:58:07', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.770726'} 2023-10-31T23:19:05.356 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-31T23:19:05.389 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-31T23:19:05.404 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2023-10-31T23:19:05.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2023-10-31T23:19:05.472 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:05.473 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-10-31T23:19:05.528 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-31T23:19:05.528 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-10-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-31T23:19:05.583 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-10-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-31 23:19:00.476900348 +0000 2023-10-31T23:19:05.584 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-31 23:15:31.917672465 +0000 2023-10-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-31 23:15:31.917672465 +0000 2023-10-31T23:19:05.585 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-31 23:15:31.917672465 +0000 2023-10-31T23:19:05.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-31T23:19:05.652 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-31T23:19:05.652 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-31T23:19:05.652 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 8.1633e-05 s, 6.3 MB/s 2023-10-31T23:19:05.653 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-31T23:19:05.709 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-10-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-10-31T23:19:05.764 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-31 23:19:00.476900348 +0000 2023-10-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-31 23:15:32.411667448 +0000 2023-10-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-31 23:15:32.411667448 +0000 2023-10-31T23:19:05.765 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-31 23:15:32.411667448 +0000 2023-10-31T23:19:05.766 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-31T23:19:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-31T23:19:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-31T23:19:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000101446 s, 5.0 MB/s 2023-10-31T23:19:05.834 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-31T23:19:05.891 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-10-31T23:19:05.946 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-31T23:19:05.946 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:05.946 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-10-31T23:19:05.947 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:05.947 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:05.947 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-31 23:19:00.476900348 +0000 2023-10-31T23:19:05.947 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-31 23:15:32.901662472 +0000 2023-10-31T23:19:05.947 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-31 23:15:32.901662472 +0000 2023-10-31T23:19:05.948 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-31 23:15:32.901662472 +0000 2023-10-31T23:19:05.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-31T23:19:06.015 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-31T23:19:06.015 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-31T23:19:06.015 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 7.9711e-05 s, 6.4 MB/s 2023-10-31T23:19:06.016 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-31T23:19:06.073 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-10-31T23:19:06.129 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-31T23:19:06.130 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:06.130 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-10-31T23:19:06.130 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:06.130 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:06.130 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-31 23:19:00.477900338 +0000 2023-10-31T23:19:06.131 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-31 23:15:33.385657557 +0000 2023-10-31T23:19:06.131 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-31 23:15:33.385657557 +0000 2023-10-31T23:19:06.131 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-31 23:15:33.385657557 +0000 2023-10-31T23:19:06.131 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-31T23:19:06.198 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-31T23:19:06.198 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-31T23:19:06.198 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.6879e-05 s, 5.3 MB/s 2023-10-31T23:19:06.199 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-31T23:19:06.255 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-31T23:19:06.255 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:06.255 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2023-10-31T23:19:06.271 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-31T23:19:06.271 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2023-10-31T23:19:06.326 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-31T23:19:06.326 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-10-31T23:19:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-31 23:18:51.191201577 +0000 2023-10-31T23:19:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-31 23:15:25.460173974 +0000 2023-10-31T23:19:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-31 23:15:25.460173974 +0000 2023-10-31T23:19:06.327 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-10-31 23:15:25.460173974 +0000 2023-10-31T23:19:06.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-31T23:19:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-31T23:19:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-31T23:19:06.392 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00022069 s, 2.3 MB/s 2023-10-31T23:19:06.393 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-31T23:19:06.448 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2023-10-31T23:19:06.502 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-31T23:19:06.503 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:06.503 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-10-31T23:19:06.503 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:06.503 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:06.503 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-31 23:18:51.192201559 +0000 2023-10-31T23:19:06.504 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-31 23:15:25.936165585 +0000 2023-10-31T23:19:06.504 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-31 23:15:25.936165585 +0000 2023-10-31T23:19:06.504 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-10-31 23:15:25.936165585 +0000 2023-10-31T23:19:06.504 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-31T23:19:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-31T23:19:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-31T23:19:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000216556 s, 2.4 MB/s 2023-10-31T23:19:06.569 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-31T23:19:06.624 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2023-10-31T23:19:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-31T23:19:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:06.679 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-10-31T23:19:06.679 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:06.679 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:06.680 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-31 23:18:51.192201559 +0000 2023-10-31T23:19:06.680 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-31 23:15:26.427156931 +0000 2023-10-31T23:19:06.680 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-31 23:15:26.427156931 +0000 2023-10-31T23:19:06.680 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-10-31 23:15:26.427156931 +0000 2023-10-31T23:19:06.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-31T23:19:06.744 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-31T23:19:06.744 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-31T23:19:06.744 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000183307 s, 2.8 MB/s 2023-10-31T23:19:06.745 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-31T23:19:06.800 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2023-10-31T23:19:06.854 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-31T23:19:06.855 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-31T23:19:06.855 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-10-31T23:19:06.855 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-31T23:19:06.855 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-31T23:19:06.855 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-31 23:18:51.192201559 +0000 2023-10-31T23:19:06.856 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-31 23:15:26.901148576 +0000 2023-10-31T23:19:06.856 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-31 23:15:26.901148576 +0000 2023-10-31T23:19:06.856 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-10-31 23:15:26.901148576 +0000 2023-10-31T23:19:06.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-31T23:19:06.919 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-31T23:19:06.920 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-31T23:19:06.920 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000176971 s, 2.9 MB/s 2023-10-31T23:19:06.921 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-31T23:19:06.976 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-31T23:19:06.977 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-10-31T23:19:06.977 INFO:tasks.ceph:Generating config... 2023-10-31T23:19:06.978 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-10-31T23:19:06.979 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-10-31T23:19:06.979 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-10-31T23:19:06.979 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-10-31T23:19:06.980 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-10-31T23:19:06.980 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-31T23:19:06.980 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-31T23:19:06.980 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-31T23:19:06.981 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2023-10-31T23:19:06.981 INFO:tasks.ceph:[mon] osd pool default crimson = True 2023-10-31T23:19:06.981 INFO:tasks.ceph:[osd] debug monc = 20 2023-10-31T23:19:06.981 INFO:tasks.ceph:[osd] crimson seastar smp = 3 2023-10-31T23:19:06.982 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-31T23:19:06.982 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-31T23:19:06.982 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-10-31T23:19:06.982 INFO:tasks.ceph:[osd] osd class default list = * 2023-10-31T23:19:06.983 INFO:tasks.ceph:[osd] osd class load list = * 2023-10-31T23:19:06.983 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-10-31T23:19:06.983 INFO:tasks.ceph:[client] debug ms = 1 2023-10-31T23:19:06.983 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2023-10-31T23:19:06.984 INFO:tasks.ceph:[global] ms client mode = crc 2023-10-31T23:19:06.984 INFO:tasks.ceph:[global] ms cluster mode = crc 2023-10-31T23:19:06.984 INFO:tasks.ceph:[global] ms mon client mode = crc 2023-10-31T23:19:06.984 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2023-10-31T23:19:06.985 INFO:tasks.ceph:[global] ms mon service mode = crc 2023-10-31T23:19:06.985 INFO:tasks.ceph:[global] ms service mode = crc 2023-10-31T23:19:06.985 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-31T23:19:06.985 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-31T23:19:06.986 INFO:tasks.ceph:Setting up mon.a... 2023-10-31T23:19:06.986 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-31T23:19:07.054 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2023-10-31T23:19:07.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-31T23:19:07.113 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-31T23:19:07.144 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8')] 2023-10-31T23:19:07.145 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}} 2023-10-31T23:19:07.146 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:07.147 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-31T23:19:07.200 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --print /home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:07.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:07.284+0000 7fd7c5c36e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:07.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:07.284+0000 7fd7c5c36e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:07.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:07.285+0000 7fd7c5c36e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:07.287 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:07.288 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:07.288 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2023-10-31T23:19:07.288 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2023-10-31T23:19:07.288 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:07.289 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2023-10-31T23:19:07.286177+0000 2023-10-31T23:19:07.289 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-31T23:19:07.286177+0000 2023-10-31T23:19:07.289 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 16 (pacific) 2023-10-31T23:19:07.289 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2023-10-31T23:19:07.289 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2023-10-31T23:19:07.290 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-10-31T23:19:07.290 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-31T23:19:07.305 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6066336e-3d1f-4c2f-a6c3-128fa49e8f52... 2023-10-31T23:19:07.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-31T23:19:07.349 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-31T23:19:07.399 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2023-10-31T23:19:07.400 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2023-10-31T23:19:07.400 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-31T23:19:07.400 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2023-10-31T23:19:07.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.401 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2023-10-31T23:19:07.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.401 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2023-10-31T23:19:07.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.401 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2023-10-31T23:19:07.402 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2023-10-31T23:19:07.402 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.402 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2023-10-31T23:19:07.402 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2023-10-31T23:19:07.402 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.402 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-31T23:19:07.403 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2023-10-31T23:19:07.403 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.403 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2023-10-31T23:19:07.403 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-31T23:19:07.403 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.404 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2023-10-31T23:19:07.404 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.404 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2023-10-31T23:19:07.404 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2023-10-31T23:19:07.404 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2023-10-31T23:19:07.405 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2023-10-31T23:19:07.405 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2023-10-31T23:19:07.405 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2023-10-31T23:19:07.405 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2023-10-31T23:19:07.405 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-31T23:19:07.405 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-31T23:19:07.406 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2023-10-31T23:19:07.406 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.406 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-31T23:19:07.406 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.406 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2023-10-31T23:19:07.407 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.407 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2023-10-31T23:19:07.407 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.407 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2023-10-31T23:19:07.407 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2023-10-31T23:19:07.408 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2023-10-31T23:19:07.408 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = 172.21.15.8 2023-10-31T23:19:07.408 INFO:teuthology.orchestra.run.smithi071.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-10-31T23:19:07.408 INFO:teuthology.orchestra.run.smithi071.stdout: ms client mode = crc 2023-10-31T23:19:07.408 INFO:teuthology.orchestra.run.smithi071.stdout: ms cluster mode = crc 2023-10-31T23:19:07.409 INFO:teuthology.orchestra.run.smithi071.stdout: ms mon client mode = crc 2023-10-31T23:19:07.409 INFO:teuthology.orchestra.run.smithi071.stdout: ms mon cluster mode = crc 2023-10-31T23:19:07.409 INFO:teuthology.orchestra.run.smithi071.stdout: ms mon service mode = crc 2023-10-31T23:19:07.409 INFO:teuthology.orchestra.run.smithi071.stdout: ms service mode = crc 2023-10-31T23:19:07.409 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:07.409 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.410 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2023-10-31T23:19:07.410 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2023-10-31T23:19:07.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.410 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2023-10-31T23:19:07.410 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2023-10-31T23:19:07.410 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2023-10-31T23:19:07.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.411 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2023-10-31T23:19:07.411 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2023-10-31T23:19:07.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.411 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2023-10-31T23:19:07.412 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2023-10-31T23:19:07.412 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2023-10-31T23:19:07.412 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.412 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2023-10-31T23:19:07.412 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2023-10-31T23:19:07.412 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.413 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2023-10-31T23:19:07.413 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.413 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2023-10-31T23:19:07.413 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.413 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2023-10-31T23:19:07.414 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.414 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2023-10-31T23:19:07.414 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2023-10-31T23:19:07.414 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.414 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2023-10-31T23:19:07.414 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2023-10-31T23:19:07.415 INFO:teuthology.orchestra.run.smithi071.stdout: debug monc = 20 2023-10-31T23:19:07.415 INFO:teuthology.orchestra.run.smithi071.stdout: crimson seastar smp = 3 2023-10-31T23:19:07.415 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-31T23:19:07.415 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2023-10-31T23:19:07.415 INFO:teuthology.orchestra.run.smithi071.stdout: osd blocked scrub grace period = 3600 2023-10-31T23:19:07.415 INFO:teuthology.orchestra.run.smithi071.stdout: osd class default list = * 2023-10-31T23:19:07.416 INFO:teuthology.orchestra.run.smithi071.stdout: osd class load list = * 2023-10-31T23:19:07.416 INFO:teuthology.orchestra.run.smithi071.stdout: osd shutdown pgref assert = True 2023-10-31T23:19:07.416 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.416 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2023-10-31T23:19:07.416 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-31T23:19:07.416 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2023-10-31T23:19:07.417 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-10-31T23:19:07.417 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-10-31T23:19:07.417 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-10-31T23:19:07.417 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-10-31T23:19:07.417 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2023-10-31T23:19:07.417 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.418 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2023-10-31T23:19:07.418 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-31T23:19:07.418 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-10-31T23:19:07.418 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2023-10-31T23:19:07.418 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-10-31T23:19:07.419 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2023-10-31T23:19:07.419 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2023-10-31T23:19:07.419 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-10-31T23:19:07.419 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2023-10-31T23:19:07.419 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2023-10-31T23:19:07.419 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-10-31T23:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-31T23:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2023-10-31T23:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2023-10-31T23:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2023-10-31T23:19:07.421 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-31T23:19:07.421 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-31T23:19:07.421 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.421 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2023-10-31T23:19:07.421 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2023-10-31T23:19:07.422 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.422 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2023-10-31T23:19:07.422 INFO:teuthology.orchestra.run.smithi071.stdout: mon min osdmap epochs = 50 2023-10-31T23:19:07.422 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune interval = 2 2023-10-31T23:19:07.422 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune min = 15 2023-10-31T23:19:07.422 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune txsize = 2 2023-10-31T23:19:07.423 INFO:teuthology.orchestra.run.smithi071.stdout: paxos service trim min = 10 2023-10-31T23:19:07.423 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on pool no app = False 2023-10-31T23:19:07.423 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default crimson = True 2023-10-31T23:19:07.423 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-31T23:19:07.423 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2023-10-31T23:19:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2023-10-31T23:19:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2023-10-31T23:19:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2023-10-31T23:19:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-31T23:19:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-31T23:19:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-31T23:19:07.425 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2023-10-31T23:19:07.426 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-31T23:19:07.426 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-10-31T23:19:07.427 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-31T23:19:07.427 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-10-31T23:19:07.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.427 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-10-31T23:19:07.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.428 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-10-31T23:19:07.428 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.428 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-10-31T23:19:07.428 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-10-31T23:19:07.428 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.429 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-10-31T23:19:07.429 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-10-31T23:19:07.429 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.429 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-31T23:19:07.429 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-10-31T23:19:07.430 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.430 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-10-31T23:19:07.430 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-31T23:19:07.430 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.430 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-10-31T23:19:07.430 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.431 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-10-31T23:19:07.431 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-10-31T23:19:07.431 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-10-31T23:19:07.431 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-10-31T23:19:07.431 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-10-31T23:19:07.432 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-10-31T23:19:07.432 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-10-31T23:19:07.432 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-31T23:19:07.432 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-31T23:19:07.432 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-10-31T23:19:07.433 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.433 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-31T23:19:07.433 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.433 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-10-31T23:19:07.433 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.434 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-10-31T23:19:07.434 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.434 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-10-31T23:19:07.434 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-10-31T23:19:07.434 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-10-31T23:19:07.434 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = 172.21.15.8 2023-10-31T23:19:07.435 INFO:teuthology.orchestra.run.smithi008.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-10-31T23:19:07.435 INFO:teuthology.orchestra.run.smithi008.stdout: ms client mode = crc 2023-10-31T23:19:07.435 INFO:teuthology.orchestra.run.smithi008.stdout: ms cluster mode = crc 2023-10-31T23:19:07.435 INFO:teuthology.orchestra.run.smithi008.stdout: ms mon client mode = crc 2023-10-31T23:19:07.435 INFO:teuthology.orchestra.run.smithi008.stdout: ms mon cluster mode = crc 2023-10-31T23:19:07.436 INFO:teuthology.orchestra.run.smithi008.stdout: ms mon service mode = crc 2023-10-31T23:19:07.436 INFO:teuthology.orchestra.run.smithi008.stdout: ms service mode = crc 2023-10-31T23:19:07.436 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:07.436 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.436 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-10-31T23:19:07.437 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-10-31T23:19:07.437 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.437 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-10-31T23:19:07.437 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-10-31T23:19:07.437 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-10-31T23:19:07.437 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.438 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-10-31T23:19:07.438 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-10-31T23:19:07.438 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.438 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-10-31T23:19:07.438 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-10-31T23:19:07.439 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-10-31T23:19:07.439 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.439 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-10-31T23:19:07.439 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-10-31T23:19:07.439 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.440 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-10-31T23:19:07.440 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.440 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-10-31T23:19:07.440 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.440 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-10-31T23:19:07.440 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.441 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-10-31T23:19:07.441 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-10-31T23:19:07.441 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.441 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-10-31T23:19:07.441 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-10-31T23:19:07.441 INFO:teuthology.orchestra.run.smithi008.stdout: debug monc = 20 2023-10-31T23:19:07.442 INFO:teuthology.orchestra.run.smithi008.stdout: crimson seastar smp = 3 2023-10-31T23:19:07.442 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-31T23:19:07.442 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-10-31T23:19:07.442 INFO:teuthology.orchestra.run.smithi008.stdout: osd blocked scrub grace period = 3600 2023-10-31T23:19:07.442 INFO:teuthology.orchestra.run.smithi008.stdout: osd class default list = * 2023-10-31T23:19:07.443 INFO:teuthology.orchestra.run.smithi008.stdout: osd class load list = * 2023-10-31T23:19:07.443 INFO:teuthology.orchestra.run.smithi008.stdout: osd shutdown pgref assert = True 2023-10-31T23:19:07.443 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.443 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-10-31T23:19:07.443 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-31T23:19:07.443 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-10-31T23:19:07.444 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-31T23:19:07.444 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-31T23:19:07.444 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-31T23:19:07.444 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-31T23:19:07.444 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-10-31T23:19:07.444 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-10-31T23:19:07.445 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-31T23:19:07.445 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-31T23:19:07.445 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-10-31T23:19:07.445 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-31T23:19:07.445 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-10-31T23:19:07.446 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-10-31T23:19:07.446 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-31T23:19:07.446 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-10-31T23:19:07.446 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-10-31T23:19:07.446 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-31T23:19:07.447 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.447 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-31T23:19:07.447 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-10-31T23:19:07.447 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-10-31T23:19:07.447 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.447 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-10-31T23:19:07.448 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-31T23:19:07.448 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-31T23:19:07.448 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.448 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-10-31T23:19:07.448 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-10-31T23:19:07.448 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.449 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-10-31T23:19:07.449 INFO:teuthology.orchestra.run.smithi008.stdout: mon min osdmap epochs = 50 2023-10-31T23:19:07.449 INFO:teuthology.orchestra.run.smithi008.stdout: mon osdmap full prune interval = 2 2023-10-31T23:19:07.449 INFO:teuthology.orchestra.run.smithi008.stdout: mon osdmap full prune min = 15 2023-10-31T23:19:07.449 INFO:teuthology.orchestra.run.smithi008.stdout: mon osdmap full prune txsize = 2 2023-10-31T23:19:07.449 INFO:teuthology.orchestra.run.smithi008.stdout: paxos service trim min = 10 2023-10-31T23:19:07.450 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on pool no app = False 2023-10-31T23:19:07.450 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default crimson = True 2023-10-31T23:19:07.450 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:07.450 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-10-31T23:19:07.450 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-10-31T23:19:07.450 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-10-31T23:19:07.451 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-10-31T23:19:07.451 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-31T23:19:07.451 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-31T23:19:07.451 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-31T23:19:07.451 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-10-31T23:19:07.451 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-31T23:19:07.452 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-31T23:19:07.531 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-31T23:19:07.532 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:07.532 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-31T23:19:07.547 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:07.547 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-31T23:19:07.602 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2023-10-31T23:19:07.602 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:07.602 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-31T23:19:07.603 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-31T23:19:07.688 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:07.689 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:07.744 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2023-10-31T23:19:07.745 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:07.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-31T23:19:07.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-31T23:19:07.785 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:07.785 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:07.840 INFO:tasks.ceph:Setting up mon nodes... 2023-10-31T23:19:07.840 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-31T23:19:07.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-31T23:19:07.952 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-31T23:19:07.955 INFO:tasks.ceph:Setting up mds nodes... 2023-10-31T23:19:07.956 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-31T23:19:07.956 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-31T23:19:08.008 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-31T23:19:08.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-31T23:19:08.075 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-31T23:19:08.090 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-31T23:19:08.090 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-10-31T23:19:08.090 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-31T23:19:08.121 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-31T23:19:08.122 INFO:tasks.ceph:role: osd.0 2023-10-31T23:19:08.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-31T23:19:08.122 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-31T23:19:08.192 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-31T23:19:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-31T23:19:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-31T23:19:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-31T23:19:08.193 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-31T23:19:08.194 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-31T23:19:08.194 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-31T23:19:08.194 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-31T23:19:08.194 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-31T23:19:08.194 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-31T23:19:08.224 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-31T23:19:08.226 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-31T23:19:08.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-31T23:19:08.300 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-31T23:19:08.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-31T23:19:08.445 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-31T23:19:08.446 INFO:tasks.ceph:role: osd.1 2023-10-31T23:19:08.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-31T23:19:08.447 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-31T23:19:08.516 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-31T23:19:08.516 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-31T23:19:08.516 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-31T23:19:08.516 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-31T23:19:08.517 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-31T23:19:08.517 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-31T23:19:08.517 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-31T23:19:08.517 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-31T23:19:08.517 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-31T23:19:08.518 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-31T23:19:08.548 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-31T23:19:08.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-31T23:19:08.550 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-31T23:19:08.626 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-31T23:19:08.701 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,278 seastar - Reactor backend: linux-aio 2023-10-31T23:19:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,298 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,298 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,298 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,298 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:==80147==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:==80147==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffccd24f000; bottom 0x7f8173094000; size: 0x007b5a1bb000 (529792741376) 2023-10-31T23:19:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:False positive error reports may follow 2023-10-31T23:19:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,360 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-31T23:19:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,360 [shard 0] osd - get_early_config: set --smp 3 2023-10-31T23:19:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:Suppressions used: 2023-10-31T23:19:09.885 INFO:teuthology.orchestra.run.smithi008.stderr: count bytes template 2023-10-31T23:19:09.885 INFO:teuthology.orchestra.run.smithi008.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:09.886 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-31T23:19:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,934 seastar - Reactor backend: linux-aio 2023-10-31T23:19:09.960 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,960 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:09.961 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,960 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:09.961 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,960 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:09.961 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:09,960 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:09.970 INFO:teuthology.orchestra.run.smithi008.stderr:==80137==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:==80137==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffccd24f000; bottom 0x7f8170e7d000; size: 0x007b5c3d2000 (529828487168) 2023-10-31T23:19:09.977 INFO:teuthology.orchestra.run.smithi008.stderr:False positive error reports may follow 2023-10-31T23:19:09.977 INFO:teuthology.orchestra.run.smithi008.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:10.063 INFO:teuthology.orchestra.run.smithi008.stderr:Reactor stalled for 33 ms on shard 0. Backtrace: 0x45d5d 0x2c4bf7d6 0x2c4c0b84 0x2c4c20d2 0x2c4c2456 0x2c4c25a0 0x2c4c29f6 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x2604eb84 0x260511cd 0x26052fde 0x26055843 0x25e854b7 0x1eb9e762 0x1eb136d3 0x1eb1763f 0x2c84465b 2023-10-31T23:19:10.064 INFO:teuthology.orchestra.run.smithi008.stderr:kernel callstack: 2023-10-31T23:19:13.587 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:13.588 INFO:teuthology.orchestra.run.smithi008.stderr:Suppressions used: 2023-10-31T23:19:13.588 INFO:teuthology.orchestra.run.smithi008.stderr: count bytes template 2023-10-31T23:19:13.588 INFO:teuthology.orchestra.run.smithi008.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:13.588 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:13.589 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-31T23:19:13.589 INFO:teuthology.orchestra.run.smithi008.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:13.627 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-31T23:19:13.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:14.202 INFO:teuthology.orchestra.run.smithi008.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:14.203 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,203 seastar - Reactor backend: linux-aio 2023-10-31T23:19:14.219 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,218 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:14.219 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,218 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:14.219 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,218 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:14.219 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,218 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:14.221 INFO:teuthology.orchestra.run.smithi008.stderr:==80958==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:14.228 INFO:teuthology.orchestra.run.smithi008.stderr:==80958==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffde4492000; bottom 0x7fb7244c2000; size: 0x0046bffd0000 (303868739584) 2023-10-31T23:19:14.228 INFO:teuthology.orchestra.run.smithi008.stderr:False positive error reports may follow 2023-10-31T23:19:14.228 INFO:teuthology.orchestra.run.smithi008.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c4bf7d6 0x2c4c0b84 0x2c4c20d2 0x2c4c2456 0x2c4c25a0 0x2c4c29f6 0x54daf 0xd5a40 0xd554b 0x287b7 0xb738c 0x1e5c3190 0x22ae3176 0x2289ea02 0x22921e0f 0x247b7df3 0x247bd62a 0x247bfef4 0x247c10cd 0x2244bd9f 0x22485620 0x224c0899 0x2c461af1 0x2c4ff8fe 0x2c724930 0x2c72677b 0x2c17cdda 0x2c17ecdb 0x1ec5c758 0x1ec668c5 0x1eae33c9 0x3feaf 0x3ff5f 0x1e59ba04 2023-10-31T23:19:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:kernel callstack: 2023-10-31T23:19:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,263 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-31T23:19:14.264 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,263 [shard 0] osd - get_early_config: set --smp 3 2023-10-31T23:19:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:Suppressions used: 2023-10-31T23:19:14.762 INFO:teuthology.orchestra.run.smithi008.stderr: count bytes template 2023-10-31T23:19:14.762 INFO:teuthology.orchestra.run.smithi008.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:14.762 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-31T23:19:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,817 seastar - Reactor backend: linux-aio 2023-10-31T23:19:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,851 [shard 2] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,851 [shard 2] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,851 [shard 2] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:INFO 2023-10-31 23:19:14,851 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:==80956==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:14.860 INFO:teuthology.orchestra.run.smithi008.stderr:==80956==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffde4492000; bottom 0x7fb7222ab000; size: 0x0046c21e7000 (303904485376) 2023-10-31T23:19:14.860 INFO:teuthology.orchestra.run.smithi008.stderr:False positive error reports may follow 2023-10-31T23:19:14.860 INFO:teuthology.orchestra.run.smithi008.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:14.945 INFO:teuthology.orchestra.run.smithi008.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c4bf7d6 0x2c4c0b84 0x2c4c20d2 0x2c4c2456 0x2c4c25a0 0x2c4c29f6 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x2604eb84 0x260511cd 0x26052fde 0x26055843 0x25e854b7 0x1eb9e762 0x1eb136d3 0x1eb1763f 0x2c84465b 2023-10-31T23:19:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:kernel callstack: 2023-10-31T23:19:18.447 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:18.448 INFO:teuthology.orchestra.run.smithi008.stderr:Suppressions used: 2023-10-31T23:19:18.448 INFO:teuthology.orchestra.run.smithi008.stderr: count bytes template 2023-10-31T23:19:18.448 INFO:teuthology.orchestra.run.smithi008.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:18.448 INFO:teuthology.orchestra.run.smithi008.stderr:----------------------------------------------------- 2023-10-31T23:19:18.448 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-31T23:19:18.449 INFO:teuthology.orchestra.run.smithi008.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:18.501 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-31T23:19:18.531 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-31T23:19:18.563 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-31T23:19:18.563 INFO:tasks.ceph:role: osd.2 2023-10-31T23:19:18.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-31T23:19:18.564 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-31T23:19:18.642 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-31T23:19:18.643 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-31T23:19:18.643 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-31T23:19:18.643 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-31T23:19:18.643 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-31T23:19:18.643 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-31T23:19:18.644 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-31T23:19:18.644 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-31T23:19:18.644 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-31T23:19:18.644 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-31T23:19:19.144 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-31T23:19:19.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-31T23:19:19.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-10-31T23:19:19.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-31T23:19:19.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-31T23:19:19.383 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-31T23:19:19.384 INFO:tasks.ceph:role: osd.3 2023-10-31T23:19:19.384 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-31T23:19:19.384 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-31T23:19:19.460 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-31T23:19:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-31T23:19:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-31T23:19:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-31T23:19:19.461 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-31T23:19:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-31T23:19:19.461 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-31T23:19:19.461 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-31T23:19:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-31T23:19:19.462 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-31T23:19:19.910 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-31T23:19:19.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-31T23:19:19.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-10-31T23:19:20.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-31T23:19:20.036 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:20.585 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:20,585 seastar - Reactor backend: linux-aio 2023-10-31T23:19:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:20,610 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:20,610 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:20,610 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:20.611 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:20,610 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:20.614 INFO:teuthology.orchestra.run.smithi071.stderr:==79706==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:==79706==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd07d8b000; bottom 0x7fe399b94000; size: 0x00196e1f7000 (109221736448) 2023-10-31T23:19:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:False positive error reports may follow 2023-10-31T23:19:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c4bf7d6 0x2c4c0b84 0x2c4c20d2 0x2c4c2456 0x2c4c25a0 0x2c4c29f6 0x54daf 0x2a2a734ad64d 0x2c6e8 0x2857c 0xb6323 0x1e63c1a9 0x1e63f8f4 0x1e6410c2 0x22927d27 0x22930fe9 0x1eaca543 0x1eaffa67 0x1ec8bf48 0x1ec8f47e 0x2c84465b 2023-10-31T23:19:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2023-10-31T23:19:20.683 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:20,682 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-31T23:19:20.683 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:20,682 [shard 0] osd - get_early_config: set --smp 3 2023-10-31T23:19:21.178 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:21.178 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2023-10-31T23:19:21.179 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2023-10-31T23:19:21.179 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:21.179 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-31T23:19:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:21,230 seastar - Reactor backend: linux-aio 2023-10-31T23:19:21.248 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:21,248 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:21.249 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:21,248 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:21.249 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:21,248 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:21.256 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:21,255 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:21.258 INFO:teuthology.orchestra.run.smithi071.stderr:==79704==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:==79704==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd07d8b000; bottom 0x7fe39797d000; size: 0x00197040e000 (109257482240) 2023-10-31T23:19:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:False positive error reports may follow 2023-10-31T23:19:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2023-10-31T23:19:24.349 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2023-10-31T23:19:24.349 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:24.350 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-31T23:19:24.350 INFO:teuthology.orchestra.run.smithi071.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:24.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-31T23:19:24.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:24,914 seastar - Reactor backend: linux-aio 2023-10-31T23:19:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:24,930 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:24,930 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:24,930 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:24,930 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:24.933 INFO:teuthology.orchestra.run.smithi071.stderr:==80515==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:24.939 INFO:teuthology.orchestra.run.smithi071.stderr:==80515==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffca7614000; bottom 0x7f2bd1726000; size: 0x00d0d5eee000 (896942399488) 2023-10-31T23:19:24.939 INFO:teuthology.orchestra.run.smithi071.stderr:False positive error reports may follow 2023-10-31T23:19:24.939 INFO:teuthology.orchestra.run.smithi071.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:24,973 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-10-31T23:19:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:24,974 [shard 0] osd - get_early_config: set --smp 3 2023-10-31T23:19:25.443 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:25.444 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2023-10-31T23:19:25.444 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2023-10-31T23:19:25.444 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:25.444 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:25.445 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-31T23:19:25.499 INFO:teuthology.orchestra.run.smithi071.stderr:WARNING: debug mode. Not for benchmarking or production 2023-10-31T23:19:25.499 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:25,499 seastar - Reactor backend: linux-aio 2023-10-31T23:19:25.518 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:25,517 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-10-31T23:19:25.518 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:25,517 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-10-31T23:19:25.518 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:25,517 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-10-31T23:19:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:INFO 2023-10-31 23:19:25,524 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-10-31T23:19:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:==80513==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-10-31T23:19:25.533 INFO:teuthology.orchestra.run.smithi071.stderr:==80513==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffca7614000; bottom 0x7f2bcf50f000; size: 0x00d0d8105000 (896978145280) 2023-10-31T23:19:25.534 INFO:teuthology.orchestra.run.smithi071.stderr:False positive error reports may follow 2023-10-31T23:19:25.534 INFO:teuthology.orchestra.run.smithi071.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-10-31T23:19:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c4bf7d6 0x2c4c0b84 0x2c4c20d2 0x2c4c2456 0x2c4c25a0 0x2c4c29f6 0x54daf 0x227ba605 0x228b71f1 0x229310cf 0x1eaca543 0x1eaffa67 0x1eb0aaf9 0x1eb1763f 0x2c84465b 2023-10-31T23:19:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:kernel callstack: 2023-10-31T23:19:28.851 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:28.851 INFO:teuthology.orchestra.run.smithi071.stderr:Suppressions used: 2023-10-31T23:19:28.852 INFO:teuthology.orchestra.run.smithi071.stderr: count bytes template 2023-10-31T23:19:28.852 INFO:teuthology.orchestra.run.smithi071.stderr: 1 8 MallocExtension::Register 2023-10-31T23:19:28.852 INFO:teuthology.orchestra.run.smithi071.stderr:----------------------------------------------------- 2023-10-31T23:19:28.852 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-31T23:19:28.853 INFO:teuthology.orchestra.run.smithi071.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:19:28.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-31T23:19:28.929 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-31T23:19:28.929 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:28.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-31T23:19:28.967 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:28.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-31T23:19:29.042 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:29.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-31T23:19:29.069 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:29.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-31T23:19:29.136 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:29.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-31T23:19:29.203 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:29.203 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-31T23:19:29.222 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:29.223 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-31T23:19:29.258 INFO:tasks.ceph:Adding keys to all mons... 2023-10-31T23:19:29.259 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-31T23:19:29.296 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2023-10-31T23:19:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBui0Fli8HPARAAX6xJympRhiWztOiMVZEExg== 2023-10-31T23:19:29.296 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2023-10-31T23:19:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQByi0FlG01HNhAAL4mTB6F148KybnnGQooNIQ== 2023-10-31T23:19:29.297 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2023-10-31T23:19:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBri0FlofPGOBAARxq5A4jP4N1EHuxjddUmOg== 2023-10-31T23:19:29.298 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2023-10-31T23:19:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB5i0FlCly0EhAA0LUglJLzjmgs8cE+KZPWZg== 2023-10-31T23:19:29.298 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2023-10-31T23:19:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB9i0Flz/6QIxAAK9n+Bf5g/NGfUiRrCa9g3g== 2023-10-31T23:19:29.299 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-31T23:19:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBsi0FlsseBABAAtTmuo2PRL5O2POt49naWbg== 2023-10-31T23:19:29.299 INFO:teuthology.orchestra.run.smithi008.stdout:[client.1] 2023-10-31T23:19:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBsi0FlkNtzBBAAkLlZWadh72Si03EFfl6NIg== 2023-10-31T23:19:29.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-31T23:19:29.411 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-31T23:19:29.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-31T23:19:29.538 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-31T23:19:29.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-31T23:19:29.661 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-31T23:19:29.727 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-31T23:19:29.792 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-31T23:19:29.793 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-31T23:19:29.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-31T23:19:29.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:29.924+0000 7f7a80e24980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:29.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:29.924+0000 7f7a80e24980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:29.941 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-31T23:19:29.972 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-31T23:19:30.027 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-31T23:19:30.028 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-31T23:19:30.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-31T23:19:30.069 INFO:tasks.ceph.mon.a:Started 2023-10-31T23:19:30.070 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-31T23:19:30.070 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-31T23:19:30.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-31T23:19:30.073 INFO:tasks.ceph.mgr.x:Started 2023-10-31T23:19:30.074 INFO:tasks.ceph:Setting crush tunables to default 2023-10-31T23:19:30.074 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2023-10-31T23:19:30.154 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:19:30.152+0000 7f296043c980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.154 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:19:30.152+0000 7f296043c980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.154 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:19:30.153+0000 7f296043c980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.174 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:30.173+0000 7f5e4241df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.179+0000 7f63f7f5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.185+0000 7f63f7f5e640 1 Processor -- start 2023-10-31T23:19:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.185+0000 7f63f7f5e640 1 -- start start 2023-10-31T23:19:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f7f5e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 0x7f63f0138520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f7f5e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f006c210 con 0x7f63f006d140 2023-10-31T23:19:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f7f5e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f006cdb0 con 0x7f63f0136100 2023-10-31T23:19:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f54f9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 0x7f63f0138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f54f9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 0x7f63f0138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57774/0 (socket says 172.21.15.8:57774) 2023-10-31T23:19:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f5cfa640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f63f006d140 0x7f63f0133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58124/0 (socket says 172.21.15.8:58124) 2023-10-31T23:19:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f54f9640 1 -- 172.21.15.8:0/1693560899 learned_addr learned my addr 172.21.15.8:0/1693560899 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f54f9640 1 -- 172.21.15.8:0/1693560899 >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 msgr2=0x7f63f0138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-31T23:19:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f54f9640 1 -- 172.21.15.8:0/1693560899 >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 msgr2=0x7f63f0138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-31T23:19:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f54f9640 1 --2- 172.21.15.8:0/1693560899 >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 0x7f63f0138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-31T23:19:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.186+0000 7f63f54f9640 1 --2- 172.21.15.8:0/1693560899 >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 0x7f63f0138520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-31T23:19:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201856680 0 0) 0x7f63f006c210 con 0x7f63f006d140 2023-10-31T23:19:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63dc0034f0 con 0x7f63f006d140 2023-10-31T23:19:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799584240 0 0) 0x7f63dc0034f0 con 0x7f63f006d140 2023-10-31T23:19:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 msgr2=0x7f63f0138520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-31T23:19:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 --2- 172.21.15.8:0/1693560899 >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 0x7f63f0138520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f006d550 con 0x7f63f006d140 2023-10-31T23:19:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 3040265907 0 0) 0x7f63ec0015a0 con 0x7f63f006d140 2023-10-31T23:19:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 >> v1:172.21.15.8:6789/0 conn(0x7f63f006d140 legacy=0x7f63f0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 --2- 172.21.15.8:0/1693560899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.207+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f006cdb0 con 0x7f63dc003940 2023-10-31T23:19:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.208+0000 7f63f5cfa640 1 --2- 172.21.15.8:0/1693560899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.208+0000 7f63f5cfa640 1 -- 172.21.15.8:0/1693560899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0034f0 con 0x7f63dc003940 2023-10-31T23:19:30.212 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:30.210+0000 7f5e4241df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.213 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:30.211+0000 7f5e4241df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.209+0000 7f63f5cfa640 1 --2- 172.21.15.8:0/1693560899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63dc003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c77d7eeee39d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f63ec007b30 con 0x7f63dc003940 2023-10-31T23:19:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f63ec0071e0 con 0x7f63dc003940 2023-10-31T23:19:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f4cf8640 1 -- 172.21.15.8:0/1693560899 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f63ec007480 con 0x7f63dc003940 2023-10-31T23:19:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f7f5e640 1 -- 172.21.15.8:0/1693560899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 msgr2=0x7f63dc003d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f7f5e640 1 --2- 172.21.15.8:0/1693560899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63dc003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f7f5e640 1 -- 172.21.15.8:0/1693560899 shutdown_connections 2023-10-31T23:19:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f7f5e640 1 --2- 172.21.15.8:0/1693560899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63dc003d90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f7f5e640 1 --2- 172.21.15.8:0/1693560899 >> v2:172.21.15.8:3300/0 conn(0x7f63f0136100 0x7f63f0138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.210+0000 7f63f7f5e640 1 -- 172.21.15.8:0/1693560899 >> 172.21.15.8:0/1693560899 conn(0x7f63f00a2d60 msgr2=0x7f63f00a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.211+0000 7f63f7f5e640 1 -- 172.21.15.8:0/1693560899 shutdown_connections 2023-10-31T23:19:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.211+0000 7f63f7f5e640 1 -- 172.21.15.8:0/1693560899 wait complete. 2023-10-31T23:19:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.211+0000 7f63f7f5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.212+0000 7f63f7f5e640 1 Processor -- start 2023-10-31T23:19:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.212+0000 7f63f7f5e640 1 -- start start 2023-10-31T23:19:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.212+0000 7f63f7f5e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63f01c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.212+0000 7f63f7f5e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f011da30 con 0x7f63dc003940 2023-10-31T23:19:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63f5cfa640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63f01c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63f5cfa640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63f01c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57788/0 (socket says 172.21.15.8:57788) 2023-10-31T23:19:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63f5cfa640 1 -- 172.21.15.8:0/3627229013 learned_addr learned my addr 172.21.15.8:0/3627229013 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63f5cfa640 1 -- 172.21.15.8:0/3627229013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f0070530 con 0x7f63dc003940 2023-10-31T23:19:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63f5cfa640 1 --2- 172.21.15.8:0/3627229013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63f01c7450 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63e67fc640 1 -- 172.21.15.8:0/3627229013 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f63ec001b60 con 0x7f63dc003940 2023-10-31T23:19:30.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63e67fc640 1 -- 172.21.15.8:0/3627229013 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f63ec007630 con 0x7f63dc003940 2023-10-31T23:19:30.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f011c0d0 con 0x7f63dc003940 2023-10-31T23:19:30.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63e67fc640 1 -- 172.21.15.8:0/3627229013 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f63ec001430 con 0x7f63dc003940 2023-10-31T23:19:30.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f011b480 con 0x7f63dc003940 2023-10-31T23:19:30.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63e67fc640 1 -- 172.21.15.8:0/3627229013 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f63ec016420 con 0x7f63dc003940 2023-10-31T23:19:30.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.213+0000 7f63e67fc640 1 -- 172.21.15.8:0/3627229013 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (crc 0 0 0) 0x7f63ec0156f0 con 0x7f63dc003940 2023-10-31T23:19:30.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.214+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f012d000 con 0x7f63dc003940 2023-10-31T23:19:30.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.216+0000 7f63e67fc640 1 -- 172.21.15.8:0/3627229013 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f63ec0168b0 con 0x7f63dc003940 2023-10-31T23:19:30.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.281+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f63f0061d90 con 0x7f63dc003940 2023-10-31T23:19:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.282+0000 7f63e67fc640 1 -- 172.21.15.8:0/3627229013 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (crc 0 0 0) 0x7f63ec016a50 con 0x7f63dc003940 2023-10-31T23:19:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-10-31T23:19:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.283+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 msgr2=0x7f63f01c7450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.283+0000 7f63f7f5e640 1 --2- 172.21.15.8:0/3627229013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63f01c7450 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.283+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 shutdown_connections 2023-10-31T23:19:30.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.283+0000 7f63f7f5e640 1 --2- 172.21.15.8:0/3627229013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63dc003940 0x7f63f01c7450 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.283+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 >> 172.21.15.8:0/3627229013 conn(0x7f63f00a2d60 msgr2=0x7f63f01352f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:30.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.283+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 shutdown_connections 2023-10-31T23:19:30.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.283+0000 7f63f7f5e640 1 -- 172.21.15.8:0/3627229013 wait complete. 2023-10-31T23:19:30.295 INFO:tasks.ceph:check_enable_crimson: True 2023-10-31T23:19:30.295 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2023-10-31T23:19:30.295 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2023-10-31T23:19:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.398+0000 7fcba519e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.403+0000 7fcba519e640 1 Processor -- start 2023-10-31T23:19:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.403+0000 7fcba519e640 1 -- start start 2023-10-31T23:19:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.404+0000 7fcba519e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcba0136040 0x7fcba0138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.404+0000 7fcba519e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba006c280 con 0x7fcba006cb00 2023-10-31T23:19:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.404+0000 7fcba519e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba006c6c0 con 0x7fcba0136040 2023-10-31T23:19:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.404+0000 7fcb9ed9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcba006cb00 0x7fcba012fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58130/0 (socket says 172.21.15.8:58130) 2023-10-31T23:19:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.404+0000 7fcb9ed9d640 1 -- 172.21.15.8:0/3804847277 learned_addr learned my addr 172.21.15.8:0/3804847277 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.404+0000 7fcb97fff640 1 --2- 172.21.15.8:0/3804847277 >> v2:172.21.15.8:3300/0 conn(0x7fcba0136040 0x7fcba0138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.404+0000 7fcb9e59c640 1 -- 172.21.15.8:0/3804847277 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184588878 0 0) 0x7fcba006c280 con 0x7fcba006cb00 2023-10-31T23:19:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.405+0000 7fcb9e59c640 1 -- 172.21.15.8:0/3804847277 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb8c0034f0 con 0x7fcba006cb00 2023-10-31T23:19:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.405+0000 7fcb97fff640 1 -- 172.21.15.8:0/3804847277 >> v1:172.21.15.8:6789/0 conn(0x7fcba006cb00 legacy=0x7fcba012fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.405+0000 7fcb97fff640 1 -- 172.21.15.8:0/3804847277 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba006d8b0 con 0x7fcba0136040 2023-10-31T23:19:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.405+0000 7fcb97fff640 1 --2- 172.21.15.8:0/3804847277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba0136040 0x7fcba0138460 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf89918d43424d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.405+0000 7fcb9e59c640 1 -- 172.21.15.8:0/3804847277 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcb88009ce0 con 0x7fcba0136040 2023-10-31T23:19:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.405+0000 7fcb9e59c640 1 -- 172.21.15.8:0/3804847277 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcb88009e40 con 0x7fcba0136040 2023-10-31T23:19:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.405+0000 7fcb9e59c640 1 -- 172.21.15.8:0/3804847277 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcb8800e360 con 0x7fcba0136040 2023-10-31T23:19:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 1 -- 172.21.15.8:0/3804847277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba0136040 msgr2=0x7fcba0138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 1 --2- 172.21.15.8:0/3804847277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba0136040 0x7fcba0138460 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 1 -- 172.21.15.8:0/3804847277 shutdown_connections 2023-10-31T23:19:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 1 --2- 172.21.15.8:0/3804847277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba0136040 0x7fcba0138460 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 1 -- 172.21.15.8:0/3804847277 >> 172.21.15.8:0/3804847277 conn(0x7fcba00a3060 msgr2=0x7fcba00a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 1 -- 172.21.15.8:0/3804847277 shutdown_connections 2023-10-31T23:19:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 1 -- 172.21.15.8:0/3804847277 wait complete. 2023-10-31T23:19:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.406+0000 7fcba519e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.407+0000 7fcba519e640 1 Processor -- start 2023-10-31T23:19:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.407+0000 7fcba519e640 1 -- start start 2023-10-31T23:19:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcba519e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba006cb00 0x7fcba006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcba519e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba006f900 con 0x7fcba006cb00 2023-10-31T23:19:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb9ed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba006cb00 0x7fcba006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb9ed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba006cb00 0x7fcba006fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57810/0 (socket says 172.21.15.8:57810) 2023-10-31T23:19:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb9ed9d640 1 -- 172.21.15.8:0/3378455579 learned_addr learned my addr 172.21.15.8:0/3378455579 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb9ed9d640 1 -- 172.21.15.8:0/3378455579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba011b540 con 0x7fcba006cb00 2023-10-31T23:19:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb9ed9d640 1 --2- 172.21.15.8:0/3378455579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba006cb00 0x7fcba006fda0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb977fe640 1 -- 172.21.15.8:0/3378455579 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcb900059d0 con 0x7fcba006cb00 2023-10-31T23:19:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb977fe640 1 -- 172.21.15.8:0/3378455579 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcb90005b30 con 0x7fcba006cb00 2023-10-31T23:19:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba011cc90 con 0x7fcba006cb00 2023-10-31T23:19:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcb977fe640 1 -- 172.21.15.8:0/3378455579 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcb90005dd0 con 0x7fcba006cb00 2023-10-31T23:19:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.408+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba011c9b0 con 0x7fcba006cb00 2023-10-31T23:19:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.409+0000 7fcb977fe640 1 -- 172.21.15.8:0/3378455579 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fcb900073b0 con 0x7fcba006cb00 2023-10-31T23:19:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.409+0000 7fcb977fe640 1 -- 172.21.15.8:0/3378455579 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (crc 0 0 0) 0x7fcb9000f570 con 0x7fcba006cb00 2023-10-31T23:19:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.409+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba00719f0 con 0x7fcba006cb00 2023-10-31T23:19:30.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.411+0000 7fcb977fe640 1 -- 172.21.15.8:0/3378455579 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7fcb9000c730 con 0x7fcba006cb00 2023-10-31T23:19:30.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:30.487+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcba0061d90 con 0x7fcba006cb00 2023-10-31T23:19:30.489 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:19:30.488+0000 7f29577f1640 -1 WARNING: experimental feature 'crimson' is enabled 2023-10-31T23:19:30.490 INFO:tasks.ceph.mon.a.smithi008.stderr:Please be aware that this feature is experimental, untested, 2023-10-31T23:19:30.490 INFO:tasks.ceph.mon.a.smithi008.stderr:unsupported, and may result in data corruption, data loss, 2023-10-31T23:19:30.490 INFO:tasks.ceph.mon.a.smithi008.stderr:and/or irreparable damage to your cluster. Do not use 2023-10-31T23:19:30.490 INFO:tasks.ceph.mon.a.smithi008.stderr:feature with important data. 2023-10-31T23:19:30.490 INFO:tasks.ceph.mon.a.smithi008.stderr: 2023-10-31T23:19:30.666 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:30.664+0000 7f5e4241df00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-31T23:19:30.719 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:30.718+0000 7f5e4241df00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-31T23:19:31.261 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.259+0000 7f5e4241df00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-31T23:19:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.283+0000 7fcb977fe640 1 -- 172.21.15.8:0/3378455579 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) v1 ==== 99+0+0 (crc 0 0 0) 0x7fcb9000c9a0 con 0x7fcba006cb00 2023-10-31T23:19:31.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.284+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba006cb00 msgr2=0x7fcba006fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:31.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.284+0000 7fcba519e640 1 --2- 172.21.15.8:0/3378455579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba006cb00 0x7fcba006fda0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.284+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 shutdown_connections 2023-10-31T23:19:31.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.284+0000 7fcba519e640 1 --2- 172.21.15.8:0/3378455579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcba006cb00 0x7fcba006fda0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.284+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 >> 172.21.15.8:0/3378455579 conn(0x7fcba00a3060 msgr2=0x7fcba01bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:31.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.284+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 shutdown_connections 2023-10-31T23:19:31.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:31.284+0000 7fcba519e640 1 -- 172.21.15.8:0/3378455579 wait complete. 2023-10-31T23:19:31.299 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-31T23:19:31.300 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:31.300 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-31T23:19:31.313 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.311+0000 7f5e4241df00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-31T23:19:31.334 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:19:31.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-31T23:19:31.358 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.356+0000 7f5e4241df00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-31T23:19:31.408 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:31.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-31T23:19:31.412 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.409+0000 7f5e4241df00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-31T23:19:31.435 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-31T23:19:31.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-31T23:19:31.455 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.454+0000 7f5e4241df00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-31T23:19:31.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 7e66b79b-b60a-4687-90c3-7fcfd90f6727 0 2023-10-31T23:19:31.561 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.560+0000 7f5e4241df00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-31T23:19:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.620+0000 7f00e4915640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.625+0000 7f00e4915640 1 Processor -- start 2023-10-31T23:19:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.625+0000 7f00e4915640 1 -- start start 2023-10-31T23:19:31.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.626+0000 7f00e4915640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00e011a990 0x7f00e011cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:31.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.626+0000 7f00e4915640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e011d380 con 0x7f00e0111d80 2023-10-31T23:19:31.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.626+0000 7f00e4915640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e011e520 con 0x7f00e011a990 2023-10-31T23:19:31.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.626+0000 7f00ddd9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00e011a990 0x7f00e011cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:31.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.626+0000 7f00de59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f00e0111d80 0x7f00e0112190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.71:40062/0 (socket says 172.21.15.71:40062) 2023-10-31T23:19:31.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.626+0000 7f00ddd9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00e011a990 0x7f00e011cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42476/0 (socket says 172.21.15.71:42476) 2023-10-31T23:19:31.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.626+0000 7f00de59c640 1 -- 172.21.15.71:0/4155362634 learned_addr learned my addr 172.21.15.71:0/4155362634 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-31T23:19:31.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.627+0000 7f00ddd9b640 1 -- 172.21.15.71:0/4155362634 >> v1:172.21.15.8:6789/0 conn(0x7f00e0111d80 legacy=0x7f00e0112190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:31.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.627+0000 7f00ddd9b640 1 -- 172.21.15.71:0/4155362634 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e011e660 con 0x7f00e011a990 2023-10-31T23:19:31.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.627+0000 7f00ddd9b640 1 --2- 172.21.15.71:0/4155362634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e011a990 0x7f00e011cdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5c0784c874f5eb server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:31.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.627+0000 7f00dd59a640 1 -- 172.21.15.71:0/4155362634 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00d4009ce0 con 0x7f00e011a990 2023-10-31T23:19:31.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.627+0000 7f00dd59a640 1 -- 172.21.15.71:0/4155362634 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f00d4009e40 con 0x7f00e011a990 2023-10-31T23:19:31.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.627+0000 7f00dd59a640 1 -- 172.21.15.71:0/4155362634 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00d400e360 con 0x7f00e011a990 2023-10-31T23:19:31.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 1 -- 172.21.15.71:0/4155362634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e011a990 msgr2=0x7f00e011cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:31.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 1 --2- 172.21.15.71:0/4155362634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e011a990 0x7f00e011cdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 1 -- 172.21.15.71:0/4155362634 shutdown_connections 2023-10-31T23:19:31.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 1 --2- 172.21.15.71:0/4155362634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e011a990 0x7f00e011cdb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 1 -- 172.21.15.71:0/4155362634 >> 172.21.15.71:0/4155362634 conn(0x7f00e006d7b0 msgr2=0x7f00e010fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:31.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 1 -- 172.21.15.71:0/4155362634 shutdown_connections 2023-10-31T23:19:31.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 1 -- 172.21.15.71:0/4155362634 wait complete. 2023-10-31T23:19:31.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.628+0000 7f00e4915640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:31.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.629+0000 7f00e4915640 1 Processor -- start 2023-10-31T23:19:31.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.629+0000 7f00e4915640 1 -- start start 2023-10-31T23:19:31.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.629+0000 7f00e4915640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0111d80 0x7f00e01ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:31.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.629+0000 7f00e4915640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01ac8a0 con 0x7f00e0111d80 2023-10-31T23:19:31.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.629+0000 7f00de59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0111d80 0x7f00e01ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:31.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.629+0000 7f00de59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0111d80 0x7f00e01ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42484/0 (socket says 172.21.15.71:42484) 2023-10-31T23:19:31.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.629+0000 7f00de59c640 1 -- 172.21.15.71:0/1265111375 learned_addr learned my addr 172.21.15.71:0/1265111375 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-31T23:19:31.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00de59c640 1 -- 172.21.15.71:0/1265111375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e01ac9e0 con 0x7f00e0111d80 2023-10-31T23:19:31.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00de59c640 1 --2- 172.21.15.71:0/1265111375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0111d80 0x7f00e01ac2d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:31.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00ceffd640 1 -- 172.21.15.71:0/1265111375 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00d00059d0 con 0x7f00e0111d80 2023-10-31T23:19:31.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00ceffd640 1 -- 172.21.15.71:0/1265111375 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f00d0005b30 con 0x7f00e0111d80 2023-10-31T23:19:31.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00ceffd640 1 -- 172.21.15.71:0/1265111375 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00d0005dd0 con 0x7f00e0111d80 2023-10-31T23:19:31.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e01acc30 con 0x7f00e0111d80 2023-10-31T23:19:31.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e01a6640 con 0x7f00e0111d80 2023-10-31T23:19:31.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00ceffd640 1 -- 172.21.15.71:0/1265111375 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f00d00073b0 con 0x7f00e0111d80 2023-10-31T23:19:31.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.630+0000 7f00ceffd640 1 -- 172.21.15.71:0/1265111375 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 747+0+0 (crc 0 0 0) 0x7f00d000f580 con 0x7f00e0111d80 2023-10-31T23:19:31.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.631+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e01ace20 con 0x7f00e0111d80 2023-10-31T23:19:31.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.633+0000 7f00ceffd640 1 -- 172.21.15.71:0/1265111375 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f00d000c7b0 con 0x7f00e0111d80 2023-10-31T23:19:31.643 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.635+0000 7f5e4241df00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-31T23:19:31.683 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.682+0000 7f5e4241df00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-31T23:19:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.705+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e66b79b-b60a-4687-90c3-7fcfd90f6727", "id": 0} v 0) v1 -- 0x7f00e01a7100 con 0x7f00e0111d80 2023-10-31T23:19:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.706+0000 7f00ceffd640 1 -- 172.21.15.71:0/1265111375 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e66b79b-b60a-4687-90c3-7fcfd90f6727", "id": 0}]=0 v4) v1 ==== 112+0+2 (crc 0 0 0) 0x7f00d000ca20 con 0x7f00e0111d80 2023-10-31T23:19:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:0 2023-10-31T23:19:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.707+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0111d80 msgr2=0x7f00e01ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.707+0000 7f00e4915640 1 --2- 172.21.15.71:0/1265111375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0111d80 0x7f00e01ac2d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.707+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 shutdown_connections 2023-10-31T23:19:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.707+0000 7f00e4915640 1 --2- 172.21.15.71:0/1265111375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0111d80 0x7f00e01ac2d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.707+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 >> 172.21.15.71:0/1265111375 conn(0x7f00e006d7b0 msgr2=0x7f00e011afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.707+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 shutdown_connections 2023-10-31T23:19:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.707+0000 7f00e4915640 1 -- 172.21.15.71:0/1265111375 wait complete. 2023-10-31T23:19:31.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 108a6e61-3342-4ba5-bdf8-b9aeacb1103c 1 2023-10-31T23:19:31.738 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.736+0000 7f5e4241df00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-31T23:19:31.787 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:31.786+0000 7f5e4241df00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-31T23:19:31.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.834+0000 7ffb4619e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:31.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.840+0000 7ffb4619e640 1 Processor -- start 2023-10-31T23:19:31.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.840+0000 7ffb4619e640 1 -- start start 2023-10-31T23:19:31.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.840+0000 7ffb4619e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb4011a990 0x7ffb4011cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:31.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.840+0000 7ffb4619e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4011d380 con 0x7ffb40111d80 2023-10-31T23:19:31.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.840+0000 7ffb4619e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4011e520 con 0x7ffb4011a990 2023-10-31T23:19:31.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3effd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb4011a990 0x7ffb4011cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:31.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3f7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ffb40111d80 0x7ffb40112190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.71:40066/0 (socket says 172.21.15.71:40066) 2023-10-31T23:19:31.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3effd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb4011a990 0x7ffb4011cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42492/0 (socket says 172.21.15.71:42492) 2023-10-31T23:19:31.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3f7fe640 1 -- 172.21.15.71:0/3550846200 learned_addr learned my addr 172.21.15.71:0/3550846200 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-31T23:19:31.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3effd640 1 -- 172.21.15.71:0/3550846200 >> v1:172.21.15.8:6789/0 conn(0x7ffb40111d80 legacy=0x7ffb40112190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:31.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3effd640 1 -- 172.21.15.71:0/3550846200 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4011e660 con 0x7ffb4011a990 2023-10-31T23:19:31.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3effd640 1 --2- 172.21.15.71:0/3550846200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb4011a990 0x7ffb4011cdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680438b3ba3df153 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:31.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3e7fc640 1 -- 172.21.15.71:0/3550846200 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb30009ce0 con 0x7ffb4011a990 2023-10-31T23:19:31.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3e7fc640 1 -- 172.21.15.71:0/3550846200 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffb30009e40 con 0x7ffb4011a990 2023-10-31T23:19:31.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.841+0000 7ffb3e7fc640 1 -- 172.21.15.71:0/3550846200 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb3000e360 con 0x7ffb4011a990 2023-10-31T23:19:31.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 1 -- 172.21.15.71:0/3550846200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb4011a990 msgr2=0x7ffb4011cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 1 --2- 172.21.15.71:0/3550846200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb4011a990 0x7ffb4011cdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 1 -- 172.21.15.71:0/3550846200 shutdown_connections 2023-10-31T23:19:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 1 --2- 172.21.15.71:0/3550846200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb4011a990 0x7ffb4011cdb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 1 -- 172.21.15.71:0/3550846200 >> 172.21.15.71:0/3550846200 conn(0x7ffb4006d7b0 msgr2=0x7ffb4010fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 1 -- 172.21.15.71:0/3550846200 shutdown_connections 2023-10-31T23:19:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 1 -- 172.21.15.71:0/3550846200 wait complete. 2023-10-31T23:19:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.842+0000 7ffb4619e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.843+0000 7ffb4619e640 1 Processor -- start 2023-10-31T23:19:31.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.843+0000 7ffb4619e640 1 -- start start 2023-10-31T23:19:31.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.843+0000 7ffb4619e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb40111d80 0x7ffb401ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:31.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.843+0000 7ffb4619e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb401ac8a0 con 0x7ffb40111d80 2023-10-31T23:19:31.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.843+0000 7ffb3f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb40111d80 0x7ffb401ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:31.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.843+0000 7ffb3f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb40111d80 0x7ffb401ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42496/0 (socket says 172.21.15.71:42496) 2023-10-31T23:19:31.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.843+0000 7ffb3f7fe640 1 -- 172.21.15.71:0/1264995226 learned_addr learned my addr 172.21.15.71:0/1264995226 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-31T23:19:31.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb3f7fe640 1 -- 172.21.15.71:0/1264995226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb401ac9e0 con 0x7ffb40111d80 2023-10-31T23:19:31.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb3f7fe640 1 --2- 172.21.15.71:0/1264995226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb40111d80 0x7ffb401ac2d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:31.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb27fff640 1 -- 172.21.15.71:0/1264995226 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb340059d0 con 0x7ffb40111d80 2023-10-31T23:19:31.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb27fff640 1 -- 172.21.15.71:0/1264995226 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffb34005b30 con 0x7ffb40111d80 2023-10-31T23:19:31.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb401acc30 con 0x7ffb40111d80 2023-10-31T23:19:31.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb27fff640 1 -- 172.21.15.71:0/1264995226 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb34005dd0 con 0x7ffb40111d80 2023-10-31T23:19:31.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb401a6640 con 0x7ffb40111d80 2023-10-31T23:19:31.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb27fff640 1 -- 172.21.15.71:0/1264995226 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7ffb340073b0 con 0x7ffb40111d80 2023-10-31T23:19:31.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.844+0000 7ffb27fff640 1 -- 172.21.15.71:0/1264995226 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 862+0+0 (crc 0 0 0) 0x7ffb3400f690 con 0x7ffb40111d80 2023-10-31T23:19:31.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.845+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb40061d90 con 0x7ffb40111d80 2023-10-31T23:19:31.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.847+0000 7ffb27fff640 1 -- 172.21.15.71:0/1264995226 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7ffb3400c770 con 0x7ffb40111d80 2023-10-31T23:19:31.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.917+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd new", "uuid": "108a6e61-3342-4ba5-bdf8-b9aeacb1103c", "id": 1} v 0) v1 -- 0x7ffb401a7100 con 0x7ffb40111d80 2023-10-31T23:19:31.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.919+0000 7ffb27fff640 1 -- 172.21.15.71:0/1264995226 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "108a6e61-3342-4ba5-bdf8-b9aeacb1103c", "id": 1}]=0 v5) v1 ==== 112+0+2 (crc 0 0 0) 0x7ffb3400c910 con 0x7ffb40111d80 2023-10-31T23:19:31.921 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-31T23:19:31.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.920+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb40111d80 msgr2=0x7ffb401ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:31.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.920+0000 7ffb4619e640 1 --2- 172.21.15.71:0/1264995226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb40111d80 0x7ffb401ac2d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.920+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 shutdown_connections 2023-10-31T23:19:31.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.920+0000 7ffb4619e640 1 --2- 172.21.15.71:0/1264995226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb40111d80 0x7ffb401ac2d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:31.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.920+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 >> 172.21.15.71:0/1264995226 conn(0x7ffb4006d7b0 msgr2=0x7ffb4011afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:31.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.920+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 shutdown_connections 2023-10-31T23:19:31.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:31.920+0000 7ffb4619e640 1 -- 172.21.15.71:0/1264995226 wait complete. 2023-10-31T23:19:31.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new aa3540c3-3ece-473b-9e50-b904bf5fd636 2 2023-10-31T23:19:32.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.031+0000 7fc7038ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:32.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.037+0000 7fc7038ad640 1 Processor -- start 2023-10-31T23:19:32.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc7038ad640 1 -- start start 2023-10-31T23:19:32.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc7038ad640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6fc111d80 0x7fc6fc112190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:32.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc7038ad640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc112950 con 0x7fc6fc116750 2023-10-31T23:19:32.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc7038ad640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc117290 con 0x7fc6fc111d80 2023-10-31T23:19:32.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc701649640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6fc111d80 0x7fc6fc112190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:32.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc701649640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6fc111d80 0x7fc6fc112190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42498/0 (socket says 172.21.15.71:42498) 2023-10-31T23:19:32.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc700e48640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc6fc116750 0x7fc6fc116b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.71:40070/0 (socket says 172.21.15.71:40070) 2023-10-31T23:19:32.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.038+0000 7fc701649640 1 -- 172.21.15.71:0/54951555 learned_addr learned my addr 172.21.15.71:0/54951555 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-31T23:19:32.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.039+0000 7fc701649640 1 -- 172.21.15.71:0/54951555 >> v1:172.21.15.8:6789/0 conn(0x7fc6fc116750 legacy=0x7fc6fc116b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.039+0000 7fc701649640 1 -- 172.21.15.71:0/54951555 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc117400 con 0x7fc6fc111d80 2023-10-31T23:19:32.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.039+0000 7fc701649640 1 --2- 172.21.15.71:0/54951555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc112190 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b226b2d2ccb46dec server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:32.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.039+0000 7fc6f3fff640 1 -- 172.21.15.71:0/54951555 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc6ec009dd0 con 0x7fc6fc111d80 2023-10-31T23:19:32.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.039+0000 7fc6f3fff640 1 -- 172.21.15.71:0/54951555 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc6ec00e230 con 0x7fc6fc111d80 2023-10-31T23:19:32.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.039+0000 7fc6f3fff640 1 -- 172.21.15.71:0/54951555 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc6ec00e4d0 con 0x7fc6fc111d80 2023-10-31T23:19:32.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 1 -- 172.21.15.71:0/54951555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 msgr2=0x7fc6fc112190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 1 --2- 172.21.15.71:0/54951555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc112190 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 1 -- 172.21.15.71:0/54951555 shutdown_connections 2023-10-31T23:19:32.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 1 --2- 172.21.15.71:0/54951555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc112190 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 1 -- 172.21.15.71:0/54951555 >> 172.21.15.71:0/54951555 conn(0x7fc6fc06d7b0 msgr2=0x7fc6fc10fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:32.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 1 -- 172.21.15.71:0/54951555 shutdown_connections 2023-10-31T23:19:32.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 1 -- 172.21.15.71:0/54951555 wait complete. 2023-10-31T23:19:32.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.040+0000 7fc7038ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:32.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.041+0000 7fc7038ad640 1 Processor -- start 2023-10-31T23:19:32.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.041+0000 7fc7038ad640 1 -- start start 2023-10-31T23:19:32.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.041+0000 7fc7038ad640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc1ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:32.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.041+0000 7fc7038ad640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc1ac9e0 con 0x7fc6fc111d80 2023-10-31T23:19:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.041+0000 7fc701649640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc1ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.041+0000 7fc701649640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc1ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42508/0 (socket says 172.21.15.71:42508) 2023-10-31T23:19:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.041+0000 7fc701649640 1 -- 172.21.15.71:0/3528028899 learned_addr learned my addr 172.21.15.71:0/3528028899 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-31T23:19:32.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc701649640 1 -- 172.21.15.71:0/3528028899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc1acb20 con 0x7fc6fc111d80 2023-10-31T23:19:32.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc701649640 1 --2- 172.21.15.71:0/3528028899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc1ac410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc6f1ffb640 1 -- 172.21.15.71:0/3528028899 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc6ec014540 con 0x7fc6fc111d80 2023-10-31T23:19:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc6f1ffb640 1 -- 172.21.15.71:0/3528028899 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc6ec0146a0 con 0x7fc6fc111d80 2023-10-31T23:19:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc1acd10 con 0x7fc6fc111d80 2023-10-31T23:19:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc6f1ffb640 1 -- 172.21.15.71:0/3528028899 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc6ec014940 con 0x7fc6fc111d80 2023-10-31T23:19:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc6f1ffb640 1 -- 172.21.15.71:0/3528028899 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fc6ec013400 con 0x7fc6fc111d80 2023-10-31T23:19:32.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc1a6700 con 0x7fc6fc111d80 2023-10-31T23:19:32.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.042+0000 7fc6f1ffb640 1 -- 172.21.15.71:0/3528028899 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 977+0+0 (crc 0 0 0) 0x7fc6ec019040 con 0x7fc6fc111d80 2023-10-31T23:19:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.043+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6fc1acf00 con 0x7fc6fc111d80 2023-10-31T23:19:32.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.046+0000 7fc6f1ffb640 1 -- 172.21.15.71:0/3528028899 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7fc6ec0136b0 con 0x7fc6fc111d80 2023-10-31T23:19:32.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.117+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aa3540c3-3ece-473b-9e50-b904bf5fd636", "id": 2} v 0) v1 -- 0x7fc6fc116750 con 0x7fc6fc111d80 2023-10-31T23:19:32.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.118+0000 7fc6f1ffb640 1 -- 172.21.15.71:0/3528028899 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa3540c3-3ece-473b-9e50-b904bf5fd636", "id": 2}]=0 v6) v1 ==== 112+0+2 (crc 0 0 0) 0x7fc6ec013850 con 0x7fc6fc111d80 2023-10-31T23:19:32.121 INFO:teuthology.orchestra.run.smithi071.stdout:2 2023-10-31T23:19:32.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.119+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 msgr2=0x7fc6fc1ac410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.119+0000 7fc7038ad640 1 --2- 172.21.15.71:0/3528028899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc1ac410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.119+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 shutdown_connections 2023-10-31T23:19:32.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.119+0000 7fc7038ad640 1 --2- 172.21.15.71:0/3528028899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6fc111d80 0x7fc6fc1ac410 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.119+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 >> 172.21.15.71:0/3528028899 conn(0x7fc6fc06d7b0 msgr2=0x7fc6fc110350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:32.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.120+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 shutdown_connections 2023-10-31T23:19:32.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.120+0000 7fc7038ad640 1 -- 172.21.15.71:0/3528028899 wait complete. 2023-10-31T23:19:32.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 4adce6a3-1bc4-4909-8962-1a913e895a6c 3 2023-10-31T23:19:32.184 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.182+0000 7f5e4241df00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-31T23:19:32.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.230+0000 7f13c5a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:32.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.236+0000 7f13c5a2d640 1 Processor -- start 2023-10-31T23:19:32.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.236+0000 7f13c5a2d640 1 -- start start 2023-10-31T23:19:32.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.236+0000 7f13c5a2d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13c010fb90 0x7f13c010ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.236+0000 7f13c5a2d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c0110760 con 0x7f13c0114570 2023-10-31T23:19:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.236+0000 7f13c5a2d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c01150b0 con 0x7f13c010fb90 2023-10-31T23:19:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13beffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13c010fb90 0x7f13c010ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:32.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13be7fc640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f13c0114570 0x7f13c0114980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.71:40084/0 (socket says 172.21.15.71:40084) 2023-10-31T23:19:32.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13be7fc640 1 -- 172.21.15.71:0/1972650038 learned_addr learned my addr 172.21.15.71:0/1972650038 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-31T23:19:32.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13beffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13c010fb90 0x7f13c010ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42518/0 (socket says 172.21.15.71:42518) 2023-10-31T23:19:32.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13beffd640 1 -- 172.21.15.71:0/1972650038 >> v1:172.21.15.8:6789/0 conn(0x7f13c0114570 legacy=0x7f13c0114980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13beffd640 1 -- 172.21.15.71:0/1972650038 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0115220 con 0x7f13c010fb90 2023-10-31T23:19:32.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13beffd640 1 --2- 172.21.15.71:0/1972650038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c010ffa0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa5833fc602c205 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:32.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13bdffb640 1 -- 172.21.15.71:0/1972650038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f13b4009ce0 con 0x7f13c010fb90 2023-10-31T23:19:32.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13bdffb640 1 -- 172.21.15.71:0/1972650038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f13b4009e40 con 0x7f13c010fb90 2023-10-31T23:19:32.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.237+0000 7f13bdffb640 1 -- 172.21.15.71:0/1972650038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f13b400e360 con 0x7f13c010fb90 2023-10-31T23:19:32.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 1 -- 172.21.15.71:0/1972650038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 msgr2=0x7f13c010ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 1 --2- 172.21.15.71:0/1972650038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c010ffa0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 1 -- 172.21.15.71:0/1972650038 shutdown_connections 2023-10-31T23:19:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 1 --2- 172.21.15.71:0/1972650038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c010ffa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 1 -- 172.21.15.71:0/1972650038 >> 172.21.15.71:0/1972650038 conn(0x7f13c00700c0 msgr2=0x7f13c010dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 1 -- 172.21.15.71:0/1972650038 shutdown_connections 2023-10-31T23:19:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 1 -- 172.21.15.71:0/1972650038 wait complete. 2023-10-31T23:19:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.238+0000 7f13c5a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.239+0000 7f13c5a2d640 1 Processor -- start 2023-10-31T23:19:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.239+0000 7f13c5a2d640 1 -- start start 2023-10-31T23:19:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.239+0000 7f13c5a2d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.239+0000 7f13c5a2d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c006dbe0 con 0x7f13c010fb90 2023-10-31T23:19:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13beffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13beffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c006bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.71:42520/0 (socket says 172.21.15.71:42520) 2023-10-31T23:19:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13beffd640 1 -- 172.21.15.71:0/15896981 learned_addr learned my addr 172.21.15.71:0/15896981 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-31T23:19:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13beffd640 1 -- 172.21.15.71:0/15896981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c006c170 con 0x7f13c010fb90 2023-10-31T23:19:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13beffd640 1 --2- 172.21.15.71:0/15896981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c006bc30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13a7fff640 1 -- 172.21.15.71:0/15896981 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f13b4014540 con 0x7f13c010fb90 2023-10-31T23:19:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13a7fff640 1 -- 172.21.15.71:0/15896981 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f13b40146a0 con 0x7f13c010fb90 2023-10-31T23:19:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c006c360 con 0x7f13c010fb90 2023-10-31T23:19:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13a7fff640 1 -- 172.21.15.71:0/15896981 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f13b4014940 con 0x7f13c010fb90 2023-10-31T23:19:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c006c7b0 con 0x7f13c010fb90 2023-10-31T23:19:32.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.240+0000 7f13a7fff640 1 -- 172.21.15.71:0/15896981 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f13b4013400 con 0x7f13c010fb90 2023-10-31T23:19:32.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.241+0000 7f13a7fff640 1 -- 172.21.15.71:0/15896981 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1092+0+0 (crc 0 0 0) 0x7f13b4013b60 con 0x7f13c010fb90 2023-10-31T23:19:32.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.241+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c0061d90 con 0x7f13c010fb90 2023-10-31T23:19:32.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.244+0000 7f13a7fff640 1 -- 172.21.15.71:0/15896981 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f13b4013e20 con 0x7f13c010fb90 2023-10-31T23:19:32.315 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.313+0000 7f5e4241df00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-31T23:19:32.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.313+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4adce6a3-1bc4-4909-8962-1a913e895a6c", "id": 3} v 0) v1 -- 0x7f13c0118ee0 con 0x7f13c010fb90 2023-10-31T23:19:32.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.315+0000 7f13a7fff640 1 -- 172.21.15.71:0/15896981 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4adce6a3-1bc4-4909-8962-1a913e895a6c", "id": 3}]=0 v7) v1 ==== 112+0+2 (crc 0 0 0) 0x7f13b40136b0 con 0x7f13c010fb90 2023-10-31T23:19:32.317 INFO:teuthology.orchestra.run.smithi071.stdout:3 2023-10-31T23:19:32.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.315+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 msgr2=0x7f13c006bc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.315+0000 7f13c5a2d640 1 --2- 172.21.15.71:0/15896981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c006bc30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.316+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 shutdown_connections 2023-10-31T23:19:32.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.316+0000 7f13c5a2d640 1 --2- 172.21.15.71:0/15896981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c010fb90 0x7f13c006bc30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.316+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 >> 172.21.15.71:0/15896981 conn(0x7f13c00700c0 msgr2=0x7f13c0113800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:32.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.316+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 shutdown_connections 2023-10-31T23:19:32.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-31T23:19:32.316+0000 7f13c5a2d640 1 -- 172.21.15.71:0/15896981 wait complete. 2023-10-31T23:19:32.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2023-10-31T23:19:32.371 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-31T23:19:32.372 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2023-10-31T23:19:32.414 INFO:tasks.ceph.osd.0:Started 2023-10-31T23:19:32.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2023-10-31T23:19:32.424 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.423+0000 7f5e4241df00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-31T23:19:32.453 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-31T23:19:32.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2023-10-31T23:19:32.469 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.468+0000 7f5e4241df00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-31T23:19:32.495 INFO:tasks.ceph.osd.1:Started 2023-10-31T23:19:32.496 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2023-10-31T23:19:32.527 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-31T23:19:32.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2023-10-31T23:19:32.570 INFO:tasks.ceph.osd.2:Started 2023-10-31T23:19:32.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2023-10-31T23:19:32.571 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.568+0000 7f5e4241df00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-31T23:19:32.601 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-31T23:19:32.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2023-10-31T23:19:32.644 INFO:tasks.ceph.osd.3:Started 2023-10-31T23:19:32.644 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-31T23:19:32.674 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.672+0000 7f5e4241df00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-31T23:19:32.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.768+0000 7fef43617640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:32.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.773+0000 7fef43617640 1 Processor -- start 2023-10-31T23:19:32.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.773+0000 7fef43617640 1 -- start start 2023-10-31T23:19:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef43617640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fef3c06cb00 0x7fef3c12fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef43617640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c06c280 con 0x7fef3c130320 2023-10-31T23:19:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef43617640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c06c6c0 con 0x7fef3c06cb00 2023-10-31T23:19:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef413b3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fef3c06cb00 0x7fef3c12fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:32.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef40bb2640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fef3c130320 0x7fef3c132cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41640/0 (socket says 172.21.15.8:41640) 2023-10-31T23:19:32.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef40bb2640 1 -- 172.21.15.8:0/2766821966 learned_addr learned my addr 172.21.15.8:0/2766821966 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:32.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef413b3640 1 -- 172.21.15.8:0/2766821966 >> v1:172.21.15.8:6789/0 conn(0x7fef3c130320 legacy=0x7fef3c132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.774+0000 7fef413b3640 1 -- 172.21.15.8:0/2766821966 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c06d8b0 con 0x7fef3c06cb00 2023-10-31T23:19:32.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.775+0000 7fef413b3640 1 --2- 172.21.15.8:0/2766821966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c12fde0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ec1f4a4c468d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:32.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.775+0000 7fef33fff640 1 -- 172.21.15.8:0/2766821966 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fef38009ce0 con 0x7fef3c06cb00 2023-10-31T23:19:32.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.775+0000 7fef33fff640 1 -- 172.21.15.8:0/2766821966 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fef38009e40 con 0x7fef3c06cb00 2023-10-31T23:19:32.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.775+0000 7fef33fff640 1 -- 172.21.15.8:0/2766821966 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fef3800e360 con 0x7fef3c06cb00 2023-10-31T23:19:32.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 1 -- 172.21.15.8:0/2766821966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 msgr2=0x7fef3c12fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 1 --2- 172.21.15.8:0/2766821966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c12fde0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 1 -- 172.21.15.8:0/2766821966 shutdown_connections 2023-10-31T23:19:32.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 1 --2- 172.21.15.8:0/2766821966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c12fde0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 1 -- 172.21.15.8:0/2766821966 >> 172.21.15.8:0/2766821966 conn(0x7fef3c0a3060 msgr2=0x7fef3c0a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:32.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 1 -- 172.21.15.8:0/2766821966 shutdown_connections 2023-10-31T23:19:32.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 1 -- 172.21.15.8:0/2766821966 wait complete. 2023-10-31T23:19:32.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.776+0000 7fef43617640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:32.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.778+0000 7fef43617640 1 Processor -- start 2023-10-31T23:19:32.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.778+0000 7fef43617640 1 -- start start 2023-10-31T23:19:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.779+0000 7fef43617640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c11c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.779+0000 7fef43617640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c11f5d0 con 0x7fef3c06cb00 2023-10-31T23:19:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.779+0000 7fef413b3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c11c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.779+0000 7fef413b3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c11c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34862/0 (socket says 172.21.15.8:34862) 2023-10-31T23:19:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.779+0000 7fef413b3640 1 -- 172.21.15.8:0/3740155100 learned_addr learned my addr 172.21.15.8:0/3740155100 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.780+0000 7fef413b3640 1 -- 172.21.15.8:0/3740155100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c11f850 con 0x7fef3c06cb00 2023-10-31T23:19:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.780+0000 7fef413b3640 1 --2- 172.21.15.8:0/3740155100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c11c460 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.780+0000 7fef31ffb640 1 -- 172.21.15.8:0/3740155100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fef38014620 con 0x7fef3c06cb00 2023-10-31T23:19:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.780+0000 7fef31ffb640 1 -- 172.21.15.8:0/3740155100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fef38014780 con 0x7fef3c06cb00 2023-10-31T23:19:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.780+0000 7fef31ffb640 1 -- 172.21.15.8:0/3740155100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fef38014a20 con 0x7fef3c06cb00 2023-10-31T23:19:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.780+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c120420 con 0x7fef3c06cb00 2023-10-31T23:19:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.780+0000 7fef31ffb640 1 -- 172.21.15.8:0/3740155100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fef38011380 con 0x7fef3c06cb00 2023-10-31T23:19:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.781+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c11ee50 con 0x7fef3c06cb00 2023-10-31T23:19:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.781+0000 7fef31ffb640 1 -- 172.21.15.8:0/3740155100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7fef38019040 con 0x7fef3c06cb00 2023-10-31T23:19:32.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.782+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c061d90 con 0x7fef3c06cb00 2023-10-31T23:19:32.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.784+0000 7fef31ffb640 1 -- 172.21.15.8:0/3740155100 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7fef380118b0 con 0x7fef3c06cb00 2023-10-31T23:19:32.837 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.835+0000 7f5e4241df00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-31T23:19:32.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.847+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef3c06c8e0 con 0x7fef3c06cb00 2023-10-31T23:19:32.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.847+0000 7fef31ffb640 1 -- 172.21.15.8:0/3740155100 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7fef38011b00 con 0x7fef3c06cb00 2023-10-31T23:19:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:32.849 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"fsid":"6066336e-3d1f-4c2f-a6c3-128fa49e8f52","created":"2023-10-31T23:19:30.199405+0000","modified":"2023-10-31T23:19:32.315417+0000","last_up_change":"0.000000","last_in_change":"2023-10-31T23:19:32.315417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"7e66b79b-b60a-4687-90c3-7fcfd90f6727","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"108a6e61-3342-4ba5-bdf8-b9aeacb1103c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"aa3540c3-3ece-473b-9e50-b904bf5fd636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4adce6a3-1bc4-4909-8962-1a913e895a6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-31T23:19:32.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.848+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 msgr2=0x7fef3c11c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:32.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.848+0000 7fef43617640 1 --2- 172.21.15.8:0/3740155100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c11c460 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.848+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 shutdown_connections 2023-10-31T23:19:32.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.848+0000 7fef43617640 1 --2- 172.21.15.8:0/3740155100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c06cb00 0x7fef3c11c460 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:32.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.848+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 >> 172.21.15.8:0/3740155100 conn(0x7fef3c0a3060 msgr2=0x7fef3c0a1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:32.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.849+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 shutdown_connections 2023-10-31T23:19:32.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:32.849+0000 7fef43617640 1 -- 172.21.15.8:0/3740155100 wait complete. 2023-10-31T23:19:32.862 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-31T23:19:32.862 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-31T23:19:32.887 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:32.885+0000 7f5e4241df00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-31T23:19:33.046 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:33.045+0000 7f5e4241df00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-31T23:19:33.264 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-31T23:19:33.365 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.360+0000 7f232799e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:33.366 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.364+0000 7f232799e640 1 Processor -- start 2023-10-31T23:19:33.366 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.364+0000 7f232799e640 1 -- start start 2023-10-31T23:19:33.367 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f232799e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f23201360d0 0x7f23201384f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:33.367 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f232799e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232006cef0 con 0x7f232012fcf0 2023-10-31T23:19:33.368 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f232799e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232009e5b0 con 0x7f23201360d0 2023-10-31T23:19:33.368 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f2324f39640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f23201360d0 0x7f23201384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:33.368 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f232573a640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f232012fcf0 0x7f2320130100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41652/0 (socket says 172.21.15.8:41652) 2023-10-31T23:19:33.368 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f232573a640 1 -- 172.21.15.8:0/3851966825 learned_addr learned my addr 172.21.15.8:0/3851966825 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:33.368 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f2324f39640 1 -- 172.21.15.8:0/3851966825 >> v1:172.21.15.8:6789/0 conn(0x7f232012fcf0 legacy=0x7f2320130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:33.369 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f2317fff640 1 -- 172.21.15.8:0/3851966825 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527661823 0 0) 0x7f232006cef0 con 0x7f232012fcf0 2023-10-31T23:19:33.369 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.365+0000 7f2324f39640 1 -- 172.21.15.8:0/3851966825 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232012f8e0 con 0x7f23201360d0 2023-10-31T23:19:33.369 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.366+0000 7f2324f39640 1 --2- 172.21.15.8:0/3851966825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23201360d0 0x7f23201384f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c2f3483adadce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:33.369 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.366+0000 7f2317fff640 1 -- 172.21.15.8:0/3851966825 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f231c009ce0 con 0x7f23201360d0 2023-10-31T23:19:33.369 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.366+0000 7f2317fff640 1 -- 172.21.15.8:0/3851966825 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f231c009e40 con 0x7f23201360d0 2023-10-31T23:19:33.370 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.366+0000 7f2317fff640 1 -- 172.21.15.8:0/3851966825 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f231c00e360 con 0x7f23201360d0 2023-10-31T23:19:33.372 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 1 -- 172.21.15.8:0/3851966825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23201360d0 msgr2=0x7f23201384f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:33.372 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 1 --2- 172.21.15.8:0/3851966825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23201360d0 0x7f23201384f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:33.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 1 -- 172.21.15.8:0/3851966825 shutdown_connections 2023-10-31T23:19:33.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 1 --2- 172.21.15.8:0/3851966825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23201360d0 0x7f23201384f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:33.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 1 -- 172.21.15.8:0/3851966825 >> 172.21.15.8:0/3851966825 conn(0x7f23200a2290 msgr2=0x7f232009f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:33.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 1 -- 172.21.15.8:0/3851966825 shutdown_connections 2023-10-31T23:19:33.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 1 -- 172.21.15.8:0/3851966825 wait complete. 2023-10-31T23:19:33.374 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.367+0000 7f232799e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:33.374 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.368+0000 7f232799e640 1 Processor -- start 2023-10-31T23:19:33.374 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.368+0000 7f232799e640 1 -- start start 2023-10-31T23:19:33.374 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232799e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f232012fcf0 0x7f23201c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:33.375 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232799e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320071640 con 0x7f232012fcf0 2023-10-31T23:19:33.375 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232573a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f232012fcf0 0x7f23201c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:33.375 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232573a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f232012fcf0 0x7f23201c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34878/0 (socket says 172.21.15.8:34878) 2023-10-31T23:19:33.375 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232573a640 1 -- 172.21.15.8:0/1239196058 learned_addr learned my addr 172.21.15.8:0/1239196058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:33.375 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232573a640 1 -- 172.21.15.8:0/1239196058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23201c7630 con 0x7f232012fcf0 2023-10-31T23:19:33.376 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232573a640 1 --2- 172.21.15.8:0/1239196058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f232012fcf0 0x7f23201c7af0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:33.376 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f2315ffb640 1 -- 172.21.15.8:0/1239196058 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2310004af0 con 0x7f232012fcf0 2023-10-31T23:19:33.376 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f2315ffb640 1 -- 172.21.15.8:0/1239196058 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2310004c50 con 0x7f232012fcf0 2023-10-31T23:19:33.376 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232011ebb0 con 0x7f232012fcf0 2023-10-31T23:19:33.376 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.369+0000 7f2315ffb640 1 -- 172.21.15.8:0/1239196058 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2310007120 con 0x7f232012fcf0 2023-10-31T23:19:33.377 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.370+0000 7f2315ffb640 1 -- 172.21.15.8:0/1239196058 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f231000c570 con 0x7f232012fcf0 2023-10-31T23:19:33.377 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.370+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232011c650 con 0x7f232012fcf0 2023-10-31T23:19:33.377 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.370+0000 7f2315ffb640 1 -- 172.21.15.8:0/1239196058 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7f231000caa0 con 0x7f232012fcf0 2023-10-31T23:19:33.377 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.371+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232006cce0 con 0x7f232012fcf0 2023-10-31T23:19:33.378 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.373+0000 7f2315ffb640 1 -- 172.21.15.8:0/1239196058 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (crc 0 0 0) 0x7f232006cce0 con 0x7f232012fcf0 2023-10-31T23:19:33.436 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.434+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2320061d90 con 0x7f232012fcf0 2023-10-31T23:19:33.436 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.435+0000 7f2315ffb640 1 -- 172.21.15.8:0/1239196058 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7f231000cc60 con 0x7f232012fcf0 2023-10-31T23:19:33.437 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-31T23:19:33.437 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":7,"fsid":"6066336e-3d1f-4c2f-a6c3-128fa49e8f52","created":"2023-10-31T23:19:30.199405+0000","modified":"2023-10-31T23:19:32.315417+0000","last_up_change":"0.000000","last_in_change":"2023-10-31T23:19:32.315417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"7e66b79b-b60a-4687-90c3-7fcfd90f6727","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"108a6e61-3342-4ba5-bdf8-b9aeacb1103c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"aa3540c3-3ece-473b-9e50-b904bf5fd636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4adce6a3-1bc4-4909-8962-1a913e895a6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-31T23:19:33.438 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.436+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f232012fcf0 msgr2=0x7f23201c7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:33.438 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.436+0000 7f232799e640 1 --2- 172.21.15.8:0/1239196058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f232012fcf0 0x7f23201c7af0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:33.438 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.436+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 shutdown_connections 2023-10-31T23:19:33.438 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.436+0000 7f232799e640 1 --2- 172.21.15.8:0/1239196058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f232012fcf0 0x7f23201c7af0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:33.439 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.436+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 >> 172.21.15.8:0/1239196058 conn(0x7f23200a2290 msgr2=0x7f23200a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:33.439 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.436+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 shutdown_connections 2023-10-31T23:19:33.439 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:33.436+0000 7f232799e640 1 -- 172.21.15.8:0/1239196058 wait complete. 2023-10-31T23:19:33.446 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-31T23:19:33.900 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:33.899+0000 7f5e4241df00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-31T23:19:34.182 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:34.181+0000 7f5e4241df00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-31T23:19:34.245 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:34.243+0000 7f5e4241df00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-31T23:19:34.355 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:34.353+0000 7f5e4241df00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-31T23:19:35.377 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:19:35.375+0000 7f5de265a640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-31T23:19:39.850 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-31T23:19:39.950 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.945+0000 7fac23755640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:39.951 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.949+0000 7fac23755640 1 Processor -- start 2023-10-31T23:19:39.951 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.949+0000 7fac23755640 1 -- start start 2023-10-31T23:19:39.952 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.950+0000 7fac23755640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac1c12fcf0 0x7fac1c130100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:39.952 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.950+0000 7fac23755640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c06cef0 con 0x7fac1c09ce10 2023-10-31T23:19:39.953 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.950+0000 7fac23755640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c09e5b0 con 0x7fac1c12fcf0 2023-10-31T23:19:39.953 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.950+0000 7fac214f1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac1c12fcf0 0x7fac1c130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:39.953 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.950+0000 7fac214f1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac1c12fcf0 0x7fac1c130100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34892/0 (socket says 172.21.15.8:34892) 2023-10-31T23:19:39.953 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.950+0000 7fac214f1640 1 -- 172.21.15.8:0/2695143 learned_addr learned my addr 172.21.15.8:0/2695143 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:39.953 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.951+0000 7fac214f1640 1 -- 172.21.15.8:0/2695143 >> v1:172.21.15.8:6789/0 conn(0x7fac1c09ce10 legacy=0x7fac1c09d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:39.954 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.951+0000 7fac214f1640 1 -- 172.21.15.8:0/2695143 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c12f8e0 con 0x7fac1c12fcf0 2023-10-31T23:19:39.954 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:39.951+0000 7fac214f1640 1 --2- 172.21.15.8:0/2695143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c12fcf0 0x7fac1c130100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5ae97c75c49214 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:40.096 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.094+0000 7fac1bfff640 1 -- 172.21.15.8:0/2695143 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fac1400e040 con 0x7fac1c12fcf0 2023-10-31T23:19:40.096 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.094+0000 7fac1bfff640 1 -- 172.21.15.8:0/2695143 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fac140091e0 con 0x7fac1c12fcf0 2023-10-31T23:19:40.096 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.094+0000 7fac1bfff640 1 -- 172.21.15.8:0/2695143 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fac14007730 con 0x7fac1c12fcf0 2023-10-31T23:19:40.098 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 1 -- 172.21.15.8:0/2695143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c12fcf0 msgr2=0x7fac1c130100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:40.098 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 1 --2- 172.21.15.8:0/2695143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c12fcf0 0x7fac1c130100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.098 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 1 -- 172.21.15.8:0/2695143 shutdown_connections 2023-10-31T23:19:40.098 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 1 --2- 172.21.15.8:0/2695143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c12fcf0 0x7fac1c130100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.098 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 1 -- 172.21.15.8:0/2695143 >> 172.21.15.8:0/2695143 conn(0x7fac1c0a2290 msgr2=0x7fac1c09f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:40.099 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 1 -- 172.21.15.8:0/2695143 shutdown_connections 2023-10-31T23:19:40.099 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 1 -- 172.21.15.8:0/2695143 wait complete. 2023-10-31T23:19:40.099 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.095+0000 7fac23755640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:40.099 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.096+0000 7fac23755640 1 Processor -- start 2023-10-31T23:19:40.099 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.096+0000 7fac23755640 1 -- start start 2023-10-31T23:19:40.101 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.097+0000 7fac23755640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c09ce10 0x7fac1c11c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:40.102 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.097+0000 7fac23755640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c11ec10 con 0x7fac1c09ce10 2023-10-31T23:19:40.102 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.097+0000 7fac214f1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c09ce10 0x7fac1c11c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:40.102 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.097+0000 7fac214f1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c09ce10 0x7fac1c11c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34906/0 (socket says 172.21.15.8:34906) 2023-10-31T23:19:40.102 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.097+0000 7fac214f1640 1 -- 172.21.15.8:0/1324675469 learned_addr learned my addr 172.21.15.8:0/1324675469 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:40.102 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.098+0000 7fac214f1640 1 -- 172.21.15.8:0/1324675469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c11d230 con 0x7fac1c09ce10 2023-10-31T23:19:40.103 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.098+0000 7fac214f1640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c09ce10 0x7fac1c11c190 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:40.103 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.098+0000 7fac19ffb640 1 -- 172.21.15.8:0/1324675469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fac1400e040 con 0x7fac1c09ce10 2023-10-31T23:19:40.103 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.098+0000 7fac19ffb640 1 -- 172.21.15.8:0/1324675469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fac14010800 con 0x7fac1c09ce10 2023-10-31T23:19:40.103 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.098+0000 7fac19ffb640 1 -- 172.21.15.8:0/1324675469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fac14010aa0 con 0x7fac1c09ce10 2023-10-31T23:19:40.103 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.098+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c12f3f0 con 0x7fac1c09ce10 2023-10-31T23:19:40.104 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.098+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c11f6d0 con 0x7fac1c09ce10 2023-10-31T23:19:40.104 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.099+0000 7fac19ffb640 1 -- 172.21.15.8:0/1324675469 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 44799+0+0 (crc 0 0 0) 0x7fac14010c00 con 0x7fac1c09ce10 2023-10-31T23:19:40.104 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.099+0000 7fac19ffb640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fac080377b0 0x7fac08039cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:40.104 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.099+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c11fb80 con 0x7fac1c09ce10 2023-10-31T23:19:40.105 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.099+0000 7fac19ffb640 1 -- 172.21.15.8:0/1324675469 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7fac140126e0 con 0x7fac1c09ce10 2023-10-31T23:19:40.105 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.099+0000 7fac20cf0640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fac080377b0 0x7fac08039cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:40.105 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.100+0000 7fac20cf0640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fac080377b0 0x7fac08039cc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:40.105 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.104+0000 7fac19ffb640 1 -- 172.21.15.8:0/1324675469 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fac1400e5b0 con 0x7fac1c09ce10 2023-10-31T23:19:40.285 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.283+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac1c06cce0 con 0x7fac1c09ce10 2023-10-31T23:19:40.285 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.284+0000 7fac19ffb640 1 -- 172.21.15.8:0/1324675469 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6865 (crc 0 0 0) 0x7fac1c06cce0 con 0x7fac1c09ce10 2023-10-31T23:19:40.286 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-31T23:19:40.286 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":11,"fsid":"6066336e-3d1f-4c2f-a6c3-128fa49e8f52","created":"2023-10-31T23:19:30.199405+0000","modified":"2023-10-31T23:19:39.483884+0000","last_up_change":"2023-10-31T23:19:36.414692+0000","last_in_change":"2023-10-31T23:19:32.315417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-31T23:19:38.428998+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e66b79b-b60a-4687-90c3-7fcfd90f6727","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":194198577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6801","nonce":194198577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":194198577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6805","nonce":194198577}]},"public_addr":"172.21.15.8:6800/194198577","cluster_addr":"172.21.15.8:6801/194198577","heartbeat_back_addr":"172.21.15.8:6804/194198577","heartbeat_front_addr":"172.21.15.8:6805/194198577","state":["exists","up"]},{"osd":1,"uuid":"108a6e61-3342-4ba5-bdf8-b9aeacb1103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":139229780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":139229780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":139229780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":139229780}]},"public_addr":"172.21.15.8:6803/139229780","cluster_addr":"172.21.15.8:6802/139229780","heartbeat_back_addr":"172.21.15.8:6806/139229780","heartbeat_front_addr":"172.21.15.8:6807/139229780","state":["exists","up"]},{"osd":2,"uuid":"aa3540c3-3ece-473b-9e50-b904bf5fd636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":3419493040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3419493040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3419493040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":3419493040}]},"public_addr":"172.21.15.71:6803/3419493040","cluster_addr":"172.21.15.71:6802/3419493040","heartbeat_back_addr":"172.21.15.71:6806/3419493040","heartbeat_front_addr":"172.21.15.71:6807/3419493040","state":["exists","up"]},{"osd":3,"uuid":"4adce6a3-1bc4-4909-8962-1a913e895a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":2504423219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2504423219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2504423219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":2504423219}]},"public_addr":"172.21.15.71:6805/2504423219","cluster_addr":"172.21.15.71:6804/2504423219","heartbeat_back_addr":"172.21.15.71:6808/2504423219","heartbeat_front_addr":"172.21.15.71:6809/2504423219","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-31T23:19:40.288 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fac080377b0 msgr2=0x7fac08039cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:40.288 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fac080377b0 0x7fac08039cc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.288 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c09ce10 msgr2=0x7fac1c11c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:40.288 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c09ce10 0x7fac1c11c190 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.289 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 shutdown_connections 2023-10-31T23:19:40.289 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fac080377b0 0x7fac08039cc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.289 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 --2- 172.21.15.8:0/1324675469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac1c09ce10 0x7fac1c11c190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.289 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 >> 172.21.15.8:0/1324675469 conn(0x7fac1c0a2290 msgr2=0x7fac1c1ba1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:40.289 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 shutdown_connections 2023-10-31T23:19:40.290 INFO:teuthology.misc.health.smithi008.stderr:2023-10-31T23:19:40.286+0000 7fac23755640 1 -- 172.21.15.8:0/1324675469 wait complete. 2023-10-31T23:19:40.296 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-31T23:19:40.297 INFO:tasks.ceph:Creating RBD pool 2023-10-31T23:19:40.297 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-31T23:19:40.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.400+0000 7f75696d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:40.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.407+0000 7f75696d5640 1 Processor -- start 2023-10-31T23:19:40.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.407+0000 7f75696d5640 1 -- start start 2023-10-31T23:19:40.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f75696d5640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f756406d080 0x7f75641332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:40.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f75696d5640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756406c250 con 0x7f7564133830 2023-10-31T23:19:40.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f75696d5640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756406cdf0 con 0x7f756406d080 2023-10-31T23:19:40.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f7562ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f756406d080 0x7f75641332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:40.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f75627fc640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7564133830 0x7f756412f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41674/0 (socket says 172.21.15.8:41674) 2023-10-31T23:19:40.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f75627fc640 1 -- 172.21.15.8:0/4174905671 learned_addr learned my addr 172.21.15.8:0/4174905671 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:40.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f7562ffd640 1 -- 172.21.15.8:0/4174905671 >> v1:172.21.15.8:6789/0 conn(0x7f7564133830 legacy=0x7f756412f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:40.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.408+0000 7f7562ffd640 1 -- 172.21.15.8:0/4174905671 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564133c40 con 0x7f756406d080 2023-10-31T23:19:40.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f7562ffd640 1 --2- 172.21.15.8:0/4174905671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641332f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0eeca25568e210 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:40.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f7561ffb640 1 -- 172.21.15.8:0/4174905671 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f755400e040 con 0x7f756406d080 2023-10-31T23:19:40.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f7561ffb640 1 -- 172.21.15.8:0/4174905671 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7554007670 con 0x7f756406d080 2023-10-31T23:19:40.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f7561ffb640 1 -- 172.21.15.8:0/4174905671 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7554007910 con 0x7f756406d080 2023-10-31T23:19:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f75696d5640 1 -- 172.21.15.8:0/4174905671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 msgr2=0x7f75641332f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f75696d5640 1 --2- 172.21.15.8:0/4174905671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641332f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f75696d5640 1 -- 172.21.15.8:0/4174905671 shutdown_connections 2023-10-31T23:19:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f75696d5640 1 --2- 172.21.15.8:0/4174905671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641332f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f75696d5640 1 -- 172.21.15.8:0/4174905671 >> 172.21.15.8:0/4174905671 conn(0x7f75640a2d60 msgr2=0x7f75640a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f75696d5640 1 -- 172.21.15.8:0/4174905671 shutdown_connections 2023-10-31T23:19:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.409+0000 7f75696d5640 1 -- 172.21.15.8:0/4174905671 wait complete. 2023-10-31T23:19:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.410+0000 7f75696d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:40.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.411+0000 7f75696d5640 1 Processor -- start 2023-10-31T23:19:40.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.411+0000 7f75696d5640 1 -- start start 2023-10-31T23:19:40.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.411+0000 7f75696d5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:40.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.411+0000 7f75696d5640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75641209b0 con 0x7f756406d080 2023-10-31T23:19:40.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f7562ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:40.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f7562ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34926/0 (socket says 172.21.15.8:34926) 2023-10-31T23:19:40.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f7562ffd640 1 -- 172.21.15.8:0/2868493887 learned_addr learned my addr 172.21.15.8:0/2868493887 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:40.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f7562ffd640 1 -- 172.21.15.8:0/2868493887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756411e140 con 0x7f756406d080 2023-10-31T23:19:40.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f7562ffd640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641c7e30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:40.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f755400e040 con 0x7f756406d080 2023-10-31T23:19:40.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7554012ab0 con 0x7f756406d080 2023-10-31T23:19:40.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7554012d50 con 0x7f756406d080 2023-10-31T23:19:40.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756411d8c0 con 0x7f756406d080 2023-10-31T23:19:40.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.412+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756412d0f0 con 0x7f756406d080 2023-10-31T23:19:40.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.413+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 44799+0+0 (crc 0 0 0) 0x7f75540153f0 con 0x7f756406d080 2023-10-31T23:19:40.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.413+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75641207b0 con 0x7f756406d080 2023-10-31T23:19:40.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.413+0000 7f755b7fe640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f75440377b0 0x7f7544039cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:40.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.413+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f75540484f0 con 0x7f756406d080 2023-10-31T23:19:40.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.413+0000 7f75627fc640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f75440377b0 0x7f7544039cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:40.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.414+0000 7f75627fc640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f75440377b0 0x7f7544039cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:40.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.418+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f755400fba0 con 0x7f756406d080 2023-10-31T23:19:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:40.600+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7564061d90 con 0x7f756406d080 2023-10-31T23:19:41.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.189+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f75540143e0 con 0x7f756406d080 2023-10-31T23:19:41.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.494+0000 7f755b7fe640 1 -- 172.21.15.8:0/2868493887 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (crc 0 0 0) 0x7f7554015c10 con 0x7f756406d080 2023-10-31T23:19:41.496 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'rbd' created 2023-10-31T23:19:41.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f75440377b0 msgr2=0x7f7544039cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:41.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f75440377b0 0x7f7544039cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:41.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 msgr2=0x7f75641c7e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:41.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641c7e30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:41.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 shutdown_connections 2023-10-31T23:19:41.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f75440377b0 0x7f7544039cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:41.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 --2- 172.21.15.8:0/2868493887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f756406d080 0x7f75641c7e30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:41.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 >> 172.21.15.8:0/2868493887 conn(0x7f75640a2d60 msgr2=0x7f756409f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:41.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 shutdown_connections 2023-10-31T23:19:41.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.497+0000 7f75696d5640 1 -- 172.21.15.8:0/2868493887 wait complete. 2023-10-31T23:19:41.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-31T23:19:41.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.624+0000 7f79de51e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:41.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.633+0000 7f79de51e640 1 Processor -- start 2023-10-31T23:19:41.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.633+0000 7f79de51e640 1 -- start start 2023-10-31T23:19:41.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79de51e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79d80973b0 0x7f79d80977c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:41.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79de51e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d8067420 con 0x7f79d8131060 2023-10-31T23:19:41.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79de51e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d806f650 con 0x7f79d80973b0 2023-10-31T23:19:41.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79d7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79d80973b0 0x7f79d80977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:41.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79d77fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f79d8131060 0x7f79d8131470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39100/0 (socket says 172.21.15.8:39100) 2023-10-31T23:19:41.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79d77fe640 1 -- 172.21.15.8:0/885060666 learned_addr learned my addr 172.21.15.8:0/885060666 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:41.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79d7fff640 1 -- 172.21.15.8:0/885060666 >> v1:172.21.15.8:6789/0 conn(0x7f79d8131060 legacy=0x7f79d8131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:41.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79d7fff640 1 -- 172.21.15.8:0/885060666 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d809b060 con 0x7f79d80973b0 2023-10-31T23:19:41.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.634+0000 7f79d7fff640 1 --2- 172.21.15.8:0/885060666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d80977c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9e839d632f16d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:41.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79d6ffd640 1 -- 172.21.15.8:0/885060666 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f79c8009ce0 con 0x7f79d80973b0 2023-10-31T23:19:41.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79d6ffd640 1 -- 172.21.15.8:0/885060666 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f79c8009e40 con 0x7f79d80973b0 2023-10-31T23:19:41.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79d6ffd640 1 -- 172.21.15.8:0/885060666 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f79c800e360 con 0x7f79d80973b0 2023-10-31T23:19:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 1 -- 172.21.15.8:0/885060666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 msgr2=0x7f79d80977c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 1 --2- 172.21.15.8:0/885060666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d80977c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 1 -- 172.21.15.8:0/885060666 shutdown_connections 2023-10-31T23:19:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 1 --2- 172.21.15.8:0/885060666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d80977c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 1 -- 172.21.15.8:0/885060666 >> 172.21.15.8:0/885060666 conn(0x7f79d80a0e10 msgr2=0x7f79d80a1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 1 -- 172.21.15.8:0/885060666 shutdown_connections 2023-10-31T23:19:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 1 -- 172.21.15.8:0/885060666 wait complete. 2023-10-31T23:19:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.635+0000 7f79de51e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.636+0000 7f79de51e640 1 Processor -- start 2023-10-31T23:19:41.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.637+0000 7f79de51e640 1 -- start start 2023-10-31T23:19:41.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.637+0000 7f79de51e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d8127a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:41.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.637+0000 7f79de51e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d81295a0 con 0x7f79d80973b0 2023-10-31T23:19:41.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.637+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d8127a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:41.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.637+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d8127a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52530/0 (socket says 172.21.15.8:52530) 2023-10-31T23:19:41.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.637+0000 7f79d7fff640 1 -- 172.21.15.8:0/1873059939 learned_addr learned my addr 172.21.15.8:0/1873059939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.638+0000 7f79d7fff640 1 -- 172.21.15.8:0/1873059939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d812ea00 con 0x7f79d80973b0 2023-10-31T23:19:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.638+0000 7f79d7fff640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d8127a00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.638+0000 7f79d4ff9640 1 -- 172.21.15.8:0/1873059939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f79c8014620 con 0x7f79d80973b0 2023-10-31T23:19:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.638+0000 7f79d4ff9640 1 -- 172.21.15.8:0/1873059939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f79c8014780 con 0x7f79d80973b0 2023-10-31T23:19:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.638+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d812a2a0 con 0x7f79d80973b0 2023-10-31T23:19:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.638+0000 7f79d4ff9640 1 -- 172.21.15.8:0/1873059939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f79c8014a20 con 0x7f79d80973b0 2023-10-31T23:19:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.638+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d812b020 con 0x7f79d80973b0 2023-10-31T23:19:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.639+0000 7f79d4ff9640 1 -- 172.21.15.8:0/1873059939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f79c8014b80 con 0x7f79d80973b0 2023-10-31T23:19:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.639+0000 7f79d4ff9640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f79b8037840 0x7f79b8039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.639+0000 7f79d4ff9640 1 -- 172.21.15.8:0/1873059939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2661+0+0 (crc 0 0 0) 0x7f79c8019040 con 0x7f79d80973b0 2023-10-31T23:19:41.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.639+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d8061d90 con 0x7f79d80973b0 2023-10-31T23:19:41.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.639+0000 7f79d77fe640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f79b8037840 0x7f79b8039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:41.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.640+0000 7f79d77fe640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f79b8037840 0x7f79b8039d50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:41.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.644+0000 7f79d4ff9640 1 -- 172.21.15.8:0/1873059939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f79c8010310 con 0x7f79d80973b0 2023-10-31T23:19:41.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:41.822+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79d8099fa0 con 0x7f79d80973b0 2023-10-31T23:19:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.495+0000 7f79d4ff9640 1 -- 172.21.15.8:0/1873059939 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (crc 0 0 0) 0x7f79c800d850 con 0x7f79d80973b0 2023-10-31T23:19:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-31T23:19:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f79b8037840 msgr2=0x7f79b8039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f79b8037840 0x7f79b8039d50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 msgr2=0x7f79d8127a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d8127a00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 shutdown_connections 2023-10-31T23:19:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f79b8037840 0x7f79b8039d50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 --2- 172.21.15.8:0/1873059939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d80973b0 0x7f79d8127a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 >> 172.21.15.8:0/1873059939 conn(0x7f79d80a0e10 msgr2=0x7f79d809d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.498+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 shutdown_connections 2023-10-31T23:19:42.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.499+0000 7f79de51e640 1 -- 172.21.15.8:0/1873059939 wait complete. 2023-10-31T23:19:42.516 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-31T23:19:42.516 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-31T23:19:42.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-31T23:19:42.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-31T23:19:42.517 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-31T23:19:42.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.637+0000 7fb9afb5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:42.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.641+0000 7fb9afb5e640 1 Processor -- start 2023-10-31T23:19:42.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.641+0000 7fb9afb5e640 1 -- start start 2023-10-31T23:19:42.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9afb5e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb9a8131670 0x7fb9a8135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:42.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9afb5e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a8130b50 con 0x7fb9a806d420 2023-10-31T23:19:42.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9afb5e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a806eb90 con 0x7fb9a8131670 2023-10-31T23:19:42.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ad0f9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb9a8131670 0x7fb9a8135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:42.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ad8fa640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb9a806d420 0x7fb9a8130f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39104/0 (socket says 172.21.15.8:39104) 2023-10-31T23:19:42.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ad8fa640 1 -- 172.21.15.8:0/209348864 learned_addr learned my addr 172.21.15.8:0/209348864 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:42.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ad0f9640 1 -- 172.21.15.8:0/209348864 >> v1:172.21.15.8:6789/0 conn(0x7fb9a806d420 legacy=0x7fb9a8130f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:42.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ad0f9640 1 -- 172.21.15.8:0/209348864 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a806d930 con 0x7fb9a8131670 2023-10-31T23:19:42.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ad0f9640 1 --2- 172.21.15.8:0/209348864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a8131670 0x7fb9a8135eb0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d16624e3cd7d22 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:42.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ac8f8640 1 -- 172.21.15.8:0/209348864 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb998009ce0 con 0x7fb9a8131670 2023-10-31T23:19:42.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ac8f8640 1 -- 172.21.15.8:0/209348864 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb998009e40 con 0x7fb9a8131670 2023-10-31T23:19:42.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.642+0000 7fb9ac8f8640 1 -- 172.21.15.8:0/209348864 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb99800e360 con 0x7fb9a8131670 2023-10-31T23:19:42.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 1 -- 172.21.15.8:0/209348864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a8131670 msgr2=0x7fb9a8135eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:42.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 1 --2- 172.21.15.8:0/209348864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a8131670 0x7fb9a8135eb0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 1 -- 172.21.15.8:0/209348864 shutdown_connections 2023-10-31T23:19:42.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 1 --2- 172.21.15.8:0/209348864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a8131670 0x7fb9a8135eb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 1 -- 172.21.15.8:0/209348864 >> 172.21.15.8:0/209348864 conn(0x7fb9a809fad0 msgr2=0x7fb9a809fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:42.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 1 -- 172.21.15.8:0/209348864 shutdown_connections 2023-10-31T23:19:42.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 1 -- 172.21.15.8:0/209348864 wait complete. 2023-10-31T23:19:42.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.643+0000 7fb9afb5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:42.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.644+0000 7fb9afb5e640 1 Processor -- start 2023-10-31T23:19:42.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.644+0000 7fb9afb5e640 1 -- start start 2023-10-31T23:19:42.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.645+0000 7fb9afb5e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a806d420 0x7fb9a812c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:42.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.645+0000 7fb9afb5e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a8119280 con 0x7fb9a806d420 2023-10-31T23:19:42.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.645+0000 7fb9ad8fa640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a806d420 0x7fb9a812c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:42.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.645+0000 7fb9ad8fa640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a806d420 0x7fb9a812c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52554/0 (socket says 172.21.15.8:52554) 2023-10-31T23:19:42.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.645+0000 7fb9ad8fa640 1 -- 172.21.15.8:0/119953245 learned_addr learned my addr 172.21.15.8:0/119953245 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:42.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.645+0000 7fb9ad8fa640 1 -- 172.21.15.8:0/119953245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a812dc90 con 0x7fb9a806d420 2023-10-31T23:19:42.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.645+0000 7fb9ad8fa640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a806d420 0x7fb9a812c030 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:42.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.646+0000 7fb99e7fc640 1 -- 172.21.15.8:0/119953245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb9a40059d0 con 0x7fb9a806d420 2023-10-31T23:19:42.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.646+0000 7fb99e7fc640 1 -- 172.21.15.8:0/119953245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb9a4005b30 con 0x7fb9a806d420 2023-10-31T23:19:42.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.646+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a8118ee0 con 0x7fb9a806d420 2023-10-31T23:19:42.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.646+0000 7fb99e7fc640 1 -- 172.21.15.8:0/119953245 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb9a4005dd0 con 0x7fb9a806d420 2023-10-31T23:19:42.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.646+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a81186c0 con 0x7fb9a806d420 2023-10-31T23:19:42.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.646+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a8061d90 con 0x7fb9a806d420 2023-10-31T23:19:42.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.647+0000 7fb99e7fc640 1 -- 172.21.15.8:0/119953245 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fb9a40070b0 con 0x7fb9a806d420 2023-10-31T23:19:42.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.647+0000 7fb99e7fc640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fb98c037840 0x7fb98c039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:42.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.647+0000 7fb99e7fc640 1 -- 172.21.15.8:0/119953245 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fb9a4046c10 con 0x7fb9a806d420 2023-10-31T23:19:42.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.647+0000 7fb9ad0f9640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fb98c037840 0x7fb98c039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:42.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.648+0000 7fb9ad0f9640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fb98c037840 0x7fb98c039d50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:42.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.651+0000 7fb99e7fc640 1 -- 172.21.15.8:0/119953245 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fb9a400d330 con 0x7fb9a806d420 2023-10-31T23:19:42.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.871+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb9a804e1b0 con 0x7fb9a806d420 2023-10-31T23:19:42.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.873+0000 7fb99e7fc640 1 -- 172.21.15.8:0/119953245 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86175 (crc 0 0 0) 0x7fb9a400d150 con 0x7fb9a806d420 2023-10-31T23:19:42.876 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fb98c037840 msgr2=0x7fb98c039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fb98c037840 0x7fb98c039d50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a806d420 msgr2=0x7fb9a812c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:42.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a806d420 0x7fb9a812c030 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 shutdown_connections 2023-10-31T23:19:42.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fb98c037840 0x7fb98c039d50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 --2- 172.21.15.8:0/119953245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a806d420 0x7fb9a812c030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:42.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 >> 172.21.15.8:0/119953245 conn(0x7fb9a809fad0 msgr2=0x7fb9a812a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:42.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 shutdown_connections 2023-10-31T23:19:42.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.875+0000 7fb9afb5e640 1 -- 172.21.15.8:0/119953245 wait complete. 2023-10-31T23:19:42.887 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":4260589995},{"type":"v1","addr":"172.21.15.71:6801","nonce":4260589995}]},"active_addr":"172.21.15.71:6801/4260589995","active_change":"2023-10-31T23:19:34.368024+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1895134223}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3459753584}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1039937709}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":2280249884}]}]} 2023-10-31T23:19:42.889 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-31T23:19:42.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-31T23:19:42.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-31T23:19:43.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:42.996+0000 7fc19a315640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc19a315640 1 Processor -- start 2023-10-31T23:19:43.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc19a315640 1 -- start start 2023-10-31T23:19:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc19a315640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc19406d800 0x7fc19412c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc19a315640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19412c540 con 0x7fc19412ce40 2023-10-31T23:19:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc19a315640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19406e990 con 0x7fc19406d800 2023-10-31T23:19:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc193fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc19406d800 0x7fc19412c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc1937fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc19412ce40 0x7fc19412fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39108/0 (socket says 172.21.15.8:39108) 2023-10-31T23:19:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.000+0000 7fc1937fe640 1 -- 172.21.15.8:0/1808793394 learned_addr learned my addr 172.21.15.8:0/1808793394 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.001+0000 7fc193fff640 1 -- 172.21.15.8:0/1808793394 >> v1:172.21.15.8:6789/0 conn(0x7fc19412ce40 legacy=0x7fc19412fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.001+0000 7fc193fff640 1 -- 172.21.15.8:0/1808793394 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19406dd40 con 0x7fc19406d800 2023-10-31T23:19:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.001+0000 7fc193fff640 1 --2- 172.21.15.8:0/1808793394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412c900 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48f26ff525878b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.001+0000 7fc192ffd640 1 -- 172.21.15.8:0/1808793394 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc184009ce0 con 0x7fc19406d800 2023-10-31T23:19:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.001+0000 7fc192ffd640 1 -- 172.21.15.8:0/1808793394 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc184009e40 con 0x7fc19406d800 2023-10-31T23:19:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.001+0000 7fc192ffd640 1 -- 172.21.15.8:0/1808793394 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc18400e360 con 0x7fc19406d800 2023-10-31T23:19:43.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 1 -- 172.21.15.8:0/1808793394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 msgr2=0x7fc19412c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 1 --2- 172.21.15.8:0/1808793394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412c900 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 1 -- 172.21.15.8:0/1808793394 shutdown_connections 2023-10-31T23:19:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 1 --2- 172.21.15.8:0/1808793394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412c900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 1 -- 172.21.15.8:0/1808793394 >> 172.21.15.8:0/1808793394 conn(0x7fc19409f840 msgr2=0x7fc19409fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 1 -- 172.21.15.8:0/1808793394 shutdown_connections 2023-10-31T23:19:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 1 -- 172.21.15.8:0/1808793394 wait complete. 2023-10-31T23:19:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.002+0000 7fc19a315640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.003+0000 7fc19a315640 1 Processor -- start 2023-10-31T23:19:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.003+0000 7fc19a315640 1 -- start start 2023-10-31T23:19:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc19a315640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc19a315640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1941182c0 con 0x7fc19406d800 2023-10-31T23:19:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc193fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc193fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52574/0 (socket says 172.21.15.8:52574) 2023-10-31T23:19:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc193fff640 1 -- 172.21.15.8:0/3750380567 learned_addr learned my addr 172.21.15.8:0/3750380567 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc193fff640 1 -- 172.21.15.8:0/3750380567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194117ea0 con 0x7fc19406d800 2023-10-31T23:19:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc193fff640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412fce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc190ff9640 1 -- 172.21.15.8:0/3750380567 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc184014620 con 0x7fc19406d800 2023-10-31T23:19:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc190ff9640 1 -- 172.21.15.8:0/3750380567 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc184014780 con 0x7fc19406d800 2023-10-31T23:19:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1941184b0 con 0x7fc19406d800 2023-10-31T23:19:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.004+0000 7fc190ff9640 1 -- 172.21.15.8:0/3750380567 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc184014a20 con 0x7fc19406d800 2023-10-31T23:19:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.005+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc194119510 con 0x7fc19406d800 2023-10-31T23:19:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.005+0000 7fc190ff9640 1 -- 172.21.15.8:0/3750380567 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fc184014b80 con 0x7fc19406d800 2023-10-31T23:19:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.005+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc194117530 con 0x7fc19406d800 2023-10-31T23:19:43.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.005+0000 7fc190ff9640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fc180037840 0x7fc180039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.006+0000 7fc190ff9640 1 -- 172.21.15.8:0/3750380567 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fc184019040 con 0x7fc19406d800 2023-10-31T23:19:43.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.006+0000 7fc1937fe640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fc180037840 0x7fc180039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.006+0000 7fc1937fe640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fc180037840 0x7fc180039d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.010+0000 7fc190ff9640 1 -- 172.21.15.8:0/3750380567 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fc184014e30 con 0x7fc19406d800 2023-10-31T23:19:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.187+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc194061d90 con 0x7fc19406d800 2023-10-31T23:19:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.187+0000 7fc190ff9640 1 -- 172.21.15.8:0/3750380567 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8624 (crc 0 0 0) 0x7fc18400d850 con 0x7fc19406d800 2023-10-31T23:19:43.192 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:43.193 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":14,"fsid":"6066336e-3d1f-4c2f-a6c3-128fa49e8f52","created":"2023-10-31T23:19:30.199405+0000","modified":"2023-10-31T23:19:42.495319+0000","last_up_change":"2023-10-31T23:19:36.414692+0000","last_in_change":"2023-10-31T23:19:32.315417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-31T23:19:38.428998+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-31T23:19:40.630657+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e66b79b-b60a-4687-90c3-7fcfd90f6727","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":194198577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6801","nonce":194198577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":194198577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6805","nonce":194198577}]},"public_addr":"172.21.15.8:6800/194198577","cluster_addr":"172.21.15.8:6801/194198577","heartbeat_back_addr":"172.21.15.8:6804/194198577","heartbeat_front_addr":"172.21.15.8:6805/194198577","state":["exists","up"]},{"osd":1,"uuid":"108a6e61-3342-4ba5-bdf8-b9aeacb1103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":139229780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":139229780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":139229780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":139229780}]},"public_addr":"172.21.15.8:6803/139229780","cluster_addr":"172.21.15.8:6802/139229780","heartbeat_back_addr":"172.21.15.8:6806/139229780","heartbeat_front_addr":"172.21.15.8:6807/139229780","state":["exists","up"]},{"osd":2,"uuid":"aa3540c3-3ece-473b-9e50-b904bf5fd636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":3419493040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3419493040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3419493040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":3419493040}]},"public_addr":"172.21.15.71:6803/3419493040","cluster_addr":"172.21.15.71:6802/3419493040","heartbeat_back_addr":"172.21.15.71:6806/3419493040","heartbeat_front_addr":"172.21.15.71:6807/3419493040","state":["exists","up"]},{"osd":3,"uuid":"4adce6a3-1bc4-4909-8962-1a913e895a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":2504423219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2504423219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2504423219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":2504423219}]},"public_addr":"172.21.15.71:6805/2504423219","cluster_addr":"172.21.15.71:6804/2504423219","heartbeat_back_addr":"172.21.15.71:6808/2504423219","heartbeat_front_addr":"172.21.15.71:6809/2504423219","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-31T23:19:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fc180037840 msgr2=0x7fc180039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fc180037840 0x7fc180039d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 msgr2=0x7fc19412fce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412fce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 shutdown_connections 2023-10-31T23:19:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fc180037840 0x7fc180039d50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 --2- 172.21.15.8:0/3750380567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc19406d800 0x7fc19412fce0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 >> 172.21.15.8:0/3750380567 conn(0x7fc19409f840 msgr2=0x7fc1941b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 shutdown_connections 2023-10-31T23:19:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.189+0000 7fc19a315640 1 -- 172.21.15.8:0/3750380567 wait complete. 2023-10-31T23:19:43.201 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-31T23:19:43.201 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-31T23:19:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.308+0000 7fbbceade640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.312+0000 7fbbceade640 1 Processor -- start 2023-10-31T23:19:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.312+0000 7fbbceade640 1 -- start start 2023-10-31T23:19:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbceade640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbbc812de50 0x7fbbc8135e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbceade640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc809af10 con 0x7fbbc809a990 2023-10-31T23:19:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbceade640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc806fad0 con 0x7fbbc812de50 2023-10-31T23:19:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbbc812de50 0x7fbbc8135e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbcc87a640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbbc809a990 0x7fbbc812d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39116/0 (socket says 172.21.15.8:39116) 2023-10-31T23:19:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbcc87a640 1 -- 172.21.15.8:0/3792610142 learned_addr learned my addr 172.21.15.8:0/3792610142 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc7fff640 1 -- 172.21.15.8:0/3792610142 >> v1:172.21.15.8:6789/0 conn(0x7fbbc809a990 legacy=0x7fbbc812d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc7fff640 1 -- 172.21.15.8:0/3792610142 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc809a2b0 con 0x7fbbc812de50 2023-10-31T23:19:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc77fe640 1 -- 172.21.15.8:0/3792610142 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427383734 0 0) 0x7fbbc809af10 con 0x7fbbc809a990 2023-10-31T23:19:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc7fff640 1 --2- 172.21.15.8:0/3792610142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc812de50 0x7fbbc8135e80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866a8f9f624e3661 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc77fe640 1 -- 172.21.15.8:0/3792610142 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fbbb4009ce0 con 0x7fbbc812de50 2023-10-31T23:19:43.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc77fe640 1 -- 172.21.15.8:0/3792610142 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fbbb4009e40 con 0x7fbbc812de50 2023-10-31T23:19:43.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.313+0000 7fbbc77fe640 1 -- 172.21.15.8:0/3792610142 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fbbb400e360 con 0x7fbbc812de50 2023-10-31T23:19:43.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 1 -- 172.21.15.8:0/3792610142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc812de50 msgr2=0x7fbbc8135e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 1 --2- 172.21.15.8:0/3792610142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc812de50 0x7fbbc8135e80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 1 -- 172.21.15.8:0/3792610142 shutdown_connections 2023-10-31T23:19:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 1 --2- 172.21.15.8:0/3792610142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc812de50 0x7fbbc8135e80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 1 -- 172.21.15.8:0/3792610142 >> 172.21.15.8:0/3792610142 conn(0x7fbbc809f840 msgr2=0x7fbbc809fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 1 -- 172.21.15.8:0/3792610142 shutdown_connections 2023-10-31T23:19:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 1 -- 172.21.15.8:0/3792610142 wait complete. 2023-10-31T23:19:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.314+0000 7fbbceade640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.315+0000 7fbbceade640 1 Processor -- start 2023-10-31T23:19:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.315+0000 7fbbceade640 1 -- start start 2023-10-31T23:19:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.316+0000 7fbbceade640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc809a990 0x7fbbc81c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.316+0000 7fbbceade640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81c52c0 con 0x7fbbc809a990 2023-10-31T23:19:43.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.316+0000 7fbbcc87a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc809a990 0x7fbbc81c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.316+0000 7fbbcc87a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc809a990 0x7fbbc81c5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52592/0 (socket says 172.21.15.8:52592) 2023-10-31T23:19:43.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.316+0000 7fbbcc87a640 1 -- 172.21.15.8:0/2869925306 learned_addr learned my addr 172.21.15.8:0/2869925306 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.317+0000 7fbbcc87a640 1 -- 172.21.15.8:0/2869925306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc811a9c0 con 0x7fbbc809a990 2023-10-31T23:19:43.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.317+0000 7fbbcc87a640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc809a990 0x7fbbc81c5780 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.317+0000 7fbbc57fa640 1 -- 172.21.15.8:0/2869925306 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fbbbc004af0 con 0x7fbbc809a990 2023-10-31T23:19:43.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.317+0000 7fbbc57fa640 1 -- 172.21.15.8:0/2869925306 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fbbbc004c50 con 0x7fbbc809a990 2023-10-31T23:19:43.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.317+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8119b80 con 0x7fbbc809a990 2023-10-31T23:19:43.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.317+0000 7fbbc57fa640 1 -- 172.21.15.8:0/2869925306 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fbbbc007120 con 0x7fbbc809a990 2023-10-31T23:19:43.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.317+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc811a4d0 con 0x7fbbc809a990 2023-10-31T23:19:43.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.318+0000 7fbbc57fa640 1 -- 172.21.15.8:0/2869925306 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fbbbc0072d0 con 0x7fbbc809a990 2023-10-31T23:19:43.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.318+0000 7fbbc57fa640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fbbac037840 0x7fbbac039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.318+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8119d70 con 0x7fbbc809a990 2023-10-31T23:19:43.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.318+0000 7fbbc57fa640 1 -- 172.21.15.8:0/2869925306 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fbbbc046e50 con 0x7fbbc809a990 2023-10-31T23:19:43.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.318+0000 7fbbc7fff640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fbbac037840 0x7fbbac039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.319+0000 7fbbc7fff640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fbbac037840 0x7fbbac039d50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.322+0000 7fbbc57fa640 1 -- 172.21.15.8:0/2869925306 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fbbbc00f230 con 0x7fbbc809a990 2023-10-31T23:19:43.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.501+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbc8061d90 con 0x7fbbc809a990 2023-10-31T23:19:43.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.503+0000 7fbbc57fa640 1 -- 172.21.15.8:0/2869925306 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8615 (crc 0 0 0) 0x7fbbbc00a530 con 0x7fbbc809a990 2023-10-31T23:19:43.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:43.505 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"fsid":"6066336e-3d1f-4c2f-a6c3-128fa49e8f52","created":"2023-10-31T23:19:30.199405+0000","modified":"2023-10-31T23:19:43.500340+0000","last_up_change":"2023-10-31T23:19:36.414692+0000","last_in_change":"2023-10-31T23:19:32.315417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-31T23:19:38.428998+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-31T23:19:40.630657+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e66b79b-b60a-4687-90c3-7fcfd90f6727","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":194198577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6801","nonce":194198577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":194198577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6805","nonce":194198577}]},"public_addr":"172.21.15.8:6800/194198577","cluster_addr":"172.21.15.8:6801/194198577","heartbeat_back_addr":"172.21.15.8:6804/194198577","heartbeat_front_addr":"172.21.15.8:6805/194198577","state":["exists","up"]},{"osd":1,"uuid":"108a6e61-3342-4ba5-bdf8-b9aeacb1103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":139229780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":139229780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":139229780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":139229780}]},"public_addr":"172.21.15.8:6803/139229780","cluster_addr":"172.21.15.8:6802/139229780","heartbeat_back_addr":"172.21.15.8:6806/139229780","heartbeat_front_addr":"172.21.15.8:6807/139229780","state":["exists","up"]},{"osd":2,"uuid":"aa3540c3-3ece-473b-9e50-b904bf5fd636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":3419493040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3419493040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3419493040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":3419493040}]},"public_addr":"172.21.15.71:6803/3419493040","cluster_addr":"172.21.15.71:6802/3419493040","heartbeat_back_addr":"172.21.15.71:6806/3419493040","heartbeat_front_addr":"172.21.15.71:6807/3419493040","state":["exists","up"]},{"osd":3,"uuid":"4adce6a3-1bc4-4909-8962-1a913e895a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":2504423219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2504423219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2504423219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":2504423219}]},"public_addr":"172.21.15.71:6805/2504423219","cluster_addr":"172.21.15.71:6804/2504423219","heartbeat_back_addr":"172.21.15.71:6808/2504423219","heartbeat_front_addr":"172.21.15.71:6809/2504423219","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-31T23:19:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fbbac037840 msgr2=0x7fbbac039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fbbac037840 0x7fbbac039d50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc809a990 msgr2=0x7fbbc81c5780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc809a990 0x7fbbc81c5780 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 shutdown_connections 2023-10-31T23:19:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fbbac037840 0x7fbbac039d50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 --2- 172.21.15.8:0/2869925306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbc809a990 0x7fbbc81c5780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 >> 172.21.15.8:0/2869925306 conn(0x7fbbc809f840 msgr2=0x7fbbc812c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 shutdown_connections 2023-10-31T23:19:43.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.505+0000 7fbbceade640 1 -- 172.21.15.8:0/2869925306 wait complete. 2023-10-31T23:19:43.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-31T23:19:43.519 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-31T23:19:43.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-31T23:19:43.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-31T23:19:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.638+0000 7f823879e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.638+0000 7effdad9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.638+0000 7f13b206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.638+0000 7fa45e19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7f823879e640 1 Processor -- start 2023-10-31T23:19:43.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7f823879e640 1 -- start start 2023-10-31T23:19:43.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7fa45e19e640 1 Processor -- start 2023-10-31T23:19:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7f13b206d640 1 Processor -- start 2023-10-31T23:19:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7effdad9e640 1 Processor -- start 2023-10-31T23:19:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7fa45e19e640 1 -- start start 2023-10-31T23:19:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7f13b206d640 1 -- start start 2023-10-31T23:19:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.643+0000 7effdad9e640 1 -- start start 2023-10-31T23:19:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7fa45e19e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa45806d690 0x7fa45812fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7effdad9e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7effd41324f0 0x7effd4134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7effdad9e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd406e400 con 0x7effd412f5d0 2023-10-31T23:19:43.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7effdad9e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd409a630 con 0x7effd41324f0 2023-10-31T23:19:43.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7fa45e19e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45812f940 con 0x7fa458130240 2023-10-31T23:19:43.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7fa45e19e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806d240 con 0x7fa45806d690 2023-10-31T23:19:43.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7fa4577fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa45806d690 0x7fa45812fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7fa4577fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa45806d690 0x7fa45812fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52596/0 (socket says 172.21.15.8:52596) 2023-10-31T23:19:43.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7effd3fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7effd41324f0 0x7effd4134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7effd3fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7effd41324f0 0x7effd4134910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52598/0 (socket says 172.21.15.8:52598) 2023-10-31T23:19:43.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7effd3fff640 1 -- 172.21.15.8:0/4212550760 learned_addr learned my addr 172.21.15.8:0/4212550760 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13b206d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13ac12f5d0 0x7f13ac12f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f823879e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8230136040 0x7f8230138460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.644+0000 7fa4577fe640 1 -- 172.21.15.8:0/2287835256 learned_addr learned my addr 172.21.15.8:0/2287835256 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13b206d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac06e400 con 0x7f13ac06bee0 2023-10-31T23:19:43.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7fa4577fe640 1 -- 172.21.15.8:0/2287835256 >> v1:172.21.15.8:6789/0 conn(0x7fa458130240 legacy=0x7fa45806bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13b206d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac09a630 con 0x7f13ac12f5d0 2023-10-31T23:19:43.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f823879e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823006c280 con 0x7f823006cb00 2023-10-31T23:19:43.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f823879e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823006c6c0 con 0x7f8230136040 2023-10-31T23:19:43.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7fa4577fe640 1 -- 172.21.15.8:0/2287835256 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45806e820 con 0x7fa45806d690 2023-10-31T23:19:43.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7effd3fff640 1 -- 172.21.15.8:0/4212550760 >> v1:172.21.15.8:6789/0 conn(0x7effd412f5d0 legacy=0x7effd412f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7effd3fff640 1 -- 172.21.15.8:0/4212550760 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd406dcb0 con 0x7effd41324f0 2023-10-31T23:19:43.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13ab7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13ac12f5d0 0x7f13ac12f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f8235d39640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8230136040 0x7f8230138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f8235d39640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8230136040 0x7f8230138460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52610/0 (socket says 172.21.15.8:52610) 2023-10-31T23:19:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f8235d39640 1 -- 172.21.15.8:0/311016825 learned_addr learned my addr 172.21.15.8:0/311016825 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7fa4577fe640 1 --2- 172.21.15.8:0/2287835256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa45812fd00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5538e102bdd500d server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13aaffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f13ac06bee0 0x7f13ac06c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39168/0 (socket says 172.21.15.8:39168) 2023-10-31T23:19:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13aaffd640 1 -- 172.21.15.8:0/307989452 learned_addr learned my addr 172.21.15.8:0/307989452 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7effd3fff640 1 --2- 172.21.15.8:0/4212550760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd41324f0 0x7effd4134910 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee7339f1e4437a server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f8235d39640 1 -- 172.21.15.8:0/311016825 >> v1:172.21.15.8:6789/0 conn(0x7f823006cb00 legacy=0x7f823012fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f8235d39640 1 -- 172.21.15.8:0/311016825 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823006d8b0 con 0x7f8230136040 2023-10-31T23:19:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13ab7fe640 1 -- 172.21.15.8:0/307989452 >> v1:172.21.15.8:6789/0 conn(0x7f13ac06bee0 legacy=0x7f13ac06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.645+0000 7f13ab7fe640 1 -- 172.21.15.8:0/307989452 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac06dcb0 con 0x7f13ac12f5d0 2023-10-31T23:19:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7fa4567fc640 1 -- 172.21.15.8:0/2287835256 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa448009da0 con 0x7fa45806d690 2023-10-31T23:19:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7effd37fe640 1 -- 172.21.15.8:0/4212550760 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7effc0009dd0 con 0x7effd41324f0 2023-10-31T23:19:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f8235d39640 1 --2- 172.21.15.8:0/311016825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8230136040 0x7f8230138460 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed63ce3931648d1d server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7effd37fe640 1 -- 172.21.15.8:0/4212550760 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7effc00103b0 con 0x7effd41324f0 2023-10-31T23:19:43.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7fa4567fc640 1 -- 172.21.15.8:0/2287835256 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa44800e230 con 0x7fa45806d690 2023-10-31T23:19:43.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7fa4567fc640 1 -- 172.21.15.8:0/2287835256 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa44800e4d0 con 0x7fa45806d690 2023-10-31T23:19:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7effd37fe640 1 -- 172.21.15.8:0/4212550760 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7effc0010650 con 0x7effd41324f0 2023-10-31T23:19:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f13ab7fe640 1 --2- 172.21.15.8:0/307989452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac12f5d0 0x7f13ac12f9e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a752aaf7abacdb server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f8235538640 1 -- 172.21.15.8:0/311016825 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8220009dd0 con 0x7f8230136040 2023-10-31T23:19:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f13aa7fc640 1 -- 172.21.15.8:0/307989452 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f139c00d450 con 0x7f13ac12f5d0 2023-10-31T23:19:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f8235538640 1 -- 172.21.15.8:0/311016825 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f822000e230 con 0x7f8230136040 2023-10-31T23:19:43.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f8235538640 1 -- 172.21.15.8:0/311016825 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f822000e4d0 con 0x7f8230136040 2023-10-31T23:19:43.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 1 -- 172.21.15.8:0/4212550760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd41324f0 msgr2=0x7effd4134910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 1 --2- 172.21.15.8:0/4212550760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd41324f0 0x7effd4134910 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 1 -- 172.21.15.8:0/4212550760 shutdown_connections 2023-10-31T23:19:43.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f13aa7fc640 1 -- 172.21.15.8:0/307989452 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f139c00d5b0 con 0x7f13ac12f5d0 2023-10-31T23:19:43.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.646+0000 7f13aa7fc640 1 -- 172.21.15.8:0/307989452 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f139c00d850 con 0x7f13ac12f5d0 2023-10-31T23:19:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 1 --2- 172.21.15.8:0/4212550760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd41324f0 0x7effd4134910 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 1 -- 172.21.15.8:0/4212550760 >> 172.21.15.8:0/4212550760 conn(0x7effd409f840 msgr2=0x7effd409fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 1 -- 172.21.15.8:0/4212550760 shutdown_connections 2023-10-31T23:19:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 1 -- 172.21.15.8:0/4212550760 wait complete. 2023-10-31T23:19:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 1 -- 172.21.15.8:0/2287835256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 msgr2=0x7fa45812fd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 1 --2- 172.21.15.8:0/2287835256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa45812fd00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 1 -- 172.21.15.8:0/2287835256 shutdown_connections 2023-10-31T23:19:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 1 --2- 172.21.15.8:0/2287835256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa45812fd00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7effdad9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 1 -- 172.21.15.8:0/2287835256 >> 172.21.15.8:0/2287835256 conn(0x7fa45809ed20 msgr2=0x7fa45809f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 1 -- 172.21.15.8:0/2287835256 shutdown_connections 2023-10-31T23:19:43.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 1 -- 172.21.15.8:0/2287835256 wait complete. 2023-10-31T23:19:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7f823879e640 1 -- 172.21.15.8:0/311016825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8230136040 msgr2=0x7f8230138460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7f823879e640 1 --2- 172.21.15.8:0/311016825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8230136040 0x7f8230138460 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7f13b206d640 1 -- 172.21.15.8:0/307989452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac12f5d0 msgr2=0x7f13ac12f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7f13b206d640 1 --2- 172.21.15.8:0/307989452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac12f5d0 0x7f13ac12f9e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.647+0000 7fa45e19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f13b206d640 1 -- 172.21.15.8:0/307989452 shutdown_connections 2023-10-31T23:19:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f13b206d640 1 --2- 172.21.15.8:0/307989452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac12f5d0 0x7f13ac12f9e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f13b206d640 1 -- 172.21.15.8:0/307989452 >> 172.21.15.8:0/307989452 conn(0x7f13ac09f840 msgr2=0x7f13ac09fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f823879e640 1 -- 172.21.15.8:0/311016825 shutdown_connections 2023-10-31T23:19:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f823879e640 1 --2- 172.21.15.8:0/311016825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8230136040 0x7f8230138460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f823879e640 1 -- 172.21.15.8:0/311016825 >> 172.21.15.8:0/311016825 conn(0x7f82300a3060 msgr2=0x7f82300a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f823879e640 1 -- 172.21.15.8:0/311016825 shutdown_connections 2023-10-31T23:19:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f823879e640 1 -- 172.21.15.8:0/311016825 wait complete. 2023-10-31T23:19:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f823879e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f13b206d640 1 -- 172.21.15.8:0/307989452 shutdown_connections 2023-10-31T23:19:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f13b206d640 1 -- 172.21.15.8:0/307989452 wait complete. 2023-10-31T23:19:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7effdad9e640 1 Processor -- start 2023-10-31T23:19:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7effdad9e640 1 -- start start 2023-10-31T23:19:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.648+0000 7f13b206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7fa45e19e640 1 Processor -- start 2023-10-31T23:19:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7fa45e19e640 1 -- start start 2023-10-31T23:19:43.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7effdad9e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd412f5d0 0x7effd41c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7effdad9e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd41237b0 con 0x7effd412f5d0 2023-10-31T23:19:43.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7effd8b3a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd412f5d0 0x7effd41c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7effd8b3a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd412f5d0 0x7effd41c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52616/0 (socket says 172.21.15.8:52616) 2023-10-31T23:19:43.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7effd8b3a640 1 -- 172.21.15.8:0/441239652 learned_addr learned my addr 172.21.15.8:0/441239652 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7f823879e640 1 Processor -- start 2023-10-31T23:19:43.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7f823879e640 1 -- start start 2023-10-31T23:19:43.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7fa45e19e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa458071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.649+0000 7effd8b3a640 1 -- 172.21.15.8:0/441239652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd411b560 con 0x7effd412f5d0 2023-10-31T23:19:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa45e19e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa458129ea0 con 0x7fa45806d690 2023-10-31T23:19:43.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa4577fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa458071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa4577fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa458071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52632/0 (socket says 172.21.15.8:52632) 2023-10-31T23:19:43.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa4577fe640 1 -- 172.21.15.8:0/392953232 learned_addr learned my addr 172.21.15.8:0/392953232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7effd8b3a640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd412f5d0 0x7effd41c4a30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa4577fe640 1 -- 172.21.15.8:0/392953232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458070a00 con 0x7fa45806d690 2023-10-31T23:19:43.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7effc800c7e0 con 0x7effd412f5d0 2023-10-31T23:19:43.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa4577fe640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa458071010 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7f13b206d640 1 Processor -- start 2023-10-31T23:19:43.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7effdad9e640 1 -- 172.21.15.8:0/441239652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd4121ec0 con 0x7effd412f5d0 2023-10-31T23:19:43.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7effc800c940 con 0x7effd412f5d0 2023-10-31T23:19:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa448014540 con 0x7fa45806d690 2023-10-31T23:19:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7effc800cbe0 con 0x7effd412f5d0 2023-10-31T23:19:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7effdad9e640 1 -- 172.21.15.8:0/441239652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd412edb0 con 0x7effd412f5d0 2023-10-31T23:19:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7f13b206d640 1 -- start start 2023-10-31T23:19:43.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7f823879e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f823006cb00 0x7f82301cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa4480146a0 con 0x7fa45806d690 2023-10-31T23:19:43.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa448014940 con 0x7fa45806d690 2023-10-31T23:19:43.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.650+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa458118260 con 0x7fa45806d690 2023-10-31T23:19:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.651+0000 7f823879e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823008cd90 con 0x7f823006cb00 2023-10-31T23:19:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.651+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4581193c0 con 0x7fa45806d690 2023-10-31T23:19:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.651+0000 7f823653a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f823006cb00 0x7f82301cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.651+0000 7f823653a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f823006cb00 0x7f82301cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52648/0 (socket says 172.21.15.8:52648) 2023-10-31T23:19:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.651+0000 7f823653a640 1 -- 172.21.15.8:0/1039757163 learned_addr learned my addr 172.21.15.8:0/1039757163 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effdad9e640 1 -- 172.21.15.8:0/441239652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effd411b3f0 con 0x7effd412f5d0 2023-10-31T23:19:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f13b206d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac06bee0 0x7f13ac1c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7effc8011310 con 0x7effd412f5d0 2023-10-31T23:19:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f13b206d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac11da20 con 0x7f13ac06bee0 2023-10-31T23:19:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa438000f10 con 0x7fa45806d690 2023-10-31T23:19:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fa448014aa0 con 0x7fa45806d690 2023-10-31T23:19:43.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effd17fa640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7effb8037890 0x7effb8039da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f13ab7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac06bee0 0x7f13ac1c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7effc80473a0 con 0x7effd412f5d0 2023-10-31T23:19:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f823653a640 1 -- 172.21.15.8:0/1039757163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823008caa0 con 0x7f823006cb00 2023-10-31T23:19:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f13ab7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac06bee0 0x7f13ac1c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52664/0 (socket says 172.21.15.8:52664) 2023-10-31T23:19:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f13ab7fe640 1 -- 172.21.15.8:0/3367584667 learned_addr learned my addr 172.21.15.8:0/3367584667 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa43ffff640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa44403bcf0 0x7fa44403e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effd17fa640 1 --2- 172.21.15.8:0/441239652 >> v2:172.21.15.8:6800/194198577 conn(0x7effb803c830 0x7effb803ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 --> v2:172.21.15.8:6800/194198577 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effb803f350 con 0x7effb803c830 2023-10-31T23:19:43.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fa448019040 con 0x7fa45806d690 2023-10-31T23:19:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7effc80476e0 con 0x7effd412f5d0 2023-10-31T23:19:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f823653a640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f823006cb00 0x7f82301cc270 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa43ffff640 1 --2- 172.21.15.8:0/392953232 >> v2:172.21.15.8:6803/139229780 conn(0x7fa444040d10 0x7fa4440431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 --> v2:172.21.15.8:6803/139229780 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa444043830 con 0x7fa444040d10 2023-10-31T23:19:43.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fa448048820 con 0x7fa45806d690 2023-10-31T23:19:43.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7effd3fff640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7effb8037890 0x7effb8039da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7fa456ffd640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa44403bcf0 0x7fa44403e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.652+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f822c00c7e0 con 0x7f823006cb00 2023-10-31T23:19:43.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f822c00c940 con 0x7f823006cb00 2023-10-31T23:19:43.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f822c00cbe0 con 0x7f823006cb00 2023-10-31T23:19:43.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7f13ab7fe640 1 -- 172.21.15.8:0/3367584667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac067ef0 con 0x7f13ac06bee0 2023-10-31T23:19:43.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823006ebe0 con 0x7f823006cb00 2023-10-31T23:19:43.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8230070690 con 0x7f823006cb00 2023-10-31T23:19:43.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7effd3fff640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7effb8037890 0x7effb8039da0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7fa456ffd640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa44403bcf0 0x7fa44403e200 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7effd933b640 1 --2- 172.21.15.8:0/441239652 >> v2:172.21.15.8:6800/194198577 conn(0x7effb803c830 0x7effb803ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-31T23:19:43.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7f13ab7fe640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac06bee0 0x7f13ac1c3440 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.653+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82301359f0 con 0x7f823006cb00 2023-10-31T23:19:43.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f139c009040 con 0x7f13ac06bee0 2023-10-31T23:19:43.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f139c00be70 con 0x7f13ac06bee0 2023-10-31T23:19:43.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f139c00cb50 con 0x7f13ac06bee0 2023-10-31T23:19:43.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac11fe70 con 0x7f13ac06bee0 2023-10-31T23:19:43.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac1216f0 con 0x7f13ac06bee0 2023-10-31T23:19:43.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f822c011310 con 0x7f823006cb00 2023-10-31T23:19:43.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f8226ffd640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f8214037840 0x7f8214039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f822c047330 con 0x7f823006cb00 2023-10-31T23:19:43.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f8226ffd640 1 --2- 172.21.15.8:0/1039757163 >> v2:172.21.15.71:6805/2504423219 conn(0x7f821403c7e0 0x7f821403ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 --> v2:172.21.15.71:6805/2504423219 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f821403f300 con 0x7f821403c7e0 2023-10-31T23:19:43.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.654+0000 7f8235d39640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f8214037840 0x7f8214039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7f822c00cd90 con 0x7f823006cb00 2023-10-31T23:19:43.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13ac11d820 con 0x7f13ac06bee0 2023-10-31T23:19:43.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f8236d3b640 1 --2- 172.21.15.8:0/1039757163 >> v2:172.21.15.71:6805/2504423219 conn(0x7f821403c7e0 0x7f821403ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-31T23:19:43.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f8235d39640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f8214037840 0x7f8214039d50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f139c00ccb0 con 0x7f13ac06bee0 2023-10-31T23:19:43.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f1393fff640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f1398037890 0x7f1398039da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f139c012040 con 0x7f13ac06bee0 2023-10-31T23:19:43.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f1393fff640 1 --2- 172.21.15.8:0/3367584667 >> v2:172.21.15.71:6803/3419493040 conn(0x7f139803c830 0x7f139803ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 --> v2:172.21.15.71:6803/3419493040 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f139803f350 con 0x7f139803c830 2023-10-31T23:19:43.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7f139c0142e0 con 0x7f13ac06bee0 2023-10-31T23:19:43.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.655+0000 7f13aaffd640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f1398037890 0x7f1398039da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.656+0000 7f13aaffd640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f1398037890 0x7f1398039da0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.656+0000 7effd933b640 1 --2- 172.21.15.8:0/441239652 >> v2:172.21.15.8:6800/194198577 conn(0x7effb803c830 0x7effb803ecc0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.657+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== osd.0 v2:172.21.15.8:6800/194198577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7effb803f350 con 0x7effb803c830 2023-10-31T23:19:43.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.657+0000 7fa457fff640 1 --2- 172.21.15.8:0/392953232 >> v2:172.21.15.8:6803/139229780 conn(0x7fa444040d10 0x7fa4440431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-31T23:19:43.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.658+0000 7f8236d3b640 1 --2- 172.21.15.8:0/1039757163 >> v2:172.21.15.71:6805/2504423219 conn(0x7f821403c7e0 0x7f821403ec70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.659+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== osd.3 v2:172.21.15.71:6805/2504423219 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f821403f300 con 0x7f821403c7e0 2023-10-31T23:19:43.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.659+0000 7f13abfff640 1 --2- 172.21.15.8:0/3367584667 >> v2:172.21.15.71:6803/3419493040 conn(0x7f139803c830 0x7f139803ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-31T23:19:43.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.660+0000 7fa457fff640 1 --2- 172.21.15.8:0/392953232 >> v2:172.21.15.8:6803/139229780 conn(0x7fa444040d10 0x7fa4440431a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.661+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== osd.1 v2:172.21.15.8:6803/139229780 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fa444043830 con 0x7fa444040d10 2023-10-31T23:19:43.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.662+0000 7f13abfff640 1 --2- 172.21.15.8:0/3367584667 >> v2:172.21.15.71:6803/3419493040 conn(0x7f139803c830 0x7f139803ecc0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.662+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 --> v2:172.21.15.71:6805/2504423219 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f823012f750 con 0x7f821403c7e0 2023-10-31T23:19:43.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f8226ffd640 1 -- 172.21.15.8:0/1039757163 <== osd.3 v2:172.21.15.71:6805/2504423219 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f822800a820 con 0x7f821403c7e0 2023-10-31T23:19:43.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 >> v2:172.21.15.71:6805/2504423219 conn(0x7f821403c7e0 msgr2=0x7f821403ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 --2- 172.21.15.8:0/1039757163 >> v2:172.21.15.71:6805/2504423219 conn(0x7f821403c7e0 0x7f821403ec70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f8214037840 msgr2=0x7f8214039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7effdad9e640 1 -- 172.21.15.8:0/441239652 --> v2:172.21.15.8:6800/194198577 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7effd40a05c0 con 0x7effb803c830 2023-10-31T23:19:43.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f8214037840 0x7f8214039d50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f823006cb00 msgr2=0x7f82301cc270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f823006cb00 0x7f82301cc270 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 shutdown_connections 2023-10-31T23:19:43.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 --2- 172.21.15.8:0/1039757163 >> v2:172.21.15.71:6805/2504423219 conn(0x7f821403c7e0 0x7f821403ec70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f8214037840 0x7f8214039d50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 --2- 172.21.15.8:0/1039757163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f823006cb00 0x7f82301cc270 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.663+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 >> 172.21.15.8:0/1039757163 conn(0x7f82300a3060 msgr2=0x7f823012e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.664+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 shutdown_connections 2023-10-31T23:19:43.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.664+0000 7f823879e640 1 -- 172.21.15.8:0/1039757163 wait complete. 2023-10-31T23:19:43.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.664+0000 7effd17fa640 1 -- 172.21.15.8:0/441239652 <== osd.0 v2:172.21.15.8:6800/194198577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7effcc00a820 con 0x7effb803c830 2023-10-31T23:19:43.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.664+0000 7effbeffd640 1 -- 172.21.15.8:0/441239652 >> v2:172.21.15.8:6800/194198577 conn(0x7effb803c830 msgr2=0x7effb803ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.664+0000 7effbeffd640 1 --2- 172.21.15.8:0/441239652 >> v2:172.21.15.8:6800/194198577 conn(0x7effb803c830 0x7effb803ecc0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.664+0000 7effbeffd640 1 -- 172.21.15.8:0/441239652 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7effb8037890 msgr2=0x7effb8039da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7effb8037890 0x7effb8039da0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 -- 172.21.15.8:0/441239652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd412f5d0 msgr2=0x7effd41c4a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd412f5d0 0x7effd41c4a30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== osd.2 v2:172.21.15.71:6803/3419493040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f139803f350 con 0x7f139803c830 2023-10-31T23:19:43.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 -- 172.21.15.8:0/441239652 shutdown_connections 2023-10-31T23:19:43.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 --2- 172.21.15.8:0/441239652 >> v2:172.21.15.8:6800/194198577 conn(0x7effb803c830 0x7effb803ecc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7effb8037890 0x7effb8039da0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 --2- 172.21.15.8:0/441239652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd412f5d0 0x7effd41c4a30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 -- 172.21.15.8:0/441239652 >> 172.21.15.8:0/441239652 conn(0x7effd409f840 msgr2=0x7effd409b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 -- 172.21.15.8:0/441239652 shutdown_connections 2023-10-31T23:19:43.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7effbeffd640 1 -- 172.21.15.8:0/441239652 wait complete. 2023-10-31T23:19:43.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.665+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 --> v2:172.21.15.8:6803/139229780 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa438002b20 con 0x7fa444040d10 2023-10-31T23:19:43.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.667+0000 7fa43ffff640 1 -- 172.21.15.8:0/392953232 <== osd.1 v2:172.21.15.8:6803/139229780 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa438002b20 con 0x7fa444040d10 2023-10-31T23:19:43.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.667+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 >> v2:172.21.15.8:6803/139229780 conn(0x7fa444040d10 msgr2=0x7fa4440431a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.667+0000 7fa45e19e640 1 --2- 172.21.15.8:0/392953232 >> v2:172.21.15.8:6803/139229780 conn(0x7fa444040d10 0x7fa4440431a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.667+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa44403bcf0 msgr2=0x7fa44403e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.667+0000 7fa45e19e640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa44403bcf0 0x7fa44403e200 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 msgr2=0x7fa458071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa458071010 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 shutdown_connections 2023-10-31T23:19:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 --2- 172.21.15.8:0/392953232 >> v2:172.21.15.8:6803/139229780 conn(0x7fa444040d10 0x7fa4440431a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa44403bcf0 0x7fa44403e200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 --2- 172.21.15.8:0/392953232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa45806d690 0x7fa458071010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 >> 172.21.15.8:0/392953232 conn(0x7fa45809ed20 msgr2=0x7fa4581b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 shutdown_connections 2023-10-31T23:19:43.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.668+0000 7fa45e19e640 1 -- 172.21.15.8:0/392953232 wait complete. 2023-10-31T23:19:43.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.669+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 --> v2:172.21.15.71:6803/3419493040 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13ac0a05c0 con 0x7f139803c830 2023-10-31T23:19:43.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f1393fff640 1 -- 172.21.15.8:0/3367584667 <== osd.2 v2:172.21.15.71:6803/3419493040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13a400a820 con 0x7f139803c830 2023-10-31T23:19:43.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 >> v2:172.21.15.71:6803/3419493040 conn(0x7f139803c830 msgr2=0x7f139803ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 --2- 172.21.15.8:0/3367584667 >> v2:172.21.15.71:6803/3419493040 conn(0x7f139803c830 0x7f139803ecc0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f1398037890 msgr2=0x7f1398039da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f1398037890 0x7f1398039da0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac06bee0 msgr2=0x7f13ac1c3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac06bee0 0x7f13ac1c3440 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 shutdown_connections 2023-10-31T23:19:43.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 --2- 172.21.15.8:0/3367584667 >> v2:172.21.15.71:6803/3419493040 conn(0x7f139803c830 0x7f139803ecc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f1398037890 0x7f1398039da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 --2- 172.21.15.8:0/3367584667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac06bee0 0x7f13ac1c3440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 >> 172.21.15.8:0/3367584667 conn(0x7f13ac09f840 msgr2=0x7f13ac117000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 shutdown_connections 2023-10-31T23:19:43.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.670+0000 7f13b206d640 1 -- 172.21.15.8:0/3367584667 wait complete. 2023-10-31T23:19:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:43.736 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-31T23:19:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:43.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-31T23:19:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:43.739 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-31T23:19:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:43.740 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-31T23:19:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.895+0000 7fe77d02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.895+0000 7f5019260640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.895+0000 7f556b39e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.895+0000 7f7c9946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7fe77d02d640 1 Processor -- start 2023-10-31T23:19:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f556b39e640 1 Processor -- start 2023-10-31T23:19:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f5019260640 1 Processor -- start 2023-10-31T23:19:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7fe77d02d640 1 -- start start 2023-10-31T23:19:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f7c9946d640 1 Processor -- start 2023-10-31T23:19:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f5019260640 1 -- start start 2023-10-31T23:19:43.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f7c9946d640 1 -- start start 2023-10-31T23:19:43.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f556b39e640 1 -- start start 2023-10-31T23:19:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7fe77d02d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe778133d60 0x7fe778136180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7fe77d02d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe778130a30 con 0x7fe778130df0 2023-10-31T23:19:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7fe77d02d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe778070840 con 0x7fe778133d60 2023-10-31T23:19:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f5019260640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f501412f5d0 0x7f501412f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.900+0000 7f5019260640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501406e400 con 0x7f501406bee0 2023-10-31T23:19:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5019260640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501409a630 con 0x7f501412f5d0 2023-10-31T23:19:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c9946d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7c9412ca10 0x7f7c9412ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c9946d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9412c630 con 0x7f7c94099a10 2023-10-31T23:19:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f556b39e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f556412de50 0x7f5564135e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f556b39e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556409af10 con 0x7f556409a990 2023-10-31T23:19:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f501259c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f501406bee0 0x7f501406c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39182/0 (socket says 172.21.15.8:39182) 2023-10-31T23:19:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f556b39e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556406fad0 con 0x7f556412de50 2023-10-31T23:19:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f501259c640 1 -- 172.21.15.8:0/3983243438 learned_addr learned my addr 172.21.15.8:0/3983243438 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5012d9d640 1 --2- 172.21.15.8:0/3983243438 >> v2:172.21.15.8:3300/0 conn(0x7f501412f5d0 0x7f501412f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c9946d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9406d1a0 con 0x7f7c9412ca10 2023-10-31T23:19:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7fe776d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe778130df0 0x7fe778131200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39172/0 (socket says 172.21.15.8:39172) 2023-10-31T23:19:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7fe776d9d640 1 -- 172.21.15.8:0/1453216573 learned_addr learned my addr 172.21.15.8:0/1453216573 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7fe77659c640 1 --2- 172.21.15.8:0/1453216573 >> v2:172.21.15.8:3300/0 conn(0x7fe778133d60 0x7fe778136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5568939640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f556412de50 0x7f5564135e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c92ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7c9412ca10 0x7f7c9412ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5568939640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f556412de50 0x7f5564135e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52698/0 (socket says 172.21.15.8:52698) 2023-10-31T23:19:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5568939640 1 -- 172.21.15.8:0/3460952039 learned_addr learned my addr 172.21.15.8:0/3460952039 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c92ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7c9412ca10 0x7f7c9412ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52688/0 (socket says 172.21.15.8:52688) 2023-10-31T23:19:43.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c92ffd640 1 -- 172.21.15.8:0/704066252 learned_addr learned my addr 172.21.15.8:0/704066252 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5011d9b640 1 -- 172.21.15.8:0/3983243438 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184434502 0 0) 0x7f501406e400 con 0x7f501406bee0 2023-10-31T23:19:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5011d9b640 1 -- 172.21.15.8:0/3983243438 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ffc005700 con 0x7f501406bee0 2023-10-31T23:19:43.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5012d9d640 1 -- 172.21.15.8:0/3983243438 >> v1:172.21.15.8:6789/0 conn(0x7f501406bee0 legacy=0x7f501406c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5012d9d640 1 -- 172.21.15.8:0/3983243438 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501406dcb0 con 0x7f501412f5d0 2023-10-31T23:19:43.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5568939640 1 -- 172.21.15.8:0/3460952039 >> v1:172.21.15.8:6789/0 conn(0x7f556409a990 legacy=0x7f556412d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-31T23:19:43.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f5568939640 1 -- 172.21.15.8:0/3460952039 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556409a2b0 con 0x7f556412de50 2023-10-31T23:19:43.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c92ffd640 1 -- 172.21.15.8:0/704066252 >> v1:172.21.15.8:6789/0 conn(0x7f7c94099a10 legacy=0x7f7c94099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.901+0000 7f7c92ffd640 1 -- 172.21.15.8:0/704066252 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9406dbb0 con 0x7f7c9412ca10 2023-10-31T23:19:43.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f5568939640 1 --2- 172.21.15.8:0/3460952039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556412de50 0x7f5564135e80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a972a5ab25ed1f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe775d9b640 1 -- 172.21.15.8:0/1453216573 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643065794 0 0) 0x7fe778130a30 con 0x7fe778130df0 2023-10-31T23:19:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe775d9b640 1 -- 172.21.15.8:0/1453216573 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7600034f0 con 0x7fe778130df0 2023-10-31T23:19:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe77659c640 1 -- 172.21.15.8:0/1453216573 >> v1:172.21.15.8:6789/0 conn(0x7fe778130df0 legacy=0x7fe778131200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe77659c640 1 -- 172.21.15.8:0/1453216573 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe778131910 con 0x7fe778133d60 2023-10-31T23:19:43.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f7c92ffd640 1 --2- 172.21.15.8:0/704066252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c9412ca10 0x7f7c9412ce20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f3cad12143ec76 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f5012d9d640 1 --2- 172.21.15.8:0/3983243438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501412f5d0 0x7f501412f9e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e3f27622f7c76c server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe77659c640 1 --2- 172.21.15.8:0/1453216573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778133d60 0x7fe778136180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14264d066c7cedb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f555bfff640 1 -- 172.21.15.8:0/3460952039 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5554009d40 con 0x7f556412de50 2023-10-31T23:19:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f555bfff640 1 -- 172.21.15.8:0/3460952039 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f555400e230 con 0x7f556412de50 2023-10-31T23:19:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f555bfff640 1 -- 172.21.15.8:0/3460952039 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5554009ea0 con 0x7f556412de50 2023-10-31T23:19:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f7c91ffb640 1 -- 172.21.15.8:0/704066252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c84009dd0 con 0x7f7c9412ca10 2023-10-31T23:19:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f5011d9b640 1 -- 172.21.15.8:0/3983243438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5004009ce0 con 0x7f501412f5d0 2023-10-31T23:19:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f5011d9b640 1 -- 172.21.15.8:0/3983243438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5004009e40 con 0x7f501412f5d0 2023-10-31T23:19:43.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f5011d9b640 1 -- 172.21.15.8:0/3983243438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f500400e360 con 0x7f501412f5d0 2023-10-31T23:19:43.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f7c91ffb640 1 -- 172.21.15.8:0/704066252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7c8400e230 con 0x7f7c9412ca10 2023-10-31T23:19:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe775d9b640 1 -- 172.21.15.8:0/1453216573 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe76c009ce0 con 0x7fe778133d60 2023-10-31T23:19:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7f7c91ffb640 1 -- 172.21.15.8:0/704066252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c8400e4d0 con 0x7f7c9412ca10 2023-10-31T23:19:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe775d9b640 1 -- 172.21.15.8:0/1453216573 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe76c009e40 con 0x7fe778133d60 2023-10-31T23:19:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.902+0000 7fe775d9b640 1 -- 172.21.15.8:0/1453216573 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe76c00e360 con 0x7fe778133d60 2023-10-31T23:19:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f7c9946d640 1 -- 172.21.15.8:0/704066252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c9412ca10 msgr2=0x7f7c9412ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7fe77d02d640 1 -- 172.21.15.8:0/1453216573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778133d60 msgr2=0x7fe778136180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f7c9946d640 1 --2- 172.21.15.8:0/704066252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c9412ca10 0x7f7c9412ce20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7fe77d02d640 1 --2- 172.21.15.8:0/1453216573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778133d60 0x7fe778136180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7fe77d02d640 1 -- 172.21.15.8:0/1453216573 shutdown_connections 2023-10-31T23:19:43.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7fe77d02d640 1 --2- 172.21.15.8:0/1453216573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778133d60 0x7fe778136180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f556b39e640 1 -- 172.21.15.8:0/3460952039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556412de50 msgr2=0x7f5564135e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f556b39e640 1 --2- 172.21.15.8:0/3460952039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556412de50 0x7f5564135e80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f7c9946d640 1 -- 172.21.15.8:0/704066252 shutdown_connections 2023-10-31T23:19:43.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f7c9946d640 1 --2- 172.21.15.8:0/704066252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c9412ca10 0x7f7c9412ce20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f7c9946d640 1 -- 172.21.15.8:0/704066252 >> 172.21.15.8:0/704066252 conn(0x7f7c9409ff80 msgr2=0x7f7c940a0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7fe77d02d640 1 -- 172.21.15.8:0/1453216573 >> 172.21.15.8:0/1453216573 conn(0x7fe77809f950 msgr2=0x7fe77809fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7fe77d02d640 1 -- 172.21.15.8:0/1453216573 shutdown_connections 2023-10-31T23:19:43.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f7c9946d640 1 -- 172.21.15.8:0/704066252 shutdown_connections 2023-10-31T23:19:43.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f7c9946d640 1 -- 172.21.15.8:0/704066252 wait complete. 2023-10-31T23:19:43.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7fe77d02d640 1 -- 172.21.15.8:0/1453216573 wait complete. 2023-10-31T23:19:43.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f5019260640 1 -- 172.21.15.8:0/3983243438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501412f5d0 msgr2=0x7f501412f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:43.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f5019260640 1 --2- 172.21.15.8:0/3983243438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501412f5d0 0x7f501412f9e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f556b39e640 1 -- 172.21.15.8:0/3460952039 shutdown_connections 2023-10-31T23:19:43.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f556b39e640 1 --2- 172.21.15.8:0/3460952039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556412de50 0x7f5564135e80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f556b39e640 1 -- 172.21.15.8:0/3460952039 >> 172.21.15.8:0/3460952039 conn(0x7f556409f840 msgr2=0x7f556409fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f5019260640 1 -- 172.21.15.8:0/3983243438 shutdown_connections 2023-10-31T23:19:43.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f5019260640 1 --2- 172.21.15.8:0/3983243438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501412f5d0 0x7f501412f9e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:43.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.903+0000 7f5019260640 1 -- 172.21.15.8:0/3983243438 >> 172.21.15.8:0/3983243438 conn(0x7f501409f840 msgr2=0x7f501409fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:43.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7f5019260640 1 -- 172.21.15.8:0/3983243438 shutdown_connections 2023-10-31T23:19:43.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7f556b39e640 1 -- 172.21.15.8:0/3460952039 shutdown_connections 2023-10-31T23:19:43.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7f556b39e640 1 -- 172.21.15.8:0/3460952039 wait complete. 2023-10-31T23:19:43.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7fe77d02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7f5019260640 1 -- 172.21.15.8:0/3983243438 wait complete. 2023-10-31T23:19:43.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7f7c9946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7f5019260640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.904+0000 7f556b39e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:43.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.905+0000 7f7c9946d640 1 Processor -- start 2023-10-31T23:19:43.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.905+0000 7fe77d02d640 1 Processor -- start 2023-10-31T23:19:43.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.905+0000 7f7c9946d640 1 -- start start 2023-10-31T23:19:43.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.905+0000 7fe77d02d640 1 -- start start 2023-10-31T23:19:43.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.905+0000 7f556b39e640 1 Processor -- start 2023-10-31T23:19:43.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.905+0000 7f556b39e640 1 -- start start 2023-10-31T23:19:43.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f5019260640 1 Processor -- start 2023-10-31T23:19:43.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f5019260640 1 -- start start 2023-10-31T23:19:43.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7fe77d02d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778130df0 0x7fe77811b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7fe77d02d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77811cec0 con 0x7fe778130df0 2023-10-31T23:19:43.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f7c9946d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94099a10 0x7f7c941c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f7c9946d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941c44b0 con 0x7f7c94099a10 2023-10-31T23:19:43.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7fe776d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778130df0 0x7fe77811b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7fe776d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778130df0 0x7fe77811b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52710/0 (socket says 172.21.15.8:52710) 2023-10-31T23:19:43.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7fe776d9d640 1 -- 172.21.15.8:0/1179330345 learned_addr learned my addr 172.21.15.8:0/1179330345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f7c92ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94099a10 0x7f7c941c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f7c92ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94099a10 0x7f7c941c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52722/0 (socket says 172.21.15.8:52722) 2023-10-31T23:19:43.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f7c92ffd640 1 -- 172.21.15.8:0/3555110915 learned_addr learned my addr 172.21.15.8:0/3555110915 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7f556b39e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556409a990 0x7f55641c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.906+0000 7fe776d9d640 1 -- 172.21.15.8:0/1179330345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77811ae50 con 0x7fe778130df0 2023-10-31T23:19:43.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f556b39e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55641c7740 con 0x7f556409a990 2023-10-31T23:19:43.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f7c92ffd640 1 -- 172.21.15.8:0/3555110915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940718b0 con 0x7f7c94099a10 2023-10-31T23:19:43.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f556913a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556409a990 0x7f55641c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f556913a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556409a990 0x7f55641c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52726/0 (socket says 172.21.15.8:52726) 2023-10-31T23:19:43.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f556913a640 1 -- 172.21.15.8:0/2664677809 learned_addr learned my addr 172.21.15.8:0/2664677809 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f7c92ffd640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94099a10 0x7f7c941c49c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f5019260640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501406bee0 0x7f501411df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7fe776d9d640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778130df0 0x7fe77811b150 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f5019260640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501411f2a0 con 0x7f501406bee0 2023-10-31T23:19:43.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f7c7b7fe640 1 -- 172.21.15.8:0/3555110915 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c84016750 con 0x7f7c94099a10 2023-10-31T23:19:43.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9411ba30 con 0x7f7c94099a10 2023-10-31T23:19:43.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f5012d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501406bee0 0x7f501411df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f5012d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501406bee0 0x7f501411df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52734/0 (socket says 172.21.15.8:52734) 2023-10-31T23:19:43.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f5012d9d640 1 -- 172.21.15.8:0/2328786871 learned_addr learned my addr 172.21.15.8:0/2328786871 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:43.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c941194b0 con 0x7f7c94099a10 2023-10-31T23:19:43.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f7c7b7fe640 1 -- 172.21.15.8:0/3555110915 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7c840168b0 con 0x7f7c94099a10 2023-10-31T23:19:43.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f7c7b7fe640 1 -- 172.21.15.8:0/3555110915 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c84016b50 con 0x7f7c94099a10 2023-10-31T23:19:43.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7fe75f7fe640 1 -- 172.21.15.8:0/1179330345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe7680059d0 con 0x7fe778130df0 2023-10-31T23:19:43.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7fe75f7fe640 1 -- 172.21.15.8:0/1179330345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe768005b30 con 0x7fe778130df0 2023-10-31T23:19:43.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7fe75f7fe640 1 -- 172.21.15.8:0/1179330345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe768005dd0 con 0x7fe778130df0 2023-10-31T23:19:43.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f556913a640 1 -- 172.21.15.8:0/2664677809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55641311b0 con 0x7f556409a990 2023-10-31T23:19:43.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7f556913a640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556409a990 0x7f55641c7b90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77811a810 con 0x7fe778130df0 2023-10-31T23:19:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.907+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77811e8e0 con 0x7fe778130df0 2023-10-31T23:19:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.908+0000 7f5012d9d640 1 -- 172.21.15.8:0/2328786871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501412ed40 con 0x7f501406bee0 2023-10-31T23:19:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.908+0000 7f5559ffb640 1 -- 172.21.15.8:0/2664677809 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f556000b8b0 con 0x7f556409a990 2023-10-31T23:19:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.908+0000 7f5559ffb640 1 -- 172.21.15.8:0/2664677809 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f556000ba10 con 0x7f556409a990 2023-10-31T23:19:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.908+0000 7f5559ffb640 1 -- 172.21.15.8:0/2664677809 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f556000bcb0 con 0x7f556409a990 2023-10-31T23:19:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.908+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556406e2f0 con 0x7f556409a990 2023-10-31T23:19:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.908+0000 7f7c7b7fe640 1 -- 172.21.15.8:0/3555110915 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f7c84016d50 con 0x7f7c94099a10 2023-10-31T23:19:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77811c3f0 con 0x7fe778130df0 2023-10-31T23:19:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7fe75f7fe640 1 -- 172.21.15.8:0/1179330345 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fe7680070b0 con 0x7fe778130df0 2023-10-31T23:19:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.908+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c94119eb0 con 0x7f7c94099a10 2023-10-31T23:19:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7f7c7b7fe640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7c80037840 0x7f7c80039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7f7c7b7fe640 1 -- 172.21.15.8:0/3555110915 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f7c8401b040 con 0x7f7c94099a10 2023-10-31T23:19:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7f5012d9d640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501406bee0 0x7f501411df40 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556411b4a0 con 0x7f556409a990 2023-10-31T23:19:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7fe75f7fe640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fe7640378e0 0x7fe764039df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7fe75f7fe640 1 -- 172.21.15.8:0/1179330345 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fe768046d40 con 0x7fe778130df0 2023-10-31T23:19:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.909+0000 7f7c927fc640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7c80037840 0x7f7c80039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.910+0000 7fe77659c640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fe7640378e0 0x7fe764039df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.910+0000 7f5559ffb640 1 -- 172.21.15.8:0/2664677809 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f5560011380 con 0x7f556409a990 2023-10-31T23:19:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.910+0000 7f5559ffb640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5548037890 0x7f5548039da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.910+0000 7f5568939640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5548037890 0x7f5548039da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.910+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556411cb60 con 0x7f556409a990 2023-10-31T23:19:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.910+0000 7fe77659c640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fe7640378e0 0x7fe764039df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.910+0000 7f7c927fc640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7c80037840 0x7f7c80039d50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.911+0000 7f5568939640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5548037890 0x7f5548039da0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.914+0000 7f7c7b7fe640 1 -- 172.21.15.8:0/3555110915 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f7c84013e40 con 0x7f7c94099a10 2023-10-31T23:19:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.918+0000 7f5559ffb640 1 -- 172.21.15.8:0/2664677809 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f556000db10 con 0x7f556409a990 2023-10-31T23:19:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.918+0000 7f4ffb7fe640 1 -- 172.21.15.8:0/2328786871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5004014410 con 0x7f501406bee0 2023-10-31T23:19:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.918+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501411d9f0 con 0x7f501406bee0 2023-10-31T23:19:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.919+0000 7fe75f7fe640 1 -- 172.21.15.8:0/1179330345 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fe768076c90 con 0x7fe778130df0 2023-10-31T23:19:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.919+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50141216b0 con 0x7f501406bee0 2023-10-31T23:19:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.919+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5014120f50 con 0x7f501406bee0 2023-10-31T23:19:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.923+0000 7f4ffb7fe640 1 -- 172.21.15.8:0/2328786871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f50040093c0 con 0x7f501406bee0 2023-10-31T23:19:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.923+0000 7f4ffb7fe640 1 -- 172.21.15.8:0/2328786871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f50040146a0 con 0x7f501406bee0 2023-10-31T23:19:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.923+0000 7f5559ffb640 1 -- 172.21.15.8:0/2664677809 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f556000dd20 con 0x7f556409a990 2023-10-31T23:19:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.924+0000 7f4ffb7fe640 1 -- 172.21.15.8:0/2328786871 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f5004014800 con 0x7f501406bee0 2023-10-31T23:19:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.924+0000 7f4ffb7fe640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5000037840 0x7f5000039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.924+0000 7f4ffb7fe640 1 -- 172.21.15.8:0/2328786871 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f5004019040 con 0x7f501406bee0 2023-10-31T23:19:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.924+0000 7f501259c640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5000037840 0x7f5000039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.925+0000 7f501259c640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5000037840 0x7f5000039d50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:43.932+0000 7f4ffb7fe640 1 -- 172.21.15.8:0/2328786871 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f500400f8a0 con 0x7f501406bee0 2023-10-31T23:19:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.104+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f55641315f0 con 0x7f556409a990 2023-10-31T23:19:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.105+0000 7f5559ffb640 1 -- 172.21.15.8:0/2664677809 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f5560010ea0 con 0x7f556409a990 2023-10-31T23:19:44.107 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:44.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5548037890 msgr2=0x7f5548039da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5548037890 0x7f5548039da0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556409a990 msgr2=0x7f55641c7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556409a990 0x7f55641c7b90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 shutdown_connections 2023-10-31T23:19:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5548037890 0x7f5548039da0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 --2- 172.21.15.8:0/2664677809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556409a990 0x7f55641c7b90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 >> 172.21.15.8:0/2664677809 conn(0x7f556409f840 msgr2=0x7f556412c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 shutdown_connections 2023-10-31T23:19:44.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.108+0000 7f556b39e640 1 -- 172.21.15.8:0/2664677809 wait complete. 2023-10-31T23:19:44.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.110+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5014061d90 con 0x7f501406bee0 2023-10-31T23:19:44.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.110+0000 7f4ffb7fe640 1 -- 172.21.15.8:0/2328786871 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f500400f6c0 con 0x7f501406bee0 2023-10-31T23:19:44.112 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:44.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5000037840 msgr2=0x7f5000039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5000037840 0x7f5000039d50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501406bee0 msgr2=0x7f501411df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501406bee0 0x7f501411df40 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 shutdown_connections 2023-10-31T23:19:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f5000037840 0x7f5000039d50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 --2- 172.21.15.8:0/2328786871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f501406bee0 0x7f501411df40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 >> 172.21.15.8:0/2328786871 conn(0x7f501409f840 msgr2=0x7f5014117000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 shutdown_connections 2023-10-31T23:19:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.112+0000 7f5019260640 1 -- 172.21.15.8:0/2328786871 wait complete. 2023-10-31T23:19:44.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.118+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe77811ac50 con 0x7fe778130df0 2023-10-31T23:19:44.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.118+0000 7fe75f7fe640 1 -- 172.21.15.8:0/1179330345 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fe76800d750 con 0x7fe778130df0 2023-10-31T23:19:44.120 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:44.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.119+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c94061d90 con 0x7f7c94099a10 2023-10-31T23:19:44.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.119+0000 7f7c7b7fe640 1 -- 172.21.15.8:0/3555110915 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f7c8400fa90 con 0x7f7c94099a10 2023-10-31T23:19:44.121 INFO:teuthology.orchestra.run.smithi008.stdout:38654705671 2023-10-31T23:19:44.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.120+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fe7640378e0 msgr2=0x7fe764039df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.120+0000 7fe77d02d640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fe7640378e0 0x7fe764039df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.120+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778130df0 msgr2=0x7fe77811b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.120+0000 7fe77d02d640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778130df0 0x7fe77811b150 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.121+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 shutdown_connections 2023-10-31T23:19:44.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.121+0000 7fe77d02d640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fe7640378e0 0x7fe764039df0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.121+0000 7fe77d02d640 1 --2- 172.21.15.8:0/1179330345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe778130df0 0x7fe77811b150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.121+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 >> 172.21.15.8:0/1179330345 conn(0x7fe77809f950 msgr2=0x7fe778131d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.121+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 shutdown_connections 2023-10-31T23:19:44.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.121+0000 7fe77d02d640 1 -- 172.21.15.8:0/1179330345 wait complete. 2023-10-31T23:19:44.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7c80037840 msgr2=0x7f7c80039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7c80037840 0x7f7c80039d50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94099a10 msgr2=0x7f7c941c49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94099a10 0x7f7c941c49c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 shutdown_connections 2023-10-31T23:19:44.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7c80037840 0x7f7c80039d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 --2- 172.21.15.8:0/3555110915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94099a10 0x7f7c941c49c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 >> 172.21.15.8:0/3555110915 conn(0x7f7c9409ff80 msgr2=0x7f7c941b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 shutdown_connections 2023-10-31T23:19:44.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.122+0000 7f7c9946d640 1 -- 172.21.15.8:0/3555110915 wait complete. 2023-10-31T23:19:44.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2023-10-31T23:19:44.130 DEBUG:teuthology.parallel:result is None 2023-10-31T23:19:44.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2023-10-31T23:19:44.131 DEBUG:teuthology.parallel:result is None 2023-10-31T23:19:44.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2023-10-31T23:19:44.135 DEBUG:teuthology.parallel:result is None 2023-10-31T23:19:44.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2023-10-31T23:19:44.136 DEBUG:teuthology.parallel:result is None 2023-10-31T23:19:44.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-31T23:19:44.136 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-31T23:19:44.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.281+0000 7fa3f6c17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:44.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.285+0000 7fa3f6c17640 1 Processor -- start 2023-10-31T23:19:44.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.285+0000 7fa3f6c17640 1 -- start start 2023-10-31T23:19:44.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3f6c17640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3f006d420 0x7fa3f0130f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3f6c17640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f0130b50 con 0x7fa3f01314a0 2023-10-31T23:19:44.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3f6c17640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f006eb90 con 0x7fa3f006d420 2023-10-31T23:19:44.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3f49b3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3f006d420 0x7fa3f0130f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3effff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa3f01314a0 0x7fa3f006bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39212/0 (socket says 172.21.15.8:39212) 2023-10-31T23:19:44.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3f49b3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3f006d420 0x7fa3f0130f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52748/0 (socket says 172.21.15.8:52748) 2023-10-31T23:19:44.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3effff640 1 -- 172.21.15.8:0/1683936952 learned_addr learned my addr 172.21.15.8:0/1683936952 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:44.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.286+0000 7fa3f49b3640 1 -- 172.21.15.8:0/1683936952 >> v1:172.21.15.8:6789/0 conn(0x7fa3f01314a0 legacy=0x7fa3f006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3f49b3640 1 -- 172.21.15.8:0/1683936952 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f006d930 con 0x7fa3f006d420 2023-10-31T23:19:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3f49b3640 1 --2- 172.21.15.8:0/1683936952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0130f60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823bee3150383e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3ef7fe640 1 -- 172.21.15.8:0/1683936952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3e0009ce0 con 0x7fa3f006d420 2023-10-31T23:19:44.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3ef7fe640 1 -- 172.21.15.8:0/1683936952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa3e0009e40 con 0x7fa3f006d420 2023-10-31T23:19:44.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3ef7fe640 1 -- 172.21.15.8:0/1683936952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3e000e360 con 0x7fa3f006d420 2023-10-31T23:19:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3f6c17640 1 -- 172.21.15.8:0/1683936952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 msgr2=0x7fa3f0130f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3f6c17640 1 --2- 172.21.15.8:0/1683936952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0130f60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.287+0000 7fa3f6c17640 1 -- 172.21.15.8:0/1683936952 shutdown_connections 2023-10-31T23:19:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.288+0000 7fa3f6c17640 1 --2- 172.21.15.8:0/1683936952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0130f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.288+0000 7fa3f6c17640 1 -- 172.21.15.8:0/1683936952 >> 172.21.15.8:0/1683936952 conn(0x7fa3f009fad0 msgr2=0x7fa3f009fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.288+0000 7fa3f6c17640 1 -- 172.21.15.8:0/1683936952 shutdown_connections 2023-10-31T23:19:44.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.288+0000 7fa3f6c17640 1 -- 172.21.15.8:0/1683936952 wait complete. 2023-10-31T23:19:44.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.288+0000 7fa3f6c17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:44.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.289+0000 7fa3f6c17640 1 Processor -- start 2023-10-31T23:19:44.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.289+0000 7fa3f6c17640 1 -- start start 2023-10-31T23:19:44.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f6c17640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0118d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f6c17640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f011ab00 con 0x7fa3f006d420 2023-10-31T23:19:44.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f49b3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0118d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f49b3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0118d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52762/0 (socket says 172.21.15.8:52762) 2023-10-31T23:19:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f49b3640 1 -- 172.21.15.8:0/3422246472 learned_addr learned my addr 172.21.15.8:0/3422246472 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f49b3640 1 -- 172.21.15.8:0/3422246472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f0119e20 con 0x7fa3f006d420 2023-10-31T23:19:44.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f49b3640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0118d80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3ed7fa640 1 -- 172.21.15.8:0/3422246472 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3e0014620 con 0x7fa3f006d420 2023-10-31T23:19:44.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3ed7fa640 1 -- 172.21.15.8:0/3422246472 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa3e0014780 con 0x7fa3f006d420 2023-10-31T23:19:44.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f0129f50 con 0x7fa3f006d420 2023-10-31T23:19:44.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3ed7fa640 1 -- 172.21.15.8:0/3422246472 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3e0014a20 con 0x7fa3f006d420 2023-10-31T23:19:44.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.290+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f011c2c0 con 0x7fa3f006d420 2023-10-31T23:19:44.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.291+0000 7fa3ed7fa640 1 -- 172.21.15.8:0/3422246472 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fa3e0014b80 con 0x7fa3f006d420 2023-10-31T23:19:44.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.291+0000 7fa3ed7fa640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa3dc037840 0x7fa3dc039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.291+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f011c770 con 0x7fa3f006d420 2023-10-31T23:19:44.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.291+0000 7fa3ed7fa640 1 -- 172.21.15.8:0/3422246472 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fa3e0019040 con 0x7fa3f006d420 2023-10-31T23:19:44.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.292+0000 7fa3effff640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa3dc037840 0x7fa3dc039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.292+0000 7fa3effff640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa3dc037840 0x7fa3dc039d50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.296+0000 7fa3ed7fa640 1 -- 172.21.15.8:0/3422246472 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7fa3e0010310 con 0x7fa3f006d420 2023-10-31T23:19:44.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.468+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 --> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3f011cd50 con 0x7fa3dc037840 2023-10-31T23:19:44.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.469+0000 7fa3ed7fa640 1 -- 172.21.15.8:0/3422246472 <== mgr.4099 v2:172.21.15.71:6800/4260589995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30047 (crc 0 0 0) 0x7fa3e4001200 con 0x7fa3dc037840 2023-10-31T23:19:44.472 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:44.473 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-31T23:19:44.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa3dc037840 msgr2=0x7fa3dc039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa3dc037840 0x7fa3dc039d50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 msgr2=0x7fa3f0118d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0118d80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 shutdown_connections 2023-10-31T23:19:44.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fa3dc037840 0x7fa3dc039d50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 --2- 172.21.15.8:0/3422246472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f006d420 0x7fa3f0118d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 >> 172.21.15.8:0/3422246472 conn(0x7fa3f009fad0 msgr2=0x7fa3f012aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 shutdown_connections 2023-10-31T23:19:44.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.471+0000 7fa3f6c17640 1 -- 172.21.15.8:0/3422246472 wait complete. 2023-10-31T23:19:44.483 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-10-31T23:19:44.373189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109584,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320816,"statfs":{"total":429496729600,"available":429384515584,"internally_reserved":0,"allocated":1433600,"data_stored":1268060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.701921"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.570776+0000","last_change":"2023-10-31T23:19:42.571244+0000","last_active":"2023-10-31T23:19:42.570776+0000","last_peered":"2023-10-31T23:19:42.570776+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.567953+0000","last_became_peered":"2023-10-31T23:19:42.567953+0000","last_unstale":"2023-10-31T23:19:42.570776+0000","last_undegraded":"2023-10-31T23:19:42.570776+0000","last_fullsized":"2023-10-31T23:19:42.570776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-31T23:19:43.508181+0000","last_change":"2023-10-31T23:19:42.535353+0000","last_active":"2023-10-31T23:19:43.508181+0000","last_peered":"2023-10-31T23:19:43.508181+0000","last_clean":"2023-10-31T23:19:43.508181+0000","last_became_active":"2023-10-31T23:19:42.532475+0000","last_became_peered":"2023-10-31T23:19:42.532475+0000","last_unstale":"2023-10-31T23:19:43.508181+0000","last_undegraded":"2023-10-31T23:19:43.508181+0000","last_fullsized":"2023-10-31T23:19:43.508181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.563590+0000","last_change":"2023-10-31T23:19:42.563988+0000","last_active":"2023-10-31T23:19:42.563590+0000","last_peered":"2023-10-31T23:19:42.563590+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.556469+0000","last_became_peered":"2023-10-31T23:19:42.556469+0000","last_unstale":"2023-10-31T23:19:42.563590+0000","last_undegraded":"2023-10-31T23:19:42.563590+0000","last_fullsized":"2023-10-31T23:19:42.563590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-31T23:19:43.508744+0000","last_change":"2023-10-31T23:19:42.547769+0000","last_active":"2023-10-31T23:19:43.508744+0000","last_peered":"2023-10-31T23:19:43.508744+0000","last_clean":"2023-10-31T23:19:43.508744+0000","last_became_active":"2023-10-31T23:19:42.539009+0000","last_became_peered":"2023-10-31T23:19:42.539009+0000","last_unstale":"2023-10-31T23:19:43.508744+0000","last_undegraded":"2023-10-31T23:19:43.508744+0000","last_fullsized":"2023-10-31T23:19:43.508744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.557125+0000","last_change":"2023-10-31T23:19:42.557734+0000","last_active":"2023-10-31T23:19:42.557125+0000","last_peered":"2023-10-31T23:19:42.557125+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.551309+0000","last_became_peered":"2023-10-31T23:19:42.551309+0000","last_unstale":"2023-10-31T23:19:42.557125+0000","last_undegraded":"2023-10-31T23:19:42.557125+0000","last_fullsized":"2023-10-31T23:19:42.557125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.551941+0000","last_change":"2023-10-31T23:19:42.552451+0000","last_active":"2023-10-31T23:19:42.551941+0000","last_peered":"2023-10-31T23:19:42.551941+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.546560+0000","last_became_peered":"2023-10-31T23:19:42.546560+0000","last_unstale":"2023-10-31T23:19:42.551941+0000","last_undegraded":"2023-10-31T23:19:42.551941+0000","last_fullsized":"2023-10-31T23:19:42.551941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.567667+0000","last_change":"2023-10-31T23:19:42.568056+0000","last_active":"2023-10-31T23:19:42.567667+0000","last_peered":"2023-10-31T23:19:42.567667+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.563626+0000","last_became_peered":"2023-10-31T23:19:42.563626+0000","last_unstale":"2023-10-31T23:19:42.567667+0000","last_undegraded":"2023-10-31T23:19:42.567667+0000","last_fullsized":"2023-10-31T23:19:42.567667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.583775+0000","last_change":"2023-10-31T23:19:42.584169+0000","last_active":"2023-10-31T23:19:42.583775+0000","last_peered":"2023-10-31T23:19:42.583775+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.579317+0000","last_became_peered":"2023-10-31T23:19:42.579317+0000","last_unstale":"2023-10-31T23:19:42.583775+0000","last_undegraded":"2023-10-31T23:19:42.583775+0000","last_fullsized":"2023-10-31T23:19:42.583775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.506050+0000","last_change":"2023-10-31T23:19:39.518518+0000","last_active":"2023-10-31T23:19:42.506050+0000","last_peered":"2023-10-31T23:19:42.506050+0000","last_clean":"2023-10-31T23:19:42.506050+0000","last_became_active":"2023-10-31T23:19:39.514416+0000","last_became_peered":"2023-10-31T23:19:39.514416+0000","last_unstale":"2023-10-31T23:19:42.506050+0000","last_undegraded":"2023-10-31T23:19:42.506050+0000","last_fullsized":"2023-10-31T23:19:42.506050+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:38.479247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:38.479247+0000","last_clean_scrub_stamp":"2023-10-31T23:19:38.479247+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-10-31T23:19:44.485 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-31T23:19:44.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.591+0000 7f7ac479e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:44.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.595+0000 7f7ac479e640 1 Processor -- start 2023-10-31T23:19:44.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.595+0000 7f7ac479e640 1 -- start start 2023-10-31T23:19:44.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac479e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7abc099e20 0x7f7abc12fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac479e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc06e400 con 0x7f7abc099a10 2023-10-31T23:19:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac479e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc09a630 con 0x7f7abc099e20 2023-10-31T23:19:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac1d39640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7abc099e20 0x7f7abc12fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac253a640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7abc099a10 0x7f7abc12f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39228/0 (socket says 172.21.15.8:39228) 2023-10-31T23:19:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac253a640 1 -- 172.21.15.8:0/3384567448 learned_addr learned my addr 172.21.15.8:0/3384567448 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:44.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac1d39640 1 -- 172.21.15.8:0/3384567448 >> v1:172.21.15.8:6789/0 conn(0x7f7abc099a10 legacy=0x7f7abc12f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac1d39640 1 -- 172.21.15.8:0/3384567448 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc06dcb0 con 0x7f7abc099e20 2023-10-31T23:19:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.596+0000 7f7ac1538640 1 -- 172.21.15.8:0/3384567448 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996701277 0 0) 0x7f7abc06e400 con 0x7f7abc099a10 2023-10-31T23:19:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac1d39640 1 --2- 172.21.15.8:0/3384567448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099e20 0x7f7abc12fce0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec87b0454e704959 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac1538640 1 -- 172.21.15.8:0/3384567448 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7ab0009ce0 con 0x7f7abc099e20 2023-10-31T23:19:44.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac1538640 1 -- 172.21.15.8:0/3384567448 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7ab0009e40 con 0x7f7abc099e20 2023-10-31T23:19:44.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac1538640 1 -- 172.21.15.8:0/3384567448 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7ab000e360 con 0x7f7abc099e20 2023-10-31T23:19:44.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac479e640 1 -- 172.21.15.8:0/3384567448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099e20 msgr2=0x7f7abc12fce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac479e640 1 --2- 172.21.15.8:0/3384567448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099e20 0x7f7abc12fce0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac479e640 1 -- 172.21.15.8:0/3384567448 shutdown_connections 2023-10-31T23:19:44.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac479e640 1 --2- 172.21.15.8:0/3384567448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099e20 0x7f7abc12fce0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac479e640 1 -- 172.21.15.8:0/3384567448 >> 172.21.15.8:0/3384567448 conn(0x7f7abc09f840 msgr2=0x7f7abc09fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac479e640 1 -- 172.21.15.8:0/3384567448 shutdown_connections 2023-10-31T23:19:44.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.597+0000 7f7ac479e640 1 -- 172.21.15.8:0/3384567448 wait complete. 2023-10-31T23:19:44.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.598+0000 7f7ac479e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:44.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.599+0000 7f7ac479e640 1 Processor -- start 2023-10-31T23:19:44.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.599+0000 7f7ac479e640 1 -- start start 2023-10-31T23:19:44.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.599+0000 7f7ac479e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099a10 0x7f7abc1c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.599+0000 7f7ac479e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc122d00 con 0x7f7abc099a10 2023-10-31T23:19:44.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.599+0000 7f7ac253a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099a10 0x7f7abc1c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.599+0000 7f7ac253a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099a10 0x7f7abc1c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52780/0 (socket says 172.21.15.8:52780) 2023-10-31T23:19:44.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.599+0000 7f7ac253a640 1 -- 172.21.15.8:0/2393600613 learned_addr learned my addr 172.21.15.8:0/2393600613 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:44.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.600+0000 7f7ac253a640 1 -- 172.21.15.8:0/2393600613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc120ac0 con 0x7f7abc099a10 2023-10-31T23:19:44.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.600+0000 7f7ac253a640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099a10 0x7f7abc1c4830 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.600+0000 7f7abaffd640 1 -- 172.21.15.8:0/2393600613 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7ab4004af0 con 0x7f7abc099a10 2023-10-31T23:19:44.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.600+0000 7f7abaffd640 1 -- 172.21.15.8:0/2393600613 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7ab4004c50 con 0x7f7abc099a10 2023-10-31T23:19:44.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.600+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc1207b0 con 0x7f7abc099a10 2023-10-31T23:19:44.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.600+0000 7f7abaffd640 1 -- 172.21.15.8:0/2393600613 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7ab4007120 con 0x7f7abc099a10 2023-10-31T23:19:44.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.600+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc122f70 con 0x7f7abc099a10 2023-10-31T23:19:44.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.601+0000 7f7abaffd640 1 -- 172.21.15.8:0/2393600613 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f7ab40072d0 con 0x7f7abc099a10 2023-10-31T23:19:44.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.601+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc124930 con 0x7f7abc099a10 2023-10-31T23:19:44.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.601+0000 7f7abaffd640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7aa8037840 0x7f7aa8039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.601+0000 7f7abaffd640 1 -- 172.21.15.8:0/2393600613 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f7ab4046e50 con 0x7f7abc099a10 2023-10-31T23:19:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.601+0000 7f7ac1d39640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7aa8037840 0x7f7aa8039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.602+0000 7f7ac1d39640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7aa8037840 0x7f7aa8039d50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.606+0000 7f7abaffd640 1 -- 172.21.15.8:0/2393600613 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f7ab400a940 con 0x7f7abc099a10 2023-10-31T23:19:44.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.778+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 --> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7abc0a05c0 con 0x7f7aa8037840 2023-10-31T23:19:44.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.780+0000 7f7abaffd640 1 -- 172.21.15.8:0/2393600613 <== mgr.4099 v2:172.21.15.71:6800/4260589995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30047 (crc 0 0 0) 0x7f7ab000e510 con 0x7f7aa8037840 2023-10-31T23:19:44.781 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:44.782 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-31T23:19:44.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7aa8037840 msgr2=0x7f7aa8039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7aa8037840 0x7f7aa8039d50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099a10 msgr2=0x7f7abc1c4830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099a10 0x7f7abc1c4830 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 shutdown_connections 2023-10-31T23:19:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f7aa8037840 0x7f7aa8039d50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 --2- 172.21.15.8:0/2393600613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7abc099a10 0x7f7abc1c4830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 >> 172.21.15.8:0/2393600613 conn(0x7f7abc09f840 msgr2=0x7f7abc1304e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 shutdown_connections 2023-10-31T23:19:44.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.781+0000 7f7ac479e640 1 -- 172.21.15.8:0/2393600613 wait complete. 2023-10-31T23:19:44.793 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-10-31T23:19:44.373189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109584,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320816,"statfs":{"total":429496729600,"available":429384515584,"internally_reserved":0,"allocated":1433600,"data_stored":1268060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.701921"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.570776+0000","last_change":"2023-10-31T23:19:42.571244+0000","last_active":"2023-10-31T23:19:42.570776+0000","last_peered":"2023-10-31T23:19:42.570776+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.567953+0000","last_became_peered":"2023-10-31T23:19:42.567953+0000","last_unstale":"2023-10-31T23:19:42.570776+0000","last_undegraded":"2023-10-31T23:19:42.570776+0000","last_fullsized":"2023-10-31T23:19:42.570776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-31T23:19:43.508181+0000","last_change":"2023-10-31T23:19:42.535353+0000","last_active":"2023-10-31T23:19:43.508181+0000","last_peered":"2023-10-31T23:19:43.508181+0000","last_clean":"2023-10-31T23:19:43.508181+0000","last_became_active":"2023-10-31T23:19:42.532475+0000","last_became_peered":"2023-10-31T23:19:42.532475+0000","last_unstale":"2023-10-31T23:19:43.508181+0000","last_undegraded":"2023-10-31T23:19:43.508181+0000","last_fullsized":"2023-10-31T23:19:43.508181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.563590+0000","last_change":"2023-10-31T23:19:42.563988+0000","last_active":"2023-10-31T23:19:42.563590+0000","last_peered":"2023-10-31T23:19:42.563590+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.556469+0000","last_became_peered":"2023-10-31T23:19:42.556469+0000","last_unstale":"2023-10-31T23:19:42.563590+0000","last_undegraded":"2023-10-31T23:19:42.563590+0000","last_fullsized":"2023-10-31T23:19:42.563590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-31T23:19:43.508744+0000","last_change":"2023-10-31T23:19:42.547769+0000","last_active":"2023-10-31T23:19:43.508744+0000","last_peered":"2023-10-31T23:19:43.508744+0000","last_clean":"2023-10-31T23:19:43.508744+0000","last_became_active":"2023-10-31T23:19:42.539009+0000","last_became_peered":"2023-10-31T23:19:42.539009+0000","last_unstale":"2023-10-31T23:19:43.508744+0000","last_undegraded":"2023-10-31T23:19:43.508744+0000","last_fullsized":"2023-10-31T23:19:43.508744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.557125+0000","last_change":"2023-10-31T23:19:42.557734+0000","last_active":"2023-10-31T23:19:42.557125+0000","last_peered":"2023-10-31T23:19:42.557125+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.551309+0000","last_became_peered":"2023-10-31T23:19:42.551309+0000","last_unstale":"2023-10-31T23:19:42.557125+0000","last_undegraded":"2023-10-31T23:19:42.557125+0000","last_fullsized":"2023-10-31T23:19:42.557125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.551941+0000","last_change":"2023-10-31T23:19:42.552451+0000","last_active":"2023-10-31T23:19:42.551941+0000","last_peered":"2023-10-31T23:19:42.551941+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.546560+0000","last_became_peered":"2023-10-31T23:19:42.546560+0000","last_unstale":"2023-10-31T23:19:42.551941+0000","last_undegraded":"2023-10-31T23:19:42.551941+0000","last_fullsized":"2023-10-31T23:19:42.551941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.567667+0000","last_change":"2023-10-31T23:19:42.568056+0000","last_active":"2023-10-31T23:19:42.567667+0000","last_peered":"2023-10-31T23:19:42.567667+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.563626+0000","last_became_peered":"2023-10-31T23:19:42.563626+0000","last_unstale":"2023-10-31T23:19:42.567667+0000","last_undegraded":"2023-10-31T23:19:42.567667+0000","last_fullsized":"2023-10-31T23:19:42.567667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.583775+0000","last_change":"2023-10-31T23:19:42.584169+0000","last_active":"2023-10-31T23:19:42.583775+0000","last_peered":"2023-10-31T23:19:42.583775+0000","last_clean":"2023-10-31T23:19:41.491857+0000","last_became_active":"2023-10-31T23:19:42.579317+0000","last_became_peered":"2023-10-31T23:19:42.579317+0000","last_unstale":"2023-10-31T23:19:42.583775+0000","last_undegraded":"2023-10-31T23:19:42.583775+0000","last_fullsized":"2023-10-31T23:19:42.583775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:41.491857+0000","last_clean_scrub_stamp":"2023-10-31T23:19:41.491857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-31T23:19:42.506050+0000","last_change":"2023-10-31T23:19:39.518518+0000","last_active":"2023-10-31T23:19:42.506050+0000","last_peered":"2023-10-31T23:19:42.506050+0000","last_clean":"2023-10-31T23:19:42.506050+0000","last_became_active":"2023-10-31T23:19:39.514416+0000","last_became_peered":"2023-10-31T23:19:39.514416+0000","last_unstale":"2023-10-31T23:19:42.506050+0000","last_undegraded":"2023-10-31T23:19:42.506050+0000","last_fullsized":"2023-10-31T23:19:42.506050+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-31T23:19:38.479247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-31T23:19:38.479247+0000","last_clean_scrub_stamp":"2023-10-31T23:19:38.479247+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-10-31T23:19:44.794 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-31T23:19:44.794 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-31T23:19:44.794 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-31T23:19:44.795 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-31T23:19:44.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.901+0000 7f51f491e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:44.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.904+0000 7f51f491e640 1 Processor -- start 2023-10-31T23:19:44.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.904+0000 7f51f491e640 1 -- start start 2023-10-31T23:19:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51f491e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f51f012f5d0 0x7f51f012f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51f491e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f006e400 con 0x7f51f006bee0 2023-10-31T23:19:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51f491e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f009a630 con 0x7f51f012f5d0 2023-10-31T23:19:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51ee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f51f012f5d0 0x7f51f012f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51edd9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f51f006bee0 0x7f51f006c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39242/0 (socket says 172.21.15.8:39242) 2023-10-31T23:19:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51edd9b640 1 -- 172.21.15.8:0/394486199 learned_addr learned my addr 172.21.15.8:0/394486199 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-31T23:19:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51ee59c640 1 -- 172.21.15.8:0/394486199 >> v1:172.21.15.8:6789/0 conn(0x7f51f006bee0 legacy=0x7f51f006c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51ee59c640 1 -- 172.21.15.8:0/394486199 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f006dcb0 con 0x7f51f012f5d0 2023-10-31T23:19:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.905+0000 7f51ee59c640 1 --2- 172.21.15.8:0/394486199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f012f5d0 0x7f51f012f9e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c34e811da0e0271 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51ed59a640 1 -- 172.21.15.8:0/394486199 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f51e0007670 con 0x7f51f012f5d0 2023-10-31T23:19:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51ed59a640 1 -- 172.21.15.8:0/394486199 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f51e00077d0 con 0x7f51f012f5d0 2023-10-31T23:19:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51ed59a640 1 -- 172.21.15.8:0/394486199 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f51e0007a70 con 0x7f51f012f5d0 2023-10-31T23:19:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51f491e640 1 -- 172.21.15.8:0/394486199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f012f5d0 msgr2=0x7f51f012f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51f491e640 1 --2- 172.21.15.8:0/394486199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f012f5d0 0x7f51f012f9e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51f491e640 1 -- 172.21.15.8:0/394486199 shutdown_connections 2023-10-31T23:19:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51f491e640 1 --2- 172.21.15.8:0/394486199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f012f5d0 0x7f51f012f9e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:44.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51f491e640 1 -- 172.21.15.8:0/394486199 >> 172.21.15.8:0/394486199 conn(0x7f51f009f840 msgr2=0x7f51f009fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:44.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51f491e640 1 -- 172.21.15.8:0/394486199 shutdown_connections 2023-10-31T23:19:44.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.906+0000 7f51f491e640 1 -- 172.21.15.8:0/394486199 wait complete. 2023-10-31T23:19:44.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.907+0000 7f51f491e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:19:44.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.908+0000 7f51f491e640 1 Processor -- start 2023-10-31T23:19:44.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.908+0000 7f51f491e640 1 -- start start 2023-10-31T23:19:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.908+0000 7f51f491e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f006bee0 0x7f51f011e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.908+0000 7f51f491e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f011dce0 con 0x7f51f006bee0 2023-10-31T23:19:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51ee59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f006bee0 0x7f51f011e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51ee59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f006bee0 0x7f51f011e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52792/0 (socket says 172.21.15.8:52792) 2023-10-31T23:19:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51ee59c640 1 -- 172.21.15.8:0/1591894566 learned_addr learned my addr 172.21.15.8:0/1591894566 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:19:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51ee59c640 1 -- 172.21.15.8:0/1591894566 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0121980 con 0x7f51f006bee0 2023-10-31T23:19:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51ee59c640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f006bee0 0x7f51f011e1a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51deffd640 1 -- 172.21.15.8:0/1591894566 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f51e0014b10 con 0x7f51f006bee0 2023-10-31T23:19:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51deffd640 1 -- 172.21.15.8:0/1591894566 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f51e0014c70 con 0x7f51f006bee0 2023-10-31T23:19:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f011d940 con 0x7f51f006bee0 2023-10-31T23:19:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51deffd640 1 -- 172.21.15.8:0/1591894566 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f51e0012400 con 0x7f51f006bee0 2023-10-31T23:19:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.909+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f0121490 con 0x7f51f006bee0 2023-10-31T23:19:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.910+0000 7f51deffd640 1 -- 172.21.15.8:0/1591894566 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7f51e00125b0 con 0x7f51f006bee0 2023-10-31T23:19:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.910+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f0070a50 con 0x7f51f006bee0 2023-10-31T23:19:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.910+0000 7f51deffd640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f51d0037840 0x7f51d0039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:19:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.910+0000 7f51deffd640 1 -- 172.21.15.8:0/1591894566 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f51e0019040 con 0x7f51f006bee0 2023-10-31T23:19:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.910+0000 7f51edd9b640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f51d0037840 0x7f51d0039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:19:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.911+0000 7f51edd9b640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f51d0037840 0x7f51d0039d50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:19:44.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:44.915+0000 7f51deffd640 1 -- 172.21.15.8:0/1591894566 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (crc 0 0 0) 0x7f51f0070a50 con 0x7f51f006bee0 2023-10-31T23:19:45.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.127+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f51f0070a50 con 0x7f51f006bee0 2023-10-31T23:19:45.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.127+0000 7f51deffd640 1 -- 172.21.15.8:0/1591894566 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (crc 0 0 0) 0x7f51f0070a50 con 0x7f51f006bee0 2023-10-31T23:19:45.129 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-31T23:19:45.130 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-31T23:19:45.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f51d0037840 msgr2=0x7f51d0039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:45.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f51d0037840 0x7f51d0039d50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:45.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f006bee0 msgr2=0x7f51f011e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:19:45.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f006bee0 0x7f51f011e1a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:45.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 shutdown_connections 2023-10-31T23:19:45.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7f51d0037840 0x7f51d0039d50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:45.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 --2- 172.21.15.8:0/1591894566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51f006bee0 0x7f51f011e1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:19:45.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 >> 172.21.15.8:0/1591894566 conn(0x7f51f009f840 msgr2=0x7f51f0117000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:19:45.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 shutdown_connections 2023-10-31T23:19:45.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-31T23:19:45.129+0000 7f51f491e640 1 -- 172.21.15.8:0/1591894566 wait complete. 2023-10-31T23:19:45.141 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-31T23:19:45.141 INFO:teuthology.run_tasks:Running task workunit... 2023-10-31T23:19:45.153 INFO:tasks.workunit:Pulling workunits from ref a9edd23b5a8ddacab225824948b06b370baf276b 2023-10-31T23:19:45.154 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-31T23:19:45.154 DEBUG:teuthology.orchestra.run.smithi008:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-31T23:19:45.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-31T23:19:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-31T23:19:45.170 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-31T23:19:45.225 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-31T23:19:45.226 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-31T23:19:45.280 INFO:tasks.workunit:timeout=3h 2023-10-31T23:19:45.280 INFO:tasks.workunit:cleanup=True 2023-10-31T23:19:45.281 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a9edd23b5a8ddacab225824948b06b370baf276b 2023-10-31T23:19:45.335 INFO:tasks.workunit.client.0.smithi008.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-31T23:20:27.117 INFO:tasks.workunit.client.0.smithi008.stderr:Note: switching to 'a9edd23b5a8ddacab225824948b06b370baf276b'. 2023-10-31T23:20:27.118 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-31T23:20:27.118 INFO:tasks.workunit.client.0.smithi008.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-31T23:20:27.118 INFO:tasks.workunit.client.0.smithi008.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-31T23:20:27.118 INFO:tasks.workunit.client.0.smithi008.stderr:state without impacting any branches by switching back to a branch. 2023-10-31T23:20:27.118 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-31T23:20:27.119 INFO:tasks.workunit.client.0.smithi008.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-31T23:20:27.119 INFO:tasks.workunit.client.0.smithi008.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-31T23:20:27.119 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-31T23:20:27.119 INFO:tasks.workunit.client.0.smithi008.stderr: git switch -c 2023-10-31T23:20:27.120 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-31T23:20:27.120 INFO:tasks.workunit.client.0.smithi008.stderr:Or undo this operation with: 2023-10-31T23:20:27.120 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-31T23:20:27.120 INFO:tasks.workunit.client.0.smithi008.stderr: git switch - 2023-10-31T23:20:27.120 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-31T23:20:27.121 INFO:tasks.workunit.client.0.smithi008.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-31T23:20:27.121 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-31T23:20:27.121 INFO:tasks.workunit.client.0.smithi008.stderr:HEAD is now at a9edd23b5a8 Merge pull request #54226 from adamemerson/wip-build-experiment 2023-10-31T23:20:27.122 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-31T23:20:27.184 INFO:tasks.workunit.client.0.smithi008.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-31T23:20:27.186 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-31T23:20:27.186 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-31T23:20:27.908 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-31T23:20:27.971 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-31T23:20:28.014 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-31T23:20:28.015 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-31T23:20:28.015 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-31T23:20:28.056 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-31T23:20:28.059 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-31T23:20:28.059 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-31T23:20:28.115 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2023-10-31T23:20:28.116 INFO:tasks.workunit:Running workunit rados/test.sh... 2023-10-31T23:20:28.117 DEBUG:teuthology.orchestra.run.smithi008:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9edd23b5a8ddacab225824948b06b370baf276b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2023-10-31T23:20:28.176 INFO:tasks.workunit.client.0.smithi008.stderr:+ parallel=1 2023-10-31T23:20:28.176 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' '' = --serial ']' 2023-10-31T23:20:28.176 INFO:tasks.workunit.client.0.smithi008.stderr:+ color= 2023-10-31T23:20:28.176 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -t 1 ']' 2023-10-31T23:20:28.177 INFO:tasks.workunit.client.0.smithi008.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2023-10-31T23:20:28.177 INFO:tasks.workunit.client.0.smithi008.stderr:+ declare -A pids 2023-10-31T23:20:28.177 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.177 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.177 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_aio 2023-10-31T23:20:28.178 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_aio' 2023-10-31T23:20:28.178 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_aio 2023-10-31T23:20:28.178 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.179 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_aio 2023-10-31T23:20:28.179 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84101 2023-10-31T23:20:28.179 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_aio on pid 84101' 2023-10-31T23:20:28.180 INFO:tasks.workunit.client.0.smithi008.stdout:test api_aio on pid 84101 2023-10-31T23:20:28.183 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84101 2023-10-31T23:20:28.183 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.183 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.184 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2023-10-31T23:20:28.184 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_aio_pp 2023-10-31T23:20:28.184 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_aio_pp' 2023-10-31T23:20:28.184 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_aio_pp 2023-10-31T23:20:28.185 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.185 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.185 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.185 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.185 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.186 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.186 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.186 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.186 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.187 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.187 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.187 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.187 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.187 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.188 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.188 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.188 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.188 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.189 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.189 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.189 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.189 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.190 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.190 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.190 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.190 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.191 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_aio_pp 2023-10-31T23:20:28.191 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84108 2023-10-31T23:20:28.191 INFO:tasks.workunit.client.0.smithi008.stdout:test api_aio_pp on pid 84108 2023-10-31T23:20:28.196 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_aio_pp on pid 84108' 2023-10-31T23:20:28.196 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84108 2023-10-31T23:20:28.197 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.197 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.197 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2023-10-31T23:20:28.197 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_io 2023-10-31T23:20:28.198 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_io' 2023-10-31T23:20:28.198 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_io 2023-10-31T23:20:28.198 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.198 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.199 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.199 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.199 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.199 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.200 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.200 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.200 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.200 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.200 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.201 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.201 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.201 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.201 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.202 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.202 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.202 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.202 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.203 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.203 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.203 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.203 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.204 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.204 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.204 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.204 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.205 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.205 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.205 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.205 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.206 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.206 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.206 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.206 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.207 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.207 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.207 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.207 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.207 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.208 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.208 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.208 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.208 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.209 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.209 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.209 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_io 2023-10-31T23:20:28.209 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84117 2023-10-31T23:20:28.210 INFO:tasks.workunit.client.0.smithi008.stdout:test api_io on pid 84117 2023-10-31T23:20:28.215 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_io on pid 84117' 2023-10-31T23:20:28.215 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84117 2023-10-31T23:20:28.216 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.216 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.216 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2023-10-31T23:20:28.216 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_io_pp 2023-10-31T23:20:28.216 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_io_pp' 2023-10-31T23:20:28.217 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_io_pp 2023-10-31T23:20:28.217 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.217 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.217 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.217 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.218 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.218 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.218 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.218 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.218 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.219 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.219 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.219 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.219 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.219 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.220 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.220 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.220 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.220 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.220 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.221 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.221 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.221 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.221 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.222 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.222 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.222 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.222 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.222 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.223 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.223 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.223 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.223 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.223 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.224 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.224 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.224 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.224 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.224 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.224 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.225 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.225 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.225 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.225 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.225 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.226 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.226 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.226 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.226 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.226 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.227 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.227 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.227 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.227 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.228 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.228 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.228 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_io_pp 2023-10-31T23:20:28.228 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84129 2023-10-31T23:20:28.229 INFO:tasks.workunit.client.0.smithi008.stdout:test api_io_pp on pid 84129 2023-10-31T23:20:28.234 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_io_pp on pid 84129' 2023-10-31T23:20:28.234 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84129 2023-10-31T23:20:28.234 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.234 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.235 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2023-10-31T23:20:28.235 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_asio 2023-10-31T23:20:28.235 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_asio' 2023-10-31T23:20:28.235 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_asio 2023-10-31T23:20:28.236 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.236 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.236 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.236 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.237 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.237 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.237 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.237 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.238 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.238 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.238 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.238 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.238 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.238 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.239 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.239 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.239 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.239 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.239 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.240 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.240 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.240 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.240 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.241 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.241 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.241 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.241 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.241 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.242 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.242 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.242 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.242 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.242 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.243 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.243 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.243 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.243 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.244 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.244 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.244 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.244 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.244 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.245 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.245 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.245 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.245 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.246 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.246 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.246 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.246 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.246 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.247 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.247 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.247 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.247 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.248 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.248 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.248 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.248 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.248 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.249 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.249 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.249 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.249 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.249 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.250 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.250 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.250 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.250 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.250 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.251 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.251 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.251 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.251 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_asio 2023-10-31T23:20:28.251 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84142 2023-10-31T23:20:28.252 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_asio on pid 84142' 2023-10-31T23:20:28.252 INFO:tasks.workunit.client.0.smithi008.stdout:test api_asio on pid 84142 2023-10-31T23:20:28.259 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84142 2023-10-31T23:20:28.259 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.259 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.259 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2023-10-31T23:20:28.260 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.260 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.260 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.260 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_list 2023-10-31T23:20:28.260 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.260 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.261 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_list' 2023-10-31T23:20:28.261 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.261 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_list 2023-10-31T23:20:28.261 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.262 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.262 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.262 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.262 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.262 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.263 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.263 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.263 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.263 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.264 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.264 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.264 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.264 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.264 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.265 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.265 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.265 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.265 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.265 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.266 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.266 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.266 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.266 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.266 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.267 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.267 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.267 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.267 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.267 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.267 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.268 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.268 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.268 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.268 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.268 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.269 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.269 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.269 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.269 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.269 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.270 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.270 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.270 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.270 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.270 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.271 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.271 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.271 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.271 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.271 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.272 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.272 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.272 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.272 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.273 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.273 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.273 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.273 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.273 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.274 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.274 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.274 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.274 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.275 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.275 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.275 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.275 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.275 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.276 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.276 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.276 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.276 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.277 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.277 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.277 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.277 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.277 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.278 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.278 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.278 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.278 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.278 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.278 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.279 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.279 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.279 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.279 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.279 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.280 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.280 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.280 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.280 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.280 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.280 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84101/exe 2023-10-31T23:20:28.281 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_list 2023-10-31T23:20:28.281 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84160 2023-10-31T23:20:28.281 INFO:tasks.workunit.client.0.smithi008.stdout:test api_list on pid 84160 2023-10-31T23:20:28.289 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_list on pid 84160' 2023-10-31T23:20:28.289 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84160 2023-10-31T23:20:28.289 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.289 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.290 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2023-10-31T23:20:28.290 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_lock 2023-10-31T23:20:28.290 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.290 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.291 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.291 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_lock' 2023-10-31T23:20:28.291 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.291 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.292 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.292 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.292 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_lock 2023-10-31T23:20:28.292 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.293 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.293 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.293 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.293 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.293 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.294 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.294 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.294 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.294 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.295 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.295 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.295 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.295 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.296 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.296 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.296 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.296 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.296 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.297 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.297 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.297 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.297 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.297 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.298 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.298 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.298 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.298 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.299 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.299 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.299 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.299 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.300 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.300 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.300 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.300 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.300 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.301 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.301 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.301 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.301 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.301 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.302 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.302 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.302 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.302 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.302 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.303 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.303 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.303 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.303 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.303 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.304 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.304 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.304 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.304 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.304 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.304 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.305 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.305 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.305 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.305 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.306 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.306 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.306 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.306 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.306 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.307 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_aio 2023-10-31T23:20:28.307 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.307 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.307 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.308 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.308 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.308 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_aio.log 2023-10-31T23:20:28.308 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.308 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.308 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.309 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.309 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.309 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.309 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.310 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.310 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.310 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.310 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.310 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.311 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.311 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.311 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.311 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.311 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.312 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.312 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.312 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.312 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_aio: /' 2023-10-31T23:20:28.312 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.313 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.313 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.313 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.313 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.314 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.314 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.314 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_lock 2023-10-31T23:20:28.314 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.314 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.315 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.315 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.315 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.315 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84177 2023-10-31T23:20:28.315 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_lock on pid 84177' 2023-10-31T23:20:28.316 INFO:tasks.workunit.client.0.smithi008.stdout:test api_lock on pid 84177 2023-10-31T23:20:28.326 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84177 2023-10-31T23:20:28.326 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.326 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.326 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_lock_pp 2023-10-31T23:20:28.327 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84108/exe 2023-10-31T23:20:28.327 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_lock_pp' 2023-10-31T23:20:28.327 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2023-10-31T23:20:28.327 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.327 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.328 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.328 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.328 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.328 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_lock_pp 2023-10-31T23:20:28.328 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.328 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.329 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.329 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.329 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.329 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.329 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.330 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.330 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.330 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.330 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.330 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.331 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.331 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.331 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.331 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.331 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.332 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.332 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.332 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.332 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.333 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.333 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.333 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.333 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.334 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.334 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.334 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.334 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.334 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.335 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.335 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.335 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.335 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.336 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.336 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.336 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.336 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.337 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.337 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.337 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.337 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.337 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.338 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.338 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.338 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.338 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.338 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.339 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.339 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.339 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.339 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.339 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.340 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.340 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.340 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.340 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.340 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.341 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.341 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.341 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.341 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.341 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.341 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.342 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.342 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.342 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.342 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.342 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.343 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.343 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.343 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.343 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.343 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.343 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.344 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.344 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.344 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.344 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.344 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.345 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.345 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.345 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.345 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.345 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.346 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.346 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.346 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.346 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.347 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.347 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.347 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.347 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.347 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.347 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.348 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.348 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.348 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.348 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.348 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.349 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_lock_pp 2023-10-31T23:20:28.349 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.349 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.349 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84196 2023-10-31T23:20:28.350 INFO:tasks.workunit.client.0.smithi008.stdout:test api_lock_pp on pid 84196 2023-10-31T23:20:28.359 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_lock_pp on pid 84196' 2023-10-31T23:20:28.359 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84196 2023-10-31T23:20:28.359 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.360 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.360 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2023-10-31T23:20:28.360 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84117/exe 2023-10-31T23:20:28.360 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.361 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.361 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_misc 2023-10-31T23:20:28.361 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.361 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.361 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.362 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.362 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.362 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.362 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.362 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_misc' 2023-10-31T23:20:28.363 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.363 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.363 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.363 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.363 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.364 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.364 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.364 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.364 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.364 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.364 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.365 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.365 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.365 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.365 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.365 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.366 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.366 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.366 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.366 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.366 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.367 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.367 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_misc 2023-10-31T23:20:28.367 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.367 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.367 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.368 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.368 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.368 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.368 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.368 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.368 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.369 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.369 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.369 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.369 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.369 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.370 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.370 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.370 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.370 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.370 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.371 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.371 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.371 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.371 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.371 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.372 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.372 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.372 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.372 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.372 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.372 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.373 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.373 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.373 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.373 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.373 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.374 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_aio_pp.log 2023-10-31T23:20:28.374 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.374 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_aio_pp: /' 2023-10-31T23:20:28.374 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.374 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.375 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.375 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84129/exe 2023-10-31T23:20:28.375 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.375 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.375 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.376 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.376 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.376 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.376 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.376 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.376 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.377 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.377 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.377 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.377 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.377 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.378 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.378 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.378 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.378 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.378 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.379 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.379 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.379 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.379 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.379 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.379 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.380 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.380 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.380 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.380 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.380 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.381 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_io.log 2023-10-31T23:20:28.381 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_io 2023-10-31T23:20:28.381 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.381 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_io: /' 2023-10-31T23:20:28.381 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.381 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.382 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.382 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.382 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.382 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.383 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.383 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.383 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.383 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.383 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.383 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_misc 2023-10-31T23:20:28.384 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.384 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.384 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.384 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.384 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.384 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.385 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.385 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.385 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84220 2023-10-31T23:20:28.385 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.385 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_misc on pid 84220' 2023-10-31T23:20:28.386 INFO:tasks.workunit.client.0.smithi008.stdout:test api_misc on pid 84220 2023-10-31T23:20:28.403 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84220 2023-10-31T23:20:28.403 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.404 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.404 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.404 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.404 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.404 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.405 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.405 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.405 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.405 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2023-10-31T23:20:28.406 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.406 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_aio_pp 2023-10-31T23:20:28.406 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.406 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.407 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.407 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_io_pp 2023-10-31T23:20:28.407 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_io_pp.log 2023-10-31T23:20:28.407 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.407 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.407 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.408 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.408 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.408 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.408 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.409 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.409 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.409 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.409 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.409 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.410 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.410 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.410 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.410 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.410 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.411 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.411 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.411 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.411 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.411 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.412 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.412 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.412 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.412 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.412 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.413 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_io_pp: /' 2023-10-31T23:20:28.413 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.413 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.413 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.413 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.413 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.414 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.414 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.414 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.414 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.414 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.415 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.415 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.415 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.415 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.415 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.416 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.416 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.416 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.416 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.416 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.416 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.417 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.417 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.417 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.417 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.417 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.418 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.418 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.418 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.418 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.418 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.419 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.419 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.419 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.419 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.419 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.419 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.420 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.420 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.420 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.420 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.420 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.421 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.421 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84142/exe 2023-10-31T23:20:28.421 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.421 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.421 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.422 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.422 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.422 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.422 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.422 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.423 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.423 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.423 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.423 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.423 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.423 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.424 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_misc_pp 2023-10-31T23:20:28.424 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_misc_pp' 2023-10-31T23:20:28.424 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.424 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.424 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.425 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.425 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.425 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.425 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.425 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.426 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.426 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.426 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.426 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.426 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.427 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.427 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.427 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.427 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.427 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.428 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_asio 2023-10-31T23:20:28.428 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.428 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.428 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.428 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.429 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.429 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.429 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.429 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.429 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.430 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.430 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.430 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.430 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.430 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.430 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.431 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.431 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.431 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.431 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.431 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.432 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.432 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.432 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_asio.log 2023-10-31T23:20:28.432 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.432 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.433 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.433 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.433 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.433 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.433 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.434 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.434 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.434 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.434 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.434 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.435 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.435 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.435 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.435 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.435 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.436 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.436 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.436 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.436 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.436 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.437 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.437 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.437 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.437 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.437 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.437 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.438 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84160/exe 2023-10-31T23:20:28.438 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.438 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.438 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.438 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.439 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.439 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.439 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.439 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.439 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.440 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.440 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.440 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.440 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.440 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.440 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_misc_pp 2023-10-31T23:20:28.441 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.441 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.441 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.441 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.441 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.442 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.442 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.442 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.442 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.442 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.443 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.443 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.443 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.443 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.443 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.444 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.444 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.444 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.444 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.444 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.444 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.445 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.445 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_asio: /' 2023-10-31T23:20:28.445 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.445 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.445 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.446 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_misc_pp 2023-10-31T23:20:28.446 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.446 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.446 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84254 2023-10-31T23:20:28.447 INFO:tasks.workunit.client.0.smithi008.stdout:test api_misc_pp on pid 84254 2023-10-31T23:20:28.464 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_misc_pp on pid 84254' 2023-10-31T23:20:28.464 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84254 2023-10-31T23:20:28.464 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.465 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.465 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.465 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.465 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.465 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.466 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.466 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_list.log 2023-10-31T23:20:28.466 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.466 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_list: /' 2023-10-31T23:20:28.466 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.467 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.467 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.467 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.467 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.467 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.467 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.468 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.468 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.468 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.468 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.468 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.469 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.469 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.469 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.469 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.469 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.470 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.470 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.470 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.470 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.470 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.470 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.471 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.471 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.471 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.471 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.471 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.472 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.472 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.472 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.472 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.472 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.473 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.473 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.473 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.473 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.473 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.474 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.474 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.474 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.474 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.474 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.475 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.475 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.475 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.475 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.476 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.476 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.476 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.476 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.476 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.477 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.477 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.477 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.477 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.477 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.478 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.478 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.478 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.478 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.478 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.479 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.479 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.481 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.482 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.482 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.482 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.482 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.482 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.483 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.483 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.483 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.483 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.484 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_list 2023-10-31T23:20:28.484 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.484 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2023-10-31T23:20:28.484 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84196/exe 2023-10-31T23:20:28.485 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.485 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.485 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.485 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.485 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.486 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.486 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.486 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.486 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.486 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.487 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.487 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.487 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.487 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.487 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.488 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.488 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.488 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.488 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.488 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.489 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.489 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.489 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.489 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.490 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.490 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.490 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.490 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.490 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.491 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.491 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.491 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.491 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.491 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.491 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.492 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.492 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.492 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.492 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.492 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.493 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.493 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.493 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.493 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.493 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.493 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.494 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.494 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.494 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.494 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.494 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.495 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.495 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.495 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.495 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.495 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.495 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.496 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.496 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.496 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.496 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.496 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.496 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.497 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.497 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.497 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.497 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.497 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.497 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.498 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_lock_pp.log 2023-10-31T23:20:28.498 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.498 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.498 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.498 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.499 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.499 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.499 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.499 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.499 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.500 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84220/exe 2023-10-31T23:20:28.500 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.500 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_tier_pp 2023-10-31T23:20:28.500 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_tier_pp' 2023-10-31T23:20:28.500 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.501 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.501 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.501 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.501 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.501 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.502 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.502 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.502 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.502 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.503 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_tier_pp 2023-10-31T23:20:28.503 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.503 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.503 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.503 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_lock_pp: /' 2023-10-31T23:20:28.504 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.504 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.504 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.504 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.504 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.504 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.505 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.505 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.505 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.505 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.505 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.506 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.506 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.506 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.506 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.506 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.507 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.507 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.507 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_lock_pp 2023-10-31T23:20:28.507 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_tier_pp 2023-10-31T23:20:28.507 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84287 2023-10-31T23:20:28.508 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_tier_pp on pid 84287' 2023-10-31T23:20:28.508 INFO:tasks.workunit.client.0.smithi008.stdout:test api_tier_pp on pid 84287 2023-10-31T23:20:28.520 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84287 2023-10-31T23:20:28.520 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.520 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.521 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2023-10-31T23:20:28.521 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.521 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.521 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.521 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.522 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.522 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.522 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.522 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.522 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.523 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.523 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.523 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.523 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.523 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.524 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.524 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.524 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.524 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.524 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.525 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.525 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.525 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.525 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.525 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.526 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.526 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84177/exe 2023-10-31T23:20:28.526 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.526 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.526 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_misc: /' 2023-10-31T23:20:28.526 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.527 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.527 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.527 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.527 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.527 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.528 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.528 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.528 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.528 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.528 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.529 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.529 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.529 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.529 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_misc 2023-10-31T23:20:28.529 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.530 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.530 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.530 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.530 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_lock 2023-10-31T23:20:28.530 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.531 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.531 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.531 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.531 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.531 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.531 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.532 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.532 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.532 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.532 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.532 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.532 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.533 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.533 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.533 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.533 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.533 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_misc.log 2023-10-31T23:20:28.533 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.534 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_pool 2023-10-31T23:20:28.534 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.534 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.534 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.534 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.535 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_lock: /' 2023-10-31T23:20:28.535 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.535 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_pool' 2023-10-31T23:20:28.535 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.535 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_lock.log 2023-10-31T23:20:28.535 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.536 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.536 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.536 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.536 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.536 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.537 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.537 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.537 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.537 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.537 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.538 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.538 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.538 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.538 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.538 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.539 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.539 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.539 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.539 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.539 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.540 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.540 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.540 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.540 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.540 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.541 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.541 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.541 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.541 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.541 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.541 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.542 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.542 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.542 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.542 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.542 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.543 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.543 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.543 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.543 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.543 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_pool 2023-10-31T23:20:28.543 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.544 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84254/exe 2023-10-31T23:20:28.544 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.544 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_pool 2023-10-31T23:20:28.544 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84334 2023-10-31T23:20:28.544 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_pool on pid 84334' 2023-10-31T23:20:28.545 INFO:tasks.workunit.client.0.smithi008.stdout:test api_pool on pid 84334 2023-10-31T23:20:28.550 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84334 2023-10-31T23:20:28.550 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.550 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.551 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2023-10-31T23:20:28.551 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.551 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.551 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.551 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.552 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.552 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.552 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.552 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.552 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.552 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.553 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.553 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.553 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.553 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.553 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.553 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.554 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_misc_pp: /' 2023-10-31T23:20:28.554 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_misc_pp 2023-10-31T23:20:28.554 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_snapshots 2023-10-31T23:20:28.554 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_snapshots' 2023-10-31T23:20:28.554 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.555 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.555 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.555 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.555 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.555 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.556 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.556 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.556 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.556 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.556 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.557 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.557 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.557 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.557 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.557 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.558 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.558 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.558 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.558 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_misc_pp.log 2023-10-31T23:20:28.558 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.559 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.559 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.559 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.559 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.559 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.559 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.560 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.560 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.560 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_snapshots 2023-10-31T23:20:28.560 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.560 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_snapshots 2023-10-31T23:20:28.561 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84387 2023-10-31T23:20:28.561 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_snapshots on pid 84387' 2023-10-31T23:20:28.561 INFO:tasks.workunit.client.0.smithi008.stdout:test api_snapshots on pid 84387 2023-10-31T23:20:28.566 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84387 2023-10-31T23:20:28.567 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.567 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.567 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2023-10-31T23:20:28.567 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_snapshots_pp 2023-10-31T23:20:28.567 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_snapshots_pp' 2023-10-31T23:20:28.568 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_snapshots_pp 2023-10-31T23:20:28.568 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.568 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.568 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.568 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.568 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.569 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.569 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.569 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.569 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.569 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.570 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.570 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.570 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.570 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.570 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.571 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.571 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.571 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.571 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.571 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.572 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.572 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.572 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.572 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.572 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.572 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.573 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.573 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.573 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.573 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.573 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.574 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.574 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.574 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.574 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.574 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.575 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.575 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.575 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.575 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.575 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.575 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.576 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.576 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.576 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_snapshots_pp 2023-10-31T23:20:28.576 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.576 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84401 2023-10-31T23:20:28.577 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.577 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.577 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.577 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.578 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.578 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_snapshots_pp on pid 84401' 2023-10-31T23:20:28.578 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.578 INFO:tasks.workunit.client.0.smithi008.stdout:test api_snapshots_pp on pid 84401 2023-10-31T23:20:28.592 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.592 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84401 2023-10-31T23:20:28.592 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.592 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.593 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.593 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.593 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.593 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.593 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.594 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.594 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.594 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.594 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.594 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.595 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.595 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2023-10-31T23:20:28.595 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.595 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.595 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.595 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.596 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.596 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.596 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.596 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.596 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.597 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.597 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.597 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.597 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.597 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.598 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.598 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.598 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.598 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.598 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.598 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.599 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.599 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.599 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.599 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.599 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.600 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.600 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.600 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.600 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.600 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.601 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.601 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.601 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.601 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.601 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.602 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.602 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.602 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.602 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.602 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.603 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.603 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.603 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.603 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.603 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.604 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.604 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_stat 2023-10-31T23:20:28.604 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.604 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.604 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.605 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.605 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.605 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.605 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.605 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.606 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.606 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_stat' 2023-10-31T23:20:28.606 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.606 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.606 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.607 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.607 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.607 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.607 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.607 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.607 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.608 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.608 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.608 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.608 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.608 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.609 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.609 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.609 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.609 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.609 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.610 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.610 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.610 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.610 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.610 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.611 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.611 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_stat 2023-10-31T23:20:28.611 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.611 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.611 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.612 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.612 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.612 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.612 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.612 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.612 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.613 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.613 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.613 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.613 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.613 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.614 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.614 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.614 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.614 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.614 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.614 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.615 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.615 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.615 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.615 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.615 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.616 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.616 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.616 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.616 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.616 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.616 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.617 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.617 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.617 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.617 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.617 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.618 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.618 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.618 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.618 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.619 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.619 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.619 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.619 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.619 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.620 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.620 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.620 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.620 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.620 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.620 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.621 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.621 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.621 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.621 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.621 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.622 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.622 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.622 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.622 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_stat 2023-10-31T23:20:28.622 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84429 2023-10-31T23:20:28.623 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_stat on pid 84429' 2023-10-31T23:20:28.623 INFO:tasks.workunit.client.0.smithi008.stdout:test api_stat on pid 84429 2023-10-31T23:20:28.635 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84429 2023-10-31T23:20:28.636 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.636 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.636 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84287/exe 2023-10-31T23:20:28.636 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.636 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.637 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.637 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.637 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2023-10-31T23:20:28.637 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.637 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.638 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.638 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.638 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.638 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.638 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.639 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.639 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.639 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.639 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.639 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.640 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.640 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.640 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.640 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.640 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.640 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.641 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.641 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.641 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.641 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.641 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.641 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.642 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.642 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.642 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.642 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.642 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.643 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_stat_pp 2023-10-31T23:20:28.643 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.643 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.643 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.643 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.644 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_stat_pp' 2023-10-31T23:20:28.644 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.644 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.644 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.644 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.644 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.645 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.645 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.645 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.645 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.646 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.646 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.646 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.646 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.646 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.647 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.647 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.647 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.647 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.647 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.647 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.648 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.648 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.648 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.648 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.648 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.649 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.649 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.649 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.649 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.649 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.649 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.650 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.650 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.650 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.650 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.650 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.651 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.651 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.651 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.651 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.651 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.652 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.652 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.652 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_tier_pp.log 2023-10-31T23:20:28.652 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_tier_pp 2023-10-31T23:20:28.652 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_tier_pp: /' 2023-10-31T23:20:28.653 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.653 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_stat_pp 2023-10-31T23:20:28.653 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.653 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84334/exe 2023-10-31T23:20:28.653 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.653 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.654 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.654 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.654 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.654 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.654 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.655 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.655 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.655 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.655 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.655 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.656 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.656 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.656 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.656 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.656 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.657 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.657 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.657 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.657 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.657 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.657 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.658 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.658 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.658 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.658 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.658 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.659 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.659 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.659 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.659 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_pool.log 2023-10-31T23:20:28.659 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.660 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_pool 2023-10-31T23:20:28.660 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.660 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.660 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.660 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.660 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.661 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.661 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.661 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.661 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.661 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.662 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.662 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.662 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.662 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.662 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.663 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.663 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.663 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.663 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.663 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.663 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.664 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.664 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.664 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_pool: /' 2023-10-31T23:20:28.664 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.664 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.665 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.665 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.665 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.665 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.665 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.666 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.666 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.666 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.666 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.666 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.666 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.667 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.667 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.667 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.667 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.667 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.668 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.668 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.668 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.668 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.668 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.669 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.669 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.669 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.669 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.669 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84387/exe 2023-10-31T23:20:28.669 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_stat_pp 2023-10-31T23:20:28.670 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84475 2023-10-31T23:20:28.670 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_stat_pp on pid 84475' 2023-10-31T23:20:28.670 INFO:tasks.workunit.client.0.smithi008.stdout:test api_stat_pp on pid 84475 2023-10-31T23:20:28.676 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84475 2023-10-31T23:20:28.677 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.677 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.677 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.677 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2023-10-31T23:20:28.678 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.678 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.678 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.678 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.678 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.679 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.679 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.679 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.679 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.679 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.680 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.680 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.680 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.680 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.680 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.681 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.681 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.681 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.681 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.681 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.682 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.682 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.682 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.682 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.683 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.683 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.683 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.683 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.683 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.683 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.684 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.684 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_watch_notify 2023-10-31T23:20:28.684 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.684 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.684 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.685 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.685 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.685 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.685 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_watch_notify' 2023-10-31T23:20:28.685 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.686 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_snapshots 2023-10-31T23:20:28.686 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.686 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.686 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.686 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.687 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.687 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_snapshots.log 2023-10-31T23:20:28.687 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.687 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.687 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.688 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.688 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_watch_notify 2023-10-31T23:20:28.688 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.688 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.688 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.688 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.689 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.689 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.689 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.689 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.689 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_snapshots: /' 2023-10-31T23:20:28.690 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.690 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.690 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84401/exe 2023-10-31T23:20:28.690 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_watch_notify 2023-10-31T23:20:28.690 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84498 2023-10-31T23:20:28.690 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_watch_notify on pid 84498' 2023-10-31T23:20:28.691 INFO:tasks.workunit.client.0.smithi008.stdout:test api_watch_notify on pid 84498 2023-10-31T23:20:28.695 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84498 2023-10-31T23:20:28.696 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.696 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.696 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.696 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.696 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.697 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.697 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.697 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.697 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.697 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.697 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.698 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.698 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_watch_notify_pp 2023-10-31T23:20:28.698 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.698 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.698 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.699 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.699 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.699 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.699 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.699 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.700 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.700 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.700 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.700 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.700 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.700 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.701 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.701 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.701 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.701 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.701 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.702 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.702 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.702 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.702 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_watch_notify_pp' 2023-10-31T23:20:28.702 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.702 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.703 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.703 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.703 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.703 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.703 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.704 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.704 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_watch_notify_pp 2023-10-31T23:20:28.704 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_snapshots_pp 2023-10-31T23:20:28.704 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.704 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_watch_notify_pp 2023-10-31T23:20:28.705 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84510 2023-10-31T23:20:28.705 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_watch_notify_pp on pid 84510' 2023-10-31T23:20:28.705 INFO:tasks.workunit.client.0.smithi008.stdout:test api_watch_notify_pp on pid 84510 2023-10-31T23:20:28.711 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84510 2023-10-31T23:20:28.711 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.711 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.712 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2023-10-31T23:20:28.712 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.712 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.712 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.712 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.713 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.713 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.713 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.713 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.713 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.714 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.714 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.714 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.714 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.714 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.715 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.715 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.715 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_cmd 2023-10-31T23:20:28.715 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.715 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.716 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.716 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.716 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_cmd' 2023-10-31T23:20:28.716 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.716 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.717 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.717 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.717 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.717 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.717 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.717 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.718 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.718 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.718 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.718 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.718 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.719 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.719 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.719 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.719 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.719 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.720 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.720 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.720 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.720 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.720 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.720 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.721 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.721 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.721 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.721 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.721 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.722 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.722 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_cmd 2023-10-31T23:20:28.722 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.722 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.722 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.723 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2023-10-31T23:20:28.723 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.723 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.723 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.723 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.723 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.724 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_cmd 2023-10-31T23:20:28.724 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84522 2023-10-31T23:20:28.724 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_cmd on pid 84522' 2023-10-31T23:20:28.724 INFO:tasks.workunit.client.0.smithi008.stdout:test api_cmd on pid 84522 2023-10-31T23:20:28.744 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84522 2023-10-31T23:20:28.745 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.745 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.745 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2023-10-31T23:20:28.745 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2023-10-31T23:20:28.745 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.746 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.746 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.746 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.746 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.746 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.747 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.747 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.747 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.747 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.747 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.748 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.748 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.748 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.748 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.748 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.749 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.749 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.749 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.749 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.749 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.750 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.750 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.750 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.750 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.751 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.751 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.751 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.751 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.751 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.751 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.752 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.752 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.752 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.752 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.752 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.753 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.753 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_snapshots_pp: /' 2023-10-31T23:20:28.753 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.753 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.753 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.754 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.754 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.754 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.754 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.754 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.754 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.755 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.755 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.755 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.755 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.755 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.756 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.756 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.756 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.756 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.756 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.756 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.757 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.757 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.757 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.757 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.757 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.758 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.758 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.758 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.758 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.758 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.759 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.759 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.759 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.759 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.759 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.759 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.760 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.760 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.760 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.760 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.761 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.761 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.761 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.761 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.762 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.762 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.762 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.762 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.762 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84475/exe 2023-10-31T23:20:28.763 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.763 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.763 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.763 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.763 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.763 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.764 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.764 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.764 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.764 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.764 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.765 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.765 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.765 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.765 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.765 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.765 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.766 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.766 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.766 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.766 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.766 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_cmd_pp 2023-10-31T23:20:28.766 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_cmd_pp' 2023-10-31T23:20:28.767 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.767 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.767 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.767 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.767 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.768 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.768 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.768 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.768 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.768 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.769 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.769 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.769 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.769 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.769 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.770 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.770 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.770 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.770 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.770 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.771 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.771 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.771 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.771 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.771 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.772 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.772 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.772 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.772 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.772 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.773 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.773 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.773 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.773 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.773 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.774 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.774 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.774 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.774 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.774 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.775 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.775 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.775 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_stat_pp: /' 2023-10-31T23:20:28.775 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.775 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.776 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.776 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.776 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.776 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.776 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.777 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.777 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.777 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_stat_pp.log 2023-10-31T23:20:28.777 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_stat_pp 2023-10-31T23:20:28.777 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84429/exe 2023-10-31T23:20:28.778 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.778 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.778 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.778 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.778 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.779 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.779 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.779 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.779 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.779 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.779 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.780 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.780 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.780 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.780 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.780 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.781 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.781 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.781 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.781 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.781 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.782 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.782 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.782 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.782 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.782 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.783 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.783 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.783 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.783 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.783 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.783 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.784 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.784 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.784 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.784 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.784 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.784 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.785 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.785 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.785 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.785 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.785 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.785 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.786 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.786 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.786 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.786 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.786 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.786 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.787 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.787 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.787 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.787 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.787 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.787 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.788 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.788 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.788 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.788 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.788 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.789 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.789 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.789 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.789 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.789 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.790 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.790 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.790 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.790 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_stat 2023-10-31T23:20:28.790 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_cmd_pp 2023-10-31T23:20:28.791 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.791 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.791 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.791 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.792 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.792 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.792 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.792 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.792 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.792 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.793 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_cmd_pp 2023-10-31T23:20:28.793 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84619 2023-10-31T23:20:28.793 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_cmd_pp on pid 84619' 2023-10-31T23:20:28.793 INFO:tasks.workunit.client.0.smithi008.stdout:test api_cmd_pp on pid 84619 2023-10-31T23:20:28.806 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84619 2023-10-31T23:20:28.806 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.806 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_stat: /' 2023-10-31T23:20:28.806 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.807 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.807 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.807 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.807 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.807 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.808 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.808 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.808 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.808 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.808 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.808 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.809 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.809 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.809 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.809 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.810 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.810 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.810 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.810 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.810 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.811 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.811 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.811 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.811 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.811 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.812 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.812 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.812 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.812 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.812 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.813 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.813 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.813 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.813 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.813 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.814 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.814 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_service 2023-10-31T23:20:28.814 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_stat.log 2023-10-31T23:20:28.814 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_service' 2023-10-31T23:20:28.814 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84510/exe 2023-10-31T23:20:28.814 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2023-10-31T23:20:28.815 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.815 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.815 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.815 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.815 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.816 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.816 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.816 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.816 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.817 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.817 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.817 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.817 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.817 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.818 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.818 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.818 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.818 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.818 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.819 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.819 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.819 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.819 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.819 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.820 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.820 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.820 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.820 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.820 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.820 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.821 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.821 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.821 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.821 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.821 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.822 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.822 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.822 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.822 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.822 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.823 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.823 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.823 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.823 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.823 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.824 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.824 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.824 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.824 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.824 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_service 2023-10-31T23:20:28.824 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.825 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.825 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.825 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.825 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.825 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.826 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.826 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.826 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.826 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.826 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.826 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.827 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.827 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.827 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.827 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.827 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.828 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.828 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.828 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.828 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.828 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.829 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.829 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.829 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.829 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.829 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.829 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.830 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.830 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.830 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.830 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.830 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.831 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.831 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.831 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.831 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.831 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.832 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.832 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.832 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.832 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.832 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.832 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.833 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.833 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.833 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.833 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.833 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.834 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.834 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.834 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.834 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.834 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.835 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.835 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.835 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2023-10-31T23:20:28.835 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2023-10-31T23:20:28.835 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_watch_notify_pp 2023-10-31T23:20:28.836 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.836 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84498/exe 2023-10-31T23:20:28.836 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_service 2023-10-31T23:20:28.836 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84668 2023-10-31T23:20:28.836 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_service on pid 84668' 2023-10-31T23:20:28.837 INFO:tasks.workunit.client.0.smithi008.stdout:test api_service on pid 84668 2023-10-31T23:20:28.843 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84668 2023-10-31T23:20:28.843 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.843 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.844 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.844 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.844 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.844 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.844 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2023-10-31T23:20:28.845 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.845 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.845 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.845 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.845 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.846 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.846 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.846 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.846 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_service_pp 2023-10-31T23:20:28.846 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.847 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.847 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.847 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.847 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_service_pp' 2023-10-31T23:20:28.847 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.847 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.848 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.848 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.848 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.848 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.848 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.849 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.849 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.849 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.849 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.849 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.850 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_service_pp 2023-10-31T23:20:28.850 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.850 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.850 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.850 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.853 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.853 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_watch_notify 2023-10-31T23:20:28.853 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_watch_notify.log 2023-10-31T23:20:28.854 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.854 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.854 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.854 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.854 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.855 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.855 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.855 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84522/exe 2023-10-31T23:20:28.855 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.855 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.855 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.856 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.856 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.856 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.856 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.856 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.857 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.857 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.857 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.857 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.857 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.857 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.858 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.858 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_watch_notify: /' 2023-10-31T23:20:28.858 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.858 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.858 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.859 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.859 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.859 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.859 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.859 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.859 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.860 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.860 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.860 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_service_pp 2023-10-31T23:20:28.860 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84684 2023-10-31T23:20:28.860 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_service_pp on pid 84684' 2023-10-31T23:20:28.861 INFO:tasks.workunit.client.0.smithi008.stdout:test api_service_pp on pid 84684 2023-10-31T23:20:28.863 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84684 2023-10-31T23:20:28.863 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.864 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.864 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.864 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.864 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.864 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.865 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.865 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.865 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.865 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.865 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.866 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.866 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.866 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.866 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.866 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2023-10-31T23:20:28.867 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.867 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.867 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.867 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.867 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.867 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.868 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.868 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.868 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.868 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.264+0000 7fefb6a2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:28.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2023-10-31T23:20:28.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [----------] Global test environment set-up. 2023-10-31T23:20:28.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [----------] 12 tests from AsioRados 2023-10-31T23:20:28.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.365+0000 7fefb6a2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:28.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.366+0000 7fefb6a2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:28.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.366+0000 7fefb6a2f640 1 Processor -- start 2023-10-31T23:20:28.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.366+0000 7fefb6a2f640 1 -- start start 2023-10-31T23:20:28.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.367+0000 7fefb6a2f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d6630660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:20:28.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.367+0000 7fefb6a2f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d65e8010 con 0x5604d66e9bf0 2023-10-31T23:20:28.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.368+0000 7fefaef9a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d6630660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:20:28.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.368+0000 7fefaef9a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d6630660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37224/0 (socket says 172.21.15.8:37224) 2023-10-31T23:20:28.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.368+0000 7fefaef9a640 1 -- 172.21.15.8:0/3105925734 learned_addr learned my addr 172.21.15.8:0/3105925734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:20:28.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.370+0000 7fefaef9a640 1 -- 172.21.15.8:0/3105925734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604d658f630 con 0x5604d66e9bf0 2023-10-31T23:20:28.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.370+0000 7fefaef9a640 1 --2- 172.21.15.8:0/3105925734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d6630660 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad3352fb5460194 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:20:28.872 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.410+0000 7fefad797640 1 -- 172.21.15.8:0/3105925734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fefa400a970 con 0x5604d66e9bf0 2023-10-31T23:20:28.872 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.410+0000 7fefad797640 1 -- 172.21.15.8:0/3105925734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fefa400aad0 con 0x5604d66e9bf0 2023-10-31T23:20:28.872 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.410+0000 7fefad797640 1 -- 172.21.15.8:0/3105925734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fefa400ad70 con 0x5604d66e9bf0 2023-10-31T23:20:28.872 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.414+0000 7fefb6a2f640 1 -- 172.21.15.8:0/3105925734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 msgr2=0x5604d6630660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:20:28.872 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.414+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/3105925734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d6630660 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:20:28.872 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.414+0000 7fefb6a2f640 1 -- 172.21.15.8:0/3105925734 shutdown_connections 2023-10-31T23:20:28.880 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.880 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.880 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.880 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.880 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.881 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.881 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_cmd 2023-10-31T23:20:28.881 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_c_write_operations 2023-10-31T23:20:28.881 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_c_write_operations' 2023-10-31T23:20:28.881 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.882 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.882 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.882 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.882 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.882 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.883 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.883 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.883 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.883 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.883 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.883 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.884 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.884 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.884 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.884 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.884 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.885 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.885 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.885 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.885 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.885 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.886 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.886 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.886 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.886 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.886 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.886 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.887 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.887 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.887 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.887 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.887 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_cmd: /' 2023-10-31T23:20:28.888 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.888 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.888 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.888 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.888 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.888 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.889 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.889 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.889 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.889 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.889 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.890 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.890 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.890 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.890 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.890 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.891 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_cmd.log 2023-10-31T23:20:28.891 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_c_write_operations 2023-10-31T23:20:28.891 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.891 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.891 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.892 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.892 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.892 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.892 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.892 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.892 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.893 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.893 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.893 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.893 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.893 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.894 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.894 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.894 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.894 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.894 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.894 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.895 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.895 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.895 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_c_write_operations 2023-10-31T23:20:28.895 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.895 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84750 2023-10-31T23:20:28.896 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.414+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/3105925734 >> [v2:172.21.test api_c_write_operations on pid 84750 2023-10-31T23:20:28.901 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_c_write_operations on pid 84750' 2023-10-31T23:20:28.901 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84750 2023-10-31T23:20:28.902 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.902 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.902 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.902 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.903 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.904 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.904 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_c_read_operations 2023-10-31T23:20:28.904 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.904 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.905 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.905 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_c_read_operations' 2023-10-31T23:20:28.905 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.905 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.905 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.905 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.906 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.906 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.906 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.906 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.906 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.907 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.907 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.907 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.907 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.907 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.908 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.908 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.908 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.908 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.908 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_c_read_operations 2023-10-31T23:20:28.909 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.909 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.909 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.909 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.909 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.910 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.910 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.910 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.910 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.910 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.911 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.911 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.911 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.911 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.911 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.911 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.912 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.912 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.912 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.912 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.912 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.913 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.913 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.913 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.913 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.913 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.914 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.914 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.914 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.914 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.914 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.914 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.915 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2023-10-31T23:20:28.915 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_c_read_operations 2023-10-31T23:20:28.915 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84770 2023-10-31T23:20:28.915 INFO:tasks.workunit.client.0.smithi008.stdout:test api_c_read_operations on pid 84770 2023-10-31T23:20:28.922 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_c_read_operations on pid 84770' 2023-10-31T23:20:28.923 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84770 2023-10-31T23:20:28.923 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.923 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.923 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.923 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.924 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.924 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.924 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.924 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.924 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.925 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.925 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s api_cls_remote_reads 2023-10-31T23:20:28.925 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.925 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.925 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' api_cls_remote_reads' 2023-10-31T23:20:28.925 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.926 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.926 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.926 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.926 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.927 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.927 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.927 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.927 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.927 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.927 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.928 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.928 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.928 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.928 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.928 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.929 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.929 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.929 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.929 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.929 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.929 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.930 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.930 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.930 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.930 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.931 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.931 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.931 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.931 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo api_cls_remote_reads 2023-10-31T23:20:28.931 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.932 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.932 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.932 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.932 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.932 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.932 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.933 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.933 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.933 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84668/exe 2023-10-31T23:20:28.933 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.933 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.934 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.934 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.934 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.934 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.934 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.935 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.935 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:28.935 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:28.935 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:28.935 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.936 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.936 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.936 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.936 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.936 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.937 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.937 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.937 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.937 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=api_cls_remote_reads 2023-10-31T23:20:28.937 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.937 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.938 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:28.938 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.938 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84795 2023-10-31T23:20:28.938 INFO:tasks.workunit.client.0.smithi008.stdout:test api_cls_remote_reads on pid 84795 2023-10-31T23:20:28.955 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test api_cls_remote_reads on pid 84795' 2023-10-31T23:20:28.955 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84795 2023-10-31T23:20:28.955 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:28.955 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:28.955 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:28.956 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:28.956 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.956 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_service 2023-10-31T23:20:28.956 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.956 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.957 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.957 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.957 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:28.957 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.957 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2023-10-31T23:20:28.958 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.958 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.958 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.958 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.959 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.959 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:28.959 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.959 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.959 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.959 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.960 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.960 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.960 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.960 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:28.960 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.961 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:28.961 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:28.961 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.961 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.961 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.962 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.962 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.962 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.962 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:28.962 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_service: /' 2023-10-31T23:20:28.963 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2023-10-31T23:20:28.963 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.963 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.963 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.963 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.963 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.964 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.964 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.964 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.964 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.964 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:28.965 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.965 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.965 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.965 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.965 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:28.966 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.966 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.966 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.966 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.966 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.967 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.967 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:28.967 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.967 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.967 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:28.967 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:28.968 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.968 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.968 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.968 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.968 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:28.969 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:28.969 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.969 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:28.969 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.969 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.970 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:28.970 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:28.970 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:28.970 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:28.970 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.971 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:28.971 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.971 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:28.971 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:28.971 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.972 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:28.972 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.972 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:28.972 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.972 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:28.973 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.973 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:28.973 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.973 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:28.973 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.974 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.974 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.974 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.974 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.974 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.975 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.975 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.975 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.975 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.975 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.976 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.976 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.976 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.976 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.976 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.977 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.977 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.977 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.977 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.977 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.977 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:28.978 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:28.978 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:28.978 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:28.978 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:28.978 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.979 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:28.979 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:28.979 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:28.979 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:28.979 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:28.980 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.980 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:28.980 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.980 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:28.980 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:28.980 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.981 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:28.981 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.981 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.981 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.981 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.981 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:28.982 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.982 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.982 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.982 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.982 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.983 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.983 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_service.log 2023-10-31T23:20:28.983 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.983 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.983 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.984 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.984 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.984 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.984 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.984 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.984 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.985 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.985 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:28.985 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.985 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s list_parallel 2023-10-31T23:20:28.985 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84619/exe 2023-10-31T23:20:28.986 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' list_parallel' 2023-10-31T23:20:28.986 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:28.986 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:28.986 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:28.986 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:28.986 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.987 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:28.987 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.987 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:28.987 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:28.987 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.988 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:28.988 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.988 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:28.988 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.988 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:28.989 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:28.989 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:28.989 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.989 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.989 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.990 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:28.990 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.990 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.990 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:28.990 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.991 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:28.991 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:28.991 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.991 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:28.991 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:28.991 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:28.992 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:28.992 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.992 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:28.992 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:28.992 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:28.993 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.993 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:28.993 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.993 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:28.993 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.994 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_cmd_pp 2023-10-31T23:20:28.994 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo list_parallel 2023-10-31T23:20:28.994 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:28.994 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:28.994 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:28.994 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:28.995 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:28.995 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:28.995 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:28.995 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:28.995 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:28.996 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=list_parallel 2023-10-31T23:20:28.996 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84837 2023-10-31T23:20:28.996 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test list_parallel on pid 84837' 2023-10-31T23:20:28.996 INFO:tasks.workunit.client.0.smithi008.stdout:test list_parallel on pid 84837 2023-10-31T23:20:29.003 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84837 2023-10-31T23:20:29.003 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:29.003 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:29.004 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s open_pools_parallel 2023-10-31T23:20:29.004 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2023-10-31T23:20:29.004 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' open_pools_parallel' 2023-10-31T23:20:29.004 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84684/exe 2023-10-31T23:20:29.005 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_cmd_pp: /' 2023-10-31T23:20:29.005 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2023-10-31T23:20:29.005 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo open_pools_parallel 2023-10-31T23:20:29.005 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:29.005 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:29.006 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:29.006 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:29.006 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:29.006 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:29.006 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:29.007 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:29.007 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.007 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:29.007 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:29.007 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:29.007 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:29.008 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.008 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:29.008 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:29.008 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:29.009 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:29.009 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:29.009 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.009 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:29.009 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:29.010 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:29.010 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:29.010 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:29.010 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:29.010 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.010 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:29.011 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:29.011 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:29.011 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_service_pp: /' 2023-10-31T23:20:29.011 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.011 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:29.012 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.012 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:29.012 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_service_pp 2023-10-31T23:20:29.012 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:29.012 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.013 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.013 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:29.013 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:29.013 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:29.013 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:29.014 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.014 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:29.014 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.014 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:29.014 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:29.015 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.015 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:29.015 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.015 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:29.015 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.016 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:29.016 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.016 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:29.016 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.016 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:29.017 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.017 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:29.017 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:29.017 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:29.017 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:29.018 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_service_pp.log 2023-10-31T23:20:29.018 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:29.018 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:29.018 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=open_pools_parallel 2023-10-31T23:20:29.018 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:29.019 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84867 2023-10-31T23:20:29.019 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test open_pools_parallel on pid 84867' 2023-10-31T23:20:29.019 INFO:tasks.workunit.client.0.smithi008.stdout:test open_pools_parallel on pid 84867 2023-10-31T23:20:29.029 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84867 2023-10-31T23:20:29.029 INFO:tasks.workunit.client.0.smithi008.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-10-31T23:20:29.029 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:29.029 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:29.029 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.030 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:29.030 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.030 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:29.030 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:29.030 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.031 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:29.031 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.031 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:29.031 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:29.031 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:29.032 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.032 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:29.032 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.032 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:29.032 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:29.033 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.033 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:29.033 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.033 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:29.033 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.034 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:29.034 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.034 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:29.034 INFO:tasks.workunit.client.0.smithi008.stderr:++ printf %25s delete_pools_parallel 2023-10-31T23:20:29.034 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:29.035 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:29.035 INFO:tasks.workunit.client.0.smithi008.stderr:+ r=' delete_pools_parallel' 2023-10-31T23:20:29.035 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:29.035 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:29.035 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.036 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:29.036 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.036 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:29.036 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.036 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:29.037 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2023-10-31T23:20:29.037 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.037 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:29.037 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.037 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:29.038 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:29.038 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:29.038 INFO:tasks.workunit.client.0.smithi008.stderr:++ awk '{print $1}' 2023-10-31T23:20:29.038 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:29.038 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:29.039 INFO:tasks.workunit.client.0.smithi008.stderr:++ echo delete_pools_parallel 2023-10-31T23:20:29.039 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:29.039 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:29.039 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.039 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:29.039 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:29.040 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:29.040 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:29.040 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:29.040 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:29.041 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.041 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:29.041 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:29.041 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.041 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.042 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:29.042 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:29.042 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.042 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:29.042 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:29.042 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.043 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:29.043 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.043 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.043 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:29.043 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.043 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:29.044 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.044 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:29.044 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:29.044 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:29.044 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:29.045 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.045 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:29.045 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.045 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:29.045 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.046 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.046 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:29.046 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:29.046 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.046 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:29.047 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.047 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:29.047 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:29.047 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:29.047 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:29.048 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:29.048 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.048 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:29.048 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.048 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:29.048 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:29.049 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:29.049 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.049 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:29.049 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.049 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:29.050 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:29.050 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:29.050 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.050 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:29.050 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.051 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:29.051 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.051 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84750/exe 2023-10-31T23:20:29.051 INFO:tasks.workunit.client.0.smithi008.stderr:+ ff=delete_pools_parallel 2023-10-31T23:20:29.051 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84883 2023-10-31T23:20:29.052 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo 'test delete_pools_parallel on pid 84883' 2023-10-31T23:20:29.052 INFO:tasks.workunit.client.0.smithi008.stdout:test delete_pools_parallel on pid 84883 2023-10-31T23:20:29.080 INFO:tasks.workunit.client.0.smithi008.stderr:+ pids[$f]=84883 2023-10-31T23:20:29.081 INFO:tasks.workunit.client.0.smithi008.stderr:+ ret=0 2023-10-31T23:20:29.081 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' 1 -eq 1 ']' 2023-10-31T23:20:29.081 INFO:tasks.workunit.client.0.smithi008.stderr:+ for t in "${!pids[@]}" 2023-10-31T23:20:29.081 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84287 2023-10-31T23:20:29.081 INFO:tasks.workunit.client.0.smithi008.stderr:+ wait 84287 2023-10-31T23:20:29.082 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:29.082 INFO:tasks.workunit.client.0.smithi008.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2023-10-31T23:20:29.082 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:29.082 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:29.082 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:29.083 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:29.083 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:29.083 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:29.083 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:29.083 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:29.084 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:29.084 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:29.084 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:29.084 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:29.084 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:29.085 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.085 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:29.085 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:29.085 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.085 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:29.086 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:29.086 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:29.086 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.086 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:29.086 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.086 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -f /etc/bashrc ']' 2023-10-31T23:20:29.087 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_c_write_operations 2023-10-31T23:20:29.087 INFO:tasks.workunit.client.0.smithi008.stderr:+ . /etc/bashrc 2023-10-31T23:20:29.087 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:29.087 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:29.087 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:29.088 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -z '' ']' 2023-10-31T23:20:29.088 INFO:tasks.workunit.client.0.smithi008.stderr:++ BASHRCSOURCED=Y 2023-10-31T23:20:29.088 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.088 INFO:tasks.workunit.client.0.smithi008.stderr:++ shopt -q login_shell 2023-10-31T23:20:29.088 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.089 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:29.089 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.089 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:29.089 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.089 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:29.090 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:29.090 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2023-10-31T23:20:29.090 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:29.090 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.090 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:29.091 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.091 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:29.091 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:29.091 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.091 INFO:tasks.workunit.client.0.smithi008.stderr:+++ umask 2023-10-31T23:20:29.091 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' 0022 -eq 0 ']' 2023-10-31T23:20:29.092 INFO:tasks.workunit.client.0.smithi008.stderr:++ SHELL=/bin/bash 2023-10-31T23:20:29.092 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.092 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-10-31T23:20:29.092 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.092 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/bash_completion.sh 2023-10-31T23:20:29.093 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-10-31T23:20:29.093 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.093 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-10-31T23:20:29.093 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.093 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/cobbler.sh 2023-10-31T23:20:29.094 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:29.094 INFO:tasks.workunit.client.0.smithi008.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-10-31T23:20:29.094 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.094 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-10-31T23:20:29.094 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.095 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorgrep.sh 2023-10-31T23:20:29.095 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.095 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.095 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:29.095 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.096 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:29.096 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:29.096 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:29.096 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:29.096 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:29.097 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:29.097 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.097 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:29.097 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.097 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:29.097 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:29.098 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.098 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:29.098 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:29.098 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:29.098 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.099 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:29.099 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.099 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:29.099 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:29.099 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.100 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.100 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:29.100 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.100 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:29.100 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.101 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:29.101 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:29.101 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.101 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:29.101 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.101 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:29.102 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:29.102 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:29.102 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:29.102 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:29.102 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.103 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:29.103 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.103 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:29.103 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:29.103 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.103 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_c_write_operations: /' 2023-10-31T23:20:29.104 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:29.104 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.104 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:29.104 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.104 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:29.105 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.105 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:29.105 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:29.105 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84795/exe 2023-10-31T23:20:29.105 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:29.105 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:29.106 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:29.106 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:29.106 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:29.106 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.106 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:29.107 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.107 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:29.107 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:29.107 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.108 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:29.108 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.108 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:29.108 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.108 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:29.109 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.109 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:29.109 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:29.109 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:29.109 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:29.109 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:29.110 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:29.110 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:29.110 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:29.110 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:29.110 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:29.111 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:29.111 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:29.111 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:29.111 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.111 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:29.112 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.112 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:29.112 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_cls_remote_reads 2023-10-31T23:20:29.112 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:29.112 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2023-10-31T23:20:29.113 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.113 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:29.113 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.113 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:29.113 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:29.113 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:29.114 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.114 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:29.114 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.114 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:29.114 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:29.115 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'grep=grep --color=auto' 2023-10-31T23:20:29.115 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'egrep=egrep --color=auto' 2023-10-31T23:20:29.115 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-10-31T23:20:29.115 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.116 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-10-31T23:20:29.116 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.116 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorls.sh 2023-10-31T23:20:29.116 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' '!' -t 0 ']' 2023-10-31T23:20:29.116 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:29.117 INFO:tasks.workunit.client.0.smithi008.stderr:+++ return 2023-10-31T23:20:29.117 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:29.117 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:29.117 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.117 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:29.118 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.118 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.118 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:29.118 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:29.118 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.119 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-10-31T23:20:29.119 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:29.119 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.119 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-10-31T23:20:29.119 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.120 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:29.120 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export S_COLORS=auto 2023-10-31T23:20:29.120 INFO:tasks.workunit.client.0.smithi008.stderr:+++ S_COLORS=auto 2023-10-31T23:20:29.120 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.120 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.121 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-10-31T23:20:29.121 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:29.121 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.121 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.121 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:29.121 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-10-31T23:20:29.122 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.122 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:29.122 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.122 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:29.122 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.123 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:29.123 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:29.123 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:29.123 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84837/exe 2023-10-31T23:20:29.123 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:29.124 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:29.124 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.124 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:29.124 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.124 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:29.124 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:29.125 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.125 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.125 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:29.125 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.125 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:29.126 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:29.126 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.126 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:29.126 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:29.126 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.126 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:29.127 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.127 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:29.127 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:29.127 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2023-10-31T23:20:29.127 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:29.128 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:29.128 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:29.128 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:29.128 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84770/exe 2023-10-31T23:20:29.128 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:29.129 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:29.129 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:29.129 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:29.129 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:29.129 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:29.129 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:29.130 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_list_parallel 2023-10-31T23:20:29.130 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:29.130 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:29.130 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:29.130 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:29.131 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:29.131 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:29.131 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:29.131 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:29.131 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:29.132 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:29.132 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_api_c_read_operations 2023-10-31T23:20:29.132 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:29.132 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:29.132 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:29.132 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:29.133 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.133 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:29.133 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.133 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:29.133 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:29.134 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.134 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.134 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:29.134 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.134 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:29.134 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.135 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:29.135 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:29.135 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.135 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:29.135 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.136 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:29.136 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:29.136 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-10-31T23:20:29.136 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-10-31T23:20:29.136 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-10-31T23:20:29.137 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.137 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-10-31T23:20:29.137 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.137 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-10-31T23:20:29.137 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-10-31T23:20:29.138 INFO:tasks.workunit.client.0.smithi008.stderr:+++ /usr/libexec/grepconf.sh -c 2023-10-31T23:20:29.138 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84867/exe 2023-10-31T23:20:29.138 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:29.138 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:29.138 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:29.139 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ api_c_read_operations: /' 2023-10-31T23:20:29.139 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:29.139 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:29.139 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:29.139 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:29.139 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_list_parallel.log 2023-10-31T23:20:29.140 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:29.140 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:29.140 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:29.140 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:29.140 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2023-10-31T23:20:29.141 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ list_parallel: /' 2023-10-31T23:20:29.141 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_open_pools_parallel 2023-10-31T23:20:29.141 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-10-31T23:20:29.141 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-10-31T23:20:29.141 INFO:tasks.workunit.client.0.smithi008.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-10-31T23:20:29.142 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.142 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-10-31T23:20:29.142 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.142 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/debuginfod.sh 2023-10-31T23:20:29.142 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2023-10-31T23:20:29.143 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-10-31T23:20:29.143 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.143 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-10-31T23:20:29.143 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.143 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/gawk.sh 2023-10-31T23:20:29.144 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ open_pools_parallel: /' 2023-10-31T23:20:29.144 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.144 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-10-31T23:20:29.144 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.144 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/lang.sh 2023-10-31T23:20:29.144 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup 2023-10-31T23:20:29.145 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/locale 2023-10-31T23:20:29.145 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.145 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG_backup=en_US.UTF-8 2023-10-31T23:20:29.145 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.145 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /etc/locale.conf ']' 2023-10-31T23:20:29.145 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -x /usr/bin/sed ']' 2023-10-31T23:20:29.146 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: 2023-10-31T23:20:28.549+0000 7f55d5e2e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:29.146 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: 2023-10-31T23:20:28.550+0000 7f55d5e2e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:29.146 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: 2023-10-31T23:20:28.550+0000 7f55d5e2e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:29.147 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2023-10-31T23:20:29.147 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2023-10-31T23:20:29.147 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2023-10-31T23:20:29.147 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2023-10-31T23:20:29.147 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/cls_remote_reads.cc:13: Skipped 2023-10-31T23:20:29.148 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: Not supported by crimson yet. Skipped 2023-10-31T23:20:29.148 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2023-10-31T23:20:29.148 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (0 ms total) 2023-10-31T23:20:29.148 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: 2023-10-31T23:20:29.148 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2023-10-31T23:20:29.149 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (0 ms total) 2023-10-31T23:20:29.149 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [ PASSED ] 0 tests. 2023-10-31T23:20:29.149 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [ SKIPPED ] 1 test, listed below: 2023-10-31T23:20:29.149 INFO:tasks.workunit.client.0.smithi008.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather 2023-10-31T23:20:29.153 INFO:tasks.workunit.client.0.smithi008.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-10-31T23:20:29.153 INFO:tasks.workunit.client.0.smithi008.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-10-31T23:20:29.153 INFO:tasks.workunit.client.0.smithi008.stderr:++++ export LANG=en_US.UTF-8 2023-10-31T23:20:29.153 INFO:tasks.workunit.client.0.smithi008.stderr:++++ LANG=en_US.UTF-8 2023-10-31T23:20:29.154 INFO:tasks.workunit.client.0.smithi008.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-10-31T23:20:29.154 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-10-31T23:20:29.154 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.154 INFO:tasks.workunit.client.0.smithi008.stderr:+++ LANG=en_US.UTF-8 2023-10-31T23:20:29.154 INFO:tasks.workunit.client.0.smithi008.stderr:+++ unset LANG_backup config 2023-10-31T23:20:29.155 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n '' ']' 2023-10-31T23:20:29.155 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-10-31T23:20:29.155 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' dumb = linux ']' 2023-10-31T23:20:29.155 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.155 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-10-31T23:20:29.156 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.156 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/less.sh 2023-10-31T23:20:29.156 INFO:tasks.workunit.client.0.smithi008.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-10-31T23:20:29.156 INFO:tasks.workunit.client.0.smithi008.stderr:++ for i in /etc/profile.d/*.sh 2023-10-31T23:20:29.156 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-10-31T23:20:29.156 INFO:tasks.workunit.client.0.smithi008.stderr:++ '[' '' ']' 2023-10-31T23:20:29.157 INFO:tasks.workunit.client.0.smithi008.stderr:++ . /etc/profile.d/which2.sh 2023-10-31T23:20:29.157 INFO:tasks.workunit.client.0.smithi008.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-10-31T23:20:29.157 INFO:tasks.workunit.client.0.smithi008.stderr:+++++ readlink /proc/84883/exe 2023-10-31T23:20:29.157 INFO:tasks.workunit.client.0.smithi008.stderr:++++ basename /usr/bin/bash 2023-10-31T23:20:29.157 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_declare='declare -f' 2023-10-31T23:20:29.158 INFO:tasks.workunit.client.0.smithi008.stderr:+++ which_opt=-f 2023-10-31T23:20:29.158 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export which_declare 2023-10-31T23:20:29.158 INFO:tasks.workunit.client.0.smithi008.stderr:+++ export -f which 2023-10-31T23:20:29.158 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset i 2023-10-31T23:20:29.158 INFO:tasks.workunit.client.0.smithi008.stderr:++ unset -f pathmunge 2023-10-31T23:20:29.159 INFO:tasks.workunit.client.0.smithi008.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-10-31T23:20:29.159 INFO:tasks.workunit.client.0.smithi008.stderr:+ export PATH 2023-10-31T23:20:29.159 INFO:tasks.workunit.client.0.smithi008.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-10-31T23:20:29.159 INFO:tasks.workunit.client.0.smithi008.stderr:+ unset rc 2023-10-31T23:20:29.159 INFO:tasks.workunit.client.0.smithi008.stderr:+ ceph_test_rados_delete_pools_parallel 2023-10-31T23:20:29.160 INFO:tasks.workunit.client.0.smithi008.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2023-10-31T23:20:29.160 INFO:tasks.workunit.client.0.smithi008.stderr:+ sed 's/^/ delete_pools_parallel: /' 2023-10-31T23:20:29.160 INFO:tasks.workunit.client.0.smithi008.stdout:15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d6630660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:20:29.160 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.414+0000 7fefb6a2f640 1 -- 172.21.15.8:0/3105925734 >> 172.21.15.8:0/3105925734 conn(0x5604d6562d80 msgr2=0x5604d66eb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:20:29.160 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.414+0000 7fefb6a2f640 1 -- 172.21.15.8:0/3105925734 shutdown_connections 2023-10-31T23:20:29.161 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.414+0000 7fefb6a2f640 1 -- 172.21.15.8:0/3105925734 wait complete. 2023-10-31T23:20:29.161 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.422+0000 7fefb6a2f640 1 Processor -- start 2023-10-31T23:20:29.161 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.422+0000 7fefb6a2f640 1 -- start start 2023-10-31T23:20:29.161 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.424+0000 7fefb6a2f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d67772b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:20:29.161 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.424+0000 7fefb6a2f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d65831e0 con 0x5604d66e9bf0 2023-10-31T23:20:29.162 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.424+0000 7fefaef9a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d67772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:20:29.162 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.424+0000 7fefaef9a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d67772b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37374/0 (socket says 172.21.15.8:37374) 2023-10-31T23:20:29.162 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.424+0000 7fefaef9a640 1 -- 172.21.15.8:0/852254332 learned_addr learned my addr 172.21.15.8:0/852254332 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-31T23:20:29.162 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.427+0000 7fefaef9a640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604d65827e0 con 0x5604d66e9bf0 2023-10-31T23:20:29.162 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.427+0000 7fefaef9a640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d67772b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:20:29.163 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.538+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fefa400f040 con 0x5604d66e9bf0 2023-10-31T23:20:29.163 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.538+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5604d6582240 con 0x5604d66e9bf0 2023-10-31T23:20:29.163 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.538+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604d6779480 con 0x5604d66e9bf0 2023-10-31T23:20:29.163 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.578+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fefa4010040 con 0x5604d66e9bf0 2023-10-31T23:20:29.163 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.578+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fefa4008e50 con 0x5604d66e9bf0 2023-10-31T23:20:29.164 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.583+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 44855+0+0 (crc 0 0 0) 0x7fefa40073d0 con 0x5604d66e9bf0 2023-10-31T23:20:33.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.584+0000 7fef97fff640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fef9c036 api_tier_pp: 2023-10-31T23:20:28.358+0000 7f3d0d839940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:33.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: 2023-10-31T23:20:28.358+0000 7f3d0d839940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:33.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2023-10-31T23:20:33.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] Global test environment set-up. 2023-10-31T23:20:33.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2023-10-31T23:20:33.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: seed 84449 2023-10-31T23:20:33.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: 2023-10-31T23:20:28.359+0000 7f3d0d839940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:33.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2023-10-31T23:20:33.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:287: Skipped 2023-10-31T23:20:33.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2023-10-31T23:20:33.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2023-10-31T23:20:33.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:2182: Skipped 2023-10-31T23:20:33.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2023-10-31T23:20:33.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2023-10-31T23:20:33.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:2561: Skipped 2023-10-31T23:20:33.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2023-10-31T23:20:33.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (0 ms total) 2023-10-31T23:20:33.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: 2023-10-31T23:20:33.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2023-10-31T23:20:33.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2023-10-31T23:20:33.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2023-10-31T23:20:33.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2023-10-31T23:20:33.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2023-10-31T23:20:33.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2023-10-31T23:20:33.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2023-10-31T23:20:33.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-10-31T23:20:33.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2023-10-31T23:20:33.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-10-31T23:20:33.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2023-10-31T23:20:33.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2023-10-31T23:20:33.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2023-10-31T23:20:33.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-10-31T23:20:33.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2023-10-31T23:20:33.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2023-10-31T23:20:33.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2023-10-31T23:20:33.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2023-10-31T23:20:33.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2023-10-31T23:20:33.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2023-10-31T23:20:33.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2023-10-31T23:20:33.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2023-10-31T23:20:33.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2023-10-31T23:20:33.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-10-31T23:20:33.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2023-10-31T23:20:33.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2023-10-31T23:20:33.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2023-10-31T23:20:33.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2023-10-31T23:20:33.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2023-10-31T23:20:33.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2023-10-31T23:20:33.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2023-10-31T23:20:33.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-10-31T23:20:33.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2023-10-31T23:20:33.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-10-31T23:20:33.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2023-10-31T23:20:33.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2023-10-31T23:20:33.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2023-10-31T23:20:33.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2023-10-31T23:20:33.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2023-10-31T23:20:33.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2023-10-31T23:20:33.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2023-10-31T23:20:33.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-10-31T23:20:33.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2023-10-31T23:20:33.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2023-10-31T23:20:33.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2023-10-31T23:20:33.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2023-10-31T23:20:33.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2023-10-31T23:20:33.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2023-10-31T23:20:33.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2023-10-31T23:20:33.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-10-31T23:20:33.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2023-10-31T23:20:33.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2023-10-31T23:20:33.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2023-10-31T23:20:33.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2023-10-31T23:20:33.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2023-10-31T23:20:33.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-10-31T23:20:33.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2023-10-31T23:20:33.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-10-31T23:20:33.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2023-10-31T23:20:33.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-10-31T23:20:33.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (1 ms) 2023-10-31T23:20:33.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-10-31T23:20:33.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2023-10-31T23:20:33.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-10-31T23:20:33.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2023-10-31T23:20:33.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-10-31T23:20:33.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2023-10-31T23:20:33.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-10-31T23:20:33.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2023-10-31T23:20:33.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2023-10-31T23:20:33.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2023-10-31T23:20:33.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-10-31T23:20:33.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2023-10-31T23:20:33.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-10-31T23:20:33.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2023-10-31T23:20:33.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2023-10-31T23:20:33.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2023-10-31T23:20:33.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-10-31T23:20:33.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2023-10-31T23:20:33.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-10-31T23:20:33.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2023-10-31T23:20:33.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-10-31T23:20:33.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2023-10-31T23:20:33.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-10-31T23:20:33.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2023-10-31T23:20:33.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2023-10-31T23:20:33.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2023-10-31T23:20:33.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-10-31T23:20:33.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.298 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:33.298 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:33.298 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2023-10-31T23:20:33.298 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-10-31T23:20:33.298 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:33.299 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:34.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2023-10-31T23:20:34.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-10-31T23:20:34.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:34.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:34.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2023-10-31T23:20:34.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-10-31T23:20:34.249 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:34.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:34.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2023-10-31T23:20:34.250 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-10-31T23:20:34.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:223: Skipped 2023-10-31T23:20:34.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:233: Skipped 2023-10-31T23:20:34.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2023-10-31T23:20:34.251 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2023-10-31T23:20:34.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: 2023-10-31T23:20:34.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2023-10-31T23:20:34.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:373: Skipped 2023-10-31T23:20:34.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.252 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2023-10-31T23:20:34.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-31T23:20:34.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-31T23:20:34.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.253 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2023-10-31T23:20:34.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2023-10-31T23:20:34.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-31T23:20:34.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-31T23:20:34.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.254 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2023-10-31T23:20:34.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2023-10-31T23:20:34.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-31T23:20:34.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-31T23:20:34.255 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2023-10-31T23:20:34.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2023-10-31T23:20:34.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:387: Skipped 2023-10-31T23:20:34.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.256 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:400: Skipped 2023-10-31T23:20:34.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2023-10-31T23:20:34.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/testcase_cxx.cc:381: Skipped 2023-10-31T23:20:34.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (0 ms total) 2023-10-31T23:20:34.257 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: 2023-10-31T23:20:34.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2023-10-31T23:20:34.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6267: Skipped 2023-10-31T23:20:34.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2023-10-31T23:20:34.258 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2023-10-31T23:20:34.259 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2023-10-31T23:20:34.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2023-10-31T23:20:34.260 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2023-10-31T23:20:34.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.261 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2023-10-31T23:20:34.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-10-31T23:20:34.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.262 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2023-10-31T23:20:34.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2023-10-31T23:20:34.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.263 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2023-10-31T23:20:34.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2023-10-31T23:20:34.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.264 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2023-10-31T23:20:34.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2023-10-31T23:20:34.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.265 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2023-10-31T23:20:34.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2023-10-31T23:20:34.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.266 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2023-10-31T23:20:34.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2023-10-31T23:20:34.267 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2023-10-31T23:20:34.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2023-10-31T23:20:34.268 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2023-10-31T23:20:34.269 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2023-10-31T23:20:34.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.270 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2023-10-31T23:20:34.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-10-31T23:20:34.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.271 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2023-10-31T23:20:34.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-10-31T23:20:34.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.272 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2023-10-31T23:20:34.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2023-10-31T23:20:34.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.273 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2023-10-31T23:20:34.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2023-10-31T23:20:34.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.274 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2023-10-31T23:20:34.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-10-31T23:20:34.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.275 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2023-10-31T23:20:34.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2023-10-31T23:20:34.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.276 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2023-10-31T23:20:34.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2023-10-31T23:20:34.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.277 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2023-10-31T23:20:34.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-10-31T23:20:34.278 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2023-10-31T23:20:34.279 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2023-10-31T23:20:34.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.280 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2023-10-31T23:20:34.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-10-31T23:20:34.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.281 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2023-10-31T23:20:34.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-10-31T23:20:34.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6278: Skipped 2023-10-31T23:20:34.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.282 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6288: Skipped 2023-10-31T23:20:34.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2023-10-31T23:20:34.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/tier_cxx.cc:6272: Skipped 2023-10-31T23:20:34.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-10-31T23:20:34.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2023-10-31T23:20:34.283 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: 2023-10-31T23:20:34.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [----------] Global test environment tear-down 2023-10-31T23:20:34.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (5885 ms total) 2023-10-31T23:20:34.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ PASSED ] 0 tests. 2023-10-31T23:20:34.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] 77 tests, listed below: 2023-10-31T23:20:34.284 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty 2023-10-31T23:20:34.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2023-10-31T23:20:34.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone 2023-10-31T23:20:34.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2023-10-31T23:20:34.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote 2023-10-31T23:20:34.285 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2023-10-31T23:20:34.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-10-31T23:20:34.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-10-31T23:20:34.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2023-10-31T23:20:34.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-10-31T23:20:34.286 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict 2023-10-31T23:20:34.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2023-10-31T23:20:34.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2023-10-31T23:20:34.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2023-10-31T23:20:34.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-10-31T23:20:34.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2023-10-31T23:20:34.287 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush 2023-10-31T23:20:34.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2023-10-31T23:20:34.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-10-31T23:20:34.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-10-31T23:20:34.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2023-10-31T23:20:34.288 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2023-10-31T23:20:34.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2023-10-31T23:20:34.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-10-31T23:20:34.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2023-10-31T23:20:34.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2023-10-31T23:20:34.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2023-10-31T23:20:34.289 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-10-31T23:20:34.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2023-10-31T23:20:34.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2023-10-31T23:20:34.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-10-31T23:20:34.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-10-31T23:20:34.290 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-10-31T23:20:34.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-10-31T23:20:34.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-10-31T23:20:34.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-10-31T23:20:34.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-10-31T23:20:34.291 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2023-10-31T23:20:34.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-10-31T23:20:34.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-10-31T23:20:34.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2023-10-31T23:20:34.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-10-31T23:20:34.292 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-10-31T23:20:34.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-10-31T23:20:34.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-10-31T23:20:34.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2023-10-31T23:20:34.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-10-31T23:20:34.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-10-31T23:20:34.293 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-10-31T23:20:34.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-10-31T23:20:34.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-10-31T23:20:34.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty 2023-10-31T23:20:34.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2023-10-31T23:20:34.294 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2023-10-31T23:20:34.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone 2023-10-31T23:20:34.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2023-10-31T23:20:34.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2023-10-31T23:20:34.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2023-10-31T23:20:34.295 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-10-31T23:20:34.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2023-10-31T23:20:34.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2023-10-31T23:20:34.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2023-10-31T23:20:34.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2023-10-31T23:20:34.296 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2023-10-31T23:20:34.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2023-10-31T23:20:34.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2023-10-31T23:20:34.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-10-31T23:20:34.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-10-31T23:20:34.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2023-10-31T23:20:34.297 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2023-10-31T23:20:34.298 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-10-31T23:20:34.298 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2023-10-31T23:20:34.299 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2023-10-31T23:20:34.299 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-10-31T23:20:34.299 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2023-10-31T23:20:34.299 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-10-31T23:20:34.299 INFO:tasks.workunit.client.0.smithi008.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-10-31T23:20:34.300 INFO:tasks.workunit.client.0.smithi008.stderr:+ for t in "${!pids[@]}" 2023-10-31T23:20:34.300 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84142 2023-10-31T23:20:34.300 INFO:tasks.workunit.client.0.smithi008.stderr:+ wait 84142 2023-10-31T23:20:36.015 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2023-10-31T23:20:36.015 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [----------] Global test environment set-up. 2023-10-31T23:20:36.015 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [----------] 4 tests from LibRadosService 2023-10-31T23:20:36.015 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2023-10-31T23:20:36.016 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:28.506+0000 7f728bc347c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:36.016 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:28.506+0000 7f728bc347c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:36.016 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:28.506+0000 7f728bc347c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:20:36.016 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5233 ms) 2023-10-31T23:20:36.017 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2023-10-31T23:20:36.017 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ OK ] LibRadosService.RegisterLate (37 ms) 2023-10-31T23:20:36.017 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2023-10-31T23:20:36.017 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: cluster: 2023-10-31T23:20:36.017 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: id: 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:20:36.017 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: health: HEALTH_WARN 2023-10-31T23:20:36.018 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 10 pool(s) do not have an application enabled 2023-10-31T23:20:36.018 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.018 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: services: 2023-10-31T23:20:36.018 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: mon: 1 daemons, quorum a (age 63s) 2023-10-31T23:20:36.018 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: mgr: x(active, since 59s) 2023-10-31T23:20:36.019 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: osd: 4 osds: 4 up (since 57s), 4 in (since 61s) 2023-10-31T23:20:36.019 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: laundry: 2 daemons active (1 hosts) 2023-10-31T23:20:36.019 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.019 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: data: 2023-10-31T23:20:36.019 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: pools: 28 pools, 841 pgs 2023-10-31T23:20:36.020 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: objects: 4 objects, 577 KiB 2023-10-31T23:20:36.020 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-10-31T23:20:36.020 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: pgs: 67.658% pgs unknown 2023-10-31T23:20:36.020 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 22.117% pgs not active 2023-10-31T23:20:36.020 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 569 unknown 2023-10-31T23:20:36.021 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 149 creating+activating 2023-10-31T23:20:36.021 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 85 active+clean 2023-10-31T23:20:36.021 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 37 creating+peering 2023-10-31T23:20:36.021 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 1 active 2023-10-31T23:20:36.021 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.022 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: io: 2023-10-31T23:20:36.022 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: client: 511 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-31T23:20:36.022 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.022 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.022 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: cluster: 2023-10-31T23:20:36.022 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: id: 6066336e-3d1f-4c2f-a6c3-128fa49e8f52 2023-10-31T23:20:36.023 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: health: HEALTH_WARN 2023-10-31T23:20:36.023 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 7 pool(s) do not have an application enabled 2023-10-31T23:20:36.023 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.023 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: services: 2023-10-31T23:20:36.023 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: mon: 1 daemons, quorum a (age 65s) 2023-10-31T23:20:36.024 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: mgr: x(active, since 61s) 2023-10-31T23:20:36.024 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: osd: 4 osds: 4 up (since 59s), 4 in (since 63s) 2023-10-31T23:20:36.024 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2023-10-31T23:20:36.024 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-10-31T23:20:36.024 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.025 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: data: 2023-10-31T23:20:36.025 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: pools: 27 pools, 809 pgs 2023-10-31T23:20:36.025 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: objects: 4 objects, 577 KiB 2023-10-31T23:20:36.025 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-10-31T23:20:36.026 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: pgs: 66.378% pgs unknown 2023-10-31T23:20:36.026 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 22.991% pgs not active 2023-10-31T23:20:36.026 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 537 unknown 2023-10-31T23:20:36.026 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 149 creating+activating 2023-10-31T23:20:36.026 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 85 active+clean 2023-10-31T23:20:36.027 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 37 creating+peering 2023-10-31T23:20:36.027 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 1 active 2023-10-31T23:20:36.027 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.027 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: io: 2023-10-31T23:20:36.027 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: client: 511 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-31T23:20:36.028 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:36.028 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:39.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-31T23:20:39.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-31T23:20:43.542 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ OK ] LibRadosService.StatusForm180 0x7fef9c038690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:20:43.542 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.587+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fefa4012450 con 0x5604d66e9bf0 2023-10-31T23:20:43.542 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.587+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefa802e6d0 con 0x5604d66e9bf0 2023-10-31T23:20:43.542 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.595+0000 7fefae799640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fef9c036180 0x7fef9c038690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-31T23:20:43.543 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.596+0000 7fefae799640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fef9c036180 0x7fef9c038690 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:20:43.543 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.738+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fefa4011e20 con 0x5604d66e9bf0 2023-10-31T23:20:43.543 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:28.738+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x5604d65f1f90 con 0x5604d66e9bf0 2023-10-31T23:20:43.543 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:29.207+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v16) v1 ==== 43+0+0 (crc 0 0 0) 0x7fefa4011bf0 con 0x5604d66e9bf0 2023-10-31T23:20:43.543 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:29.207+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=16}) v3 -- 0x7fef9c03aaa0 con 0x5604d66e9bf0 2023-10-31T23:20:43.544 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:29.208+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 9256+0+0 (crc 0 0 0) 0x7fefa4006360 con 0x5604d66e9bf0 2023-10-31T23:20:43.544 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:29.208+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/852254332 >> v2:172.21.15.71:6803/3419493040 conn(0x5604d66eff60 0x5604d678fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-31T23:20:43.544 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:29.208+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:2 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x5604d6779da0 con 0x5604d66eff60 2023-10-31T23:20:43.544 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:29.209+0000 7fefaf79b640 1 --2- 172.21.15.8:0/852254332 >> v2:172.21.15.71:6803/3419493040 conn(0x5604d66eff60 0x5604d678fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-31T23:20:43.544 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:29.217+0000 7fefaf79b640 1 --2- 172.21.15.8:0/852254332 >> v2:172.21.15.71:6803/3419493040 conn(0x5604d66eff60 0x5604d678fb90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-31T23:20:43.545 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:43.540+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=17}) v3 -- 0x7fef80001dc0 con 0x5604d66e9bf0 2023-10-31T23:20:43.545 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:43.540+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- ping magic: 0 v1 -- 0x7fef80002150 con 0x5604d66eff60 2023-10-31T23:20:44.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2023-10-31T23:20:44.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2023-10-31T23:20:49.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~11s 2023-10-31T23:20:49.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~11s 2023-10-31T23:20:55.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~16s 2023-10-31T23:20:55.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~16s 2023-10-31T23:20:56.059 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:43.540+0000 at (2236 ms) 2023-10-31T23:20:56.059 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ RUN ] LibRadosService.Status 2023-10-31T23:20:56.060 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ OK ] LibRadosService.Status (20041 ms) 2023-10-31T23:20:56.060 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [----------] 4 tests from LibRadosService (27547 ms total) 2023-10-31T23:20:56.060 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: 2023-10-31T23:20:56.060 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [----------] Global test environment tear-down 2023-10-31T23:20:56.061 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27548 ms total) 2023-10-31T23:20:56.061 INFO:tasks.workunit.client.0.smithi008.stdout: api_service: [ PASSED ] 4 tests. 2023-10-31T23:20:58.396 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: Running main() from gmock_main.cc 2023-10-31T23:20:58.396 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2023-10-31T23:20:58.396 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [----------] Global test environment set-up. 2023-10-31T23:20:58.397 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [----------] 9 tests from LibRadosPools 2023-10-31T23:20:58.397 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2023-10-31T23:20:58.397 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2884 ms) 2023-10-31T23:20:58.397 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2023-10-31T23:20:58.397 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3019 ms) 2023-10-31T23:20:58.398 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2023-10-31T23:20:58.398 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3014 ms) 2023-10-31T23:20:58.398 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2023-10-31T23:20:58.398 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3020 ms) 2023-10-31T23:20:58.398 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2023-10-31T23:20:58.399 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3019 ms) 2023-10-31T23:20:58.399 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2023-10-31T23:20:58.399 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5030 ms) 2023-10-31T23:20:58.399 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2023-10-31T23:20:58.399 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5033 ms) 2023-10-31T23:20:58.400 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2023-10-31T23:20:58.400 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5031 ms) 2023-10-31T23:20:58.400 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2023-10-31T23:20:58.400 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6795-gd1dcabba/rpm/el9/BUILD/ceph-18.0.0-6795-gd1dcabba/src/test/librados/pool.cc:139: Skipped 2023-10-31T23:20:58.400 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: Not supported by crimson yet. Skipped 2023-10-31T23:20:58.401 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2023-10-31T23:20:58.401 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [----------] 9 tests from LibRadosPools (30050 ms total) 2023-10-31T23:20:58.401 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: 2023-10-31T23:20:58.401 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [----------] Global test environment tear-down 2023-10-31T23:20:58.401 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (30050 ms total) 2023-10-31T23:20:58.401 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ PASSED ] 8 tests. 2023-10-31T23:20:58.402 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ SKIPPED ] 1 test, listed below: 2023-10-31T23:20:58.402 INFO:tasks.workunit.client.0.smithi008.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier 2023-10-31T23:21:00.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~22s 2023-10-31T23:21:00.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~22s 2023-10-31T23:21:01.784 INFO:tasks.workunit.client.0.smithi008.stdout:7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 9 ==== osd_map(17..30 src has 1..30) v4 ==== 19647+0+0 (crc 0 0 0) 0x7fefa4011bb0 con 0x5604d66e9bf0 2023-10-31T23:21:01.785 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:48.541+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=31}) v3 -- 0x7fef80002310 con 0x5604d66e9bf0 2023-10-31T23:21:01.785 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:48.541+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- ping magic: 0 v1 -- 0x7fef80002560 con 0x5604d66eff60 2023-10-31T23:21:01.785 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:48.541+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 10 ==== osd_map(31..35 src has 1..35) v4 ==== 2426+0+0 (crc 0 0 0) 0x7fefa4004280 con 0x5604d66e9bf0 2023-10-31T23:21:01.785 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:53.542+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=36}) v3 -- 0x7fef80002720 con 0x5604d66e9bf0 2023-10-31T23:21:01.785 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:53.542+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- ping magic: 0 v1 -- 0x7fef80002970 con 0x5604d66eff60 2023-10-31T23:21:01.786 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:53.542+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 11 ==== osd_map(36..40 src has 1..40) v4 ==== 2432+0+0 (crc 0 0 0) 0x7fefa4045040 con 0x5604d66e9bf0 2023-10-31T23:21:01.786 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:58.543+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=41}) v3 -- 0x7fef80002720 con 0x5604d66e9bf0 2023-10-31T23:21:01.786 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:58.543+0000 7fefb11fe640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- ping magic: 0 v1 -- 0x7fef80002b90 con 0x5604d66eff60 2023-10-31T23:21:01.786 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:20:58.543+0000 7fef97fff640 1 -- 172.21.15.8:0/852254332 <== mon.0 v2:172.21.15.8:3300/0 12 ==== osd_map(41..45 src has 1..45) v4 ==== 2426+0+0 (crc 0 0 0) 0x7fefa4004440 con 0x5604d66e9bf0 2023-10-31T23:21:01.787 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.594+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 1 ==== osd_op_reply(2 exist [writefull 0~5] v19'1 uv0 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fefa000c430 con 0x5604d66eff60 2023-10-31T23:21:01.787 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2023-10-31T23:21:01.787 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.594+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:3 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d678cb70 con 0x5604d66eff60 2023-10-31T23:21:01.787 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.594+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:4 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d678d480 con 0x5604d66eff60 2023-10-31T23:21:01.788 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.768+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v19'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fefa000c430 con 0x5604d66eff60 2023-10-31T23:21:01.788 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.783+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fefa000c430 con 0x5604d66eff60 2023-10-31T23:21:01.788 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (189 ms) 2023-10-31T23:21:01.788 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2023-10-31T23:21:01.788 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.783+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:5 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d678d810 con 0x5604d66eff60 2023-10-31T23:21:01.856 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.783+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:6 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67900d0 con 0x5604d66eff60 2023-10-31T23:21:01.856 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.808+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v19'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.856 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.808+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.856 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (25 ms) 2023-10-31T23:21:01.857 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2023-10-31T23:21:01.857 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.808+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:7 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d678cfc0 con 0x5604d66eff60 2023-10-31T23:21:01.857 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.809+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:8 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67d0f60 con 0x5604d66eff60 2023-10-31T23:21:01.857 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.812+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.858 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.812+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v19'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.858 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (4 ms) 2023-10-31T23:21:01.858 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2023-10-31T23:21:01.858 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.812+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:9 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d6791440 con 0x5604d66eff60 2023-10-31T23:21:01.858 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.841+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 8 ==== osd_op_reply(9 exist [write 0~5] v47'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.859 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (29 ms) 2023-10-31T23:21:01.859 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2023-10-31T23:21:01.859 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.841+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:10 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67918f0 con 0x5604d66eff60 2023-10-31T23:21:01.859 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.848+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 9 ==== osd_op_reply(10 exist [write 0~5] v47'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.859 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (7 ms) 2023-10-31T23:21:01.860 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2023-10-31T23:21:01.860 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.848+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:11 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67b3d50 con 0x5604d66eff60 2023-10-31T23:21:01.868 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.854+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 10 ==== osd_op_reply(11 exist [write 0~5] v47'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.868 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (6 ms) 2023-10-31T23:21:01.868 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2023-10-31T23:21:01.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.854+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:12 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d6790430 con 0x5604d66eff60 2023-10-31T23:21:01.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.854+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:13 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d6790d80 con 0x5604d66eff60 2023-10-31T23:21:01.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.860+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 11 ==== osd_op_reply(12 exist [read 0~5 out=5b] v47'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.861+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 12 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.869 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (7 ms) 2023-10-31T23:21:01.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2023-10-31T23:21:01.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.861+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:14 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67908e0 con 0x5604d66eff60 2023-10-31T23:21:01.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.861+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:15 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67b4160 con 0x5604d66eff60 2023-10-31T23:21:01.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.863+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v47'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.870 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.864+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (3 ms) 2023-10-31T23:21:01.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2023-10-31T23:21:01.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.864+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:16 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67908e0 con 0x5604d66eff60 2023-10-31T23:21:01.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.864+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:17 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67b3d30 con 0x5604d66eff60 2023-10-31T23:21:01.871 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.866+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v47'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.878 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.867+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.878 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (3 ms) 2023-10-31T23:21:01.878 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2023-10-31T23:21:01.878 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.867+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:18 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d6790d90 con 0x5604d66eff60 2023-10-31T23:21:01.879 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.870+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 17 ==== osd_op_reply(18 exist [writefull 0~5] v47'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.879 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (3 ms) 2023-10-31T23:21:01.879 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2023-10-31T23:21:01.879 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.870+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:19 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d6790d90 con 0x5604d66eff60 2023-10-31T23:21:01.881 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.873+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 18 ==== osd_op_reply(19 exist [writefull 0~5] v47'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.881 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (3 ms) 2023-10-31T23:21:01.881 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2023-10-31T23:21:01.881 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.873+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 --> v2:172.21.15.71:6803/3419493040 -- osd_op(unknown.0.0:20 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) v8 -- 0x5604d67908e0 con 0x5604d66eff60 2023-10-31T23:21:01.882 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.876+0000 7fefaf79b640 1 -- 172.21.15.8:0/852254332 <== osd.2 v2:172.21.15.71:6803/3419493040 19 ==== osd_op_reply(20 exist [writefull 0~5] v47'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fefa0014040 con 0x5604d66eff60 2023-10-31T23:21:01.882 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (3 ms) 2023-10-31T23:21:01.882 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.876+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 >> v2:172.21.15.71:6803/3419493040 conn(0x5604d66eff60 msgr2=0x5604d678fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:21:01.882 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.876+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/852254332 >> v2:172.21.15.71:6803/3419493040 conn(0x5604d66eff60 0x5604d678fb90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:21:01.882 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.876+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fef9c036180 msgr2=0x7fef9c038690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:21:01.883 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.876+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fef9c036180 0x7fef9c038690 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:21:01.883 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 msgr2=0x5604d67772b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-31T23:21:01.883 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d67772b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:21:01.883 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 shutdown_connections 2023-10-31T23:21:01.884 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/852254332 >> v2:172.21.15.71:6803/3419493040 conn(0x5604d66eff60 0x5604d678fb90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:21:01.884 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.71:6800/4260589995,v1:172.21.15.71:6801/4260589995] conn(0x7fef9c036180 0x7fef9c038690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:21:01.884 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 --2- 172.21.15.8:0/852254332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604d66e9bf0 0x5604d67772b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-31T23:21:01.885 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 >> 172.21.15.8:0/852254332 conn(0x5604d6562d80 msgr2=0x5604d66eb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-31T23:21:01.885 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 shutdown_connections 2023-10-31T23:21:01.885 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.877+0000 7fefb6a2f640 1 -- 172.21.15.8:0/852254332 wait complete. 2023-10-31T23:21:01.885 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [----------] 12 tests from AsioRados (282 ms total) 2023-10-31T23:21:01.885 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: 2023-10-31T23:21:01.886 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [----------] Global test environment tear-down 2023-10-31T23:21:01.886 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (33511 ms total) 2023-10-31T23:21:01.886 INFO:tasks.workunit.client.0.smithi008.stdout: api_asio: [ PASSED ] 12 tests. 2023-10-31T23:21:01.886 INFO:tasks.workunit.client.0.smithi008.stderr:+ for t in "${!pids[@]}" 2023-10-31T23:21:01.887 INFO:tasks.workunit.client.0.smithi008.stderr:+ pid=84387 2023-10-31T23:21:01.887 INFO:tasks.workunit.client.0.smithi008.stderr:+ wait 84387 2023-10-31T23:21:02.236 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2023-10-31T23:21:02.236 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [----------] Global test environment set-up. 2023-10-31T23:21:02.236 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2023-10-31T23:21:02.237 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2023-10-31T23:21:02.237 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2023-10-31T23:21:02.237 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-10-31T23:21:02.237 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: 2023-10-31T23:21:02.237 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2023-10-31T23:21:02.237 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2023-10-31T23:21:02.238 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: 2023-10-31T23:20:28.301+0000 7f422242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:21:02.238 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: 2023-10-31T23:20:28.301+0000 7f422242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:21:02.238 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: 2023-10-31T23:20:28.301+0000 7f422242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:21:02.238 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2023-10-31T23:21:02.238 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: 2023-10-31T23:20:28.432+0000 7f422242c640 -1 failed for service _ceph-mon._tcp 2023-10-31T23:21:02.239 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: 2023-10-31T23:20:28.432+0000 7f422242c640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2023-10-31T23:21:02.239 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (133 ms) 2023-10-31T23:21:02.239 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2023-10-31T23:21:02.239 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2022 ms) 2023-10-31T23:21:02.239 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2155 ms total) 2023-10-31T23:21:02.240 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: 2023-10-31T23:21:02.240 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2023-10-31T23:21:02.240 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2023-10-31T23:21:02.240 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x7f41ec005d20 2023-10-31T23:21:02.240 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x7f421000a100 2023-10-31T23:21:02.240 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d67703d0 2023-10-31T23:21:02.241 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6769ec0 2023-10-31T23:21:02.241 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d67220e0 2023-10-31T23:21:02.241 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d66f6be0 2023-10-31T23:21:02.241 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d66f4020 2023-10-31T23:21:02.241 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a46740 2023-10-31T23:21:02.242 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a47170 2023-10-31T23:21:02.242 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a3f100 2023-10-31T23:21:02.242 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a480f0 2023-10-31T23:21:02.242 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a46f20 2023-10-31T23:21:02.242 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a49030 2023-10-31T23:21:02.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a47ea0 2023-10-31T23:21:02.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a49f50 2023-10-31T23:21:02.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a48e00 2023-10-31T23:21:02.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4aeb0 2023-10-31T23:21:02.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a49d40 2023-10-31T23:21:02.243 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4be10 2023-10-31T23:21:02.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4abf0 2023-10-31T23:21:02.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4cd30 2023-10-31T23:21:02.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4bbe0 2023-10-31T23:21:02.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4dc90 2023-10-31T23:21:02.244 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4cae0 2023-10-31T23:21:02.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4ebb0 2023-10-31T23:21:02.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4da60 2023-10-31T23:21:02.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4fb10 2023-10-31T23:21:02.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4e9a0 2023-10-31T23:21:02.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a50a70 2023-10-31T23:21:02.245 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 0x55d4d6a4f870 2023-10-31T23:21:02.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: started 30 aios 2023-10-31T23:21:02.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x7f41ec005d20 2023-10-31T23:21:02.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x7f421000a100 2023-10-31T23:21:02.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d67703d0 2023-10-31T23:21:02.246 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d6769ec0 2023-10-31T23:21:02.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d67220e0 2023-10-31T23:21:02.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d66f6be0 2023-10-31T23:21:02.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d66f4020 2023-10-31T23:21:02.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d6a46740 2023-10-31T23:21:02.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d6a47170 2023-10-31T23:21:02.247 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d6a3f100 2023-10-31T23:21:02.248 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waiting 0x55d4d6a480f0 2023-10-31T23:21:03.971 INFO:tasks.workunit.client.0.smithi008.stdout: api_misc: waitin api_service_pp: [==========] Running 4 tests from 1 test suite. 2023-10-31T23:21:03.972 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [----------] Global test environment set-up. 2023-10-31T23:21:03.972 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2023-10-31T23:21:03.972 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2023-10-31T23:21:03.972 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: 2023-10-31T23:20:28.520+0000 7fe671e2f7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:21:03.972 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: 2023-10-31T23:20:28.521+0000 7fe671e2f7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:21:03.973 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: 2023-10-31T23:20:28.521+0000 7fe671e2f7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-10-31T23:21:03.973 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5219 ms) 2023-10-31T23:21:03.973 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2023-10-31T23:21:03.973 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (85 ms) 2023-10-31T23:21:03.973 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2023-10-31T23:21:03.974 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20038 ms) 2023-10-31T23:21:03.974 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2023-10-31T23:21:03.974 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: attempt 0 of 20 2023-10-31T23:21:03.974 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: failed to deregister: 2023-10-31T23:21:03.974 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: { 2023-10-31T23:21:03.975 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "epoch": 6, 2023-10-31T23:21:03.975 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "modified": "2023-10-31T23:20:56.393214+0000", 2023-10-31T23:21:03.975 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "services": { 2023-10-31T23:21:03.975 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "laundry": { 2023-10-31T23:21:03.975 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "daemons": { 2023-10-31T23:21:03.976 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "summary": "", 2023-10-31T23:21:03.976 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "close-test-pid84852": { 2023-10-31T23:21:03.976 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "start_epoch": 5, 2023-10-31T23:21:03.976 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "start_stamp": "2023-10-31T23:20:53.895408+0000", 2023-10-31T23:21:03.976 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "gid": 4370, 2023-10-31T23:21:03.976 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "addr": "172.21.15.8:0/940484212", 2023-10-31T23:21:03.977 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "metadata": { 2023-10-31T23:21:03.977 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "arch": "x86_64", 2023-10-31T23:21:03.977 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "ceph_release": "reef", 2023-10-31T23:21:03.977 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "ceph_version": "ceph version 18.0.0-6795-gd1dcabba (d1dcabbaf4ab585825bf6f16fc9df7bfd64a85b2) reef (dev)", 2023-10-31T23:21:03.977 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "ceph_version_short": "18.0.0-6795-gd1dcabba", 2023-10-31T23:21:03.978 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2023-10-31T23:21:03.978 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "distro": "centos", 2023-10-31T23:21:03.978 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2023-10-31T23:21:03.978 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "distro_version": "9", 2023-10-31T23:21:03.978 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "foo": "bar", 2023-10-31T23:21:03.979 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "hostname": "smithi008", 2023-10-31T23:21:03.979 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Oct 19 18:39:36 UTC 2023", 2023-10-31T23:21:03.979 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "kernel_version": "5.14.0-378.el9.x86_64", 2023-10-31T23:21:03.979 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "mem_swap_kb": "0", 2023-10-31T23:21:03.979 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "mem_total_kb": "32494900", 2023-10-31T23:21:03.979 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "os": "Linux", 2023-10-31T23:21:03.980 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "this": "that" 2023-10-31T23:21:03.980 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: }, 2023-10-31T23:21:03.980 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: "task_status": {} 2023-10-31T23:21:03.980 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: } 2023-10-31T23:21:03.980 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: } 2023-10-31T23:21:03.981 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: } 2023-10-31T23:21:03.981 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: } 2023-10-31T23:21:03.981 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: } 2023-10-31T23:21:03.981 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: 2023-10-31T23:21:03.981 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: attempt 1 of 20 2023-10-31T23:21:03.981 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10107 ms) 2023-10-31T23:21:03.982 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35449 ms total) 2023-10-31T23:21:03.982 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: 2023-10-31T23:21:03.982 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [----------] Global test environment tear-down 2023-10-31T23:21:03.983 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35449 ms total) 2023-10-31T23:21:03.983 INFO:tasks.workunit.client.0.smithi008.stdout: api_service_pp: [ PASSED ] 4 tests. 2023-10-31T23:21:05.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-31T23:21:05.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~27s 2023-10-31T23:21:05.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~27s 2023-10-31T23:21:11.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2023-10-31T23:21:11.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~32s 2023-10-31T23:21:11.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~32s 2023-10-31T23:21:16.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~11s 2023-10-31T23:21:16.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~38s 2023-10-31T23:21:16.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~38s 2023-10-31T23:21:21.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~16s 2023-10-31T23:21:21.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~43s 2023-10-31T23:21:21.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~43s 2023-10-31T23:21:27.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~21s 2023-10-31T23:21:27.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~48s 2023-10-31T23:21:27.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~48s 2023-10-31T23:21:32.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~27s 2023-10-31T23:21:32.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~54s 2023-10-31T23:21:32.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~54s 2023-10-31T23:21:37.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~32s 2023-10-31T23:21:37.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2023-10-31T23:21:37.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~59s 2023-10-31T23:21:43.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~37s 2023-10-31T23:21:43.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2023-10-31T23:21:43.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~64s 2023-10-31T23:21:48.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~42s 2023-10-31T23:21:48.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~69s 2023-10-31T23:21:48.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~69s 2023-10-31T23:21:53.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~48s 2023-10-31T23:21:53.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~75s 2023-10-31T23:21:53.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2023-10-31T23:21:58.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2023-10-31T23:21:58.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2023-10-31T23:21:58.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2023-10-31T23:22:00.205 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:00.203+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:04.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2023-10-31T23:22:04.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2023-10-31T23:22:04.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-10-31T23:22:05.206 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:05.204+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:09.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2023-10-31T23:22:09.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~91s 2023-10-31T23:22:09.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~91s 2023-10-31T23:22:10.206 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:10.204+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:14.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~69s 2023-10-31T23:22:14.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~96s 2023-10-31T23:22:14.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~96s 2023-10-31T23:22:15.207 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:15.206+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:20.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~74s 2023-10-31T23:22:20.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~101s 2023-10-31T23:22:20.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~101s 2023-10-31T23:22:20.209 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:20.207+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:25.210 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:25.209+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:25.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2023-10-31T23:22:25.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~107s 2023-10-31T23:22:25.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~107s 2023-10-31T23:22:30.211 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:30.210+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:30.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-10-31T23:22:30.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~112s 2023-10-31T23:22:30.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~112s 2023-10-31T23:22:35.212 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:35.211+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:36.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2023-10-31T23:22:36.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2023-10-31T23:22:36.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~117s 2023-10-31T23:22:40.214 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:40.212+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:41.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2023-10-31T23:22:41.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~122s 2023-10-31T23:22:41.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~122s 2023-10-31T23:22:45.215 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:45.214+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:46.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~101s 2023-10-31T23:22:46.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~128s 2023-10-31T23:22:46.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~128s 2023-10-31T23:22:50.216 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:50.215+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:51.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2023-10-31T23:22:51.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~133s 2023-10-31T23:22:51.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~133s 2023-10-31T23:22:55.217 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:22:55.216+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:22:57.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2023-10-31T23:22:57.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~138s 2023-10-31T23:22:57.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~138s 2023-10-31T23:23:00.219 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:00.218+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:02.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2023-10-31T23:23:02.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~144s 2023-10-31T23:23:02.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~144s 2023-10-31T23:23:05.220 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:05.219+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:07.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2023-10-31T23:23:07.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~149s 2023-10-31T23:23:07.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~149s 2023-10-31T23:23:10.221 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:10.220+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:13.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~127s 2023-10-31T23:23:13.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~154s 2023-10-31T23:23:13.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~154s 2023-10-31T23:23:15.223 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:15.221+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:18.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~133s 2023-10-31T23:23:18.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2023-10-31T23:23:18.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2023-10-31T23:23:20.224 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:20.223+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:23.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~138s 2023-10-31T23:23:23.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2023-10-31T23:23:23.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-10-31T23:23:25.225 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:25.224+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:29.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~143s 2023-10-31T23:23:29.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2023-10-31T23:23:29.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2023-10-31T23:23:30.226 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:30.225+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:34.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~149s 2023-10-31T23:23:34.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~176s 2023-10-31T23:23:34.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~176s 2023-10-31T23:23:35.227 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:35.226+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:39.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~154s 2023-10-31T23:23:39.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~181s 2023-10-31T23:23:39.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~181s 2023-10-31T23:23:40.229 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:40.228+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:45.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~159s 2023-10-31T23:23:45.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~186s 2023-10-31T23:23:45.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~186s 2023-10-31T23:23:45.230 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:45.228+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:50.231 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:50.229+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:50.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~164s 2023-10-31T23:23:50.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~191s 2023-10-31T23:23:50.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~191s 2023-10-31T23:23:55.232 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:23:55.230+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:23:55.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2023-10-31T23:23:55.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~197s 2023-10-31T23:23:55.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~197s 2023-10-31T23:24:00.233 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:00.232+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:00.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2023-10-31T23:24:00.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~202s 2023-10-31T23:24:00.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~202s 2023-10-31T23:24:05.234 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:05.233+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:06.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2023-10-31T23:24:06.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~207s 2023-10-31T23:24:06.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~207s 2023-10-31T23:24:10.235 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:10.234+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:11.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~186s 2023-10-31T23:24:11.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~213s 2023-10-31T23:24:11.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~213s 2023-10-31T23:24:15.236 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:15.235+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:16.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~191s 2023-10-31T23:24:16.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~218s 2023-10-31T23:24:16.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~218s 2023-10-31T23:24:20.238 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:20.236+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:22.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~196s 2023-10-31T23:24:22.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~223s 2023-10-31T23:24:22.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~223s 2023-10-31T23:24:25.239 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:25.237+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:27.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~202s 2023-10-31T23:24:27.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~229s 2023-10-31T23:24:27.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~229s 2023-10-31T23:24:30.240 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:30.238+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:32.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~207s 2023-10-31T23:24:32.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~234s 2023-10-31T23:24:32.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~234s 2023-10-31T23:24:35.241 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:35.239+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:38.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~212s 2023-10-31T23:24:38.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~239s 2023-10-31T23:24:38.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~239s 2023-10-31T23:24:40.243 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:40.241+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:43.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~217s 2023-10-31T23:24:43.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~244s 2023-10-31T23:24:43.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~244s 2023-10-31T23:24:45.244 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:45.242+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:48.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~223s 2023-10-31T23:24:48.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~250s 2023-10-31T23:24:48.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~250s 2023-10-31T23:24:50.245 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:50.243+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:53.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~228s 2023-10-31T23:24:53.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2023-10-31T23:24:53.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2023-10-31T23:24:55.246 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:24:55.244+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:24:59.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~233s 2023-10-31T23:24:59.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2023-10-31T23:24:59.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2023-10-31T23:25:00.247 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:00.246+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:04.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~239s 2023-10-31T23:25:04.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~266s 2023-10-31T23:25:04.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~266s 2023-10-31T23:25:05.248 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:05.247+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:09.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~244s 2023-10-31T23:25:09.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~271s 2023-10-31T23:25:09.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~271s 2023-10-31T23:25:10.249 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:10.248+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:15.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~249s 2023-10-31T23:25:15.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~276s 2023-10-31T23:25:15.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~276s 2023-10-31T23:25:15.250 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:15.249+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:20.252 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:20.250+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:20.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2023-10-31T23:25:20.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~282s 2023-10-31T23:25:20.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~282s 2023-10-31T23:25:25.253 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:25.250+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:25.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2023-10-31T23:25:25.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~287s 2023-10-31T23:25:25.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~287s 2023-10-31T23:25:30.254 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:30.252+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:31.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2023-10-31T23:25:31.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~292s 2023-10-31T23:25:31.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~292s 2023-10-31T23:25:35.255 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:35.253+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:36.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2023-10-31T23:25:36.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~298s 2023-10-31T23:25:36.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~298s 2023-10-31T23:25:40.256 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:40.255+0000 7f2959ff6640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 v2:172.21.15.8:6800/194198577 for 29sec e56 v56) 2023-10-31T23:25:41.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~276s 2023-10-31T23:25:41.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~303s 2023-10-31T23:25:41.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~303s 2023-10-31T23:25:41.717 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-31T23:25:42.022 INFO:tasks.ceph.osd.2:Sent signal 15 2023-10-31T23:25:42.023 INFO:tasks.ceph.mon.a:Sent signal 15 2023-10-31T23:25:42.023 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-10-31T23:25:42.025 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:25:42.024+0000 7f5e3c7f7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 81391) UID: 0 2023-10-31T23:25:42.025 INFO:tasks.ceph.mgr.x.smithi071.stderr:2023-10-31T23:25:42.024+0000 7f5e3c7f7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-31T23:25:42.026 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:42.023+0000 7f295cffc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 82091) UID: 0 2023-10-31T23:25:42.026 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-31T23:25:42.023+0000 7f295cffc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-01T00:01:01.844 INFO:tasks.workunit.client.0.smithi008.stdout: api_aio: Running main() from gmock_main.cc 2023-11-01T00:01:01.845 INFO:tasks.workunit.client.0.smithi008.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2023-11-01T00:01:01.845 INFO:tasks.workunit.client.0.smithi008.stdout: api_aio: [----------] Global test environment set-up. 2023-11-01T00:01:01.845 INFO:tasks.workunit.client.0.smithi008.stdout: api_aio: [----------] 26 tests from LibRadosAio 2023-11-01T00:01:01.845 INFO:tasks.workunit.client.0.smithi008.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2023-11-01T00:01:01.845 INFO:tasks.workunit.client.0.smithi008.stdout: api_aio: [ OK ] LibRadosAio.TooBig (3010 ms) 2023-11-01T00:01:01.846 INFO:tasks.workunit.client.0.smithi008.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2023-11-01T00:01:01.846 INFO:tasks.workunit.client.0.smithi008.stderr:bash: line 1: 84171 Alarm clock ceph_test_rados_api_aio 2>&1 2023-11-01T00:01:01.846 INFO:tasks.workunit.client.0.smithi008.stderr: 84172 Done | tee ceph_test_rados_api_aio.log 2023-11-01T00:01:01.846 INFO:tasks.workunit.client.0.smithi008.stderr: 84175 Done | sed "s/^/ api_aio: /" 2023-11-01T00:01:01.855 INFO:tasks.workunit.client.0.smithi008.stdout: api_watch_notify: Running main() from gmock_main.cc 2023-11-01T00:01:01.855 INFO:tasks.workunit.client.0.smithi008.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2023-11-01T00:01:01.855 INFO:tasks.workunit.client.0.smithi008.stdout: api_watch_notify: [----------] Global test environment set-up. 2023-11-01T00:01:01.856 INFO:tasks.workunit.client.0.smithi008.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2023-11-01T00:01:01.856 INFO:tasks.workunit.client.0.smithi008.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2023-11-01T00:01:01.856 INFO:tasks.workunit.client.0.smithi008.stdout: api_watch_notify: watch_notify_test_cb 2023-11-01T00:01:01.856 INFO:tasks.workunit.client.0.smithi008.stderr:bash: line 1: 84675 Alarm clock ceph_test_rados_api_watch_notify 2>&1 2023-11-01T00:01:01.856 INFO:tasks.workunit.client.0.smithi008.stderr: 84676 Done | tee ceph_test_rados_api_watch_notify.log 2023-11-01T00:01:01.857 INFO:tasks.workunit.client.0.smithi008.stderr: 84677 Done | sed "s/^/ api_watch_notify: /" 2023-11-01T02:20:28.175 INFO:tasks.workunit.client.0.smithi008.stderr:++ cleanup 2023-11-01T02:20:28.177 INFO:tasks.workunit.client.0.smithi008.stderr:++ pkill -P 84096 2023-11-01T02:20:28.202 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-01T02:20:28.203 INFO:tasks.workunit.client.0.smithi008.stderr:++ true 2023-11-01T02:20:28.203 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2023-11-01T02:20:28.204 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-01T02:20:28.515 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi008 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9edd23b5a8ddacab225824948b06b370baf276b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-11-01T02:20:28.582 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6c72d137554a4589bb08fa08c87637ca Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi008 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9edd23b5a8ddacab225824948b06b370baf276b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-11-01T02:20:28.585 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-01T02:20:28.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-01T02:20:28.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T02:20:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.721+0000 7f7ef4d9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-01T02:20:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.725+0000 7f7ef4d9e640 1 Processor -- start 2023-11-01T02:20:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.725+0000 7f7ef4d9e640 1 -- start start 2023-11-01T02:20:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.726+0000 7f7ef4d9e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ef012c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.726+0000 7f7ef4d9e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ef012ce40 2023-11-01T02:20:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.726+0000 7f7ef4d9e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ef006d800 2023-11-01T02:20:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.726+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ef012c900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.726+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ef012fa40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.726+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ef012c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.927+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ef012c900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.927+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ef012fa40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:28.927+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ef012c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:29.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:29.328+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ef012fa40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:29.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:29.328+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ef012c900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:29.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:29.328+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ef012c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:30.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:30.129+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ef012fa40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:30.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:30.129+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ef012c900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:30.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:30.129+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ef012c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:31.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ef012c900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:31.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ef012c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:31.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ef012fa40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:31.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:31.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ef012ce40 2023-11-01T02:20:31.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ef006d800 2023-11-01T02:20:31.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:31.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:31.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.727+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ed0007c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:31.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.928+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:31.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.928+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ed0007c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:31.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:31.928+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:32.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:32.329+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ed0007c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:32.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:32.329+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:32.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:32.329+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:33.130+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:33.130+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ed0007c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:33.130+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ef012ce40 legacy=0x7f7ed0007c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed00093f0 2023-11-01T02:20:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ef006d800 2023-11-01T02:20:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00093f0 legacy=0x7f7ed0009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.727+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:34.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.928+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00093f0 legacy=0x7f7ed0009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:34.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.928+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:34.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:34.928+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:35.329+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00093f0 legacy=0x7f7ed0009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:35.329+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:35.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:35.329+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:36.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:36.130+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00093f0 legacy=0x7f7ed0009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:36.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:36.130+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:36.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:36.130+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00093f0 legacy=0x7f7ed0009880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0005c40 2023-11-01T02:20:37.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ef006d800 2023-11-01T02:20:37.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005c40 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:37.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:37.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.727+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:37.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.928+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005c40 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:37.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.928+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:37.928+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:38.329+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005c40 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:38.329+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:38.329+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:39.129+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005c40 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:39.129+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:39.129+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005c40 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:40.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0008380 2023-11-01T02:20:40.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ef006d800 2023-11-01T02:20:40.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008380 legacy=0x7f7ed0008790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:40.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.727+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.928+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008380 legacy=0x7f7ed0008790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.928+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:40.928+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:41.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:41.329+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008380 legacy=0x7f7ed0008790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:41.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:41.329+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:41.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:41.329+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:42.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:42.130+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008380 legacy=0x7f7ed0008790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:42.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:42.130+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:42.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:42.130+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:43.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008380 legacy=0x7f7ed0008790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:43.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:43.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0008ea0 2023-11-01T02:20:43.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ef006d800 2023-11-01T02:20:43.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:43.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:43.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.727+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:43.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.928+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.928+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:43.928+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:44.329+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:44.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:44.329+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:44.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:44.329+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:45.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:45.130+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:45.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:45.130+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:45.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:45.131+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 msgr2=0x7f7ed0009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ef006d800 0x7f7ed0009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000c590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 0x7f7ed0005640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0008ea0 2023-11-01T02:20:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0008790 2023-11-01T02:20:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.728+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:46.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.929+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.929+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:46.929+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:47.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:47.330+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:47.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:47.330+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:47.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:47.330+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:48.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:48.131+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:48.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:48.131+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:48.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:48.131+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:49.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 msgr2=0x7f7ed0005640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:49.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0008790 0x7f7ed0005640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:49.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:49.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:49.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0008ea0 2023-11-01T02:20:49.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0009800 2023-11-01T02:20:49.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:49.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:49.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.728+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.929+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:49.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.929+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:49.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:49.929+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:50.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:50.330+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:50.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:50.330+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:50.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:50.330+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:51.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:51.131+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:51.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:51.131+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:51.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:51.131+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:52.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:52.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:52.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0008ea0 legacy=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:52.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:52.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0003630 2023-11-01T02:20:52.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0009800 2023-11-01T02:20:52.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003630 legacy=0x7f7ed000e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:52.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:52.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.728+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:52.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.929+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003630 legacy=0x7f7ed000e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:52.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.929+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:52.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:52.929+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:53.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:53.330+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003630 legacy=0x7f7ed000e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:53.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:53.330+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:53.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:53.330+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:54.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:54.131+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003630 legacy=0x7f7ed000e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:54.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:54.131+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:54.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:54.131+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000dcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003630 legacy=0x7f7ed000e1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed000aac0 2023-11-01T02:20:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0009800 2023-11-01T02:20:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.729+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.930+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.930+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:55.930+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:56.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:56.331+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:56.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:56.331+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:56.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:56.331+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:20:57.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:57.132+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:57.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:57.132+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:57.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:57.132+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:20:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 msgr2=0x7f7ed000a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0009800 0x7f7ed000a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:20:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:20:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 0x7f7ed0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:20:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed000aac0 2023-11-01T02:20:58.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003a40 2023-11-01T02:20:58.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:58.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:58.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.729+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:20:58.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.930+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:58.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.930+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:58.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:58.930+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:20:59.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:59.331+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:20:59.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:59.331+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:20:59.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:20:59.331+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:00.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:00.132+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:00.132+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:00.132+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003a40 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0004aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed000aac0 2023-11-01T02:21:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000a580 2023-11-01T02:21:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0004aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:01.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.729+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0004aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.930+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.930+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0004aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:01.930+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0004aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:02.331+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:02.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:02.331+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0004aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:02.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:02.331+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0004aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:03.132+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:03.132+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0004aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:03.132+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0004aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:04.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0004aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:04.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0004aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:04.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed0004fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed000aac0 2023-11-01T02:21:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000a580 2023-11-01T02:21:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.730+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:04.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.931+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.931+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:04.931+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:05.332+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:05.332+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:05.332+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:06.133+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:06.133+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:06.133+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:07.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed0003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:07.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:07.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aac0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:07.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed000aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:07.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed00053a0 2023-11-01T02:21:07.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000a580 2023-11-01T02:21:07.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00053a0 legacy=0x7f7ed000b5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:07.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:07.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.730+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed000aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.931+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00053a0 legacy=0x7f7ed000b5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:07.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.931+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:07.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:07.931+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed000aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:08.332+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:08.332+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00053a0 legacy=0x7f7ed000b5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:08.332+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed000aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:09.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:09.133+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00053a0 legacy=0x7f7ed000b5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:09.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:09.133+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:09.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:09.133+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed000aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:10.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 msgr2=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:10.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000a580 0x7f7ed000aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:10.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00053a0 legacy=0x7f7ed000b5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed00047a0 2023-11-01T02:21:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003e50 2023-11-01T02:21:10.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:10.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:10.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.730+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:10.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.931+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:10.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.931+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:10.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:10.931+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:11.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:11.332+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:11.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:11.332+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:11.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:11.332+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:12.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:12.133+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:12.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:12.133+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:12.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:12.133+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:13.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:13.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:13.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:13.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 0x7f7ed000cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:13.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed00047a0 2023-11-01T02:21:13.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed00052c0 2023-11-01T02:21:13.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 msgr2=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:13.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:13.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.731+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 0x7f7ed000cee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:13.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.932+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 msgr2=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:13.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.932+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:13.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:13.932+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 0x7f7ed000cee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:14.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:14.333+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:14.333+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 msgr2=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:14.333+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 0x7f7ed000cee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:15.134+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 msgr2=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:15.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:15.134+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:15.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:15.134+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 0x7f7ed000cee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 msgr2=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed00052c0 0x7f7ed000cee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00047a0 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 0x7f7ed0013b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0003e50 2023-11-01T02:21:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0004260 2023-11-01T02:21:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 msgr2=0x7f7ed0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.731+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 0x7f7ed0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:16.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.932+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:16.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.932+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 msgr2=0x7f7ed0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:16.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:16.932+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 0x7f7ed0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:17.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:17.333+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:17.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:17.333+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 msgr2=0x7f7ed0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:17.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:17.333+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 0x7f7ed0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:18.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:18.134+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:18.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:18.134+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 msgr2=0x7f7ed0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:18.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:18.134+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 0x7f7ed0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:19.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 msgr2=0x7f7ed0013b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:19.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004260 0x7f7ed0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:19.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:19.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 0x7f7ed00140b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:19.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0004bb0 2023-11-01T02:21:19.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000bee0 2023-11-01T02:21:19.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 msgr2=0x7f7ed00140b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:19.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0004bb0 legacy=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:19.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.731+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 0x7f7ed00140b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:19.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.932+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 msgr2=0x7f7ed00140b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:19.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.932+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0004bb0 legacy=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:19.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:19.932+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 0x7f7ed00140b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:20.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:20.333+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 msgr2=0x7f7ed00140b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:20.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:20.333+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0004bb0 legacy=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:20.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:20.333+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 0x7f7ed00140b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:21.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:21.134+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0004bb0 legacy=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:21.134+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 msgr2=0x7f7ed00140b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:21.134+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 0x7f7ed00140b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:22.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 msgr2=0x7f7ed00140b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000bee0 0x7f7ed00140b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0004bb0 legacy=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00145f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0003e50 2023-11-01T02:21:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0011af0 2023-11-01T02:21:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00145f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed00103d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:22.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.732+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00145f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.933+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00145f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.933+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed00103d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:22.933+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00145f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:23.334+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed00103d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:23.334+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00145f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:23.334+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00145f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:24.135+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed00103d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:24.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:24.135+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00145f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:24.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:24.135+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00145f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:25.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00145f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:25.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00145f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed00103d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0013f90 2023-11-01T02:21:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0011af0 2023-11-01T02:21:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0013f90 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00052c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.732+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00052c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:25.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.933+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0013f90 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:25.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.933+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00052c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:25.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:25.933+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00052c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:26.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:26.334+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0013f90 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:26.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:26.334+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00052c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:26.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:26.334+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00052c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:27.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:27.135+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00052c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:27.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:27.135+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0013f90 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:27.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:27.135+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00052c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed00052c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed00052c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0013f90 legacy=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0003e50 2023-11-01T02:21:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0011af0 2023-11-01T02:21:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000e3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.732+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:28.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.933+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:28.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.933+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000e3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:28.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:28.933+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:29.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:29.334+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:29.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:29.334+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000e3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:29.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:29.334+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:30.135+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000e3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:30.135+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:30.135+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:31.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011af0 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000e3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 0x7f7ed00050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0005630 2023-11-01T02:21:31.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000def0 2023-11-01T02:21:31.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 msgr2=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:31.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005630 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:31.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.733+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 0x7f7ed00050f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:31.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.934+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 msgr2=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:31.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.934+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005630 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:31.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:31.934+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 0x7f7ed00050f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:32.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:32.335+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 msgr2=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:32.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:32.335+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005630 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:32.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:32.335+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 0x7f7ed00050f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:33.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:33.136+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005630 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:33.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:33.136+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 msgr2=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:33.136+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 0x7f7ed00050f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 msgr2=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000def0 0x7f7ed00050f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005630 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed000aed0 2023-11-01T02:21:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003e50 2023-11-01T02:21:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.733+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.934+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.934+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:34.934+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:35.335+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:35.335+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:35.335+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:36.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:36.136+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:36.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:36.136+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:36.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:36.136+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:37.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:37.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed000aed0 2023-11-01T02:21:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000e600 2023-11-01T02:21:37.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:37.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:37.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.733+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.934+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.934+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:37.934+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:38.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:38.335+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:38.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:38.335+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:38.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:38.335+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:39.136+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:39.136+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:39.136+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed000aed0 legacy=0x7f7ed00050f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:40.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0003e50 2023-11-01T02:21:40.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000e600 2023-11-01T02:21:40.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:40.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.734+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.935+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.935+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:40.935+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:41.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:41.336+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:41.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:41.336+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:41.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:41.336+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:42.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:42.137+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:42.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:42.137+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:42.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:42.137+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:43.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:43.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:43.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:43.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:43.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed00050f0 2023-11-01T02:21:43.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000e600 2023-11-01T02:21:43.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:43.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:43.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.734+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.935+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.935+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:43.935+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:44.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:44.336+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:44.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:44.336+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:44.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:44.336+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:45.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:45.137+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:45.137+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:45.137+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0003e50 2023-11-01T02:21:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000e600 2023-11-01T02:21:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.734+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:46.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.935+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:46.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.935+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:46.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:46.935+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:47.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:47.336+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:47.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:47.336+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:47.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:47.336+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:48.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:48.137+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:48.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:48.137+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:48.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:48.137+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:49.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:49.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000e600 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:49.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0010a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:49.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0012140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:49.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed00050f0 2023-11-01T02:21:49.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0005500 2023-11-01T02:21:49.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:49.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:49.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.735+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:49.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.936+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.936+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:49.936+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:50.337+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:50.337+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:50.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:50.337+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:51.138+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:51.138+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:51.138+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:52.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:52.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0003e50 2023-11-01T02:21:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0005500 2023-11-01T02:21:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.735+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.936+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.936+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:52.936+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:53.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:53.337+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:53.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:53.337+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:53.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:53.337+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:54.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:54.138+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:54.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:54.138+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:54.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:54.138+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:55.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:55.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:55.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:55.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:55.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed00050f0 2023-11-01T02:21:55.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0005500 2023-11-01T02:21:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000eef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.736+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.937+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.937+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000eef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:55.937+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:56.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:56.338+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000eef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:56.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:56.338+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:56.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:56.338+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:21:57.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:57.139+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000eef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:57.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:57.139+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:57.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:57.139+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:21:58.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:58.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0005500 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:21:58.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000eef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:21:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:21:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed00050f0 2023-11-01T02:21:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003e50 2023-11-01T02:21:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:58.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:58.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.736+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:21:58.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.937+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.937+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:58.937+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:21:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:59.338+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:21:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:59.338+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:21:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:21:59.338+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:00.139+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:00.139+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:00.139+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:01.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:01.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:01.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000cee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:01.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:01.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0005500 2023-11-01T02:22:01.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003e50 2023-11-01T02:22:01.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:01.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:01.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.736+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:01.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.937+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:01.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.937+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:01.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:01.937+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:02.338+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:02.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:02.338+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:02.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:02.338+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:03.139+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:03.139+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:03.139+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed00050f0 2023-11-01T02:22:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003e50 2023-11-01T02:22:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:04.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.737+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:04.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.938+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:04.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.938+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:04.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:04.938+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:05.339+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:05.339+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:05.339+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:06.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:06.140+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:06.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:06.140+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:06.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:06.140+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:07.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:07.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:07.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0005500 2023-11-01T02:22:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0011d30 2023-11-01T02:22:07.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:07.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:07.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.737+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.938+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.938+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:07.938+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:08.339+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:08.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:08.339+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:08.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:08.339+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:09.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:09.140+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:09.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:09.140+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:09.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:09.140+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:10.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:10.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:10.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:10.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:10.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed00050f0 2023-11-01T02:22:10.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003e50 2023-11-01T02:22:10.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:10.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:10.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.737+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:10.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.938+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:10.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.938+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:10.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:10.938+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:11.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:11.339+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:11.339+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:11.339+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:12.139+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:12.139+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:12.139+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:13.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:13.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:13.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:13.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0005500 2023-11-01T02:22:13.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0003e50 2023-11-01T02:22:13.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed000e600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:13.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.737+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:13.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.938+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed000e600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.938+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:13.938+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:14.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:14.339+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed000e600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:14.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:14.339+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:14.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:14.339+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:15.140+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:15.140+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed000e600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:15.140+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 msgr2=0x7f7ed0004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0003e50 0x7f7ed0004bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed000e600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed00050f0 2023-11-01T02:22:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0011d30 2023-11-01T02:22:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.737+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.938+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.938+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:16.938+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:17.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:17.339+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:17.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:17.339+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:17.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:17.339+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:18.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:18.140+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:18.140+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:18.140+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:19.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.737+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:19.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.737+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:19.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.737+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed00050f0 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:19.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.738+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:19.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.738+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0003e50 2023-11-01T02:22:19.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.738+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0011d30 2023-11-01T02:22:19.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.738+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:19.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.738+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:19.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.738+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.939+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:19.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.939+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:19.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:19.939+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:20.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:20.340+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:20.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:20.340+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:20.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:20.340+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:21.141+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:21.141+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:21.141+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 msgr2=0x7f7ed0012140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0011d30 0x7f7ed0012140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed0012680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 0x7f7ed0004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef012c540 con 0x7f7ed0005500 2023-11-01T02:22:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed0004bb0 2023-11-01T02:22:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 msgr2=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.738+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 0x7f7ed0004fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:22.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.939+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:22.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.939+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 msgr2=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:22.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:22.939+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 0x7f7ed0004fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:23.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:23.340+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 msgr2=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:23.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:23.340+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:23.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:23.340+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 0x7f7ed0004fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:24.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:24.141+0000 7f7eee59c640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 msgr2=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:24.141+0000 7f7ee7fff640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:24.141+0000 7f7eee59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 0x7f7ed0004fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7eecd99640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 msgr2=0x7f7ed0004fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed0004bb0 0x7f7ed0004fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T02:22:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7eecd99640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0005500 legacy=0x7f7ed0010f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T02:22:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7eecd99640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 0x7f7ed0013620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T02:22:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7eecd99640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006dd40 con 0x7f7ed0003e50 2023-11-01T02:22:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7eecd99640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006e990 con 0x7f7ed000c5f0 2023-11-01T02:22:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 msgr2=0x7f7ed0013620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.738+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 0x7f7ed0013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T02:22:25.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.939+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:25.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.939+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 msgr2=0x7f7ed0013620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:25.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:25.939+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 0x7f7ed0013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T02:22:26.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:26.340+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:26.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:26.340+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 msgr2=0x7f7ed0013620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:26.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:26.340+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 0x7f7ed0013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T02:22:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:27.141+0000 7f7eee59c640 1 -- >> v1:172.21.15.8:6789/0 conn(0x7f7ed0003e50 legacy=0x7f7ed000aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.8:6789/0 2023-11-01T02:22:27.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:27.141+0000 7f7ee7fff640 1 -- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 msgr2=0x7f7ed0013620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.8:3300/0 2023-11-01T02:22:27.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-01T02:22:27.141+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ed000c5f0 0x7f7ed0013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T02:22:28.650 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-01T02:22:28.652 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-01T02:22:28.661 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-01T02:22:28.662 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-01T02:22:28.662 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-01T02:22:28.663 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T02:22:28.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:28.666 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log' 2023-11-01T02:22:28.675 INFO:tasks.ceph.osd.0:Stopped 2023-11-01T02:22:28.676 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-01T02:22:28.676 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T02:22:28.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:28.678 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log' 2023-11-01T02:22:28.688 INFO:tasks.ceph.osd.1:Stopped 2023-11-01T02:22:28.689 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-01T02:22:28.689 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T02:22:28.770 INFO:tasks.ceph.osd.2:Stopped 2023-11-01T02:22:28.771 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-01T02:22:28.771 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T02:22:28.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:28.772 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi071 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log' 2023-11-01T02:22:28.782 INFO:tasks.ceph.osd.3:Stopped 2023-11-01T02:22:28.783 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-01T02:22:28.783 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-01T02:22:28.783 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T02:22:28.786 INFO:tasks.ceph.mgr.x:Stopped 2023-11-01T02:22:28.787 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-01T02:22:28.787 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-01T02:22:28.787 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T02:22:28.788 INFO:tasks.ceph.mon.a:Stopped 2023-11-01T02:22:28.789 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-01T02:22:28.789 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-11-01T02:22:28.830 INFO:teuthology.orchestra.run.smithi008.stdout:2023-10-31T23:21:00.189897+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN) 2023-11-01T02:22:28.831 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-11-01T02:22:28.832 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com 2023-11-01T02:22:28.832 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-01T02:22:28.968 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi008.front.sepia.ceph.com 2023-11-01T02:22:28.969 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-01T02:22:29.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2023-11-01T02:22:29.059 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-01T02:22:29.218 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi071.front.sepia.ceph.com 2023-11-01T02:22:29.218 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-01T02:22:29.322 INFO:tasks.ceph:Archiving mon data... 2023-11-01T02:22:29.324 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/data/mon.a.tgz 2023-11-01T02:22:29.325 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-11-01T02:22:29.344 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.Td6zf8NGPr 2023-11-01T02:22:29.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Td6zf8NGPr 2023-11-01T02:22:29.603 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.Td6zf8NGPr 2023-11-01T02:22:29.693 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.Td6zf8NGPr is 760KB 2023-11-01T02:22:29.796 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.Td6zf8NGPr 2023-11-01T02:22:29.811 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-01T02:22:29.811 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-01T02:22:29.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-01T02:22:29.884 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-01T02:22:29.885 DEBUG:teuthology.orchestra.run.smithi008:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-01T02:22:29.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-01T02:22:29.952 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-01T02:22:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-01T02:22:29.962 INFO:tasks.ceph:Archiving crash dumps... 2023-11-01T02:22:29.964 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/remote/smithi008/crash 2023-11-01T02:22:29.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-01T02:22:30.027 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/remote/smithi071/crash 2023-11-01T02:22:30.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-01T02:22:30.065 INFO:tasks.ceph:Compressing logs... 2023-11-01T02:22:30.066 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-01T02:22:30.072 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-01T02:22:30.101 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83503.log 2023-11-01T02:22:30.101 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84252.log 2023-11-01T02:22:30.101 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84538.log 2023-11-01T02:22:30.102 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84252.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-01T02:22:30.102 INFO:teuthology.orchestra.run.smithi008.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83503.log.gz 2023-11-01T02:22:30.102 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84796.log 2023-11-01T02:22:30.111 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83506.log 2023-11-01T02:22:30.111 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84449.log 2023-11-01T02:22:30.111 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84505.log 2023-11-01T02:22:30.112 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83504.log 2023-11-01T02:22:30.112 INFO:teuthology.orchestra.run.smithi008.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83506.log.gz 2023-11-01T02:22:30.112 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82172.log 2023-11-01T02:22:30.113 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83504.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.84449.log.gz --verbose 2023-11-01T02:22:30.113 INFO:teuthology.orchestra.run.smithi008.stderr: -- /var/log/ceph/ceph-client.admin.84908.log 2023-11-01T02:22:30.113 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose 86.6% -- replaced with /var/log/ceph/ceph-client.admin.83504.log.gz 2023-11-01T02:22:30.113 INFO:teuthology.orchestra.run.smithi008.stderr: -- /var/log/ceph/ceph-client.admin.84692.log 2023-11-01T02:22:30.114 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84908.log: /var/log/ceph/ceph-client.admin.82172.log: 52.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84463.log 2023-11-01T02:22:30.114 INFO:teuthology.orchestra.run.smithi008.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84908.log.gz 2023-11-01T02:22:30.114 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84692.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.82172.log.gz 2023-11-01T02:22:30.115 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83866.log 2023-11-01T02:22:30.115 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84241.log 2023-11-01T02:22:30.115 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83866.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.83866.log.gz 91.2% -- replaced with /var/log/ceph/ceph-client.admin.84796.log.gz 2023-11-01T02:22:30.115 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-11-01T02:22:30.116 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82093.log 2023-11-01T02:22:30.116 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84241.log: gzip -5 --verbose 91.9% -- replaced with /var/log/ceph/ceph-client.admin.84463.log.gz 2023-11-01T02:22:30.116 INFO:teuthology.orchestra.run.smithi008.stderr: -- /var/log/ceph/ceph-client.admin.84336.log 2023-11-01T02:22:30.117 INFO:teuthology.orchestra.run.smithi008.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.84241.log.gz 2023-11-01T02:22:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84959.log 2023-11-01T02:22:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.82093.log: /var/log/ceph/ceph-client.admin.84336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84171.log 2023-11-01T02:22:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84959.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.82093.log.gz 2023-11-01T02:22:30.118 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82356.log 2023-11-01T02:22:30.125 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84171.log: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.84171.log.gz 2023-11-01T02:22:30.125 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83278.log 2023-11-01T02:22:30.125 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.82356.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.82356.log.gz 2023-11-01T02:22:30.126 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83320.log 2023-11-01T02:22:30.126 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83278.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83278.log.gz 2023-11-01T02:22:30.126 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82328.log 2023-11-01T02:22:30.127 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83320.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83320.log.gz 2023-11-01T02:22:30.127 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83673.log 2023-11-01T02:22:30.127 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.82328.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.82328.log.gz 2023-11-01T02:22:30.127 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-01T02:22:30.128 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83673.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83673.log.gz 2023-11-01T02:22:30.128 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84960.log 2023-11-01T02:22:30.128 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.audit.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-01T02:22:30.129 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84607.log 2023-11-01T02:22:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84960.log: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.84252.log.gz 2023-11-01T02:22:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84206.log 2023-11-01T02:22:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81471.log 2023-11-01T02:22:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81591.log 2023-11-01T02:22:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-01T02:22:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.81471.log: /var/log/ceph/ceph-client.admin.81591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81511.log 2023-11-01T02:22:30.140 INFO:teuthology.orchestra.run.smithi071.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.81471.log.gz 2023-11-01T02:22:30.140 INFO:teuthology.orchestra.run.smithi071.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.81591.log.gz 2023-11-01T02:22:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-01T02:22:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.81511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81551.log 2023-11-01T02:22:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.x.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.81511.log.gz 2023-11-01T02:22:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-01T02:22:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.81551.log: /var/log/ceph/ceph-osd.2.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.81551.log.gz 2023-11-01T02:22:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84607.log: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.84959.log.gz 2023-11-01T02:22:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84831.log 2023-11-01T02:22:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84206.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84538.log.gz 2023-11-01T02:22:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85025.log 2023-11-01T02:22:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84831.log: 96.4% 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84505.log.gz 2023-11-01T02:22:30.147 INFO:teuthology.orchestra.run.smithi008.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84336.log.gz 2023-11-01T02:22:30.148 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-01T02:22:30.148 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.85025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84223.log 2023-11-01T02:22:30.148 INFO:teuthology.orchestra.run.smithi008.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84692.log.gz 2023-11-01T02:22:30.149 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83236.log 2023-11-01T02:22:30.149 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84223.log: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.84960.log.gz 2023-11-01T02:22:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85022.log 2023-11-01T02:22:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83236.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83236.log.gz 2023-11-01T02:22:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83505.log 2023-11-01T02:22:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.85022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83671.log 2023-11-01T02:22:30.161 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83505.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83505.log.gz 2023-11-01T02:22:30.164 INFO:teuthology.orchestra.run.smithi008.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.85025.log.gz 2023-11-01T02:22:30.169 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83362.log 2023-11-01T02:22:30.169 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83671.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83671.log.gz 2023-11-01T02:22:30.169 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83782.log 2023-11-01T02:22:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83362.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83362.log.gz 2023-11-01T02:22:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83404.log 2023-11-01T02:22:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83782.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.83782.log.gz 2023-11-01T02:22:30.171 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 96.5% -- replaced with /var/log/ceph/ceph-client.admin.84206.log.gz 2023-11-01T02:22:30.171 INFO:teuthology.orchestra.run.smithi008.stderr: --verbose -- /var/log/ceph/ceph-client.admin.84283.log 2023-11-01T02:22:30.171 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84988.log 2023-11-01T02:22:30.171 INFO:teuthology.orchestra.run.smithi008.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.83404.log.gz 2023-11-01T02:22:30.172 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84661.log 2023-11-01T02:22:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84988.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84607.log.gz 2023-11-01T02:22:30.176 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84926.log 2023-11-01T02:22:30.178 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84661.log: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.84223.log.gz 2023-11-01T02:22:30.180 INFO:teuthology.orchestra.run.smithi008.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84831.log.gz 2023-11-01T02:22:30.182 INFO:teuthology.orchestra.run.smithi008.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.85022.log.gz 2023-11-01T02:22:30.189 INFO:teuthology.orchestra.run.smithi071.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-01T02:22:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86259.log 2023-11-01T02:22:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83824.log 2023-11-01T02:22:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.86259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84213.log 2023-11-01T02:22:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83824.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.83824.log.gz 2023-11-01T02:22:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84888.log 2023-11-01T02:22:30.196 INFO:teuthology.orchestra.run.smithi008.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.86259.log.gz 2023-11-01T02:22:30.203 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84213.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84661.log.gz 2023-11-01T02:22:30.205 INFO:teuthology.orchestra.run.smithi008.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.84283.log.gz 2023-11-01T02:22:30.208 INFO:teuthology.orchestra.run.smithi008.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84988.log.gz 2023-11-01T02:22:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84888.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79772.log 2023-11-01T02:22:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84675.log 2023-11-01T02:22:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.tmp-client.admin.79772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84272.log 2023-11-01T02:22:30.210 INFO:teuthology.orchestra.run.smithi008.stderr: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79772.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83674.log 2023-11-01T02:22:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84675.log: 2023-11-01T02:22:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84272.log: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.84675.log.gz 2023-11-01T02:22:30.215 INFO:teuthology.orchestra.run.smithi008.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.84926.log.gz 2023-11-01T02:22:30.224 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-01T02:22:30.225 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83674.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-01T02:22:30.225 INFO:teuthology.orchestra.run.smithi008.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83674.log.gz 2023-11-01T02:22:30.225 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83672.log 2023-11-01T02:22:30.225 INFO:teuthology.orchestra.run.smithi008.stderr: 96.2%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.84213.log.gz 2023-11-01T02:22:30.226 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84479.log 2023-11-01T02:22:30.226 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84852.log 2023-11-01T02:22:30.226 INFO:teuthology.orchestra.run.smithi008.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83672.log.gz 2023-11-01T02:22:30.226 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84479.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84297.log 2023-11-01T02:22:30.227 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-11-01T02:22:30.228 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84852.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.84852.log.gz 2023-11-01T02:22:30.229 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83172.log 2023-11-01T02:22:30.229 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84989.log 2023-11-01T02:22:30.229 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.83172.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.83172.log.gz 2023-11-01T02:22:30.230 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.84989.log: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.84888.log.gz 2023-11-01T02:22:30.236 INFO:teuthology.orchestra.run.smithi008.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.84272.log.gz 2023-11-01T02:22:30.249 INFO:teuthology.orchestra.run.smithi008.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.84297.log.gz 2023-11-01T02:22:30.250 INFO:teuthology.orchestra.run.smithi008.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.84989.log.gz 2023-11-01T02:22:30.258 INFO:teuthology.orchestra.run.smithi008.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84479.log.gz 2023-11-01T02:22:30.272 INFO:teuthology.orchestra.run.smithi071.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-01T02:22:30.297 INFO:teuthology.orchestra.run.smithi008.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-01T02:22:30.437 INFO:teuthology.orchestra.run.smithi008.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-01T02:22:31.102 INFO:teuthology.orchestra.run.smithi008.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-01T02:22:31.104 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-11-01T02:22:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:real 0m1.020s 2023-11-01T02:22:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:user 0m2.046s 2023-11-01T02:22:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m0.137s 2023-11-01T02:22:31.274 INFO:teuthology.orchestra.run.smithi071.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-01T02:22:31.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-11-01T02:22:31.277 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m1.153s 2023-11-01T02:22:31.277 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m1.288s 2023-11-01T02:22:31.277 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.064s 2023-11-01T02:22:31.278 INFO:tasks.ceph:Archiving logs... 2023-11-01T02:22:31.279 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/remote/smithi008/log 2023-11-01T02:22:31.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-01T02:22:31.597 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/remote/smithi071/log 2023-11-01T02:22:31.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-01T02:22:31.839 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-01T02:22:31.848 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-01T02:22:31.858 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-01T02:22:31.862 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-01T02:22:31.863 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-01T02:22:31.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-01T02:22:31.949 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-01T02:22:31.958 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-01T02:22:31.960 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-01T02:22:31.962 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-01T02:22:31.975 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2023-11-01T02:22:31.976 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2023-11-01T02:22:31.979 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-01T02:22:31.980 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-11-01T02:22:31.980 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +304us[ +286us] +/- 96ms 2023-11-01T02:22:31.980 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 7 377 58 -172us[ -189us] +/- 51ms 2023-11-01T02:22:31.981 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +35us[ +17us] +/- 60ms 2023-11-01T02:22:31.981 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T02:22:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-01T02:22:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-11-01T02:22:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 70 +285us[ +285us] +/- 96ms 2023-11-01T02:22:31.983 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv02.front.sepia.ceph.com 3 10 377 200 -218us[ -227us] +/- 49ms 2023-11-01T02:22:31.984 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -39us[ -39us] +/- 61ms 2023-11-01T02:22:31.984 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T02:22:31.984 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-01T02:22:31.994 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-01T02:22:31.995 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-01T02:22:32.004 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-01T02:22:32.123 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-01T02:22:32.212 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-01T02:22:32.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:32.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-01T02:22:32.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:32.280 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-01T02:22:32.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-01T02:22:32.299 INFO:teuthology.task.internal:Duration was 11527.617745 seconds 2023-11-01T02:22:32.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-01T02:22:32.308 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-01T02:22:32.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-01T02:22:32.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-01T02:22:32.360 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-01T02:22:32.363 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-01T02:22:32.673 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-01T02:22:32.674 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-11-01T02:22:32.675 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-01T02:22:32.695 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2023-11-01T02:22:32.696 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-01T02:22:32.733 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-01T02:22:32.733 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-01T02:22:32.738 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-01T02:22:32.801 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-01T02:22:32.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-01T02:22:32.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-01T02:22:32.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-01T02:22:32.947 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-01T02:22:32.947 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-01T02:22:32.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-01T02:22:33.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-01T02:22:33.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-01T02:22:33.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-01T02:22:33.049 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-11-01T02:22:33.072 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2023-11-01T02:22:33.096 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-01T02:22:33.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:33.130 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-01T02:22:33.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:33.151 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-01T02:22:33.161 INFO:teuthology.task.internal:Transferring archived files... 2023-11-01T02:22:33.162 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/remote/smithi008 2023-11-01T02:22:33.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-01T02:22:33.210 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519/remote/smithi071 2023-11-01T02:22:33.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-01T02:22:33.245 INFO:teuthology.task.internal:Removing archive directory... 2023-11-01T02:22:33.246 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-01T02:22:33.249 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-01T02:22:33.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-01T02:22:33.307 INFO:teuthology.task.internal:Not uploading archives. 2023-11-01T02:22:33.307 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-01T02:22:33.317 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-01T02:22:33.317 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-01T02:22:33.320 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-01T02:22:33.333 INFO:teuthology.orchestra.run.smithi008.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 1 02:22 /home/ubuntu/cephtest 2023-11-01T02:22:33.333 INFO:teuthology.orchestra.run.smithi008.stdout: 531668 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 31 23:19 /home/ubuntu/cephtest/mnt.0 2023-11-01T02:22:33.333 INFO:teuthology.orchestra.run.smithi008.stdout: 531669 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0 2023-11-01T02:22:33.334 INFO:teuthology.orchestra.run.smithi008.stdout: 545577 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-01T02:22:33.334 INFO:teuthology.orchestra.run.smithi008.stdout: 545588 60 -rw-r--r-- 1 ubuntu ubuntu 59016 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_tier_pp.log 2023-11-01T02:22:33.334 INFO:teuthology.orchestra.run.smithi008.stdout: 545592 4 -rw-r--r-- 1 ubuntu ubuntu 567 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat_pp.log 2023-11-01T02:22:33.334 INFO:teuthology.orchestra.run.smithi008.stdout: 545586 4 -rw-r--r-- 1 ubuntu ubuntu 208 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock.log 2023-11-01T02:22:33.335 INFO:teuthology.orchestra.run.smithi008.stdout: 545603 4 -rw-r--r-- 1 ubuntu ubuntu 284 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_read_operations.log 2023-11-01T02:22:33.335 INFO:teuthology.orchestra.run.smithi008.stdout: 545602 0 -rw-r--r-- 1 ubuntu ubuntu 0 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_list_parallel.log 2023-11-01T02:22:33.335 INFO:teuthology.orchestra.run.smithi008.stdout: 545587 4 -rw-r--r-- 1 ubuntu ubuntu 939 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc_pp.log 2023-11-01T02:22:33.335 INFO:teuthology.orchestra.run.smithi008.stdout: 545578 4 -rw-r--r-- 1 ubuntu ubuntu 279 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio.log 2023-11-01T02:22:33.336 INFO:teuthology.orchestra.run.smithi008.stdout: 545585 4 -rw-r--r-- 1 ubuntu ubuntu 3049 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc.log 2023-11-01T02:22:33.336 INFO:teuthology.orchestra.run.smithi008.stdout: 545601 4 -rw-r--r-- 1 ubuntu ubuntu 1171 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cls_remote_reads.log 2023-11-01T02:22:33.336 INFO:teuthology.orchestra.run.smithi008.stdout: 545598 4 -rw-r--r-- 1 ubuntu ubuntu 362 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd_pp.log 2023-11-01T02:22:33.336 INFO:teuthology.orchestra.run.smithi008.stdout: 545596 4 -rw-r--r-- 1 ubuntu ubuntu 351 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd.log 2023-11-01T02:22:33.337 INFO:teuthology.orchestra.run.smithi008.stdout: 545595 4 -rw-r--r-- 1 ubuntu ubuntu 242 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify.log 2023-11-01T02:22:33.337 INFO:teuthology.orchestra.run.smithi008.stdout: 545590 4 -rw-r--r-- 1 ubuntu ubuntu 398 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots.log 2023-11-01T02:22:33.337 INFO:teuthology.orchestra.run.smithi008.stdout: 545582 28 -rw-r--r-- 1 ubuntu ubuntu 26410 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_asio.log 2023-11-01T02:22:33.338 INFO:teuthology.orchestra.run.smithi008.stdout: 545593 4 -rw-r--r-- 1 ubuntu ubuntu 271 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat.log 2023-11-01T02:22:33.338 INFO:teuthology.orchestra.run.smithi008.stdout: 545605 0 -rw-r--r-- 1 ubuntu ubuntu 0 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_delete_pools_parallel.log 2023-11-01T02:22:33.338 INFO:teuthology.orchestra.run.smithi008.stdout: 545599 4 -rw-r--r-- 1 ubuntu ubuntu 2628 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service_pp.log 2023-11-01T02:22:33.338 INFO:teuthology.orchestra.run.smithi008.stdout: 545600 4 -rw-r--r-- 1 ubuntu ubuntu 512 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_write_operations.log 2023-11-01T02:22:33.339 INFO:teuthology.orchestra.run.smithi008.stdout: 545597 4 -rw-r--r-- 1 ubuntu ubuntu 2573 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service.log 2023-11-01T02:22:33.339 INFO:teuthology.orchestra.run.smithi008.stdout: 545579 4 -rw-r--r-- 1 ubuntu ubuntu 283 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio_pp.log 2023-11-01T02:22:33.339 INFO:teuthology.orchestra.run.smithi008.stdout: 545581 4 -rw-r--r-- 1 ubuntu ubuntu 724 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io_pp.log 2023-11-01T02:22:33.339 INFO:teuthology.orchestra.run.smithi008.stdout: 545604 0 -rw-r--r-- 1 ubuntu ubuntu 0 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_open_pools_parallel.log 2023-11-01T02:22:33.340 INFO:teuthology.orchestra.run.smithi008.stdout: 545594 4 -rw-r--r-- 1 ubuntu ubuntu 2782 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify_pp.log 2023-11-01T02:22:33.340 INFO:teuthology.orchestra.run.smithi008.stdout: 545584 4 -rw-r--r-- 1 ubuntu ubuntu 225 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock_pp.log 2023-11-01T02:22:33.340 INFO:teuthology.orchestra.run.smithi008.stdout: 545589 4 -rw-r--r-- 1 ubuntu ubuntu 1611 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_pool.log 2023-11-01T02:22:33.341 INFO:teuthology.orchestra.run.smithi008.stdout: 545583 4 -rw-r--r-- 1 ubuntu ubuntu 547 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_list.log 2023-11-01T02:22:33.341 INFO:teuthology.orchestra.run.smithi008.stdout: 545591 4 -rw-r--r-- 1 ubuntu ubuntu 641 Oct 31 23:21 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots_pp.log 2023-11-01T02:22:33.341 INFO:teuthology.orchestra.run.smithi008.stdout: 545580 4 -rw-r--r-- 1 ubuntu ubuntu 503 Oct 31 23:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io.log 2023-11-01T02:22:33.342 INFO:teuthology.orchestra.run.smithi008.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-01T02:22:33.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:22:33.344 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a9edd23b5a8ddacab225824948b06b370baf276b/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-01T02:22:33.355 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-01T02:22:33.365 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-01T02:22:33.375 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi008 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-01T02:22:33.376 INFO:teuthology.nuke:Checking targets against current locks 2023-11-01T02:22:33.383 INFO:teuthology.orchestra.run.smithi071.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 1 02:22 /home/ubuntu/cephtest 2023-11-01T02:22:33.408 DEBUG:teuthology.nuke:shortname: smithi008 2023-11-01T02:22:33.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-01T02:22:33.431 DEBUG:teuthology.nuke:shortname: smithi071 2023-11-01T02:22:33.431 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-01T02:22:33.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 23:00:54.701644', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk4jIz0Iy/U3c8+afCQ9hOCWAOAG/mDAXaEyzVYEMXV72ZflTOEbDTPDMEy+UwRxojIvv6ph7LNAyg4kVYEMMA='} 2023-11-01T02:22:33.459 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-31_22:58:07-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-part3-distro-crimson-smithi/7442519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 23:00:54.699617', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpHKTlIFzQP0Aod3adCh8dUG6w/cE6VCroP+6taVVpGtgJxna+5b9584yxJhS90ia8cGkl5+V+oF/umwREmzT4='} 2023-11-01T02:22:33.486 INFO:teuthology.orchestra.console.smithi008:Power off 2023-11-01T02:22:33.487 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-01T02:22:33.510 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-11-01T02:22:33.511 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T02:22:33.524 INFO:teuthology.orchestra.console.smithi071:Power off 2023-11-01T02:22:33.525 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-01T02:22:33.533 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-11-01T02:22:33.546 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-11-01T02:22:33.546 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T02:22:33.566 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-11-01T02:22:37.535 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T02:22:37.567 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T02:22:37.645 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-11-01T02:22:37.678 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-11-01T02:22:41.650 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T02:22:41.679 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T02:22:41.761 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-11-01T02:22:41.790 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-11-01T02:22:41.863 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-11-01T02:22:45.794 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T02:22:45.904 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-11-01T02:22:46.005 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-11-01T02:22:46.111 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 11527.617745161057 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi008 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9edd23b5a8ddacab225824948b06b370baf276b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh''' flavor: crimson owner: scheduled_matan@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=6c72d137554a4589bb08fa08c87637ca status: fail success: false 2023-11-01T02:22:46.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-01T02:22:46.190 INFO:teuthology.run:FAIL